2024-02-15T23:59:26.992 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T23:59:26.992 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739 --owner scheduled_yuriw@teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} --name yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi -- /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/orig.config.yaml 2024-02-15T23:59:27.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T23:59:27.103 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739 branch: wip-yuri2-testing-2024-02-15-0913-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: yweinste@redhat.com first_in_suite: false job_id: '7561739' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri2-testing-2024-02-15-0913-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2024-02-15-0913-squid sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9739 sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 sleep_before_teardown: 0 subset: 111/120000 suite: rgw suite_branch: wip-yuri2-testing-2024-02-15-0913-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEH+KhokNcHpZWggZirFpySWhReuX32XHsL6TUgWvGEoU59RoE6oG9711jUvDWqQ89fdkkFFLUiY6Mvtxe/TGqw= smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2CF3qZKlLdIA78yBYMU3nWGsx2QcOBR1MqoNjZrUvYDEJw6q8NhgRSVSnYC5jIuJE0mOJ6e5dybHmWoY9RAHU= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:10:42 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-15T23:59:27.104 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa; will attempt to use it 2024-02-15T23:59:27.104 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks 2024-02-15T23:59:27.104 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T23:59:27.106 INFO:teuthology.task.internal:Checking packages... 2024-02-15T23:59:27.128 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'fddf34c14d11a944c077fae4b86a8722d85c0772' 2024-02-15T23:59:27.128 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T23:59:27.128 INFO:teuthology.packaging:ref: None 2024-02-15T23:59:27.128 INFO:teuthology.packaging:tag: None 2024-02-15T23:59:27.128 INFO:teuthology.packaging:branch: wip-yuri2-testing-2024-02-15-0913-squid 2024-02-15T23:59:27.128 INFO:teuthology.packaging:sha1: fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-15T23:59:27.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri2-testing-2024-02-15-0913-squid 2024-02-15T23:59:27.284 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1468.gfddf34c1 2024-02-15T23:59:27.286 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T23:59:27.293 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T23:59:27.293 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T23:59:27.314 INFO:teuthology.task.internal:Saving configuration 2024-02-15T23:59:27.325 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T23:59:27.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T23:59:27.352 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:54:46.277020', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEH+KhokNcHpZWggZirFpySWhReuX32XHsL6TUgWvGEoU59RoE6oG9711jUvDWqQ89fdkkFFLUiY6Mvtxe/TGqw='} 2024-02-15T23:59:27.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:54:46.275506', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2CF3qZKlLdIA78yBYMU3nWGsx2QcOBR1MqoNjZrUvYDEJw6q8NhgRSVSnYC5jIuJE0mOJ6e5dybHmWoY9RAHU='} 2024-02-15T23:59:27.377 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T23:59:27.383 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-02-15T23:59:27.383 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-15T23:59:27.383 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T23:59:27.485 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7f1dbf5f70>, signals=[15]) 2024-02-15T23:59:27.486 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T23:59:27.492 INFO:teuthology.task.internal:Opening connections... 2024-02-15T23:59:27.492 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-02-15T23:59:27.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:59:27.599 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-02-15T23:59:27.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T23:59:27.701 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T23:59:27.708 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-02-15T23:59:27.727 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-02-15T23:59:27.727 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-02-15T23:59:27.785 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-02-15T23:59:27.786 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T23:59:27.786 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-02-15T23:59:27.786 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T23:59:27.786 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T23:59:27.786 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T23:59:27.786 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-02-15T23:59:27.805 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-02-15T23:59:27.823 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-02-15T23:59:27.823 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T23:59:27.881 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T23:59:27.882 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-02-15T23:59:27.905 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T23:59:27.913 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T23:59:27.919 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T23:59:27.919 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-02-15T23:59:27.921 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-02-15T23:59:27.937 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T23:59:27.943 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T23:59:27.944 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-02-15T23:59:27.979 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-02-15T23:59:28.006 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T23:59:28.062 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T23:59:28.077 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T23:59:28.077 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T23:59:28.078 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T23:59:28.078 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T23:59:28.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:59:28.095 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-02-15T23:59:28.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:59:28.096 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-02-15T23:59:28.153 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-361.el9.x86_64 2024-02-15T23:59:28.153 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-361.el9.x86_64 2024-02-15T23:59:28.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-02-15T23:59:28.154 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-361.el9.x86_64 2024-02-15T23:59:28.155 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-361.el9.x86_64 2024-02-15T23:59:28.155 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-02-15T23:59:30.589 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - AppStream 9.2 MB/s | 6.7 MB 00:00 2024-02-15T23:59:30.664 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.7 MB 00:00 2024-02-15T23:59:32.123 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2024-02-15T23:59:32.164 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2024-02-15T23:59:33.880 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.0 MB 00:01 2024-02-15T23:59:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-02-15T23:59:37.422 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 19 MB 00:02 2024-02-15T23:59:37.539 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 19 MB 00:02 2024-02-15T23:59:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.1 MB 00:00 2024-02-15T23:59:43.307 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.1 MB 00:02 2024-02-15T23:59:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 15 kB 00:00 2024-02-15T23:59:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2024-02-15T23:59:45.007 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-15T23:59:46.986 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-02-15T23:59:50.050 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-02-15T23:59:52.051 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-02-15T23:59:52.473 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T23:59:52.473 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T23:59:52.573 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-15T23:59:52.580 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-15T23:59:52.580 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-15T23:59:52.580 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-15T23:59:52.580 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-02-15T23:59:52.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-15T23:59:52.582 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 100 M 2024-02-15T23:59:52.582 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 123 M 2024-02-15T23:59:52.582 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-15T23:59:53.576 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 6.1 MB/s | 6.1 MB 00:00 2024-02-15T23:59:54.433 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T23:59:54.433 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T23:59:54.534 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-15T23:59:54.543 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-15T23:59:54.543 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-15T23:59:54.543 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-02-15T23:59:54.544 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-15T23:59:54.545 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 100 M 2024-02-15T23:59:54.545 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 123 M 2024-02-15T23:59:54.545 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-15T23:59:54.726 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 9.8 MB/s | 21 MB 00:02 2024-02-15T23:59:55.177 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 9.6 MB/s | 6.1 MB 00:00 2024-02-15T23:59:55.401 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 14 MB/s | 39 MB 00:02 2024-02-15T23:59:55.861 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 16 MB/s | 21 MB 00:01 2024-02-15T23:59:56.051 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 14 MB/s | 33 MB 00:02 2024-02-15T23:59:56.054 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-15T23:59:56.054 INFO:teuthology.orchestra.run.smithi002.stdout:Total 29 MB/s | 100 MB 00:03 2024-02-15T23:59:56.055 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-15T23:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-15T23:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-15T23:59:56.519 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 25 MB/s | 33 MB 00:01 2024-02-15T23:59:56.894 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 17 MB/s | 39 MB 00:02 2024-02-15T23:59:56.898 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-15T23:59:56.898 INFO:teuthology.orchestra.run.smithi042.stdout:Total 42 MB/s | 100 MB 00:02 2024-02-15T23:59:56.898 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-15T23:59:57.341 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-15T23:59:57.342 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-15T23:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-15T23:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-15T23:59:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-15T23:59:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:00:00.133 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:00:00.825 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-16T00:00:00.956 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:00:00.968 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T00:00:01.645 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-16T00:00:01.787 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T00:00:03.864 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T00:00:04.044 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T00:00:04.704 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T00:00:04.854 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T00:00:09.116 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T00:00:09.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:09.954 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T00:00:10.060 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:15.159 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:45.282 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-16T00:00:45.282 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:00:45.355 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:45.814 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:45.814 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-16T00:00:45.814 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T00:00:45.814 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T00:00:46.008 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:46.009 INFO:teuthology.orchestra.run.smithi042.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-16T00:00:46.009 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:00:46.083 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:46.257 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:00:46.258 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:00:46.530 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:46.531 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-16T00:00:46.531 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-16T00:00:46.531 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-16T00:00:46.725 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T00:00:46.862 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.862 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T00:00:46.862 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-16T00:00:46.862 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T00:00:46.862 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T00:00:46.863 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-16T00:00:46.863 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T00:00:46.863 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T00:00:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-16T00:00:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:00:46.953 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:00:46.974 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T00:00:46.974 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T00:00:46.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-02-16T00:00:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-02-16T00:00:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-02-16T00:00:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-02-16T00:00:47.018 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-02-16T00:00:47.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:00:47.020 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-16T00:00:47.020 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-16T00:00:47.020 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-16T00:00:47.020 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-02-16T00:00:47.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:00:47.020 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-02-16T00:00:47.021 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-16T00:00:47.021 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-421.el9.x86_64 2024-02-16T00:00:47.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-16T00:00:47.463 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T00:00:47.610 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T00:00:47.611 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T00:00:47.611 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-16T00:00:47.611 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T00:00:47.611 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T00:00:47.611 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-02-16T00:00:47.611 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T00:00:47.611 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-02-16T00:00:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-02-16T00:00:47.723 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-16T00:00:47.724 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-16T00:00:47.724 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-02-16T00:00:47.761 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-02-16T00:00:47.761 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-02-16T00:00:47.761 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-02-16T00:00:47.761 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 68.el9 2024-02-16T00:00:47.761 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8264254 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-16T00:00:47.762 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-02-16T00:00:47.763 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-02-16T00:00:47.763 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-16T00:00:47.763 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-02-16T00:00:47.763 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-02-16T00:00:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:00:47.764 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-16T00:00:47.764 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-16T00:00:47.764 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-16T00:00:47.764 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-02-16T00:00:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:00:47.764 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-02-16T00:00:47.766 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-16T00:00:47.766 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-421.el9.x86_64 2024-02-16T00:00:47.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-16T00:00:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-02-16T00:00:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-16T00:00:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-02-16T00:00:49.047 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-02-16T00:00:49.062 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Z3f8zUdV1h 2024-02-16T00:00:49.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Z3f8zUdV1h 2024-02-16T00:00:49.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Z3f8zUdV1h 2024-02-16T00:00:49.282 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Z3f8zUdV1h is 6KB 2024-02-16T00:00:49.331 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Z3f8zUdV1h 2024-02-16T00:00:49.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-02-16T00:00:49.415 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-16T00:00:49.415 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-16T00:00:49.415 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-16T00:00:49.415 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-16T00:00:49.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-16T00:00:49.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-02-16T00:00:49.747 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-16T00:00:49.782 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-02-16T00:00:49.784 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-02-16T00:00:49.799 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.8W6EbHqncf 2024-02-16T00:00:49.800 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8W6EbHqncf 2024-02-16T00:00:49.880 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.8W6EbHqncf 2024-02-16T00:00:50.021 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.8W6EbHqncf is 6KB 2024-02-16T00:00:50.070 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.8W6EbHqncf 2024-02-16T00:00:50.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-02-16T00:00:50.158 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-16T00:00:50.159 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-16T00:00:50.159 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-16T00:00:50.159 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-16T00:00:50.160 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-16T00:00:50.297 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-02-16T00:01:19.608 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-16T00:01:19.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-02-16T00:01:19.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:01:20.300 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-02-16T00:01:20.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-02-16T00:01:20.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:01:38.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-02-16T00:01:38.620 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-02-16T00:01:47.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-02-16T00:01:47.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:01:47.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-02-16T00:01:47.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:02:47.181 DEBUG:teuthology.orchestra.remote:timed out 2024-02-16T00:02:47.625 DEBUG:teuthology.orchestra.remote:timed out 2024-02-16T00:02:59.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-02-16T00:02:59.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:02:59.565 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-02-16T00:02:59.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-02-16T00:02:59.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:02:59.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-02-16T00:02:59.944 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-421.el9.x86_64"... 2024-02-16T00:02:59.944 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-02-16T00:02:59.959 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-421.el9.x86_64 2024-02-16T00:02:59.959 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-16T00:02:59.959 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T00:02:59.959 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-16T00:02:59.990 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-02-16T00:03:00.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-02-16T00:03:00.365 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-421.el9.x86_64"... 2024-02-16T00:03:00.365 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-02-16T00:03:00.380 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-421.el9.x86_64 2024-02-16T00:03:00.380 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-16T00:03:00.380 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T00:03:00.381 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-16T00:03:00.960 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-16T00:03:00.960 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T00:03:01.039 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-02-16T00:03:01.070 DEBUG:teuthology.parallel:result is None 2024-02-16T00:03:01.381 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-02-16T00:03:01.381 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T00:03:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-02-16T00:03:01.480 DEBUG:teuthology.parallel:result is None 2024-02-16T00:03:01.480 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-16T00:03:01.498 INFO:teuthology.task.internal:Creating test directory... 2024-02-16T00:03:01.498 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T00:03:01.500 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T00:03:01.516 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-16T00:03:01.523 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-16T00:03:01.534 INFO:teuthology.task.internal:Creating archive directory... 2024-02-16T00:03:01.534 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T00:03:01.558 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T00:03:01.586 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-16T00:03:01.594 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-16T00:03:01.595 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T00:03:01.624 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T00:03:01.657 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T00:03:01.670 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T00:03:01.673 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T00:03:01.686 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T00:03:01.691 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-16T00:03:01.700 INFO:teuthology.task.internal:Configuring sudo... 2024-02-16T00:03:01.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T00:03:01.714 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T00:03:01.743 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-16T00:03:01.758 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-16T00:03:01.758 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T00:03:01.783 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T00:03:01.799 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T00:03:01.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T00:03:01.930 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T00:03:02.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T00:03:02.054 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:03:02.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T00:03:02.121 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T00:03:02.166 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T00:03:02.219 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T00:03:02.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T00:03:02.348 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:03:02.348 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T00:03:02.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-02-16T00:03:02.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-02-16T00:03:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T00:03:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T00:03:03.013 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-16T00:03:03.029 INFO:teuthology.task.internal:Starting timer... 2024-02-16T00:03:03.029 INFO:teuthology.run_tasks:Running task pcp... 2024-02-16T00:03:03.067 INFO:teuthology.run_tasks:Running task selinux... 2024-02-16T00:03:03.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-02-16T00:03:03.183 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-02-16T00:03:03.185 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-02-16T00:03:03.247 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-02-16T00:03:03.249 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-16T00:03:03.249 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-02-16T00:03:03.271 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-02-16T00:03:03.271 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-02-16T00:03:03.302 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-02-16T00:03:03.303 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi042.front.sepia.ceph.com': 'permissive'} 2024-02-16T00:03:03.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T00:03:03.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T00:03:03.340 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T00:03:03.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T00:03:03.430 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-16T00:03:03.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-02-16T00:03:03.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-02-16T00:03:03.505 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-16T00:03:03.528 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-16T00:03:03.534 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-16T00:03:03.671 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-16T00:03:03.686 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-16T00:03:03.687 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi042.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-16T00:07:20.536 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi042.front.sepia.ceph.com')] 2024-02-16T00:07:20.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-02-16T00:07:20.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:07:20.630 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-02-16T00:07:20.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-02-16T00:07:20.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-02-16T00:07:20.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T00:07:20.807 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-02-16T00:07:20.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-02-16T00:07:20.854 INFO:teuthology.run_tasks:Running task clock... 2024-02-16T00:07:20.938 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-16T00:07:20.938 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T00:07:20.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T00:07:20.941 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T00:07:20.941 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T00:07:20.971 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-16T00:07:20.973 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-16T00:07:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-16T00:07:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-16T00:07:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-02-16T00:07:21.020 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-02-16T00:07:21.032 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-02-16T00:07:21.034 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-02-16T00:07:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-16T00:07:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-16T00:07:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-16T00:07:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-16T00:07:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-02-16T00:07:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-02-16T00:07:21.118 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T00:07:21.118 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-02-16T00:07:21.118 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.118 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.118 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.118 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.119 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T00:07:21.119 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-02-16T00:07:21.119 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.119 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.119 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.119 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:07:21.120 INFO:teuthology.run_tasks:Running task install... 2024-02-16T00:07:21.168 DEBUG:teuthology.task.install:project ceph 2024-02-16T00:07:21.168 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}} 2024-02-16T00:07:21.168 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'} 2024-02-16T00:07:21.168 INFO:teuthology.task.install:Using flavor: default 2024-02-16T00:07:21.174 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-16T00:07:21.174 INFO:teuthology.task.install:extra packages: [] 2024-02-16T00:07:21.175 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'tag': None, 'wait_for_package': False} 2024-02-16T00:07:21.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-16T00:07:21.178 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'tag': None, 'wait_for_package': False} 2024-02-16T00:07:21.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-16T00:07:21.432 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/ 2024-02-16T00:07:21.433 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1468.gfddf34c1 2024-02-16T00:07:21.438 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/ 2024-02-16T00:07:21.438 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1468.gfddf34c1 2024-02-16T00:07:21.643 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-16T00:07:21.643 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:07:21.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-16T00:07:21.648 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-15-0913-squid/fddf34c14d11a944c077fae4b86a8722d85c0772/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-16T00:07:21.648 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:07:21.648 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-16T00:07:21.672 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-16T00:07:21.672 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fddf34c14d11a944c077fae4b86a8722d85c0772/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-16T00:07:21.675 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-16T00:07:21.676 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fddf34c14d11a944c077fae4b86a8722d85c0772/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-16T00:07:21.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-16T00:07:21.742 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-16T00:07:21.819 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-16T00:07:21.821 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-16T00:07:21.886 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-02-16T00:07:21.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-02-16T00:07:21.888 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-02-16T00:07:21.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-02-16T00:07:22.137 INFO:teuthology.orchestra.run.smithi042.stdout:74 files removed 2024-02-16T00:07:22.143 INFO:teuthology.orchestra.run.smithi002.stdout:74 files removed 2024-02-16T00:07:22.165 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw 2024-02-16T00:07:22.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw 2024-02-16T00:07:22.839 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 234 kB/s | 82 kB 00:00 2024-02-16T00:07:22.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 210 kB/s | 82 kB 00:00 2024-02-16T00:07:23.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-02-16T00:07:23.273 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-02-16T00:07:23.649 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-02-16T00:07:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-02-16T00:07:24.168 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-02-16T00:07:24.345 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-16T00:07:25.618 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-02-16T00:07:25.820 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-02-16T00:07:27.584 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.0 MB 00:01 2024-02-16T00:07:27.644 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.0 MB 00:01 2024-02-16T00:07:30.389 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-02-16T00:07:35.431 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.1 MB 00:01 2024-02-16T00:07:37.074 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-02-16T00:07:38.117 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2024-02-16T00:07:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-02-16T00:07:46.022 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 9.8 M 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.4 M 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-16T00:07:46.041 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.3 M 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 20 M 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 25 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 741 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 498 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.1 M 2024-02-16T00:07:46.042 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 45 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 131 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 161 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 320 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 298 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 99 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-02-16T00:07:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout:Install 30 Packages 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:07:46.044 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 58 M 2024-02-16T00:07:46.045 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:07:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:(1/32): ceph-radosgw-19.0.0-1468.gfddf34c1.el9. 12 MB/s | 9.8 MB 00:00 2024-02-16T00:07:47.284 INFO:teuthology.orchestra.run.smithi002.stdout:(2/32): ceph-selinux-19.0.0-1468.gfddf34c1.el9. 506 kB/s | 25 kB 00:00 2024-02-16T00:07:47.368 INFO:teuthology.orchestra.run.smithi002.stdout:(3/32): libcephfs2-19.0.0-1468.gfddf34c1.el9.x8 8.7 MB/s | 741 kB 00:00 2024-02-16T00:07:47.427 INFO:teuthology.orchestra.run.smithi002.stdout:(4/32): libradosstriper1-19.0.0-1468.gfddf34c1. 8.3 MB/s | 498 kB 00:00 2024-02-16T00:07:47.568 INFO:teuthology.orchestra.run.smithi002.stdout:(5/32): ceph-base-19.0.0-1468.gfddf34c1.el9.x86 4.6 MB/s | 5.3 MB 00:01 2024-02-16T00:07:47.652 INFO:teuthology.orchestra.run.smithi002.stdout:(6/32): python3-ceph-argparse-19.0.0-1468.gfddf 541 kB/s | 45 kB 00:00 2024-02-16T00:07:47.736 INFO:teuthology.orchestra.run.smithi002.stdout:(7/32): librgw2-19.0.0-1468.gfddf34c1.el9.x86_6 17 MB/s | 5.1 MB 00:00 2024-02-16T00:07:47.761 INFO:teuthology.orchestra.run.smithi002.stdout:(8/32): python3-ceph-common-19.0.0-1468.gfddf34 1.2 MB/s | 131 kB 00:00 2024-02-16T00:07:47.795 INFO:teuthology.orchestra.run.smithi002.stdout:(9/32): python3-cephfs-19.0.0-1468.gfddf34c1.el 2.7 MB/s | 161 kB 00:00 2024-02-16T00:07:47.845 INFO:teuthology.orchestra.run.smithi002.stdout:(10/32): python3-rados-19.0.0-1468.gfddf34c1.el 3.8 MB/s | 320 kB 00:00 2024-02-16T00:07:47.870 INFO:teuthology.orchestra.run.smithi002.stdout:(11/32): python3-rbd-19.0.0-1468.gfddf34c1.el9. 3.9 MB/s | 298 kB 00:00 2024-02-16T00:07:47.913 INFO:teuthology.orchestra.run.smithi002.stdout:(12/32): python3-rgw-19.0.0-1468.gfddf34c1.el9. 1.4 MB/s | 99 kB 00:00 2024-02-16T00:07:48.029 INFO:teuthology.orchestra.run.smithi002.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 667 kB/s | 106 kB 00:00 2024-02-16T00:07:48.054 INFO:teuthology.orchestra.run.smithi002.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2024-02-16T00:07:48.079 INFO:teuthology.orchestra.run.smithi002.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-02-16T00:07:48.130 INFO:teuthology.orchestra.run.smithi002.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-02-16T00:07:48.155 INFO:teuthology.orchestra.run.smithi002.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-02-16T00:07:48.180 INFO:teuthology.orchestra.run.smithi002.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2024-02-16T00:07:48.205 INFO:teuthology.orchestra.run.smithi002.stdout:(19/32): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-02-16T00:07:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:(20/32): qatlib-service-23.11.0-1.el9.x86_64.rp 677 kB/s | 34 kB 00:00 2024-02-16T00:07:48.256 INFO:teuthology.orchestra.run.smithi002.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 862 kB/s | 43 kB 00:00 2024-02-16T00:07:48.715 INFO:teuthology.orchestra.run.smithi002.stdout:(22/32): ceph-common-19.0.0-1468.gfddf34c1.el9. 8.6 MB/s | 20 MB 00:02 2024-02-16T00:07:48.815 INFO:teuthology.orchestra.run.smithi002.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 529 kB/s | 309 kB 00:00 2024-02-16T00:07:48.915 INFO:teuthology.orchestra.run.smithi002.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-02-16T00:07:49.024 INFO:teuthology.orchestra.run.smithi002.stdout:(25/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 84 kB/s | 26 kB 00:00 2024-02-16T00:07:49.049 INFO:teuthology.orchestra.run.smithi002.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 504 kB/s | 67 kB 00:00 2024-02-16T00:07:49.150 INFO:teuthology.orchestra.run.smithi002.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-02-16T00:07:49.175 INFO:teuthology.orchestra.run.smithi002.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-02-16T00:07:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-02-16T00:07:49.525 INFO:teuthology.orchestra.run.smithi002.stdout:(30/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2024-02-16T00:07:49.750 INFO:teuthology.orchestra.run.smithi002.stdout:(31/32): librbd1-19.0.0-1468.gfddf34c1.el9.x86_ 6.7 MB/s | 3.1 MB 00:00 2024-02-16T00:07:50.159 INFO:teuthology.orchestra.run.smithi002.stdout:(32/32): librados2-19.0.0-1468.gfddf34c1.el9.x8 3.4 MB/s | 3.4 MB 00:00 2024-02-16T00:07:50.163 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:07:50.164 INFO:teuthology.orchestra.run.smithi002.stdout:Total 14 MB/s | 58 MB 00:04 2024-02-16T00:07:50.164 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:07:50.205 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:07:50.205 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:07:50.700 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:07:50.701 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:07:52.200 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:07:52.277 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-02-16T00:07:52.305 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-02-16T00:07:52.331 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-02-16T00:07:52.362 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-16T00:07:52.378 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-16T00:07:52.525 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-16T00:07:52.585 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-16T00:07:52.931 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-02-16T00:07:52.974 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-16T00:07:53.067 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-16T00:07:53.172 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 8/34 2024-02-16T00:07:53.200 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-16T00:07:53.246 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-16T00:07:53.275 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-02-16T00:07:53.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 11/34 2024-02-16T00:07:53.388 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-16T00:07:53.419 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-16T00:07:53.465 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-16T00:07:53.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-02-16T00:07:53.612 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-02-16T00:07:53.654 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-02-16T00:07:53.694 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-02-16T00:07:53.725 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-02-16T00:07:53.754 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-02-16T00:07:53.787 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-02-16T00:07:54.112 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-02-16T00:07:54.141 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-16T00:07:54.257 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-16T00:07:54.288 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 23/34 2024-02-16T00:07:54.326 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-02-16T00:07:54.811 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-02-16T00:07:54.836 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-16T00:07:54.890 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-16T00:07:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 27/34 2024-02-16T00:07:54.996 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 28/34 2024-02-16T00:07:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-16T00:07:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-16T00:07:57.852 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-16T00:07:57.887 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-16T00:07:57.968 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-16T00:07:57.969 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-16T00:07:57.969 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-16T00:07:57.969 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:07:58.014 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-16T00:08:08.083 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-16T00:08:08.083 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-02-16T00:08:08.083 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-02-16T00:08:08.083 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-02-16T00:08:08.083 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-02-16T00:08:08.084 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-02-16T00:08:08.084 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-02-16T00:08:08.084 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-02-16T00:08:08.084 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:09.039 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-16T00:08:09.064 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-16T00:08:09.064 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:09.064 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-16T00:08:09.064 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T00:08:09.064 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T00:08:09.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:09.066 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-16T00:08:09.150 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-16T00:08:09.150 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 6/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 8/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 9/34 2024-02-16T00:08:10.327 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 10/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 11/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 13/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-02-16T00:08:10.328 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-02-16T00:08:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/34 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-16T00:08:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-3.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:11.335 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:11.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-test 2024-02-16T00:08:12.243 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:29 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:12.425 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:12.426 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 47 M 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 163 k 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:12.427 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2024-02-16T00:08:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:12.428 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 48 M 2024-02-16T00:08:12.428 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 205 M 2024-02-16T00:08:12.428 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:08:12.619 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2024-02-16T00:08:12.652 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-02-16T00:08:12.702 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 3.7 MB/s | 186 kB 00:00 2024-02-16T00:08:12.753 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-02-16T00:08:12.845 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): libcephsqlite-19.0.0-1468.gfddf34c1.el9. 392 kB/s | 163 kB 00:00 2024-02-16T00:08:16.395 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): ceph-test-19.0.0-1468.gfddf34c1.el9.x86_ 12 MB/s | 47 MB 00:03 2024-02-16T00:08:16.398 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:16.398 INFO:teuthology.orchestra.run.smithi002.stdout:Total 12 MB/s | 48 MB 00:03 2024-02-16T00:08:16.398 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:08:16.420 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:08:16.420 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:08:16.481 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 410 kB/s | 19 MB 00:47 2024-02-16T00:08:16.834 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:08:16.834 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:08:17.426 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:08:17.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-16T00:08:17.530 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-16T00:08:17.580 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-16T00:08:17.620 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-16T00:08:17.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-16T00:08:22.032 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.1 MB 00:01 2024-02-16T00:08:22.380 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-16T00:08:22.465 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-16T00:08:23.433 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 15 kB 00:00 2024-02-16T00:08:24.959 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-16T00:08:24.959 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/6 2024-02-16T00:08:24.959 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/6 2024-02-16T00:08:24.959 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-16T00:08:24.959 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-16T00:08:24.959 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-16T00:08:25.347 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-16T00:08:25.347 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:08:25.347 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:25.347 INFO:teuthology.orchestra.run.smithi002.stdout: jq-1.6-16.el9.x86_64 2024-02-16T00:08:25.348 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:25.348 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-16T00:08:25.348 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-16T00:08:25.348 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-16T00:08:25.348 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:25.348 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:25.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph 2024-02-16T00:08:26.246 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:43 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:26.427 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:26.430 INFO:teuthology.orchestra.run.smithi002.stdout:========================================================================================= 2024-02-16T00:08:26.430 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:08:26.430 INFO:teuthology.orchestra.run.smithi002.stdout:========================================================================================= 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 6.6 k 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 2.1 M 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 1.5 M 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 247 k 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 4.7 M 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 17 M 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-16T00:08:26.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-16T00:08:26.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-16T00:08:26.433 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout:========================================================================================= 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout:Install 36 Packages 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 30 M 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 107 M 2024-02-16T00:08:26.434 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:08:26.747 INFO:teuthology.orchestra.run.smithi002.stdout:(1/36): ceph-19.0.0-1468.gfddf34c1.el9.x86_64.r 34 kB/s | 6.6 kB 00:00 2024-02-16T00:08:26.955 INFO:teuthology.orchestra.run.smithi002.stdout:(2/36): ceph-mds-19.0.0-1468.gfddf34c1.el9.x86_ 5.3 MB/s | 2.1 MB 00:00 2024-02-16T00:08:27.014 INFO:teuthology.orchestra.run.smithi002.stdout:(3/36): ceph-mgr-19.0.0-1468.gfddf34c1.el9.x86_ 3.3 MB/s | 1.5 MB 00:00 2024-02-16T00:08:27.114 INFO:teuthology.orchestra.run.smithi002.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1468.gfddf 2.4 MB/s | 247 kB 00:00 2024-02-16T00:08:27.231 INFO:teuthology.orchestra.run.smithi002.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-02-16T00:08:27.264 INFO:teuthology.orchestra.run.smithi002.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 4.3 MB/s | 144 kB 00:00 2024-02-16T00:08:27.290 INFO:teuthology.orchestra.run.smithi002.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-02-16T00:08:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2024-02-16T00:08:27.340 INFO:teuthology.orchestra.run.smithi002.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2024-02-16T00:08:27.382 INFO:teuthology.orchestra.run.smithi002.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-02-16T00:08:27.449 INFO:teuthology.orchestra.run.smithi002.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 17 MB/s | 1.1 MB 00:00 2024-02-16T00:08:27.482 INFO:teuthology.orchestra.run.smithi002.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-02-16T00:08:27.516 INFO:teuthology.orchestra.run.smithi002.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2024-02-16T00:08:27.550 INFO:teuthology.orchestra.run.smithi002.stdout:(14/36): python3-requests-2.25.1-8.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2024-02-16T00:08:27.592 INFO:teuthology.orchestra.run.smithi002.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2024-02-16T00:08:27.842 INFO:teuthology.orchestra.run.smithi002.stdout:(16/36): ceph-osd-19.0.0-1468.gfddf34c1.el9.x86 19 MB/s | 17 MB 00:00 2024-02-16T00:08:27.909 INFO:teuthology.orchestra.run.smithi002.stdout:(17/36): ceph-mon-19.0.0-1468.gfddf34c1.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-02-16T00:08:28.251 INFO:teuthology.orchestra.run.smithi002.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 127 kB/s | 43 kB 00:00 2024-02-16T00:08:28.276 INFO:teuthology.orchestra.run.smithi002.stdout:(19/36): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-02-16T00:08:28.301 INFO:teuthology.orchestra.run.smithi002.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 329 kB/s | 151 kB 00:00 2024-02-16T00:08:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2024-02-16T00:08:28.435 INFO:teuthology.orchestra.run.smithi002.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 937 kB/s | 172 kB 00:00 2024-02-16T00:08:28.436 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 20 MB 00:04 2024-02-16T00:08:28.502 INFO:teuthology.orchestra.run.smithi002.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-02-16T00:08:28.536 INFO:teuthology.orchestra.run.smithi002.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2024-02-16T00:08:28.611 INFO:teuthology.orchestra.run.smithi002.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 179 kB/s | 19 kB 00:00 2024-02-16T00:08:28.720 INFO:teuthology.orchestra.run.smithi002.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 107 kB/s | 20 kB 00:00 2024-02-16T00:08:28.745 INFO:teuthology.orchestra.run.smithi002.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 346 kB/s | 46 kB 00:00 2024-02-16T00:08:28.829 INFO:teuthology.orchestra.run.smithi002.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 726 kB/s | 79 kB 00:00 2024-02-16T00:08:28.879 INFO:teuthology.orchestra.run.smithi002.stdout:(29/36): python3-cherrypy-18.6.1-2.el9.noarch.r 595 kB/s | 358 kB 00:00 2024-02-16T00:08:28.938 INFO:teuthology.orchestra.run.smithi002.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-02-16T00:08:28.963 INFO:teuthology.orchestra.run.smithi002.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 122 kB/s | 16 kB 00:00 2024-02-16T00:08:29.030 INFO:teuthology.orchestra.run.smithi002.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 598 kB/s | 90 kB 00:00 2024-02-16T00:08:29.055 INFO:teuthology.orchestra.run.smithi002.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 305 kB/s | 36 kB 00:00 2024-02-16T00:08:29.097 INFO:teuthology.orchestra.run.smithi002.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-02-16T00:08:29.164 INFO:teuthology.orchestra.run.smithi002.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-02-16T00:08:29.223 INFO:teuthology.orchestra.run.smithi002.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.2 MB/s | 427 kB 00:00 2024-02-16T00:08:29.226 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:29.226 INFO:teuthology.orchestra.run.smithi002.stdout:Total 11 MB/s | 30 MB 00:02 2024-02-16T00:08:29.248 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:08:29.294 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:08:29.294 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:08:29.721 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:08:29.722 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:08:31.036 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:08:31.100 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-16T00:08:31.133 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-16T00:08:31.161 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-16T00:08:31.234 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-16T00:08:31.280 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-16T00:08:31.325 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-16T00:08:31.421 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-16T00:08:31.498 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-16T00:08:31.545 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-16T00:08:31.619 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-16T00:08:31.681 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-02-16T00:08:31.720 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-02-16T00:08:31.778 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-02-16T00:08:31.839 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-02-16T00:08:32.032 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-02-16T00:08:32.082 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-02-16T00:08:32.120 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-02-16T00:08:32.155 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-02-16T00:08:32.185 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-02-16T00:08:32.264 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-02-16T00:08:32.295 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-16T00:08:32.329 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-02-16T00:08:32.369 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-02-16T00:08:32.405 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-02-16T00:08:32.439 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-02-16T00:08:32.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-02-16T00:08:32.578 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-02-16T00:08:32.652 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-02-16T00:08:32.792 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-02-16T00:08:32.917 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-16T00:08:33.095 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 31/36 2024-02-16T00:08:33.124 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-16T00:08:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-16T00:08:33.149 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:33.149 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-16T00:08:33.149 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T00:08:33.149 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T00:08:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:33.459 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-16T00:08:34.666 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-16T00:08:34.693 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-16T00:08:34.693 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:34.693 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-16T00:08:34.693 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T00:08:34.693 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T00:08:34.694 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:35.159 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-16T00:08:35.182 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-16T00:08:35.182 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:35.182 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-16T00:08:35.182 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T00:08:35.182 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T00:08:35.182 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:35.401 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-16T00:08:35.424 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-16T00:08:35.424 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:35.424 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-16T00:08:35.424 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T00:08:35.425 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T00:08:35.425 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:35.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-16T00:08:36.222 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:08:36.236 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:08:36.236 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:08:36.236 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:08:36.236 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:08:36.236 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 9.8 M 2024-02-16T00:08:36.236 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.4 M 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.3 M 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 20 M 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 25 k 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-16T00:08:36.237 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 741 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 498 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 5.1 M 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse 2024-02-16T00:08:36.238 INFO:teuthology.orchestra.run.smithi042.stdout: x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 45 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 131 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 161 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 320 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 298 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 99 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-02-16T00:08:36.239 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout:Install 30 Packages 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 2 Packages 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 58 M 2024-02-16T00:08:36.240 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:08:37.402 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 6/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-02-16T00:08:37.403 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-16T00:08:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-16T00:08:37.405 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-16T00:08:37.868 INFO:teuthology.orchestra.run.smithi042.stdout:(1/32): ceph-common-19.0.0-1468.gfddf34c1.el9.x 16 MB/s | 20 MB 00:01 2024-02-16T00:08:37.918 INFO:teuthology.orchestra.run.smithi042.stdout:(2/32): ceph-selinux-19.0.0-1468.gfddf34c1.el9. 503 kB/s | 25 kB 00:00 2024-02-16T00:08:38.002 INFO:teuthology.orchestra.run.smithi042.stdout:(3/32): libcephfs2-19.0.0-1468.gfddf34c1.el9.x8 8.7 MB/s | 741 kB 00:00 2024-02-16T00:08:38.061 INFO:teuthology.orchestra.run.smithi042.stdout:(4/32): libradosstriper1-19.0.0-1468.gfddf34c1. 8.3 MB/s | 498 kB 00:00 2024-02-16T00:08:38.361 INFO:teuthology.orchestra.run.smithi042.stdout:(5/32): librgw2-19.0.0-1468.gfddf34c1.el9.x86_6 17 MB/s | 5.1 MB 00:00 2024-02-16T00:08:38.403 INFO:teuthology.orchestra.run.smithi042.stdout:(6/32): python3-ceph-argparse-19.0.0-1468.gfddf 1.1 MB/s | 45 kB 00:00 2024-02-16T00:08:38.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-16T00:08:38.431 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:38.431 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:08:38.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:38.431 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-16T00:08:38.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-16T00:08:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-16T00:08:38.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-16T00:08:38.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-16T00:08:38.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-16T00:08:38.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-16T00:08:38.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-16T00:08:38.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-16T00:08:38.435 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-16T00:08:38.436 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-16T00:08:38.436 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:38.436 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:38.453 INFO:teuthology.orchestra.run.smithi042.stdout:(7/32): python3-ceph-common-19.0.0-1468.gfddf34 2.6 MB/s | 131 kB 00:00 2024-02-16T00:08:38.520 INFO:teuthology.orchestra.run.smithi042.stdout:(8/32): ceph-base-19.0.0-1468.gfddf34c1.el9.x86 2.8 MB/s | 5.3 MB 00:01 2024-02-16T00:08:38.545 INFO:teuthology.orchestra.run.smithi042.stdout:(9/32): python3-cephfs-19.0.0-1468.gfddf34c1.el 1.7 MB/s | 161 kB 00:00 2024-02-16T00:08:38.587 INFO:teuthology.orchestra.run.smithi042.stdout:(10/32): python3-rados-19.0.0-1468.gfddf34c1.el 4.7 MB/s | 320 kB 00:00 2024-02-16T00:08:38.612 INFO:teuthology.orchestra.run.smithi042.stdout:(11/32): python3-rbd-19.0.0-1468.gfddf34c1.el9. 4.3 MB/s | 298 kB 00:00 2024-02-16T00:08:38.671 INFO:teuthology.orchestra.run.smithi042.stdout:(12/32): python3-rgw-19.0.0-1468.gfddf34c1.el9. 1.2 MB/s | 99 kB 00:00 2024-02-16T00:08:38.738 INFO:teuthology.orchestra.run.smithi042.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 843 kB/s | 106 kB 00:00 2024-02-16T00:08:38.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-base 2024-02-16T00:08:38.763 INFO:teuthology.orchestra.run.smithi042.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 159 kB 00:00 2024-02-16T00:08:38.789 INFO:teuthology.orchestra.run.smithi042.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2024-02-16T00:08:38.831 INFO:teuthology.orchestra.run.smithi042.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-02-16T00:08:38.856 INFO:teuthology.orchestra.run.smithi042.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-02-16T00:08:38.873 INFO:teuthology.orchestra.run.smithi042.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 995 kB/s | 41 kB 00:00 2024-02-16T00:08:38.898 INFO:teuthology.orchestra.run.smithi042.stdout:(19/32): qatlib-23.11.0-1.el9.x86_64.rpm 5.1 MB/s | 215 kB 00:00 2024-02-16T00:08:38.915 INFO:teuthology.orchestra.run.smithi042.stdout:(20/32): qatlib-service-23.11.0-1.el9.x86_64.rp 815 kB/s | 34 kB 00:00 2024-02-16T00:08:38.932 INFO:teuthology.orchestra.run.smithi042.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-02-16T00:08:39.291 INFO:teuthology.orchestra.run.smithi042.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 824 kB/s | 309 kB 00:00 2024-02-16T00:08:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:56 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:39.374 INFO:teuthology.orchestra.run.smithi042.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-02-16T00:08:39.458 INFO:teuthology.orchestra.run.smithi042.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-02-16T00:08:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:08:39.525 INFO:teuthology.orchestra.run.smithi042.stdout:(25/32): libarrow-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-02-16T00:08:39.536 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:39.537 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:08:39.537 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:39.550 INFO:teuthology.orchestra.run.smithi042.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-02-16T00:08:39.618 INFO:teuthology.orchestra.run.smithi042.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2024-02-16T00:08:39.642 INFO:teuthology.orchestra.run.smithi042.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-02-16T00:08:39.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install cephadm 2024-02-16T00:08:39.751 INFO:teuthology.orchestra.run.smithi042.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-02-16T00:08:39.968 INFO:teuthology.orchestra.run.smithi042.stdout:(30/32): ceph-radosgw-19.0.0-1468.gfddf34c1.el9 2.9 MB/s | 9.8 MB 00:03 2024-02-16T00:08:40.035 INFO:teuthology.orchestra.run.smithi042.stdout:(31/32): librbd1-19.0.0-1468.gfddf34c1.el9.x86_ 11 MB/s | 3.1 MB 00:00 2024-02-16T00:08:40.285 INFO:teuthology.orchestra.run.smithi042.stdout:(32/32): librados2-19.0.0-1468.gfddf34c1.el9.x8 5.2 MB/s | 3.4 MB 00:00 2024-02-16T00:08:40.288 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:40.289 INFO:teuthology.orchestra.run.smithi042.stdout:Total 14 MB/s | 58 MB 00:04 2024-02-16T00:08:40.289 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:08:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:57 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:40.331 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:08:40.331 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:08:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:40.472 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 748 k 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 748 k 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 754 k 2024-02-16T00:08:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:08:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm-19.0.0-1468.gfddf34c1.el9.noarch.rpm 2.5 MB/s | 748 kB 00:00 2024-02-16T00:08:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.5 MB/s | 748 kB 00:00 2024-02-16T00:08:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:08:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:08:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:08:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:08:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:08:40.833 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:08:40.833 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:08:40.859 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:08:41.277 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:08:41.375 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:08:41.770 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:08:42.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:08:42.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:08:42.064 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:08:42.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:42.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-immutable-object-cache 2024-02-16T00:08:42.374 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:08:42.458 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-02-16T00:08:42.498 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-02-16T00:08:42.524 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-02-16T00:08:42.555 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-16T00:08:42.571 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-02-16T00:08:42.763 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-16T00:08:42.819 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-02-16T00:08:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:59 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 145 k 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:08:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 145 k 2024-02-16T00:08:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 436 k 2024-02-16T00:08:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:08:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-immutable-object-cache-19.0.0-1468.gfddf34 673 kB/s | 145 kB 00:00 2024-02-16T00:08:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:Total 668 kB/s | 145 kB 00:00 2024-02-16T00:08:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:08:43.225 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-02-16T00:08:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:08:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:08:43.259 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-16T00:08:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:08:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:08:43.351 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-16T00:08:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:08:43.447 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 8/34 2024-02-16T00:08:43.477 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-16T00:08:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-16T00:08:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-16T00:08:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-16T00:08:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 9/34 2024-02-16T00:08:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-02-16T00:08:43.604 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 11/34 2024-02-16T00:08:43.674 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-16T00:08:43.696 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-16T00:08:43.758 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 13/34 2024-02-16T00:08:43.786 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-02-16T00:08:43.898 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-02-16T00:08:43.936 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-02-16T00:08:43.989 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-02-16T00:08:44.019 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-02-16T00:08:44.048 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-02-16T00:08:44.080 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-02-16T00:08:44.414 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-02-16T00:08:44.452 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-16T00:08:44.541 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-16T00:08:44.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:08:44.541 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:08:44.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:44.542 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 22/34 2024-02-16T00:08:44.573 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 23/34 2024-02-16T00:08:44.619 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-02-16T00:08:44.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr 2024-02-16T00:08:45.102 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-02-16T00:08:45.129 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-16T00:08:45.201 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 26/34 2024-02-16T00:08:45.271 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 27/34 2024-02-16T00:08:45.307 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 28/34 2024-02-16T00:08:45.369 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:02 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:45.489 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:08:45.543 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:45.544 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:08:45.545 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:45.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-dashboard 2024-02-16T00:08:46.186 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:03 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:46.359 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:46.360 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-02-16T00:08:46.360 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:08:46.360 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-02-16T00:08:46.360 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 1.8 M 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 31 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 15 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-16T00:08:46.361 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 6.9 M 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2024-02-16T00:08:46.362 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:08:47.302 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): ceph-prometheus-alerts-19.0.0-1468.gfdd 76 kB/s | 15 kB 00:00 2024-02-16T00:08:47.402 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): ceph-grafana-dashboards-19.0.0-1468.gfd 104 kB/s | 31 kB 00:00 2024-02-16T00:08:47.594 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-02-16T00:08:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-16T00:08:47.619 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 238 kB 00:00 2024-02-16T00:08:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-16T00:08:47.737 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1468.gfddf34c 2.8 MB/s | 1.8 MB 00:00 2024-02-16T00:08:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.5 MB/s | 863 kB 00:00 2024-02-16T00:08:47.995 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-02-16T00:08:48.112 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-02-16T00:08:48.188 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 417 kB/s | 31 kB 00:00 2024-02-16T00:08:48.238 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 667 kB/s | 144 kB 00:00 2024-02-16T00:08:48.259 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 29/34 2024-02-16T00:08:48.280 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-02-16T00:08:48.298 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-16T00:08:48.378 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 30/34 2024-02-16T00:08:48.378 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-16T00:08:48.378 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-16T00:08:48.378 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:08:48.408 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-16T00:08:48.555 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.3 MB/s | 2.0 MB 00:00 2024-02-16T00:08:48.561 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:48.562 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.1 MB/s | 6.9 MB 00:02 2024-02-16T00:08:48.582 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:08:48.602 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:08:48.602 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:08:48.790 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:08:48.790 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:08:49.315 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:08:49.381 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-16T00:08:49.416 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-16T00:08:49.464 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-16T00:08:49.509 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-16T00:08:49.618 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-16T00:08:49.749 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-16T00:08:49.850 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-16T00:08:49.906 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-16T00:08:49.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-16T00:08:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 10/12 2024-02-16T00:08:50.220 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 11/12 2024-02-16T00:08:50.258 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-16T00:08:51.063 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-16T00:08:51.063 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 1/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 2/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 3/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-16T00:08:51.064 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-16T00:08:51.456 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-16T00:08:51.456 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:51.456 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:08:51.456 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-16T00:08:51.456 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:51.457 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:08:51.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-16T00:08:52.287 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:09 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:08:52.462 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 7.4 M 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-16T00:08:52.464 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-02-16T00:08:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:08:52.466 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 37 M 2024-02-16T00:08:52.466 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 209 M 2024-02-16T00:08:52.466 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:08:52.678 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 225 kB/s | 32 kB 00:00 2024-02-16T00:08:52.720 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 429 kB/s | 17 kB 00:00 2024-02-16T00:08:52.787 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-02-16T00:08:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 383 kB/s | 34 kB 00:00 2024-02-16T00:08:52.979 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2024-02-16T00:08:53.046 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-02-16T00:08:53.072 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-02-16T00:08:53.230 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 802 kB 00:00 2024-02-16T00:08:53.398 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-02-16T00:08:53.422 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 194 kB 00:00 2024-02-16T00:08:53.548 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-02-16T00:08:54.073 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-1 4.8 MB/s | 7.4 MB 00:01 2024-02-16T00:08:54.075 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:08:54.076 INFO:teuthology.orchestra.run.smithi002.stdout:Total 23 MB/s | 37 MB 00:01 2024-02-16T00:08:54.088 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:08:54.113 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:08:54.113 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:08:54.492 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:08:54.493 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:08:55.222 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:08:55.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-16T00:08:55.327 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-16T00:08:55.425 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-16T00:08:55.456 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-16T00:08:55.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T00:08:55.663 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T00:08:55.747 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-16T00:08:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-16T00:08:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-16T00:08:57.854 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-16T00:08:58.418 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-16T00:08:58.418 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-02-16T00:08:58.418 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-02-16T00:08:58.419 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-02-16T00:08:58.419 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-02-16T00:08:58.419 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-02-16T00:08:58.419 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-02-16T00:08:58.419 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-02-16T00:08:58.419 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:08:58.930 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-16T00:08:58.962 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-16T00:08:59.381 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-16T00:08:59.405 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/34 2024-02-16T00:08:59.405 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:08:59.405 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-16T00:08:59.405 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T00:08:59.406 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-16T00:08:59.406 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:08:59.407 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-16T00:08:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-02-16T00:08:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_6 6/34 2024-02-16T00:09:00.658 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 7/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9. 8/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x8 9/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 10/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 11/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 12/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 13/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-02-16T00:09:00.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-02-16T00:09:00.660 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-02-16T00:09:00.661 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-02-16T00:09:00.661 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 31/34 2024-02-16T00:09:00.661 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-02-16T00:09:00.661 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/34 2024-02-16T00:09:01.471 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-16T00:09:01.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 1/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-16T00:09:01.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-16T00:09:01.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-16T00:09:01.794 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-16T00:09:01.795 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-3.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:01.796 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:01.960 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-16T00:09:01.960 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:01.960 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:01.960 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:01.961 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:02.055 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-test 2024-02-16T00:09:02.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-rook 2024-02-16T00:09:02.636 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:29 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:02.818 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:02.819 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:02.819 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:02.819 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:02.819 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 47 M 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 163 k 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout:Install 6 Packages 2024-02-16T00:09:02.820 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:02.821 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 48 M 2024-02-16T00:09:02.821 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 205 M 2024-02-16T00:09:02.821 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:02.867 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:19 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:02.997 INFO:teuthology.orchestra.run.smithi042.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.7 MB/s | 300 kB 00:00 2024-02-16T00:09:03.030 INFO:teuthology.orchestra.run.smithi042.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-02-16T00:09:03.044 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:03.045 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================== 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================== 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 52 k 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-16T00:09:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================== 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2024-02-16T00:09:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:03.048 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.0 M 2024-02-16T00:09:03.048 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2024-02-16T00:09:03.048 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:03.072 INFO:teuthology.orchestra.run.smithi042.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-02-16T00:09:03.114 INFO:teuthology.orchestra.run.smithi042.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-02-16T00:09:03.223 INFO:teuthology.orchestra.run.smithi042.stdout:(5/6): libcephsqlite-19.0.0-1468.gfddf34c1.el9. 407 kB/s | 163 kB 00:00 2024-02-16T00:09:03.786 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 157 kB/s | 24 kB 00:00 2024-02-16T00:09:03.803 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 105 kB/s | 18 kB 00:00 2024-02-16T00:09:03.828 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): ceph-mgr-rook-19.0.0-1468.gfddf34c1.el9 264 kB/s | 52 kB 00:00 2024-02-16T00:09:03.887 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 174 kB 00:00 2024-02-16T00:09:03.912 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 132 kB 00:00 2024-02-16T00:09:03.937 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 211 kB 00:00 2024-02-16T00:09:03.962 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 571 kB/s | 43 kB 00:00 2024-02-16T00:09:04.371 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 37 kB/s | 15 kB 00:00 2024-02-16T00:09:04.396 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 66 kB/s | 32 kB 00:00 2024-02-16T00:09:04.605 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 284 kB/s | 59 kB 00:00 2024-02-16T00:09:04.680 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 283 kB/s | 203 kB 00:00 2024-02-16T00:09:04.763 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 566 kB/s | 90 kB 00:00 2024-02-16T00:09:04.905 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-02-16T00:09:04.909 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:04.910 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.1 MB/s | 2.0 MB 00:01 2024-02-16T00:09:04.910 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:04.924 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:04.924 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:05.028 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:05.029 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:05.556 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-16T00:09:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-16T00:09:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-16T00:09:05.856 INFO:teuthology.orchestra.run.smithi042.stdout:(6/6): ceph-test-19.0.0-1468.gfddf34c1.el9.x86_ 16 MB/s | 47 MB 00:03 2024-02-16T00:09:05.860 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:05.860 INFO:teuthology.orchestra.run.smithi042.stdout:Total 16 MB/s | 48 MB 00:03 2024-02-16T00:09:05.860 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:05.882 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:05.882 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:05.883 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-16T00:09:05.924 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-16T00:09:06.021 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-16T00:09:06.130 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-16T00:09:06.185 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-16T00:09:06.301 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:06.301 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:06.887 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:06.938 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-16T00:09:06.942 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-16T00:09:06.980 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-16T00:09:06.998 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-16T00:09:07.032 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-16T00:09:07.038 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-16T00:09:07.081 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-16T00:09:07.084 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-16T00:09:07.109 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-16T00:09:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 1/13 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-16T00:09:07.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-16T00:09:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-16T00:09:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-16T00:09:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-16T00:09:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-16T00:09:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-16T00:09:07.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-16T00:09:08.279 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:08.280 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:08.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-cephadm 2024-02-16T00:09:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:26 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:09.292 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:09.294 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================== 2024-02-16T00:09:09.294 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:09:09.295 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================== 2024-02-16T00:09:09.295 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:09.295 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 138 k 2024-02-16T00:09:09.295 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:09:09.295 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-16T00:09:09.295 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================== 2024-02-16T00:09:09.296 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2024-02-16T00:09:09.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:09.297 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 6.8 M 2024-02-16T00:09:09.297 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 33 M 2024-02-16T00:09:09.298 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:09.832 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 227 kB 00:00 2024-02-16T00:09:09.966 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-02-16T00:09:10.091 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): ceph-mgr-cephadm-19.0.0-1468.gfddf34c1.e 317 kB/s | 138 kB 00:00 2024-02-16T00:09:10.566 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 100 kB/s | 58 kB 00:00 2024-02-16T00:09:10.650 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 96 kB/s | 51 kB 00:00 2024-02-16T00:09:11.017 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 463 kB/s | 548 kB 00:01 2024-02-16T00:09:11.021 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:11.022 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.9 MB/s | 6.8 MB 00:01 2024-02-16T00:09:11.022 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:11.033 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:11.033 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:11.132 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:11.133 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-16T00:09:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-16T00:09:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/6 2024-02-16T00:09:12.013 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-16T00:09:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-16T00:09:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-16T00:09:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-16T00:09:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-16T00:09:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-16T00:09:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/6 2024-02-16T00:09:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-16T00:09:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-16T00:09:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-16T00:09:13.242 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-16T00:09:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:13.556 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:13.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-fuse 2024-02-16T00:09:14.434 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 6/6 2024-02-16T00:09:14.434 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/6 2024-02-16T00:09:14.434 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/6 2024-02-16T00:09:14.434 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-16T00:09:14.434 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-16T00:09:14.434 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-16T00:09:14.546 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:31 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 887 k 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2024-02-16T00:09:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 966 k 2024-02-16T00:09:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 2.8 M 2024-02-16T00:09:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:14.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: jq-1.6-16.el9.x86_64 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:14.794 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:14.876 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 515 kB/s | 79 kB 00:00 2024-02-16T00:09:15.043 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): ceph-fuse-19.0.0-1468.gfddf34c1.el9.x86_ 2.7 MB/s | 887 kB 00:00 2024-02-16T00:09:15.044 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:15.044 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.9 MB/s | 966 kB 00:00 2024-02-16T00:09:15.044 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:15.065 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:15.065 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:15.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph 2024-02-16T00:09:15.144 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:15.144 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:15.331 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:15.490 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-16T00:09:15.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-16T00:09:15.657 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:42 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:15.835 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout:========================================================================================= 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout:========================================================================================= 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 6.6 k 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 2.1 M 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 1.5 M 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 247 k 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 4.7 M 2024-02-16T00:09:15.838 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 17 M 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-16T00:09:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-16T00:09:15.840 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-16T00:09:15.841 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-16T00:09:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-16T00:09:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:15.842 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:15.842 INFO:teuthology.orchestra.run.smithi042.stdout:========================================================================================= 2024-02-16T00:09:15.842 INFO:teuthology.orchestra.run.smithi042.stdout:Install 36 Packages 2024-02-16T00:09:15.842 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:15.843 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 30 M 2024-02-16T00:09:15.843 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 107 M 2024-02-16T00:09:15.843 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:16.270 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-16T00:09:16.270 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/2 2024-02-16T00:09:16.436 INFO:teuthology.orchestra.run.smithi042.stdout:(1/36): ceph-19.0.0-1468.gfddf34c1.el9.x86_64.r 40 kB/s | 6.6 kB 00:00 2024-02-16T00:09:16.586 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-16T00:09:16.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:16.586 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:16.586 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-16T00:09:16.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:16.587 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:16.703 INFO:teuthology.orchestra.run.smithi042.stdout:(2/36): ceph-mgr-19.0.0-1468.gfddf34c1.el9.x86_ 3.4 MB/s | 1.5 MB 00:00 2024-02-16T00:09:16.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-volume 2024-02-16T00:09:16.912 INFO:teuthology.orchestra.run.smithi042.stdout:(3/36): ceph-mon-19.0.0-1468.gfddf34c1.el9.x86_ 9.9 MB/s | 4.7 MB 00:00 2024-02-16T00:09:16.962 INFO:teuthology.orchestra.run.smithi042.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1468.gfddf 4.8 MB/s | 247 kB 00:00 2024-02-16T00:09:17.087 INFO:teuthology.orchestra.run.smithi042.stdout:(5/36): ceph-mds-19.0.0-1468.gfddf34c1.el9.x86_ 2.6 MB/s | 2.1 MB 00:00 2024-02-16T00:09:17.112 INFO:teuthology.orchestra.run.smithi042.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-02-16T00:09:17.138 INFO:teuthology.orchestra.run.smithi042.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-16T00:09:17.172 INFO:teuthology.orchestra.run.smithi042.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 631 kB/s | 32 kB 00:00 2024-02-16T00:09:17.188 INFO:teuthology.orchestra.run.smithi042.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 941 kB/s | 47 kB 00:00 2024-02-16T00:09:17.214 INFO:teuthology.orchestra.run.smithi042.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 770 kB/s | 39 kB 00:00 2024-02-16T00:09:17.239 INFO:teuthology.orchestra.run.smithi042.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-16T00:09:17.298 INFO:teuthology.orchestra.run.smithi042.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-02-16T00:09:17.340 INFO:teuthology.orchestra.run.smithi042.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-02-16T00:09:17.365 INFO:teuthology.orchestra.run.smithi042.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 124 kB 00:00 2024-02-16T00:09:17.390 INFO:teuthology.orchestra.run.smithi042.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-16T00:09:17.415 INFO:teuthology.orchestra.run.smithi042.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-02-16T00:09:17.478 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:34 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:17.652 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:17.652 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:17.652 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-02-16T00:09:17.652 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 264 k 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2024-02-16T00:09:17.655 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 332 k 2024-02-16T00:09:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 1.5 M 2024-02-16T00:09:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:17.699 INFO:teuthology.orchestra.run.smithi042.stdout:(17/36): ceph-osd-19.0.0-1468.gfddf34c1.el9.x86 17 MB/s | 17 MB 00:00 2024-02-16T00:09:17.724 INFO:teuthology.orchestra.run.smithi042.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2024-02-16T00:09:17.781 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 540 kB/s | 69 kB 00:00 2024-02-16T00:09:17.875 INFO:teuthology.orchestra.run.smithi042.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 329 kB/s | 151 kB 00:00 2024-02-16T00:09:17.931 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): ceph-volume-19.0.0-1468.gfddf34c1.el9.no 951 kB/s | 264 kB 00:00 2024-02-16T00:09:17.932 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:17.932 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.2 MB/s | 332 kB 00:00 2024-02-16T00:09:17.933 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:17.942 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:17.942 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:17.988 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:17.988 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:18.016 INFO:teuthology.orchestra.run.smithi042.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 137 kB/s | 43 kB 00:00 2024-02-16T00:09:18.117 INFO:teuthology.orchestra.run.smithi042.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2024-02-16T00:09:18.143 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:18.150 INFO:teuthology.orchestra.run.smithi042.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-02-16T00:09:18.176 INFO:teuthology.orchestra.run.smithi042.stdout:(23/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 381 kB/s | 172 kB 00:00 2024-02-16T00:09:18.217 INFO:teuthology.orchestra.run.smithi042.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-02-16T00:09:18.251 INFO:teuthology.orchestra.run.smithi042.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 230 kB/s | 23 kB 00:00 2024-02-16T00:09:18.293 INFO:teuthology.orchestra.run.smithi042.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 165 kB/s | 19 kB 00:00 2024-02-16T00:09:18.318 INFO:teuthology.orchestra.run.smithi042.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 195 kB/s | 20 kB 00:00 2024-02-16T00:09:18.338 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-16T00:09:18.352 INFO:teuthology.orchestra.run.smithi042.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 460 kB/s | 46 kB 00:00 2024-02-16T00:09:18.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-16T00:09:18.399 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-16T00:09:18.399 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:18.400 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-16T00:09:18.400 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:18.402 INFO:teuthology.orchestra.run.smithi042.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 725 kB/s | 79 kB 00:00 2024-02-16T00:09:18.453 INFO:teuthology.orchestra.run.smithi042.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 163 kB/s | 16 kB 00:00 2024-02-16T00:09:18.503 INFO:teuthology.orchestra.run.smithi042.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 899 kB/s | 90 kB 00:00 2024-02-16T00:09:18.553 INFO:teuthology.orchestra.run.smithi042.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 357 kB/s | 36 kB 00:00 2024-02-16T00:09:18.578 INFO:teuthology.orchestra.run.smithi042.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-02-16T00:09:18.662 INFO:teuthology.orchestra.run.smithi042.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-02-16T00:09:18.687 INFO:teuthology.orchestra.run.smithi042.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-02-16T00:09:18.712 INFO:teuthology.orchestra.run.smithi042.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-02-16T00:09:18.716 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:18.716 INFO:teuthology.orchestra.run.smithi042.stdout:Total 10 MB/s | 30 MB 00:02 2024-02-16T00:09:18.734 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:18.780 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:18.780 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:19.163 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 1/2 2024-02-16T00:09:19.203 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:19.203 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:19.513 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-16T00:09:19.513 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:19.513 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:19.513 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:19.514 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-16T00:09:19.514 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:19.514 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:19.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados-devel 2024-02-16T00:09:20.416 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:37 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:20.588 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:20.588 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:20.588 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 127 k 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:09:20.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:20.590 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 127 k 2024-02-16T00:09:20.590 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 456 k 2024-02-16T00:09:20.590 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:20.705 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-16T00:09:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-16T00:09:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-16T00:09:20.820 INFO:teuthology.orchestra.run.smithi002.stdout:librados-devel-19.0.0-1468.gfddf34c1.el9.x86_64 552 kB/s | 127 kB 00:00 2024-02-16T00:09:20.820 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:20.821 INFO:teuthology.orchestra.run.smithi002.stdout:Total 547 kB/s | 127 kB 00:00 2024-02-16T00:09:20.821 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:20.827 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:20.827 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:20.884 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:20.885 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:20.890 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-16T00:09:20.941 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-16T00:09:20.974 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-16T00:09:21.036 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-16T00:09:21.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-16T00:09:21.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:21.194 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-16T00:09:21.268 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-16T00:09:21.337 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-02-16T00:09:21.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-02-16T00:09:21.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-02-16T00:09:21.498 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-02-16T00:09:21.619 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-02-16T00:09:21.737 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-02-16T00:09:21.780 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-02-16T00:09:21.819 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-02-16T00:09:21.848 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-02-16T00:09:21.919 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:21.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:21.919 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:21.919 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:21.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:21.919 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:21.928 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-02-16T00:09:21.967 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-16T00:09:22.000 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-02-16T00:09:22.041 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-02-16T00:09:22.076 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-02-16T00:09:22.110 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-02-16T00:09:22.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs2 2024-02-16T00:09:22.203 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-02-16T00:09:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-02-16T00:09:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-02-16T00:09:22.456 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-02-16T00:09:22.580 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-16T00:09:22.748 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:39 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 31/36 2024-02-16T00:09:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-16T00:09:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 32/36 2024-02-16T00:09:22.811 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:22.811 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-16T00:09:22.812 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T00:09:22.812 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-16T00:09:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:22.868 INFO:teuthology.orchestra.run.smithi002.stdout:Package libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:22.924 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:22.925 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:22.925 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:22.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs-devel 2024-02-16T00:09:23.578 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:40 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:23.752 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:23.752 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 31 k 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:09:23.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:23.754 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 31 k 2024-02-16T00:09:23.754 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 140 k 2024-02-16T00:09:23.754 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:23.992 INFO:teuthology.orchestra.run.smithi002.stdout:libcephfs-devel-19.0.0-1468.gfddf34c1.el9.x86_6 131 kB/s | 31 kB 00:00 2024-02-16T00:09:23.993 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:23.993 INFO:teuthology.orchestra.run.smithi002.stdout:Total 130 kB/s | 31 kB 00:00 2024-02-16T00:09:23.993 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:23.997 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:23.997 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:24.132 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:24.235 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-16T00:09:24.355 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 33/36 2024-02-16T00:09:24.355 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:24.355 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-16T00:09:24.356 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T00:09:24.356 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-16T00:09:24.356 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:24.644 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:24.830 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-16T00:09:24.852 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 34/36 2024-02-16T00:09:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-16T00:09:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T00:09:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-16T00:09:24.853 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:24.932 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:24.932 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:24.932 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:24.932 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:24.932 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:24.932 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-16T00:09:25.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados2 2024-02-16T00:09:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 35/36 2024-02-16T00:09:25.094 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:25.095 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-16T00:09:25.095 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T00:09:25.095 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-16T00:09:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:25.164 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-16T00:09:25.675 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:42 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:25.794 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:25.849 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:25.850 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:25.850 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:25.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librbd1 2024-02-16T00:09:26.489 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:43 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:26.607 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:26.662 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:26.663 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:26.663 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:26.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rados 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 36/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 3/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 4/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 5/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9. 6/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-02-16T00:09:26.862 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-16T00:09:26.863 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-16T00:09:26.864 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-16T00:09:27.291 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:44 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:27.467 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:27.468 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:27.468 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:27.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rgw 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:27.797 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-16T00:09:27.798 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-16T00:09:27.799 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-16T00:09:27.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:27.800 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:28.109 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:45 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:28.179 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-base 2024-02-16T00:09:28.227 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:28.282 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:28.283 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:28.283 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:28.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-cephfs 2024-02-16T00:09:28.768 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:55 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:28.886 INFO:teuthology.orchestra.run.smithi042.stdout:Package ceph-base-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:28.920 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:45 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:28.939 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:28.941 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:09:28.941 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:29.005 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install cephadm 2024-02-16T00:09:29.037 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:29.092 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:29.093 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:29.093 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:29.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rbd 2024-02-16T00:09:29.583 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:56 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:29.729 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:46 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:29.758 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 748 k 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 748 k 2024-02-16T00:09:29.759 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 754 k 2024-02-16T00:09:29.760 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:29.848 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:29.902 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:29.903 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-02-16T00:09:29.903 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:29.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-fuse 2024-02-16T00:09:30.212 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm-19.0.0-1468.gfddf34c1.el9.noarch.rpm 1.6 MB/s | 748 kB 00:00 2024-02-16T00:09:30.213 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:30.214 INFO:teuthology.orchestra.run.smithi042.stdout:Total 1.6 MB/s | 748 kB 00:00 2024-02-16T00:09:30.214 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:30.219 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:30.219 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:30.225 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:30.225 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:30.420 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:30.539 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:47 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:30.713 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 85 k 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:30.714 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 85 k 2024-02-16T00:09:30.715 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 231 k 2024-02-16T00:09:30.715 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:09:31.012 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:09:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-fuse-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 265 kB/s | 85 kB 00:00 2024-02-16T00:09:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:Total 264 kB/s | 85 kB 00:00 2024-02-16T00:09:31.038 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:31.045 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:31.045 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:31.102 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:31.103 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:31.256 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:31.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:31.374 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:09:31.659 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/1 2024-02-16T00:09:31.659 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:31.659 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:31.659 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:31.659 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:31.660 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:31.809 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:31.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-immutable-object-cache 2024-02-16T00:09:32.115 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:32.115 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:32.115 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:32.115 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:32.115 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:32.115 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:32.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-mirror 2024-02-16T00:09:32.451 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:59 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:32.623 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:32.624 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:32.624 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-02-16T00:09:32.624 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:32.624 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:32.624 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 145 k 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 145 k 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 436 k 2024-02-16T00:09:32.625 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:32.921 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:49 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:32.935 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-immutable-object-cache-19.0.0-1468.gfddf34 468 kB/s | 145 kB 00:00 2024-02-16T00:09:32.936 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:32.936 INFO:teuthology.orchestra.run.smithi042.stdout:Total 466 kB/s | 145 kB 00:00 2024-02-16T00:09:32.936 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:32.945 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:32.945 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:33.004 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:33.004 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:33.094 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:33.095 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:33.095 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-02-16T00:09:33.095 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 3.1 M 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 13 M 2024-02-16T00:09:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:33.147 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:33.211 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-16T00:09:33.235 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-16T00:09:33.235 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:33.235 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-16T00:09:33.235 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:33.473 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-mirror-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 8.2 MB/s | 3.1 MB 00:00 2024-02-16T00:09:33.474 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:33.474 INFO:teuthology.orchestra.run.smithi002.stdout:Total 8.2 MB/s | 3.1 MB 00:00 2024-02-16T00:09:33.474 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:33.484 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:33.484 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:33.560 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:33.560 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:34.000 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:34.057 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:34.080 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:34.081 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:09:34.081 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-16T00:09:34.081 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T00:09:34.081 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T00:09:34.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:34.350 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1. 1/1 2024-02-16T00:09:34.351 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:34.351 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:34.351 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:34.351 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:34.351 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:34.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr 2024-02-16T00:09:35.179 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:02 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:35.232 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:35.232 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:35.298 INFO:teuthology.orchestra.run.smithi042.stdout:Package ceph-mgr-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:09:35.352 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:35.353 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:09:35.353 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:35.417 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-dashboard 2024-02-16T00:09:35.503 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-nbd 2024-02-16T00:09:35.998 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:02 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:36.097 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:53 ago on Fri 16 Feb 2024 12:07:43 AM UTC. 2024-02-16T00:09:36.172 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 1.8 M 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:09:36.173 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 31 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 15 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-16T00:09:36.174 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-02-16T00:09:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:Install 12 Packages 2024-02-16T00:09:36.175 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 6.9 M 2024-02-16T00:09:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 26 M 2024-02-16T00:09:36.176 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:36.273 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-02-16T00:09:36.273 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:36.273 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-02-16T00:09:36.273 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:36.273 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-02-16T00:09:36.273 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 171 k 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 171 k 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 494 k 2024-02-16T00:09:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-02-16T00:09:36.509 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-nbd-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 725 kB/s | 171 kB 00:00 2024-02-16T00:09:36.510 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:36.510 INFO:teuthology.orchestra.run.smithi002.stdout:Total 720 kB/s | 171 kB 00:00 2024-02-16T00:09:36.510 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-02-16T00:09:36.518 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-02-16T00:09:36.519 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-02-16T00:09:36.577 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-02-16T00:09:36.577 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-02-16T00:09:36.724 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-02-16T00:09:36.844 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:36.889 INFO:teuthology.orchestra.run.smithi042.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1468.gfd 121 kB/s | 31 kB 00:00 2024-02-16T00:09:36.914 INFO:teuthology.orchestra.run.smithi042.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1468.gfdd 54 kB/s | 15 kB 00:00 2024-02-16T00:09:37.073 INFO:teuthology.orchestra.run.smithi042.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 238 kB 00:00 2024-02-16T00:09:37.107 INFO:teuthology.orchestra.run.smithi042.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-02-16T00:09:37.240 INFO:teuthology.orchestra.run.smithi042.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1468.gfddf34c 2.9 MB/s | 1.8 MB 00:00 2024-02-16T00:09:37.341 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:37.491 INFO:teuthology.orchestra.run.smithi042.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-02-16T00:09:37.583 INFO:teuthology.orchestra.run.smithi042.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-02-16T00:09:37.663 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:09:37.663 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:37.663 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-02-16T00:09:37.663 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:09:37.663 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:09:37.663 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-02-16T00:09:37.674 INFO:teuthology.orchestra.run.smithi042.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.5 MB/s | 144 kB 00:00 2024-02-16T00:09:37.766 INFO:teuthology.orchestra.run.smithi042.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 336 kB/s | 31 kB 00:00 2024-02-16T00:09:37.875 INFO:teuthology.orchestra.run.smithi042.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-02-16T00:09:37.897 DEBUG:teuthology.parallel:result is None 2024-02-16T00:09:37.958 INFO:teuthology.orchestra.run.smithi042.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.4 MB/s | 2.0 MB 00:00 2024-02-16T00:09:38.209 INFO:teuthology.orchestra.run.smithi042.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 761 kB/s | 863 kB 00:01 2024-02-16T00:09:38.216 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:38.216 INFO:teuthology.orchestra.run.smithi042.stdout:Total 3.4 MB/s | 6.9 MB 00:02 2024-02-16T00:09:38.235 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:38.255 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:38.255 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:38.447 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:38.448 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:38.966 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:39.051 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-16T00:09:39.095 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-16T00:09:39.142 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-16T00:09:39.172 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-16T00:09:39.273 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-16T00:09:39.401 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-16T00:09:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-16T00:09:39.552 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-16T00:09:39.579 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-16T00:09:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 10/12 2024-02-16T00:09:39.862 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 11/12 2024-02-16T00:09:39.894 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-16T00:09:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 12/12 2024-02-16T00:09:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el 1/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noa 2/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9 3/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-16T00:09:40.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-16T00:09:41.085 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-16T00:09:41.085 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:41.085 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:41.086 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:41.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-16T00:09:41.911 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:08 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:42.086 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 7.4 M 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-16T00:09:42.087 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:42.088 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-02-16T00:09:42.089 INFO:teuthology.orchestra.run.smithi042.stdout:Install 12 Packages 2024-02-16T00:09:42.089 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:42.089 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 37 M 2024-02-16T00:09:42.089 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 209 M 2024-02-16T00:09:42.090 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:42.374 INFO:teuthology.orchestra.run.smithi042.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 219 kB/s | 32 kB 00:00 2024-02-16T00:09:42.416 INFO:teuthology.orchestra.run.smithi042.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 427 kB/s | 17 kB 00:00 2024-02-16T00:09:42.520 INFO:teuthology.orchestra.run.smithi042.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-02-16T00:09:42.550 INFO:teuthology.orchestra.run.smithi042.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 259 kB/s | 34 kB 00:00 2024-02-16T00:09:42.717 INFO:teuthology.orchestra.run.smithi042.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2024-02-16T00:09:42.784 INFO:teuthology.orchestra.run.smithi042.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-02-16T00:09:42.809 INFO:teuthology.orchestra.run.smithi042.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-02-16T00:09:42.967 INFO:teuthology.orchestra.run.smithi042.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 802 kB 00:00 2024-02-16T00:09:43.176 INFO:teuthology.orchestra.run.smithi042.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-02-16T00:09:43.201 INFO:teuthology.orchestra.run.smithi042.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 839 kB/s | 194 kB 00:00 2024-02-16T00:09:43.835 INFO:teuthology.orchestra.run.smithi042.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-1 4.6 MB/s | 7.4 MB 00:01 2024-02-16T00:09:44.068 INFO:teuthology.orchestra.run.smithi042.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 275 kB/s | 245 kB 00:00 2024-02-16T00:09:44.071 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:44.071 INFO:teuthology.orchestra.run.smithi042.stdout:Total 19 MB/s | 37 MB 00:01 2024-02-16T00:09:44.085 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:44.112 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:44.112 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:44.478 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:44.478 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:45.316 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:45.401 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-16T00:09:45.431 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-16T00:09:45.529 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-16T00:09:45.577 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-16T00:09:45.759 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T00:09:45.792 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T00:09:45.873 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-16T00:09:46.553 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-16T00:09:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-16T00:09:47.988 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-16T00:09:49.060 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-16T00:09:49.091 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-16T00:09:51.728 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 12/12 2024-02-16T00:09:51.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf3 1/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-16T00:09:51.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-16T00:09:52.166 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:52.167 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:52.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-rook 2024-02-16T00:09:53.139 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:20 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:53.317 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:53.318 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================== 2024-02-16T00:09:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:53.318 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================== 2024-02-16T00:09:53.318 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 52 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-16T00:09:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================== 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout:Install 13 Packages 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:53.320 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 2.0 M 2024-02-16T00:09:53.321 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 26 M 2024-02-16T00:09:53.321 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:53.542 INFO:teuthology.orchestra.run.smithi042.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 176 kB/s | 24 kB 00:00 2024-02-16T00:09:53.567 INFO:teuthology.orchestra.run.smithi042.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 110 kB/s | 18 kB 00:00 2024-02-16T00:09:53.601 INFO:teuthology.orchestra.run.smithi042.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 174 kB 00:00 2024-02-16T00:09:53.626 INFO:teuthology.orchestra.run.smithi042.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-02-16T00:09:53.651 INFO:teuthology.orchestra.run.smithi042.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-02-16T00:09:53.668 INFO:teuthology.orchestra.run.smithi042.stdout:(6/13): ceph-mgr-rook-19.0.0-1468.gfddf34c1.el9 197 kB/s | 52 kB 00:00 2024-02-16T00:09:53.685 INFO:teuthology.orchestra.run.smithi042.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 730 kB/s | 43 kB 00:00 2024-02-16T00:09:53.935 INFO:teuthology.orchestra.run.smithi042.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-02-16T00:09:53.961 INFO:teuthology.orchestra.run.smithi042.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 104 kB/s | 32 kB 00:00 2024-02-16T00:09:54.069 INFO:teuthology.orchestra.run.smithi042.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 528 kB/s | 203 kB 00:00 2024-02-16T00:09:54.103 INFO:teuthology.orchestra.run.smithi042.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 416 kB/s | 59 kB 00:00 2024-02-16T00:09:54.153 INFO:teuthology.orchestra.run.smithi042.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2024-02-16T00:09:54.312 INFO:teuthology.orchestra.run.smithi042.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.7 MB/s | 1.0 MB 00:00 2024-02-16T00:09:54.316 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:54.316 INFO:teuthology.orchestra.run.smithi042.stdout:Total 2.1 MB/s | 2.0 MB 00:00 2024-02-16T00:09:54.316 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:54.330 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:54.330 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:54.433 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:54.434 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:09:54.959 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:09:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-16T00:09:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-16T00:09:55.244 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-16T00:09:55.281 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-16T00:09:55.322 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-16T00:09:55.419 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-16T00:09:55.528 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-16T00:09:55.582 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-16T00:09:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-16T00:09:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-16T00:09:56.421 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-16T00:09:56.470 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-16T00:09:56.499 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-16T00:09:57.321 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 13/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 1/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-16T00:09:57.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-16T00:09:57.699 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:57.700 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:09:57.977 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-cephadm 2024-02-16T00:09:58.564 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:25 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:09:58.738 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:09:58.739 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================== 2024-02-16T00:09:58.739 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:09:58.739 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================== 2024-02-16T00:09:58.739 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:09:58.739 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 138 k 2024-02-16T00:09:58.739 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================== 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout:Install 6 Packages 2024-02-16T00:09:58.740 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:09:58.741 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 6.8 M 2024-02-16T00:09:58.741 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 33 M 2024-02-16T00:09:58.741 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:09:59.038 INFO:teuthology.orchestra.run.smithi042.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 918 kB/s | 227 kB 00:00 2024-02-16T00:09:59.230 INFO:teuthology.orchestra.run.smithi042.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2024-02-16T00:09:59.255 INFO:teuthology.orchestra.run.smithi042.stdout:(3/6): ceph-mgr-cephadm-19.0.0-1468.gfddf34c1.e 297 kB/s | 138 kB 00:00 2024-02-16T00:09:59.564 INFO:teuthology.orchestra.run.smithi042.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 173 kB/s | 58 kB 00:00 2024-02-16T00:09:59.589 INFO:teuthology.orchestra.run.smithi042.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 153 kB/s | 51 kB 00:00 2024-02-16T00:09:59.614 INFO:teuthology.orchestra.run.smithi042.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 952 kB/s | 548 kB 00:00 2024-02-16T00:09:59.616 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:09:59.617 INFO:teuthology.orchestra.run.smithi042.stdout:Total 7.7 MB/s | 6.8 MB 00:00 2024-02-16T00:09:59.617 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:09:59.626 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:09:59.627 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:09:59.721 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:09:59.722 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:00.030 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:00.207 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-16T00:10:00.259 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-16T00:10:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-16T00:10:00.896 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-16T00:10:00.957 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-16T00:10:00.987 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-16T00:10:01.803 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 6/6 2024-02-16T00:10:01.803 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 1/6 2024-02-16T00:10:01.803 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-16T00:10:01.803 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-16T00:10:01.803 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-16T00:10:01.803 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-16T00:10:02.114 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-16T00:10:02.114 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:02.114 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:02.114 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:10:02.114 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-16T00:10:02.114 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-16T00:10:02.115 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-16T00:10:02.115 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-16T00:10:02.115 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-16T00:10:02.115 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:02.115 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:02.319 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-fuse 2024-02-16T00:10:02.910 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:29 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:03.087 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 887 k 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:03.088 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:03.089 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:03.089 INFO:teuthology.orchestra.run.smithi042.stdout:Install 2 Packages 2024-02-16T00:10:03.089 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:03.089 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 966 k 2024-02-16T00:10:03.089 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 2.8 M 2024-02-16T00:10:03.089 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:03.208 INFO:teuthology.orchestra.run.smithi042.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 664 kB/s | 79 kB 00:00 2024-02-16T00:10:03.400 INFO:teuthology.orchestra.run.smithi042.stdout:(2/2): ceph-fuse-19.0.0-1468.gfddf34c1.el9.x86_ 2.8 MB/s | 887 kB 00:00 2024-02-16T00:10:03.401 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:03.401 INFO:teuthology.orchestra.run.smithi042.stdout:Total 3.0 MB/s | 966 kB 00:00 2024-02-16T00:10:03.401 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:03.423 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:03.423 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:03.502 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:03.503 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:03.693 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:03.822 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-16T00:10:03.895 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-16T00:10:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2/2 2024-02-16T00:10:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/2 2024-02-16T00:10:04.924 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-16T00:10:04.924 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:04.924 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:04.924 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-16T00:10:04.924 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:04.924 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:05.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-volume 2024-02-16T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:32 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:05.983 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:05.983 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:05.983 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-02-16T00:10:05.983 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:05.983 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.0.0-1468.gfddf34c1.el9 ceph-noarch 264 k 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout:Install 2 Packages 2024-02-16T00:10:05.984 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:05.985 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 332 k 2024-02-16T00:10:05.985 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 1.5 M 2024-02-16T00:10:05.985 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:06.106 INFO:teuthology.orchestra.run.smithi042.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 566 kB/s | 69 kB 00:00 2024-02-16T00:10:06.348 INFO:teuthology.orchestra.run.smithi042.stdout:(2/2): ceph-volume-19.0.0-1468.gfddf34c1.el9.no 726 kB/s | 264 kB 00:00 2024-02-16T00:10:06.349 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:06.350 INFO:teuthology.orchestra.run.smithi042.stdout:Total 909 kB/s | 332 kB 00:00 2024-02-16T00:10:06.350 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:06.359 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:06.359 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:06.405 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:06.406 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:06.562 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:06.738 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-16T00:10:06.776 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-16T00:10:06.791 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2/2 2024-02-16T00:10:06.791 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:10:06.791 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-16T00:10:06.791 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 1/2 2024-02-16T00:10:07.871 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-16T00:10:07.871 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:07.871 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:07.871 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.0.0-1468.gfddf34c1.el9.noarch 2024-02-16T00:10:07.872 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-16T00:10:07.872 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:07.872 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:08.201 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librados-devel 2024-02-16T00:10:08.791 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:35 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:08.965 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 127 k 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:08.966 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 127 k 2024-02-16T00:10:08.967 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 456 k 2024-02-16T00:10:08.967 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:09.271 INFO:teuthology.orchestra.run.smithi042.stdout:librados-devel-19.0.0-1468.gfddf34c1.el9.x86_64 417 kB/s | 127 kB 00:00 2024-02-16T00:10:09.271 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:09.271 INFO:teuthology.orchestra.run.smithi042.stdout:Total 415 kB/s | 127 kB 00:00 2024-02-16T00:10:09.271 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:09.277 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:09.277 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:09.335 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:09.335 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:09.582 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:10.036 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:10.329 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:10.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:10.329 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:10.329 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:10:10.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:10.329 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:10.548 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install libcephfs2 2024-02-16T00:10:11.138 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:38 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:11.256 INFO:teuthology.orchestra.run.smithi042.stdout:Package libcephfs2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:11.311 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:11.312 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:11.312 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:11.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install libcephfs-devel 2024-02-16T00:10:11.961 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:38 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:12.133 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:12.134 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:12.134 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-02-16T00:10:12.134 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:12.134 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 31 k 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:12.135 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 31 k 2024-02-16T00:10:12.136 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 140 k 2024-02-16T00:10:12.136 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:12.307 INFO:teuthology.orchestra.run.smithi042.stdout:libcephfs-devel-19.0.0-1468.gfddf34c1.el9.x86_6 181 kB/s | 31 kB 00:00 2024-02-16T00:10:12.308 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:12.308 INFO:teuthology.orchestra.run.smithi042.stdout:Total 179 kB/s | 31 kB 00:00 2024-02-16T00:10:12.308 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:12.312 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:12.312 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:12.340 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:12.340 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:12.961 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:13.288 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:13.288 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:13.289 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:13.289 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:10:13.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:13.289 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:13.577 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librados2 2024-02-16T00:10:14.165 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:41 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:14.285 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:14.340 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:14.341 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:14.341 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:14.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librbd1 2024-02-16T00:10:14.980 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:41 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:15.099 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:15.155 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:15.156 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:15.156 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:15.210 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rados 2024-02-16T00:10:15.793 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:42 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:15.912 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rados-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:15.966 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:15.967 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:15.967 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:16.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rgw 2024-02-16T00:10:16.600 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:43 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:16.718 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rgw-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:16.773 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:16.774 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:16.774 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:16.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-cephfs 2024-02-16T00:10:17.407 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:44 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:17.526 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-cephfs-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:17.579 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:17.580 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:17.580 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:17.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rbd 2024-02-16T00:10:18.215 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:45 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:18.335 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 is already installed. 2024-02-16T00:10:18.391 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:18.392 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-02-16T00:10:18.392 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:18.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-fuse 2024-02-16T00:10:19.041 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:46 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:19.215 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 85 k 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:19.216 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:19.217 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:10:19.217 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:19.217 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 85 k 2024-02-16T00:10:19.217 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 231 k 2024-02-16T00:10:19.217 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:19.544 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-fuse-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 261 kB/s | 85 kB 00:00 2024-02-16T00:10:19.544 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:19.544 INFO:teuthology.orchestra.run.smithi042.stdout:Total 260 kB/s | 85 kB 00:00 2024-02-16T00:10:19.544 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:19.552 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:19.552 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:19.611 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:19.611 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:19.764 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:19.861 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:20.270 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:20.581 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:20.581 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:20.581 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:20.581 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:10:20.581 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:20.582 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:20.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-mirror 2024-02-16T00:10:21.439 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:48 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:21.612 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 3.1 M 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:21.613 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 3.1 M 2024-02-16T00:10:21.614 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 13 M 2024-02-16T00:10:21.614 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:22.780 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-mirror-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 2.6 MB/s | 3.1 MB 00:01 2024-02-16T00:10:22.781 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:22.781 INFO:teuthology.orchestra.run.smithi042.stdout:Total 2.6 MB/s | 3.1 MB 00:01 2024-02-16T00:10:22.782 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:22.794 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:22.794 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:22.874 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:22.875 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:23.320 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:23.373 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:23.397 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:23.397 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-16T00:10:23.397 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-16T00:10:23.398 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T00:10:23.398 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-16T00:10:23.398 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:24.560 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:24.560 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:24.560 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:24.560 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:10:24.560 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:24.560 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:24.802 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-nbd 2024-02-16T00:10:25.403 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:52 ago on Fri 16 Feb 2024 12:08:33 AM UTC. 2024-02-16T00:10:25.577 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.0.0-1468.gfddf34c1.el9 ceph 171 k 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:25.578 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-02-16T00:10:25.579 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-02-16T00:10:25.579 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-02-16T00:10:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:25.579 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 171 k 2024-02-16T00:10:25.579 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 494 k 2024-02-16T00:10:25.579 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-02-16T00:10:25.934 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-nbd-19.0.0-1468.gfddf34c1.el9.x86_64.rpm 481 kB/s | 171 kB 00:00 2024-02-16T00:10:25.935 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-02-16T00:10:25.935 INFO:teuthology.orchestra.run.smithi042.stdout:Total 479 kB/s | 171 kB 00:00 2024-02-16T00:10:25.935 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-02-16T00:10:25.943 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-02-16T00:10:25.943 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-02-16T00:10:26.001 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-02-16T00:10:26.002 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-02-16T00:10:26.153 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-02-16T00:10:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:26.699 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:26.999 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 1/1 2024-02-16T00:10:26.999 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:26.999 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-02-16T00:10:26.999 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.0.0-1468.gfddf34c1.el9.x86_64 2024-02-16T00:10:26.999 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:26.999 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-02-16T00:10:27.197 DEBUG:teuthology.parallel:result is None 2024-02-16T00:10:27.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-16T00:10:27.440 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-16T00:10:27.466 INFO:teuthology.orchestra.run.smithi002.stdout:19.0.0-1468.gfddf34c1.el9 2024-02-16T00:10:27.467 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1468.gfddf34c1.el9 2024-02-16T00:10:27.467 INFO:teuthology.task.install:The correct ceph version 19.0.0-1468.gfddf34c1 is installed. 2024-02-16T00:10:27.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fddf34c14d11a944c077fae4b86a8722d85c0772 2024-02-16T00:10:27.609 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-16T00:10:27.632 INFO:teuthology.orchestra.run.smithi042.stdout:19.0.0-1468.gfddf34c1.el9 2024-02-16T00:10:27.632 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1468.gfddf34c1.el9 2024-02-16T00:10:27.632 INFO:teuthology.task.install:The correct ceph version 19.0.0-1468.gfddf34c1 is installed. 2024-02-16T00:10:27.634 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-16T00:10:27.634 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:27.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T00:10:27.668 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:27.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T00:10:27.702 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-16T00:10:27.702 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:27.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T00:10:27.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T00:10:27.807 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:27.807 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T00:10:27.857 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T00:10:27.925 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-16T00:10:27.925 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:27.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T00:10:27.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T00:10:28.023 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:28.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T00:10:28.051 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T00:10:28.120 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-16T00:10:28.120 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:28.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T00:10:28.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T00:10:28.215 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:28.216 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T00:10:28.243 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T00:10:28.311 INFO:teuthology.run_tasks:Running task ceph... 2024-02-16T00:10:28.402 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-16T00:10:28.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-02-16T00:10:28.404 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-02-16T00:10:28.432 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-16T00:10:28.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-16T00:10:28.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-16T00:10:28.500 INFO:tasks.ceph:Creating extra log directories... 2024-02-16T00:10:28.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-16T00:10:28.540 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-16T00:10:28.608 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-16T00:10:28.608 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-16T00:10:28.609 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739', 'branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7561739', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2024-02-15-0913-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9739, 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rgw', 'suite_branch': 'wip-yuri2-testing-2024-02-15-0913-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEH+KhokNcHpZWggZirFpySWhReuX32XHsL6TUgWvGEoU59RoE6oG9711jUvDWqQ89fdkkFFLUiY6Mvtxe/TGqw=', 'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2CF3qZKlLdIA78yBYMU3nWGsx2QcOBR1MqoNjZrUvYDEJw6q8NhgRSVSnYC5jIuJE0mOJ6e5dybHmWoY9RAHU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'fddf34c14d11a944c077fae4b86a8722d85c0772', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-15_21:10:42', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-16T00:10:28.609 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-16T00:10:28.611 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-16T00:10:28.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-02-16T00:10:28.666 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-02-16T00:10:28.693 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:28.693 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T00:10:28.747 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T00:10:28.747 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-02-16 00:09:34.320962166 +0000 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-02-16 00:06:57.686801474 +0000 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-02-16 00:06:57.686801474 +0000 2024-02-16T00:10:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-02-16 00:06:57.686801474 +0000 2024-02-16T00:10:28.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T00:10:28.868 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-02-16T00:10:28.869 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-02-16T00:10:28.869 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.519e-05 s, 5.4 MB/s 2024-02-16T00:10:28.870 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T00:10:28.925 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-02-16T00:10:28.979 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T00:10:28.979 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:28.979 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-16T00:10:28.980 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:28.980 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:28.980 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-02-16 00:09:34.321962143 +0000 2024-02-16T00:10:28.980 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-02-16 00:06:58.021793769 +0000 2024-02-16T00:10:28.980 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-02-16 00:06:58.021793769 +0000 2024-02-16T00:10:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-02-16 00:06:58.021793769 +0000 2024-02-16T00:10:28.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T00:10:29.044 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-02-16T00:10:29.044 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-02-16T00:10:29.044 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.7715e-05 s, 5.2 MB/s 2024-02-16T00:10:29.045 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T00:10:29.100 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-02-16T00:10:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T00:10:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:29.154 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-16T00:10:29.155 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:29.155 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:29.155 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-02-16 00:09:34.321962143 +0000 2024-02-16T00:10:29.155 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-02-16 00:06:58.359785994 +0000 2024-02-16T00:10:29.155 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-02-16 00:06:58.359785994 +0000 2024-02-16T00:10:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-02-16 00:06:58.359785994 +0000 2024-02-16T00:10:29.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T00:10:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-02-16T00:10:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-02-16T00:10:29.219 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 8.5762e-05 s, 6.0 MB/s 2024-02-16T00:10:29.221 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T00:10:29.275 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-02-16T00:10:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T00:10:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-02-16 00:09:34.321962143 +0000 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-02-16 00:06:58.699778173 +0000 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-02-16 00:06:58.699778173 +0000 2024-02-16T00:10:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-02-16 00:06:58.699778173 +0000 2024-02-16T00:10:29.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T00:10:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-02-16T00:10:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-02-16T00:10:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.8523e-05 s, 5.2 MB/s 2024-02-16T00:10:29.397 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T00:10:29.452 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-16T00:10:29.453 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:29.453 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T00:10:29.470 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T00:10:29.471 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-02-16T00:10:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T00:10:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:29.528 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-16T00:10:29.529 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:29.529 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:29.529 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-02-16 00:10:23.647415799 +0000 2024-02-16T00:10:29.529 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-02-16 00:06:57.689629499 +0000 2024-02-16T00:10:29.529 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-02-16 00:06:57.689629499 +0000 2024-02-16T00:10:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-02-16 00:06:57.689629499 +0000 2024-02-16T00:10:29.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T00:10:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-02-16T00:10:29.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-02-16T00:10:29.599 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00011523 s, 4.4 MB/s 2024-02-16T00:10:29.600 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T00:10:29.657 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-02-16 00:10:23.648415791 +0000 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-02-16 00:06:58.018627005 +0000 2024-02-16T00:10:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-02-16 00:06:58.018627005 +0000 2024-02-16T00:10:29.715 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-02-16 00:06:58.018627005 +0000 2024-02-16T00:10:29.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T00:10:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-02-16T00:10:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-02-16T00:10:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000104743 s, 4.9 MB/s 2024-02-16T00:10:29.783 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T00:10:29.841 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-02-16T00:10:29.898 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T00:10:29.898 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:29.898 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-16T00:10:29.898 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:29.898 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:29.899 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-02-16 00:10:23.648415791 +0000 2024-02-16T00:10:29.899 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-02-16 00:06:58.356624442 +0000 2024-02-16T00:10:29.899 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-02-16 00:06:58.356624442 +0000 2024-02-16T00:10:29.899 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-02-16 00:06:58.356624442 +0000 2024-02-16T00:10:29.899 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T00:10:29.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-02-16T00:10:29.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-02-16T00:10:29.966 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000103347 s, 5.0 MB/s 2024-02-16T00:10:29.967 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T00:10:30.025 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-02-16T00:10:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-02-16 00:10:23.649415783 +0000 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-02-16 00:06:58.692621895 +0000 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-02-16 00:06:58.692621895 +0000 2024-02-16T00:10:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-02-16 00:06:58.692621895 +0000 2024-02-16T00:10:30.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T00:10:30.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-02-16T00:10:30.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-02-16T00:10:30.149 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000106574 s, 4.8 MB/s 2024-02-16T00:10:30.150 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T00:10:30.208 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T00:10:30.208 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-16T00:10:30.208 INFO:tasks.ceph:Generating config... 2024-02-16T00:10:30.210 INFO:tasks.ceph:[client] debug ms = 1 2024-02-16T00:10:30.210 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-02-16T00:10:30.210 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-16T00:10:30.210 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-16T00:10:30.210 INFO:tasks.ceph:[client] setuser = ceph 2024-02-16T00:10:30.210 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] debug objclass = 20 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-16T00:10:30.211 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-16T00:10:30.212 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-16T00:10:30.212 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-16T00:10:30.212 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-16T00:10:30.212 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-16T00:10:30.212 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-16T00:10:30.212 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-16T00:10:30.212 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-16T00:10:30.212 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-16T00:10:30.213 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-16T00:10:30.213 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-16T00:10:30.213 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-16T00:10:30.213 INFO:tasks.ceph:Setting up mon.a... 2024-02-16T00:10:30.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-16T00:10:30.271 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-02-16T00:10:30.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-16T00:10:30.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T00:10:30.348 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2')] 2024-02-16T00:10:30.349 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-02-16T00:10:30.350 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:30.350 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-16T00:10:30.404 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:30.484 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:10:30.484 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:fsid b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-02-16T00:10:30.483369+0000 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-02-16T00:10:30.483369+0000 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 17 (quincy) 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-02-16T00:10:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-02-16T00:10:30.486 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-02-16T00:10:30.487 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-16T00:10:30.541 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57... 2024-02-16T00:10:30.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-16T00:10:30.583 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-16T00:10:30.631 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-02-16T00:10:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-02-16T00:10:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-16T00:10:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-02-16T00:10:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-02-16T00:10:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-16T00:10:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-02-16T00:10:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = 172.21.15.2 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-02-16T00:10:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: debug objclass = 20 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-02-16T00:10:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-02-16T00:10:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-02-16T00:10:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-02-16T00:10:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-02-16T00:10:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: rgw gc obj min wait = 15 2024-02-16T00:10:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: debug rgw = 20 2024-02-16T00:10:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: setgroup = ceph 2024-02-16T00:10:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: setuser = ceph 2024-02-16T00:10:30.642 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-02-16T00:10:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-02-16T00:10:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-16T00:10:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-02-16T00:10:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-02-16T00:10:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-02-16T00:10:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-02-16T00:10:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-02-16T00:10:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-02-16T00:10:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-02-16T00:10:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-02-16T00:10:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-16T00:10:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-16T00:10:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-02-16T00:10:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-16T00:10:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-02-16T00:10:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-02-16T00:10:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-02-16T00:10:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-02-16T00:10:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-02-16T00:10:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = 172.21.15.2 2024-02-16T00:10:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57 2024-02-16T00:10:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-02-16T00:10:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-02-16T00:10:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: debug objclass = 20 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-02-16T00:10:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-02-16T00:10:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-02-16T00:10:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-02-16T00:10:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-16T00:10:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-16T00:10:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-02-16T00:10:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-02-16T00:10:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: rgw gc obj min wait = 15 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: debug rgw = 20 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: setgroup = ceph 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: setuser = ceph 2024-02-16T00:10:30.657 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-02-16T00:10:30.659 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-16T00:10:30.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-16T00:10:30.714 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-16T00:10:30.714 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:30.714 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-16T00:10:30.730 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:30.730 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-16T00:10:30.784 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-02-16T00:10:30.785 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:30.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-16T00:10:30.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T00:10:30.864 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:30.864 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:30.919 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:10:30.919 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:30.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-16T00:10:30.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T00:10:30.966 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:30.966 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:31.022 INFO:tasks.ceph:Setting up mon nodes... 2024-02-16T00:10:31.022 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-16T00:10:31.022 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-16T00:10:31.129 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-16T00:10:31.132 INFO:tasks.ceph:Setting up mds nodes... 2024-02-16T00:10:31.132 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-16T00:10:31.132 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-16T00:10:31.174 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-16T00:10:31.188 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-16T00:10:31.188 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-16T00:10:31.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-16T00:10:31.216 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-16T00:10:31.216 INFO:tasks.ceph:role: osd.0 2024-02-16T00:10:31.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-02-16T00:10:31.216 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T00:10:31.284 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-16T00:10:31.285 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T00:10:31.285 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T00:10:31.316 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-02-16T00:10:31.317 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-02-16T00:10:31.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-16T00:10:31.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-16T00:10:31.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:31.551+0000 7fbd4aa12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-16T00:10:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:31.551+0000 7fbd4aa12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-16T00:10:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:31.551+0000 7fbd4aa12640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T00:10:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:31.551+0000 7fbd4aa12640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T00:10:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:31.551+0000 7fbd4aa12640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T00:10:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:31.552+0000 7fbd4aa12640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-16T00:10:34.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T00:10:34.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-16T00:10:34.487 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T00:10:34.487 INFO:tasks.ceph:role: osd.1 2024-02-16T00:10:34.487 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:10:34.487 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-16T00:10:34.557 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T00:10:34.558 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T00:10:34.590 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-02-16T00:10:34.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-02-16T00:10:34.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-16T00:10:34.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-16T00:10:34.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-16T00:10:34.808 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T00:10:34.808 INFO:tasks.ceph:role: osd.2 2024-02-16T00:10:34.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:10:34.809 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-16T00:10:34.875 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T00:10:34.875 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T00:10:34.876 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T00:10:34.907 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-02-16T00:10:34.909 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-02-16T00:10:34.909 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-02-16T00:10:34.980 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-16T00:10:35.054 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-16T00:10:35.121 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T00:10:35.121 INFO:tasks.ceph:role: osd.3 2024-02-16T00:10:35.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:10:35.121 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-16T00:10:35.188 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T00:10:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T00:10:35.189 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T00:10:35.221 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-02-16T00:10:35.223 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-02-16T00:10:35.223 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-02-16T00:10:35.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-16T00:10:35.368 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:35.460+0000 7f51ffb8f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-16T00:10:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:35.461+0000 7f51ffb8f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-16T00:10:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:35.461+0000 7f51ffb8f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T00:10:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:35.461+0000 7f51ffb8f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T00:10:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:35.461+0000 7f51ffb8f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T00:10:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:35.461+0000 7f51ffb8f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-16T00:10:38.314 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T00:10:38.345 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:38.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:38.433+0000 7f719b617640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-16T00:10:38.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:38.433+0000 7f719b617640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-16T00:10:38.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:38.433+0000 7f719b617640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T00:10:38.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:38.433+0000 7f719b617640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T00:10:38.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:38.433+0000 7f719b617640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T00:10:38.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:38.433+0000 7f719b617640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-16T00:10:41.287 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T00:10:41.318 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:41.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:41.406+0000 7f91beb9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-16T00:10:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:41.406+0000 7f91beb9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-16T00:10:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:41.406+0000 7f91beb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T00:10:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:41.406+0000 7f91beb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T00:10:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:41.406+0000 7f91beb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T00:10:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:41.407+0000 7f91beb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-16T00:10:44.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T00:10:44.291 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-16T00:10:44.291 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:44.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-16T00:10:44.324 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:44.324 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-16T00:10:44.362 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:44.362 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-16T00:10:44.431 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:44.432 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-16T00:10:44.500 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:44.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-16T00:10:44.569 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:44.569 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-16T00:10:44.623 INFO:tasks.ceph:Adding keys to all mons... 2024-02-16T00:10:44.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-16T00:10:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-02-16T00:10:44.653 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD3p85ln6TvIBAAthHd0iwHkvDBxFB8OMGQcw== 2024-02-16T00:10:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD3p85lvLOhBxAAKSgQk/goj654BQx3DTQBZg== 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD7p85lF8eLGxAAdB/+86EvLJokqipZLIDkdQ== 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD+p85lQ7TlGRAAik0nkYdw5bUB1bNfnprPEA== 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQABqM5lCClPGBAAfQCCLHuY+uTDl9lPgelA0g== 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-02-16T00:10:44.654 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD3p85lZJBHChAAVMXYa/3KHElGmubfu4Ujfg== 2024-02-16T00:10:44.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T00:10:44.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-16T00:10:44.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T00:10:44.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T00:10:44.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T00:10:44.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-16T00:10:45.017 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-16T00:10:45.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-16T00:10:45.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-16T00:10:45.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-16T00:10:45.165 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-16T00:10:45.219 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-16T00:10:45.219 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-16T00:10:45.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-16T00:10:45.261 INFO:tasks.ceph.mon.a:Started 2024-02-16T00:10:45.262 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-16T00:10:45.262 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-16T00:10:45.262 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-16T00:10:45.264 INFO:tasks.ceph.mgr.x:Started 2024-02-16T00:10:45.264 INFO:tasks.ceph:Setting crush tunables to default 2024-02-16T00:10:45.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-02-16T00:10:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c76d6640 1 Processor -- start 2024-02-16T00:10:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c76d6640 1 -- start start 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c76d6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c76d6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c009be70 con 0x7f11c012c1f0 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c76d6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c012bdb0 con 0x7f11c009c4e0 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c4c71640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c4c71640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47298/0 (socket says 172.21.15.2:47298) 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c5472640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f11c012c1f0 0x7f11c009a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33450/0 (socket says 172.21.15.2:33450) 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c4c71640 1 -- 172.21.15.2:0/964324501 learned_addr learned my addr 172.21.15.2:0/964324501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c4c71640 1 -- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 msgr2=0x7f11c012c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c4c71640 1 -- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 msgr2=0x7f11c012c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.361+0000 7f11c4c71640 1 --2- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-16T00:10:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.362+0000 7f11c4c71640 1 --2- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258329700 0 0) 0x7f11c009be70 con 0x7f11c012c1f0 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11ac003520 con 0x7f11c012c1f0 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682600713 0 0) 0x7f11ac003520 con 0x7f11c012c1f0 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 msgr2=0x7f11c012c5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 --2- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c009b4b0 con 0x7f11c012c1f0 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 3373925309 0 0) 0x7f11bc0015a0 con 0x7f11c012c1f0 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 >> v1:172.21.15.2:6789/0 conn(0x7f11c012c1f0 legacy=0x7f11c009a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 --2- 172.21.15.2:0/964324501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11ac003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.372+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c012bdb0 con 0x7f11ac003970 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.373+0000 7f11c5472640 1 --2- 172.21.15.2:0/964324501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11ac003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.373+0000 7f11c5472640 1 -- 172.21.15.2:0/964324501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac003520 con 0x7f11ac003970 2024-02-16T00:10:45.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.375+0000 7f11c5472640 1 --2- 172.21.15.2:0/964324501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11ac003d70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f11bc007ef0 tx=0x7f11ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b524d16a33d0cf49 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:45.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.375+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11bc02ca40 con 0x7f11ac003970 2024-02-16T00:10:45.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.375+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc02cba0 con 0x7f11ac003970 2024-02-16T00:10:45.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.375+0000 7f11b7fff640 1 -- 172.21.15.2:0/964324501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11bc02ce80 con 0x7f11ac003970 2024-02-16T00:10:45.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.375+0000 7f11c76d6640 1 -- 172.21.15.2:0/964324501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 msgr2=0x7f11ac003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.375+0000 7f11c76d6640 1 --2- 172.21.15.2:0/964324501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11ac003d70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f11bc007ef0 tx=0x7f11ac0057f0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 -- 172.21.15.2:0/964324501 shutdown_connections 2024-02-16T00:10:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 --2- 172.21.15.2:0/964324501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11ac003d70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 --2- 172.21.15.2:0/964324501 >> v2:172.21.15.2:3300/0 conn(0x7f11c009c4e0 0x7f11c012c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 -- 172.21.15.2:0/964324501 >> 172.21.15.2:0/964324501 conn(0x7f11c0070150 msgr2=0x7f11c0098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 -- 172.21.15.2:0/964324501 shutdown_connections 2024-02-16T00:10:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 -- 172.21.15.2:0/964324501 wait complete. 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.376+0000 7f11c76d6640 1 Processor -- start 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c76d6640 1 -- start start 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c76d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11c011a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c76d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c011b4f0 con 0x7f11ac003970 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c5472640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11c011a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c5472640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11c011a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47324/0 (socket says 172.21.15.2:47324) 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c5472640 1 -- 172.21.15.2:0/1503657603 learned_addr learned my addr 172.21.15.2:0/1503657603 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c5472640 1 -- 172.21.15.2:0/1503657603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c011c140 con 0x7f11ac003970 2024-02-16T00:10:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.377+0000 7f11c5472640 1 --2- 172.21.15.2:0/1503657603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11c011a390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11bc007ef0 tx=0x7f11bc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11bc03c040 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc004910 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c011ced0 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11bc004bb0 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c011c930 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f11bc032070 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.378+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11bc04a8c0 con 0x7f11ac003970 2024-02-16T00:10:45.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.379+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c00627b0 con 0x7f11ac003970 2024-02-16T00:10:45.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.381+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f11bc007bc0 con 0x7f11ac003970 2024-02-16T00:10:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.447+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f11c0067aa0 con 0x7f11ac003970 2024-02-16T00:10:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.448+0000 7f11b5ffb640 1 -- 172.21.15.2:0/1503657603 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f11bc04ab20 con 0x7f11ac003970 2024-02-16T00:10:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 msgr2=0x7f11c011a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 --2- 172.21.15.2:0/1503657603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11c011a390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11bc007ef0 tx=0x7f11bc02e070 comp rx=0 tx=0).stop 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 shutdown_connections 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 --2- 172.21.15.2:0/1503657603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ac003970 0x7f11c011a390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 >> 172.21.15.2:0/1503657603 conn(0x7f11c0070150 msgr2=0x7f11c0070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 shutdown_connections 2024-02-16T00:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:45.449+0000 7f11c76d6640 1 -- 172.21.15.2:0/1503657603 wait complete. 2024-02-16T00:10:45.462 INFO:tasks.ceph:check_enable_crimson: False 2024-02-16T00:10:45.462 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-16T00:10:45.462 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-02-16T00:10:45.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-16T00:10:45.489 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:45.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-16T00:10:45.516 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:45.516 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-16T00:10:45.583 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-02-16T00:10:45.583 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-16T00:10:45.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new d5f3c90d-053a-47b1-9fae-357476ad3c27 0 2024-02-16T00:10:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fc5ac1640 1 Processor -- start 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fc5ac1640 1 -- start start 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fc5ac1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5fc006c8e0 0x7f5fc006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fc5ac1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc011cd10 con 0x7f5fc006d200 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fc5ac1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc011ded0 con 0x7f5fc006c8e0 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fbf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5fc006c8e0 0x7f5fc006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fbf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5fc006c8e0 0x7f5fc006ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54452/0 (socket says 172.21.15.42:54452) 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.789+0000 7f5fbf7fe640 1 -- 172.21.15.42:0/1833021256 learned_addr learned my addr 172.21.15.42:0/1833021256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.790+0000 7f5fbf7fe640 1 -- 172.21.15.42:0/1833021256 >> v1:172.21.15.2:6789/0 conn(0x7f5fc006d200 legacy=0x7f5fc011b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.790+0000 7f5fbf7fe640 1 -- 172.21.15.42:0/1833021256 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc011e040 con 0x7f5fc006c8e0 2024-02-16T00:10:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.790+0000 7f5fbe7fc640 1 -- 172.21.15.42:0/1833021256 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153984499 0 0) 0x7f5fc011cd10 con 0x7f5fc006d200 2024-02-16T00:10:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.790+0000 7f5fbf7fe640 1 --2- 172.21.15.42:0/1833021256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc006ccc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00097f0 tx=0x7f5fb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dc9e30febb8897 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fbe7fc640 1 -- 172.21.15.42:0/1833021256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fb00317a0 con 0x7f5fc006c8e0 2024-02-16T00:10:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fbe7fc640 1 -- 172.21.15.42:0/1833021256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb0031900 con 0x7f5fc006c8e0 2024-02-16T00:10:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fbe7fc640 1 -- 172.21.15.42:0/1833021256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fb0031bc0 con 0x7f5fc006c8e0 2024-02-16T00:10:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/1833021256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 msgr2=0x7f5fc006ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 --2- 172.21.15.42:0/1833021256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc006ccc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00097f0 tx=0x7f5fb002b910 comp rx=0 tx=0).stop 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/1833021256 shutdown_connections 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 --2- 172.21.15.42:0/1833021256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc006ccc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/1833021256 >> 172.21.15.42:0/1833021256 conn(0x7f5fc00702e0 msgr2=0x7f5fc0072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/1833021256 shutdown_connections 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.791+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/1833021256 wait complete. 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fc5ac1640 1 Processor -- start 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fc5ac1640 1 -- start start 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fc5ac1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc01abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fc5ac1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc01ac200 con 0x7f5fc006c8e0 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fbf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc01abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fbf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc01abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54468/0 (socket says 172.21.15.42:54468) 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.792+0000 7f5fbf7fe640 1 -- 172.21.15.42:0/3094496519 learned_addr learned my addr 172.21.15.42:0/3094496519 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fbf7fe640 1 -- 172.21.15.42:0/3094496519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00094d0 con 0x7f5fc006c8e0 2024-02-16T00:10:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fbf7fe640 1 --2- 172.21.15.42:0/3094496519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc01abc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00090b0 tx=0x7f5fb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fb00317a0 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb0031a70 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc01ac400 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fb0004030 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc01a5a70 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5fb0043070 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.793+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5fb002d040 con 0x7f5fc006c8e0 2024-02-16T00:10:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.794+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc00627b0 con 0x7f5fc006c8e0 2024-02-16T00:10:45.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.796+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5fb0035020 con 0x7f5fc006c8e0 2024-02-16T00:10:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.871+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d5f3c90d-053a-47b1-9fae-357476ad3c27", "id": 0} v 0) v1 -- 0x7f5fc006d200 con 0x7f5fc006c8e0 2024-02-16T00:10:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.872+0000 7f5fa7fff640 1 -- 172.21.15.42:0/3094496519 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5f3c90d-053a-47b1-9fae-357476ad3c27", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5fb004e940 con 0x7f5fc006c8e0 2024-02-16T00:10:45.874 INFO:teuthology.orchestra.run.smithi042.stdout:0 2024-02-16T00:10:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.872+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 msgr2=0x7f5fc01abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.872+0000 7f5fc5ac1640 1 --2- 172.21.15.42:0/3094496519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc01abc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00090b0 tx=0x7f5fb00046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.872+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 shutdown_connections 2024-02-16T00:10:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.872+0000 7f5fc5ac1640 1 --2- 172.21.15.42:0/3094496519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc006c8e0 0x7f5fc01abc30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.872+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 >> 172.21.15.42:0/3094496519 conn(0x7f5fc00702e0 msgr2=0x7f5fc0115460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.873+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 shutdown_connections 2024-02-16T00:10:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.873+0000 7f5fc5ac1640 1 -- 172.21.15.42:0/3094496519 wait complete. 2024-02-16T00:10:45.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 9ada2c50-de0c-45de-aa91-91b6bb010c01 1 2024-02-16T00:10:45.896 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:45.894+0000 7f76c542b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-16T00:10:45.959 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:45.954+0000 7f76c542b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-16T00:10:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f8299d640 1 Processor -- start 2024-02-16T00:10:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f8299d640 1 -- start start 2024-02-16T00:10:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f8299d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f7c10e200 0x7f1f7c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f8299d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c11cd20 con 0x7f1f7c10eb20 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f8299d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c11dee0 con 0x7f1f7c10e200 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f7bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f7c10e200 0x7f1f7c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f7bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f7c10e200 0x7f1f7c10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54482/0 (socket says 172.21.15.42:54482) 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f7b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1f7c10eb20 0x7f1f7c11b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:42784/0 (socket says 172.21.15.42:42784) 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.987+0000 7f1f7bfff640 1 -- 172.21.15.42:0/2127674026 learned_addr learned my addr 172.21.15.42:0/2127674026 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.988+0000 7f1f7bfff640 1 -- 172.21.15.42:0/2127674026 >> v1:172.21.15.2:6789/0 conn(0x7f1f7c10eb20 legacy=0x7f1f7c11b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.988+0000 7f1f7bfff640 1 -- 172.21.15.42:0/2127674026 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c11e050 con 0x7f1f7c10e200 2024-02-16T00:10:45.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.988+0000 7f1f7bfff640 1 --2- 172.21.15.42:0/2127674026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c10e5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097f0 tx=0x7f1f6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69d1d08cf491a2c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:45.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f7affd640 1 -- 172.21.15.42:0/2127674026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c030790 con 0x7f1f7c10e200 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f7affd640 1 -- 172.21.15.42:0/2127674026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0308f0 con 0x7f1f7c10e200 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f7affd640 1 -- 172.21.15.42:0/2127674026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c030bb0 con 0x7f1f7c10e200 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 -- 172.21.15.42:0/2127674026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 msgr2=0x7f1f7c10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 --2- 172.21.15.42:0/2127674026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c10e5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097f0 tx=0x7f1f6c02b9a0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 -- 172.21.15.42:0/2127674026 shutdown_connections 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 --2- 172.21.15.42:0/2127674026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c10e5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 -- 172.21.15.42:0/2127674026 >> 172.21.15.42:0/2127674026 conn(0x7f1f7c06f440 msgr2=0x7f1f7c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 -- 172.21.15.42:0/2127674026 shutdown_connections 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.989+0000 7f1f8299d640 1 -- 172.21.15.42:0/2127674026 wait complete. 2024-02-16T00:10:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f8299d640 1 Processor -- start 2024-02-16T00:10:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f8299d640 1 -- start start 2024-02-16T00:10:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f8299d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c1abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f8299d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1ac3f0 con 0x7f1f7c10e200 2024-02-16T00:10:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c1abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c1abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54488/0 (socket says 172.21.15.42:54488) 2024-02-16T00:10:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.990+0000 7f1f7bfff640 1 -- 172.21.15.42:0/3023875111 learned_addr learned my addr 172.21.15.42:0/3023875111 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f7bfff640 1 -- 172.21.15.42:0/3023875111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0094d0 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f7bfff640 1 --2- 172.21.15.42:0/3023875111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c1abe20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097f0 tx=0x7f1f6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c039be0 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c039d40 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c043400 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c1ac590 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c1a5ca0 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1f6c043560 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.991+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1f6c03e070 con 0x7f1f7c10e200 2024-02-16T00:10:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.992+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c0627b0 con 0x7f1f7c10e200 2024-02-16T00:10:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:45.994+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1f6c034070 con 0x7f1f7c10e200 2024-02-16T00:10:46.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.068+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ada2c50-de0c-45de-aa91-91b6bb010c01", "id": 1} v 0) v1 -- 0x7f1f7c067570 con 0x7f1f7c10e200 2024-02-16T00:10:46.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.069+0000 7f1f78ff9640 1 -- 172.21.15.42:0/3023875111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ada2c50-de0c-45de-aa91-91b6bb010c01", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1f6c04d530 con 0x7f1f7c10e200 2024-02-16T00:10:46.072 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-02-16T00:10:46.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.069+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 msgr2=0x7f1f7c1abe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.069+0000 7f1f8299d640 1 --2- 172.21.15.42:0/3023875111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c1abe20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097f0 tx=0x7f1f6c004730 comp rx=0 tx=0).stop 2024-02-16T00:10:46.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.069+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 shutdown_connections 2024-02-16T00:10:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.069+0000 7f1f8299d640 1 --2- 172.21.15.42:0/3023875111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7c10e200 0x7f1f7c1abe20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.069+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 >> 172.21.15.42:0/3023875111 conn(0x7f1f7c06f440 msgr2=0x7f1f7c11b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.070+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 shutdown_connections 2024-02-16T00:10:46.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.070+0000 7f1f8299d640 1 -- 172.21.15.42:0/3023875111 wait complete. 2024-02-16T00:10:46.083 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf 2 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.220+0000 7fc405538640 1 Processor -- start 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.220+0000 7fc405538640 1 -- start start 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.220+0000 7fc405538640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc400118190 0x7fc40011a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.220+0000 7fc405538640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40011ab50 con 0x7fc400115400 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.220+0000 7fc405538640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40011bcf0 con 0x7fc400118190 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.220+0000 7fc3f7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc400118190 0x7fc40011a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.221+0000 7fc3f7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc400118190 0x7fc40011a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54490/0 (socket says 172.21.15.42:54490) 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.221+0000 7fc3f7fff640 1 -- 172.21.15.42:0/3744458889 learned_addr learned my addr 172.21.15.42:0/3744458889 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.221+0000 7fc3feffd640 1 --1- 172.21.15.42:0/3744458889 >> v1:172.21.15.2:6789/0 conn(0x7fc400115400 0x7fc4001157e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:42794/0 (socket says 172.21.15.42:42794) 2024-02-16T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.221+0000 7fc3f7fff640 1 -- 172.21.15.42:0/3744458889 >> v1:172.21.15.2:6789/0 conn(0x7fc400115400 legacy=0x7fc4001157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.221+0000 7fc3f7fff640 1 -- 172.21.15.42:0/3744458889 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40011be30 con 0x7fc400118190 2024-02-16T00:10:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc3f7fff640 1 --2- 172.21.15.42:0/3744458889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400118190 0x7fc40011a580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80097f0 tx=0x7fc3e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf53d7653592f26 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc3fe7fc640 1 -- 172.21.15.42:0/3744458889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3e80317a0 con 0x7fc400118190 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc3fe7fc640 1 -- 172.21.15.42:0/3744458889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8031900 con 0x7fc400118190 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc3fe7fc640 1 -- 172.21.15.42:0/3744458889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3e8031bc0 con 0x7fc400118190 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 -- 172.21.15.42:0/3744458889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400118190 msgr2=0x7fc40011a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 --2- 172.21.15.42:0/3744458889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400118190 0x7fc40011a580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80097f0 tx=0x7fc3e802b910 comp rx=0 tx=0).stop 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 -- 172.21.15.42:0/3744458889 shutdown_connections 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 --2- 172.21.15.42:0/3744458889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400118190 0x7fc40011a580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 -- 172.21.15.42:0/3744458889 >> 172.21.15.42:0/3744458889 conn(0x7fc400070250 msgr2=0x7fc400072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 -- 172.21.15.42:0/3744458889 shutdown_connections 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.222+0000 7fc405538640 1 -- 172.21.15.42:0/3744458889 wait complete. 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.223+0000 7fc405538640 1 Processor -- start 2024-02-16T00:10:46.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.223+0000 7fc405538640 1 -- start start 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.223+0000 7fc405538640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 0x7fc4001a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.223+0000 7fc405538640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4001a4300 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 0x7fc4001a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 0x7fc4001a3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54500/0 (socket says 172.21.15.42:54500) 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3feffd640 1 -- 172.21.15.42:0/384863439 learned_addr learned my addr 172.21.15.42:0/384863439 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3feffd640 1 -- 172.21.15.42:0/384863439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80094d0 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3feffd640 1 --2- 172.21.15.42:0/384863439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 0x7fc4001a3dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c450 tx=0x7fc3f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3f0007410 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0007570 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4001a4560 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3f0004910 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.224+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4001a86c0 con 0x7fc400115400 2024-02-16T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.225+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc3f0013400 con 0x7fc400115400 2024-02-16T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.225+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc3f0012810 con 0x7fc400115400 2024-02-16T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.225+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4000627b0 con 0x7fc400115400 2024-02-16T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.228+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc3f0004e00 con 0x7fc400115400 2024-02-16T00:10:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.301+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf", "id": 2} v 0) v1 -- 0x7fc400067570 con 0x7fc400115400 2024-02-16T00:10:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc3f77fe640 1 -- 172.21.15.42:0/384863439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3f00124c0 con 0x7fc400115400 2024-02-16T00:10:46.305 INFO:teuthology.orchestra.run.smithi042.stdout:2 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 msgr2=0x7fc4001a3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 --2- 172.21.15.42:0/384863439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 0x7fc4001a3dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c450 tx=0x7fc3f000c910 comp rx=0 tx=0).stop 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 shutdown_connections 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 --2- 172.21.15.42:0/384863439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc400115400 0x7fc4001a3dc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 >> 172.21.15.42:0/384863439 conn(0x7fc400070250 msgr2=0x7fc400116d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 shutdown_connections 2024-02-16T00:10:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.303+0000 7fc405538640 1 -- 172.21.15.42:0/384863439 wait complete. 2024-02-16T00:10:46.317 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new c55010bc-d742-4bfc-9ac4-190a4e687fdf 3 2024-02-16T00:10:46.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.415+0000 7f3fd11cf640 1 Processor -- start 2024-02-16T00:10:46.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.415+0000 7f3fd11cf640 1 -- start start 2024-02-16T00:10:46.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.415+0000 7f3fd11cf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fcc118170 0x7f3fcc11a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:46.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.415+0000 7f3fd11cf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc11ab30 con 0x7f3fcc1153e0 2024-02-16T00:10:46.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.415+0000 7f3fd11cf640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc11bcd0 con 0x7f3fcc118170 2024-02-16T00:10:46.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.416+0000 7f3fc3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fcc118170 0x7f3fcc11a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:46.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.416+0000 7f3fc3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fcc118170 0x7f3fcc11a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54508/0 (socket says 172.21.15.42:54508) 2024-02-16T00:10:46.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.416+0000 7f3fc3fff640 1 -- 172.21.15.42:0/497263085 learned_addr learned my addr 172.21.15.42:0/497263085 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:46.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.416+0000 7f3fc3fff640 1 -- 172.21.15.42:0/497263085 >> v1:172.21.15.2:6789/0 conn(0x7f3fcc1153e0 legacy=0x7f3fcc1157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.416+0000 7f3fc3fff640 1 -- 172.21.15.42:0/497263085 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc11be10 con 0x7f3fcc118170 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.417+0000 7f3fc3fff640 1 --2- 172.21.15.42:0/497263085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc118170 0x7f3fcc11a560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40097f0 tx=0x7f3fb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ead927eb023b6d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.417+0000 7f3fca59c640 1 -- 172.21.15.42:0/497263085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fb40317a0 con 0x7f3fcc118170 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.417+0000 7f3fca59c640 1 -- 172.21.15.42:0/497263085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4031900 con 0x7f3fcc118170 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.417+0000 7f3fca59c640 1 -- 172.21.15.42:0/497263085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fb4031bc0 con 0x7f3fcc118170 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.417+0000 7f3fd11cf640 1 -- 172.21.15.42:0/497263085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc118170 msgr2=0x7f3fcc11a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.417+0000 7f3fd11cf640 1 --2- 172.21.15.42:0/497263085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc118170 0x7f3fcc11a560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40097f0 tx=0x7f3fb402b910 comp rx=0 tx=0).stop 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 -- 172.21.15.42:0/497263085 shutdown_connections 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 --2- 172.21.15.42:0/497263085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc118170 0x7f3fcc11a560 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 -- 172.21.15.42:0/497263085 >> 172.21.15.42:0/497263085 conn(0x7f3fcc0701e0 msgr2=0x7f3fcc072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 -- 172.21.15.42:0/497263085 shutdown_connections 2024-02-16T00:10:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 -- 172.21.15.42:0/497263085 wait complete. 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 Processor -- start 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.418+0000 7f3fd11cf640 1 -- start start 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fd11cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 0x7f3fcc1a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fd11cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc1a42b0 con 0x7f3fcc1153e0 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fcad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 0x7f3fcc1a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fcad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 0x7f3fcc1a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54516/0 (socket says 172.21.15.42:54516) 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fcad9d640 1 -- 172.21.15.42:0/1576794186 learned_addr learned my addr 172.21.15.42:0/1576794186 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:46.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fcad9d640 1 -- 172.21.15.42:0/1576794186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40094d0 con 0x7f3fcc1153e0 2024-02-16T00:10:46.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.419+0000 7f3fcad9d640 1 --2- 172.21.15.42:0/1576794186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 0x7f3fcc1a3d70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c450 tx=0x7f3fbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:46.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc005200 con 0x7f3fcc1153e0 2024-02-16T00:10:46.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc005380 con 0x7f3fcc1153e0 2024-02-16T00:10:46.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc1a4510 con 0x7f3fcc1153e0 2024-02-16T00:10:46.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc0035f0 con 0x7f3fcc1153e0 2024-02-16T00:10:46.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc1a8670 con 0x7f3fcc1153e0 2024-02-16T00:10:46.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3fbc007020 con 0x7f3fcc1153e0 2024-02-16T00:10:46.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.420+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3fbc003db0 con 0x7f3fcc1153e0 2024-02-16T00:10:46.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.421+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0627b0 con 0x7f3fcc1153e0 2024-02-16T00:10:46.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.423+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3fbc017070 con 0x7f3fcc1153e0 2024-02-16T00:10:46.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.497+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c55010bc-d742-4bfc-9ac4-190a4e687fdf", "id": 3} v 0) v1 -- 0x7f3fcc067570 con 0x7f3fcc1153e0 2024-02-16T00:10:46.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.498+0000 7f3fc37fe640 1 -- 172.21.15.42:0/1576794186 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c55010bc-d742-4bfc-9ac4-190a4e687fdf", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3fbc007600 con 0x7f3fcc1153e0 2024-02-16T00:10:46.501 INFO:teuthology.orchestra.run.smithi042.stdout:3 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 msgr2=0x7f3fcc1a3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 --2- 172.21.15.42:0/1576794186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 0x7f3fcc1a3d70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c450 tx=0x7f3fbc00c910 comp rx=0 tx=0).stop 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 shutdown_connections 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 --2- 172.21.15.42:0/1576794186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fcc1153e0 0x7f3fcc1a3d70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 >> 172.21.15.42:0/1576794186 conn(0x7f3fcc0701e0 msgr2=0x7f3fcc116da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 shutdown_connections 2024-02-16T00:10:46.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:46.499+0000 7f3fd11cf640 1 -- 172.21.15.42:0/1576794186 wait complete. 2024-02-16T00:10:46.512 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-16T00:10:46.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-16T00:10:46.515 INFO:tasks.ceph.osd.0:Started 2024-02-16T00:10:46.515 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-16T00:10:46.515 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-16T00:10:46.517 INFO:tasks.ceph.osd.1:Started 2024-02-16T00:10:46.517 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-16T00:10:46.517 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-16T00:10:46.518 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.515+0000 7f76c542b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-16T00:10:46.519 INFO:tasks.ceph.osd.2:Started 2024-02-16T00:10:46.520 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-16T00:10:46.520 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-16T00:10:46.522 INFO:tasks.ceph.osd.3:Started 2024-02-16T00:10:46.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T00:10:46.584 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.581+0000 7f76c542b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-16T00:10:46.632 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.629+0000 7f76c542b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-16T00:10:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd8580ff640 1 Processor -- start 2024-02-16T00:10:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd8580ff640 1 -- start start 2024-02-16T00:10:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd8580ff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd85008eef0 0x7fd850133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd8580ff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85009b9b0 con 0x7fd85008e400 2024-02-16T00:10:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd8580ff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd850099d70 con 0x7fd85008eef0 2024-02-16T00:10:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd85569a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd85008eef0 0x7fd850133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.632+0000 7fd855e9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd85008e400 0x7fd85008e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33466/0 (socket says 172.21.15.2:33466) 2024-02-16T00:10:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.633+0000 7fd85569a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd85008eef0 0x7fd850133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47344/0 (socket says 172.21.15.2:47344) 2024-02-16T00:10:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.633+0000 7fd855e9b640 1 -- 172.21.15.2:0/329549484 learned_addr learned my addr 172.21.15.2:0/329549484 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.633+0000 7fd85569a640 1 -- 172.21.15.2:0/329549484 >> v1:172.21.15.2:6789/0 conn(0x7fd85008e400 legacy=0x7fd85008e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.633+0000 7fd85569a640 1 -- 172.21.15.2:0/329549484 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85008f740 con 0x7fd85008eef0 2024-02-16T00:10:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.633+0000 7fd85569a640 1 --2- 172.21.15.2:0/329549484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008eef0 0x7fd850133110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd840009720 tx=0x7fd84002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e2231d6158b3b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd854e99640 1 -- 172.21.15.2:0/329549484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84002e070 con 0x7fd85008eef0 2024-02-16T00:10:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd854e99640 1 -- 172.21.15.2:0/329549484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400316d0 con 0x7fd85008eef0 2024-02-16T00:10:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd854e99640 1 -- 172.21.15.2:0/329549484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd840031990 con 0x7fd85008eef0 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 -- 172.21.15.2:0/329549484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008eef0 msgr2=0x7fd850133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 --2- 172.21.15.2:0/329549484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008eef0 0x7fd850133110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd840009720 tx=0x7fd84002b840 comp rx=0 tx=0).stop 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 -- 172.21.15.2:0/329549484 shutdown_connections 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 --2- 172.21.15.2:0/329549484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008eef0 0x7fd850133110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 -- 172.21.15.2:0/329549484 >> 172.21.15.2:0/329549484 conn(0x7fd85009a7f0 msgr2=0x7fd85009ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 -- 172.21.15.2:0/329549484 shutdown_connections 2024-02-16T00:10:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.634+0000 7fd8580ff640 1 -- 172.21.15.2:0/329549484 wait complete. 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.635+0000 7fd8580ff640 1 Processor -- start 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.635+0000 7fd8580ff640 1 -- start start 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8580ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 0x7fd8501c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8580ff640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850127750 con 0x7fd85008e400 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd855e9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 0x7fd8501c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd855e9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 0x7fd8501c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47346/0 (socket says 172.21.15.2:47346) 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd855e9b640 1 -- 172.21.15.2:0/1509567440 learned_addr learned my addr 172.21.15.2:0/1509567440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd855e9b640 1 -- 172.21.15.2:0/1509567440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009400 con 0x7fd85008e400 2024-02-16T00:10:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd855e9b640 1 --2- 172.21.15.2:0/1509567440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 0x7fd8501c2970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c4a0 tx=0x7fd84c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84c005c10 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c005d70 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850126b50 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84c0071a0 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd850127c80 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.636+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd84c007300 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.637+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd84c012910 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.637+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd850121380 con 0x7fd85008e400 2024-02-16T00:10:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.639+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd84c021060 con 0x7fd85008e400 2024-02-16T00:10:46.687 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.684+0000 7f76c542b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-16T00:10:46.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.700+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8500627b0 con 0x7fd85008e400 2024-02-16T00:10:46.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.701+0000 7fd8467fc640 1 -- 172.21.15.2:0/1509567440 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fd84c017070 con 0x7fd85008e400 2024-02-16T00:10:46.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:46.703 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"fsid":"b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57","created":"2024-02-16T00:10:45.367875+0000","modified":"2024-02-16T00:10:46.498824+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T00:10:46.498824+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5f3c90d-053a-47b1-9fae-357476ad3c27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9ada2c50-de0c-45de-aa91-91b6bb010c01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c55010bc-d742-4bfc-9ac4-190a4e687fdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T00:10:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.701+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 msgr2=0x7fd8501c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.701+0000 7fd8580ff640 1 --2- 172.21.15.2:0/1509567440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 0x7fd8501c2970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c4a0 tx=0x7fd84c00c960 comp rx=0 tx=0).stop 2024-02-16T00:10:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.701+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 shutdown_connections 2024-02-16T00:10:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.701+0000 7fd8580ff640 1 --2- 172.21.15.2:0/1509567440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd85008e400 0x7fd8501c2970 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.701+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 >> 172.21.15.2:0/1509567440 conn(0x7fd85009a7f0 msgr2=0x7fd850129770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.702+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 shutdown_connections 2024-02-16T00:10:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:46.702+0000 7fd8580ff640 1 -- 172.21.15.2:0/1509567440 wait complete. 2024-02-16T00:10:46.714 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-16T00:10:46.714 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-16T00:10:46.731 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.728+0000 7f76c542b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-16T00:10:46.850 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.847+0000 7f76c542b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-16T00:10:46.922 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.919+0000 7f76c542b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-16T00:10:46.970 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:46.967+0000 7f76c542b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-16T00:10:47.023 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.021+0000 7f76c542b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-16T00:10:47.072 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.069+0000 7f76c542b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-16T00:10:47.112 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-02-16T00:10:47.109+0000 7f4c42817640 -1 Falling back to public interface 2024-02-16T00:10:47.115 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-02-16T00:10:47.112+0000 7f4caac11640 -1 Falling back to public interface 2024-02-16T00:10:47.117 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T00:10:47.118 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-02-16T00:10:47.115+0000 7f55710a2640 -1 Falling back to public interface 2024-02-16T00:10:47.118 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-02-16T00:10:47.116+0000 7f60be2c8640 -1 Falling back to public interface 2024-02-16T00:10:47.213 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.209+0000 7fbfe0f77640 1 Processor -- start 2024-02-16T00:10:47.213 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.209+0000 7fbfe0f77640 1 -- start start 2024-02-16T00:10:47.213 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfe0f77640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfdc12e8c0 0x7fbfdc09a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:47.213 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfe0f77640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc09cf40 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.213 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfe0f77640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc12ed10 con 0x7fbfdc12e8c0 2024-02-16T00:10:47.213 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfd3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfdc12e8c0 0x7fbfdc09a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:47.214 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfda59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbfdc12e4e0 0x7fbfdc099a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33482/0 (socket says 172.21.15.2:33482) 2024-02-16T00:10:47.214 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfda59c640 1 -- 172.21.15.2:0/1153436377 learned_addr learned my addr 172.21.15.2:0/1153436377 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:47.214 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfd3fff640 1 -- 172.21.15.2:0/1153436377 >> v1:172.21.15.2:6789/0 conn(0x7fbfdc12e4e0 legacy=0x7fbfdc099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:47.214 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfd3fff640 1 -- 172.21.15.2:0/1153436377 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc09cc30 con 0x7fbfdc12e8c0 2024-02-16T00:10:47.214 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.210+0000 7fbfd9d9b640 1 -- 172.21.15.2:0/1153436377 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748476921 0 0) 0x7fbfdc09cf40 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.211+0000 7fbfd3fff640 1 --2- 172.21.15.2:0/1153436377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e8c0 0x7fbfdc09a130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009720 tx=0x7fbfc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7154fbfc3f84c8fc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.211+0000 7fbfd9d9b640 1 -- 172.21.15.2:0/1153436377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc402e070 con 0x7fbfdc12e8c0 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.211+0000 7fbfd9d9b640 1 -- 172.21.15.2:0/1153436377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc40316d0 con 0x7fbfdc12e8c0 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.211+0000 7fbfd9d9b640 1 -- 172.21.15.2:0/1153436377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc4031990 con 0x7fbfdc12e8c0 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 -- 172.21.15.2:0/1153436377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e8c0 msgr2=0x7fbfdc09a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 --2- 172.21.15.2:0/1153436377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e8c0 0x7fbfdc09a130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009720 tx=0x7fbfc402b840 comp rx=0 tx=0).stop 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 -- 172.21.15.2:0/1153436377 shutdown_connections 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 --2- 172.21.15.2:0/1153436377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e8c0 0x7fbfdc09a130 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:47.218 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 -- 172.21.15.2:0/1153436377 >> 172.21.15.2:0/1153436377 conn(0x7fbfdc06c210 msgr2=0x7fbfdc06c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 -- 172.21.15.2:0/1153436377 shutdown_connections 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.212+0000 7fbfe0f77640 1 -- 172.21.15.2:0/1153436377 wait complete. 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfe0f77640 1 Processor -- start 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfe0f77640 1 -- start start 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfe0f77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 0x7fbfdc11cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfe0f77640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc11ff40 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfda59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 0x7fbfdc11cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfda59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 0x7fbfdc11cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47350/0 (socket says 172.21.15.2:47350) 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.213+0000 7fbfda59c640 1 -- 172.21.15.2:0/3117475449 learned_addr learned my addr 172.21.15.2:0/3117475449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:47.219 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfda59c640 1 -- 172.21.15.2:0/3117475449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009400 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfda59c640 1 --2- 172.21.15.2:0/3117475449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 0x7fbfdc11cb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c420 tx=0x7fbfcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0074d0 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc007630 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc11f3c0 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc004950 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc11f7d0 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbfcc004b70 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.214+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbfcc01c990 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.220 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.215+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc067ef0 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.221 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.217+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbfcc018070 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.281 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.278+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfdc11e6a0 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.282 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.279+0000 7fbfd2ffd640 1 -- 172.21.15.2:0/3117475449 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fbfcc01cc20 con 0x7fbfdc12e4e0 2024-02-16T00:10:47.282 INFO:teuthology.misc.health.smithi002.stdout: 2024-02-16T00:10:47.282 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":6,"fsid":"b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57","created":"2024-02-16T00:10:45.367875+0000","modified":"2024-02-16T00:10:46.498824+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T00:10:46.498824+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5f3c90d-053a-47b1-9fae-357476ad3c27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9ada2c50-de0c-45de-aa91-91b6bb010c01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c55010bc-d742-4bfc-9ac4-190a4e687fdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T00:10:47.284 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.279+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 msgr2=0x7fbfdc11cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:47.284 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.279+0000 7fbfe0f77640 1 --2- 172.21.15.2:0/3117475449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 0x7fbfdc11cb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c420 tx=0x7fbfcc00c8e0 comp rx=0 tx=0).stop 2024-02-16T00:10:47.284 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.280+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 shutdown_connections 2024-02-16T00:10:47.284 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.280+0000 7fbfe0f77640 1 --2- 172.21.15.2:0/3117475449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc12e4e0 0x7fbfdc11cb60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:47.284 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.280+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 >> 172.21.15.2:0/3117475449 conn(0x7fbfdc06c210 msgr2=0x7fbfdc1b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:47.284 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.280+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 shutdown_connections 2024-02-16T00:10:47.285 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:47.280+0000 7fbfe0f77640 1 -- 172.21.15.2:0/3117475449 wait complete. 2024-02-16T00:10:47.292 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-16T00:10:47.467 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.464+0000 7f76c542b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-16T00:10:47.605 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.603+0000 7f76c542b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-16T00:10:47.733 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.731+0000 7f76c542b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-16T00:10:47.783 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.778+0000 7f76c542b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-16T00:10:47.896 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.893+0000 7f76c542b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-16T00:10:47.994 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:47.991+0000 7f76c542b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-16T00:10:48.153 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:48.151+0000 7f76c542b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-16T00:10:48.197 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:48.194+0000 7f76c542b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-16T00:10:48.357 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:48.354+0000 7f76c542b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-16T00:10:49.192 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:49.189+0000 7f76c542b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-16T00:10:49.474 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:49.472+0000 7f76c542b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-16T00:10:49.527 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:49.525+0000 7f76c542b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-16T00:10:49.650 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:49.647+0000 7f76c542b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-16T00:10:50.544 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-02-16T00:10:50.542+0000 7f4c42817640 -1 osd.0 0 log_to_monitors true 2024-02-16T00:10:50.603 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-02-16T00:10:50.600+0000 7f55710a2640 -1 osd.2 0 log_to_monitors true 2024-02-16T00:10:50.625 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-02-16T00:10:50.622+0000 7f60be2c8640 -1 osd.3 0 log_to_monitors true 2024-02-16T00:10:50.626 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-02-16T00:10:50.624+0000 7f4caac11640 -1 osd.1 0 log_to_monitors true 2024-02-16T00:10:50.670 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-02-16T00:10:50.668+0000 7f76659d5640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-16T00:10:52.428 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-02-16T00:10:52.425+0000 7f4c3d9c9640 -1 osd.0 0 waiting for initial osdmap 2024-02-16T00:10:52.437 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-02-16T00:10:52.435+0000 7f4c35ffb640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T00:10:52.916 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-02-16T00:10:52.914+0000 7f4ca5cec640 -1 osd.1 0 waiting for initial osdmap 2024-02-16T00:10:52.923 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-02-16T00:10:52.921+0000 7f60b9a3b640 -1 osd.3 0 waiting for initial osdmap 2024-02-16T00:10:52.926 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-02-16T00:10:52.925+0000 7f4c9e31e640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T00:10:52.934 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-02-16T00:10:52.933+0000 7f60b206d640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T00:10:52.937 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-02-16T00:10:52.935+0000 7f556c815640 -1 osd.2 0 waiting for initial osdmap 2024-02-16T00:10:52.952 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-02-16T00:10:52.951+0000 7f5564e47640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T00:10:53.695 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T00:10:53.797 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb8e172640 1 Processor -- start 2024-02-16T00:10:53.797 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb8e172640 1 -- start start 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb8e172640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb88128fe0 0x7ffb88130d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb8e172640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb88095140 con 0x7ffb88092520 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb8e172640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb88093040 con 0x7ffb88128fe0 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb86ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb88128fe0 0x7ffb88130d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb877fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffb88092520 0x7ffb881288d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55190/0 (socket says 172.21.15.2:55190) 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.794+0000 7ffb877fe640 1 -- 172.21.15.2:0/1862148744 learned_addr learned my addr 172.21.15.2:0/1862148744 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.795+0000 7ffb86ffd640 1 -- 172.21.15.2:0/1862148744 >> v1:172.21.15.2:6789/0 conn(0x7ffb88092520 legacy=0x7ffb881288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.795+0000 7ffb867fc640 1 -- 172.21.15.2:0/1862148744 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256818142 0 0) 0x7ffb88095140 con 0x7ffb88092520 2024-02-16T00:10:53.798 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.795+0000 7ffb86ffd640 1 -- 172.21.15.2:0/1862148744 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb880965b0 con 0x7ffb88128fe0 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb86ffd640 1 --2- 172.21.15.2:0/1862148744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88128fe0 0x7ffb88130d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009720 tx=0x7ffb7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f73e13e67462 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb867fc640 1 -- 172.21.15.2:0/1862148744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb7c02e070 con 0x7ffb88128fe0 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb867fc640 1 -- 172.21.15.2:0/1862148744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0316d0 con 0x7ffb88128fe0 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb867fc640 1 -- 172.21.15.2:0/1862148744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb7c031990 con 0x7ffb88128fe0 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 -- 172.21.15.2:0/1862148744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88128fe0 msgr2=0x7ffb88130d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 --2- 172.21.15.2:0/1862148744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88128fe0 0x7ffb88130d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009720 tx=0x7ffb7c02b840 comp rx=0 tx=0).stop 2024-02-16T00:10:53.801 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 -- 172.21.15.2:0/1862148744 shutdown_connections 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 --2- 172.21.15.2:0/1862148744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88128fe0 0x7ffb88130d40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 -- 172.21.15.2:0/1862148744 >> 172.21.15.2:0/1862148744 conn(0x7ffb8809a3f0 msgr2=0x7ffb8809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 -- 172.21.15.2:0/1862148744 shutdown_connections 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.796+0000 7ffb8e172640 1 -- 172.21.15.2:0/1862148744 wait complete. 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.797+0000 7ffb8e172640 1 Processor -- start 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.797+0000 7ffb8e172640 1 -- start start 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb8e172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 0x7ffb880905c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb8e172640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88091690 con 0x7ffb88092520 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 0x7ffb880905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 0x7ffb880905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44876/0 (socket says 172.21.15.2:44876) 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb877fe640 1 -- 172.21.15.2:0/2997799539 learned_addr learned my addr 172.21.15.2:0/2997799539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb877fe640 1 -- 172.21.15.2:0/2997799539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009400 con 0x7ffb88092520 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb877fe640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 0x7ffb880905c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c370 tx=0x7ffb7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:53.802 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb78007410 con 0x7ffb88092520 2024-02-16T00:10:53.803 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78007590 con 0x7ffb88092520 2024-02-16T00:10:53.803 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb881286a0 con 0x7ffb88092520 2024-02-16T00:10:53.803 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb78004950 con 0x7ffb88092520 2024-02-16T00:10:53.803 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.798+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8806d160 con 0x7ffb88092520 2024-02-16T00:10:53.804 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.799+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7ffb78004ab0 con 0x7ffb88092520 2024-02-16T00:10:53.804 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.799+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb88098290 con 0x7ffb88092520 2024-02-16T00:10:53.804 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.799+0000 7ffb6ffff640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ffb74037e60 0x7ffb7403a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:53.804 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.799+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2743+0+0 (secure 0 0 0) 0x7ffb7804a320 con 0x7ffb88092520 2024-02-16T00:10:53.804 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.800+0000 7ffb86ffd640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ffb74037e60 0x7ffb7403a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:53.804 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.800+0000 7ffb86ffd640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ffb74037e60 0x7ffb7403a320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c036000 tx=0x7ffb7c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:53.807 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.805+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb780102c0 con 0x7ffb88092520 2024-02-16T00:10:53.986 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.984+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb880627b0 con 0x7ffb88092520 2024-02-16T00:10:53.987 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.984+0000 7ffb6ffff640 1 -- 172.21.15.2:0/2997799539 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+6044 (secure 0 0 0) 0x7ffb7801bbd0 con 0x7ffb88092520 2024-02-16T00:10:53.987 INFO:teuthology.misc.health.smithi002.stdout: 2024-02-16T00:10:53.987 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":9,"fsid":"b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57","created":"2024-02-16T00:10:45.367875+0000","modified":"2024-02-16T00:10:53.427469+0000","last_up_change":"2024-02-16T00:10:53.427469+0000","last_in_change":"2024-02-16T00:10:46.498824+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5f3c90d-053a-47b1-9fae-357476ad3c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6801","nonce":1783370926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6803","nonce":1783370926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6807","nonce":1783370926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6805","nonce":1783370926}]},"public_addr":"172.21.15.2:6801/1783370926","cluster_addr":"172.21.15.2:6803/1783370926","heartbeat_back_addr":"172.21.15.2:6807/1783370926","heartbeat_front_addr":"172.21.15.2:6805/1783370926","state":["exists","up"]},{"osd":1,"uuid":"9ada2c50-de0c-45de-aa91-91b6bb010c01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6801","nonce":2950936693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6803","nonce":2950936693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6807","nonce":2950936693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6805","nonce":2950936693}]},"public_addr":"172.21.15.42:6801/2950936693","cluster_addr":"172.21.15.42:6803/2950936693","heartbeat_back_addr":"172.21.15.42:6807/2950936693","heartbeat_front_addr":"172.21.15.42:6805/2950936693","state":["exists","up"]},{"osd":2,"uuid":"3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6809","nonce":1288904824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6814","nonce":1288904824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6822","nonce":1288904824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6819","nonce":1288904824}]},"public_addr":"172.21.15.42:6809/1288904824","cluster_addr":"172.21.15.42:6814/1288904824","heartbeat_back_addr":"172.21.15.42:6822/1288904824","heartbeat_front_addr":"172.21.15.42:6819/1288904824","state":["exists","up"]},{"osd":3,"uuid":"c55010bc-d742-4bfc-9ac4-190a4e687fdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6811","nonce":474355007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6815","nonce":474355007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6823","nonce":474355007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6818","nonce":474355007}]},"public_addr":"172.21.15.42:6811/474355007","cluster_addr":"172.21.15.42:6815/474355007","heartbeat_back_addr":"172.21.15.42:6823/474355007","heartbeat_front_addr":"172.21.15.42:6818/474355007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T00:10:53.989 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ffb74037e60 msgr2=0x7ffb7403a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:53.989 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ffb74037e60 0x7ffb7403a320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c036000 tx=0x7ffb7c008030 comp rx=0 tx=0).stop 2024-02-16T00:10:53.989 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 msgr2=0x7ffb880905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:53.989 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 0x7ffb880905c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c370 tx=0x7ffb7800c830 comp rx=0 tx=0).stop 2024-02-16T00:10:53.990 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 shutdown_connections 2024-02-16T00:10:53.990 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ffb74037e60 0x7ffb7403a320 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:53.990 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 --2- 172.21.15.2:0/2997799539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb88092520 0x7ffb880905c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:53.990 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 >> 172.21.15.2:0/2997799539 conn(0x7ffb8809a3f0 msgr2=0x7ffb8812b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:53.990 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 shutdown_connections 2024-02-16T00:10:53.990 INFO:teuthology.misc.health.smithi002.stderr:2024-02-16T00:10:53.986+0000 7ffb8e172640 1 -- 172.21.15.2:0/2997799539 wait complete. 2024-02-16T00:10:53.998 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-16T00:10:53.999 INFO:tasks.ceph:Creating RBD pool 2024-02-16T00:10:53.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-16T00:10:54.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.097+0000 7fc167414640 1 Processor -- start 2024-02-16T00:10:54.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.097+0000 7fc167414640 1 -- start start 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc167414640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc160098410 0x7fc1601335e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc167414640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16009a000 con 0x7fc160097150 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc167414640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16009a310 con 0x7fc160098410 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc1649af640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc160098410 0x7fc1601335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc1651b0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc160097150 0x7fc160097d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55196/0 (socket says 172.21.15.2:55196) 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc1651b0640 1 -- 172.21.15.2:0/1277827855 learned_addr learned my addr 172.21.15.2:0/1277827855 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc1649af640 1 -- 172.21.15.2:0/1277827855 >> v1:172.21.15.2:6789/0 conn(0x7fc160097150 legacy=0x7fc160097d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.098+0000 7fc1649af640 1 -- 172.21.15.2:0/1277827855 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160099960 con 0x7fc160098410 2024-02-16T00:10:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc1649af640 1 --2- 172.21.15.2:0/1277827855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160098410 0x7fc1601335e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc15402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45402441d7194d10 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc15ffff640 1 -- 172.21.15.2:0/1277827855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc15402e070 con 0x7fc160098410 2024-02-16T00:10:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc15ffff640 1 -- 172.21.15.2:0/1277827855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1540316d0 con 0x7fc160098410 2024-02-16T00:10:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc15ffff640 1 -- 172.21.15.2:0/1277827855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc154031990 con 0x7fc160098410 2024-02-16T00:10:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 -- 172.21.15.2:0/1277827855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160098410 msgr2=0x7fc1601335e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:54.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 --2- 172.21.15.2:0/1277827855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160098410 0x7fc1601335e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc15402b840 comp rx=0 tx=0).stop 2024-02-16T00:10:54.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 -- 172.21.15.2:0/1277827855 shutdown_connections 2024-02-16T00:10:54.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 --2- 172.21.15.2:0/1277827855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160098410 0x7fc1601335e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:54.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 -- 172.21.15.2:0/1277827855 >> 172.21.15.2:0/1277827855 conn(0x7fc16009e540 msgr2=0x7fc16009e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:54.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 -- 172.21.15.2:0/1277827855 shutdown_connections 2024-02-16T00:10:54.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.099+0000 7fc167414640 1 -- 172.21.15.2:0/1277827855 wait complete. 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.100+0000 7fc167414640 1 Processor -- start 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.100+0000 7fc167414640 1 -- start start 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc167414640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 0x7fc160093350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc167414640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600960c0 con 0x7fc160097150 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc1651b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 0x7fc160093350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc1651b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 0x7fc160093350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44888/0 (socket says 172.21.15.2:44888) 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc1651b0640 1 -- 172.21.15.2:0/1236633962 learned_addr learned my addr 172.21.15.2:0/1236633962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:54.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc1651b0640 1 -- 172.21.15.2:0/1236633962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009400 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc1651b0640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 0x7fc160093350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc15000cb20 tx=0x7fc15000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc15000abf0 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000ad50 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1600952f0 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc150012400 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.101+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc160094c10 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.102+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7fc150012560 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.102+0000 7fc15dffb640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc14c037e60 0x7fc14c03a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.102+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc160125750 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.102+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2743+0+0 (secure 0 0 0) 0x7fc15004a440 con 0x7fc160097150 2024-02-16T00:10:54.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.103+0000 7fc1649af640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc14c037e60 0x7fc14c03a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:54.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.103+0000 7fc1649af640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc14c037e60 0x7fc14c03a320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc154036000 tx=0x7fc154008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:54.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.107+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc150017030 con 0x7fc160097150 2024-02-16T00:10:54.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.287+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc1600627b0 con 0x7fc160097150 2024-02-16T00:10:54.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.428+0000 7fc15dffb640 1 -- 172.21.15.2:0/1236633962 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc15003c030 con 0x7fc160097150 2024-02-16T00:10:54.431 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'rbd' created 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc14c037e60 msgr2=0x7fc14c03a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc14c037e60 0x7fc14c03a320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc154036000 tx=0x7fc154008030 comp rx=0 tx=0).stop 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 msgr2=0x7fc160093350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 0x7fc160093350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc15000cb20 tx=0x7fc15000a060 comp rx=0 tx=0).stop 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 shutdown_connections 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc14c037e60 0x7fc14c03a320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 --2- 172.21.15.2:0/1236633962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc160097150 0x7fc160093350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 >> 172.21.15.2:0/1236633962 conn(0x7fc16009e540 msgr2=0x7fc16006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 shutdown_connections 2024-02-16T00:10:54.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.430+0000 7fc167414640 1 -- 172.21.15.2:0/1236633962 wait complete. 2024-02-16T00:10:54.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-16T00:10:54.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.544+0000 7fdf7fbcf640 1 Processor -- start 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.544+0000 7fdf7fbcf640 1 -- start start 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7fbcf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdf7812b060 0x7fdf7812b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7fbcf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7809c0c0 con 0x7fdf78121030 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7fbcf640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7806cfa0 con 0x7fdf7812b060 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7d96b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdf7812b060 0x7fdf7812b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7d16a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdf78121030 0x7fdf78121450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55206/0 (socket says 172.21.15.2:55206) 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7d16a640 1 -- 172.21.15.2:0/2306374706 learned_addr learned my addr 172.21.15.2:0/2306374706 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7d96b640 1 -- 172.21.15.2:0/2306374706 >> v1:172.21.15.2:6789/0 conn(0x7fdf78121030 legacy=0x7fdf78121450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7c969640 1 -- 172.21.15.2:0/2306374706 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648179637 0 0) 0x7fdf7809c0c0 con 0x7fdf78121030 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.545+0000 7fdf7d96b640 1 -- 172.21.15.2:0/2306374706 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78093ad0 con 0x7fdf7812b060 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7d96b640 1 --2- 172.21.15.2:0/2306374706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf7812b060 0x7fdf7812b440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b9c0 tx=0x7fdf7402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de798627fecab441 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7c969640 1 -- 172.21.15.2:0/2306374706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf7402ecf0 con 0x7fdf7812b060 2024-02-16T00:10:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7c969640 1 -- 172.21.15.2:0/2306374706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7402ee50 con 0x7fdf7812b060 2024-02-16T00:10:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7c969640 1 -- 172.21.15.2:0/2306374706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf74036590 con 0x7fdf7812b060 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/2306374706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf7812b060 msgr2=0x7fdf7812b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7fbcf640 1 --2- 172.21.15.2:0/2306374706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf7812b060 0x7fdf7812b440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b9c0 tx=0x7fdf7402e010 comp rx=0 tx=0).stop 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/2306374706 shutdown_connections 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7fbcf640 1 --2- 172.21.15.2:0/2306374706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf7812b060 0x7fdf7812b440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.546+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/2306374706 >> 172.21.15.2:0/2306374706 conn(0x7fdf7809a290 msgr2=0x7fdf7809a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.547+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/2306374706 shutdown_connections 2024-02-16T00:10:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.547+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/2306374706 wait complete. 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.547+0000 7fdf7fbcf640 1 Processor -- start 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.547+0000 7fdf7fbcf640 1 -- start start 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7fbcf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 0x7fdf78126b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7fbcf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf78129ce0 con 0x7fdf78121030 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7d96b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 0x7fdf78126b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7d96b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 0x7fdf78126b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44916/0 (socket says 172.21.15.2:44916) 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7d96b640 1 -- 172.21.15.2:0/587448052 learned_addr learned my addr 172.21.15.2:0/587448052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7d96b640 1 -- 172.21.15.2:0/587448052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7400b6a0 con 0x7fdf78121030 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7d96b640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 0x7fdf78126b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b9c0 tx=0x7fdf740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf74040680 con 0x7fdf78121030 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74040800 con 0x7fdf78121030 2024-02-16T00:10:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7806e800 con 0x7fdf78121030 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf74040ae0 con 0x7fdf78121030 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.548+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7806ec40 con 0x7fdf78121030 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.549+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7fdf7403d040 con 0x7fdf78121030 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.549+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf78127cc0 con 0x7fdf78121030 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.549+0000 7fdf6e7fc640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdf5c037e60 0x7fdf5c03a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.549+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 3460+0+0 (secure 0 0 0) 0x7fdf7406f370 con 0x7fdf78121030 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.550+0000 7fdf7d16a640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdf5c037e60 0x7fdf5c03a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.550+0000 7fdf7d16a640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdf5c037e60 0x7fdf5c03a320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf680011e0 tx=0x7fdf68007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:54.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.554+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf7404b9a0 con 0x7fdf78121030 2024-02-16T00:10:54.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:54.734+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdf7806e990 con 0x7fdf78121030 2024-02-16T00:10:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.429+0000 7fdf6e7fc640 1 -- 172.21.15.2:0/587448052 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdf7403b020 con 0x7fdf78121030 2024-02-16T00:10:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-16T00:10:55.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdf5c037e60 msgr2=0x7fdf5c03a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdf5c037e60 0x7fdf5c03a320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf680011e0 tx=0x7fdf68007930 comp rx=0 tx=0).stop 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 msgr2=0x7fdf78126b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 0x7fdf78126b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b9c0 tx=0x7fdf740046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 shutdown_connections 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdf5c037e60 0x7fdf5c03a320 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 --2- 172.21.15.2:0/587448052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf78121030 0x7fdf78126b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 >> 172.21.15.2:0/587448052 conn(0x7fdf7809a290 msgr2=0x7fdf78096970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 shutdown_connections 2024-02-16T00:10:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.432+0000 7fdf7fbcf640 1 -- 172.21.15.2:0/587448052 wait complete. 2024-02-16T00:10:55.448 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-16T00:10:55.449 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-16T00:10:55.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-16T00:10:55.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-16T00:10:55.450 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.553+0000 7fcca8074640 1 Processor -- start 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca8074640 1 -- start start 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca8074640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcca00993f0 0x7fcca0133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca8074640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca009dc90 con 0x7fcca0098900 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca8074640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca009a170 con 0x7fcca00993f0 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca560f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcca00993f0 0x7fcca0133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca5e10640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcca0098900 0x7fcca0098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55210/0 (socket says 172.21.15.2:55210) 2024-02-16T00:10:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca5e10640 1 -- 172.21.15.2:0/4194227334 learned_addr learned my addr 172.21.15.2:0/4194227334 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca560f640 1 -- 172.21.15.2:0/4194227334 >> v1:172.21.15.2:6789/0 conn(0x7fcca0098900 legacy=0x7fcca0098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.554+0000 7fcca560f640 1 -- 172.21.15.2:0/4194227334 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0099d30 con 0x7fcca00993f0 2024-02-16T00:10:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.555+0000 7fcca560f640 1 --2- 172.21.15.2:0/4194227334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca00993f0 0x7fcca0133350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009720 tx=0x7fcc9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fa35ed4fed7be4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.555+0000 7fcca4e0e640 1 -- 172.21.15.2:0/4194227334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9002e070 con 0x7fcca00993f0 2024-02-16T00:10:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.555+0000 7fcca4e0e640 1 -- 172.21.15.2:0/4194227334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc900316d0 con 0x7fcca00993f0 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.555+0000 7fcca4e0e640 1 -- 172.21.15.2:0/4194227334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc90031990 con 0x7fcca00993f0 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 -- 172.21.15.2:0/4194227334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca00993f0 msgr2=0x7fcca0133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 --2- 172.21.15.2:0/4194227334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca00993f0 0x7fcca0133350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009720 tx=0x7fcc9002b840 comp rx=0 tx=0).stop 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 -- 172.21.15.2:0/4194227334 shutdown_connections 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 --2- 172.21.15.2:0/4194227334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca00993f0 0x7fcca0133350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 -- 172.21.15.2:0/4194227334 >> 172.21.15.2:0/4194227334 conn(0x7fcca00a0a20 msgr2=0x7fcca009cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 -- 172.21.15.2:0/4194227334 shutdown_connections 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.556+0000 7fcca8074640 1 -- 172.21.15.2:0/4194227334 wait complete. 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca8074640 1 Processor -- start 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca8074640 1 -- start start 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca8074640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 0x7fcca01c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca8074640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca012cc50 con 0x7fcca0098900 2024-02-16T00:10:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca5e10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 0x7fcca01c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca5e10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 0x7fcca01c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44938/0 (socket says 172.21.15.2:44938) 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca5e10640 1 -- 172.21.15.2:0/2193531421 learned_addr learned my addr 172.21.15.2:0/2193531421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.557+0000 7fcca5e10640 1 -- 172.21.15.2:0/2193531421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009400 con 0x7fcca0098900 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.558+0000 7fcca5e10640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 0x7fcca01c2a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c4a0 tx=0x7fcc9c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.558+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c005c10 con 0x7fcca0098900 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.558+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c005d70 con 0x7fcca0098900 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.558+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca012ce50 con 0x7fcca0098900 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.558+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c0071a0 con 0x7fcca0098900 2024-02-16T00:10:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.558+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca0132e40 con 0x7fcca0098900 2024-02-16T00:10:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.559+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7fcc9c007300 con 0x7fcca0098900 2024-02-16T00:10:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.559+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca00627b0 con 0x7fcca0098900 2024-02-16T00:10:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.559+0000 7fcc967fc640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcc84037e60 0x7fcc8403a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.559+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fcc9c049c50 con 0x7fcca0098900 2024-02-16T00:10:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.559+0000 7fcca560f640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcc84037e60 0x7fcc8403a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.560+0000 7fcca560f640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcc84037e60 0x7fcc8403a320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc90008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:55.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.564+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc9c0198b0 con 0x7fcca0098900 2024-02-16T00:10:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.797+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcca012bd40 con 0x7fcca0098900 2024-02-16T00:10:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.799+0000 7fcc967fc640 1 -- 172.21.15.2:0/2193531421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+86534 (secure 0 0 0) 0x7fcc9c017030 con 0x7fcca0098900 2024-02-16T00:10:55.803 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcc84037e60 msgr2=0x7fcc8403a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcc84037e60 0x7fcc8403a320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc90008030 comp rx=0 tx=0).stop 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 msgr2=0x7fcca01c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 0x7fcca01c2a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c4a0 tx=0x7fcc9c00c960 comp rx=0 tx=0).stop 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 shutdown_connections 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcc84037e60 0x7fcc8403a320 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 --2- 172.21.15.2:0/2193531421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca0098900 0x7fcca01c2a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 >> 172.21.15.2:0/2193531421 conn(0x7fcca00a0a20 msgr2=0x7fcca009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 shutdown_connections 2024-02-16T00:10:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.801+0000 7fcca8074640 1 -- 172.21.15.2:0/2193531421 wait complete. 2024-02-16T00:10:55.814 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":1216866101},{"type":"v1","addr":"172.21.15.42:6825","nonce":1216866101}]},"active_addr":"172.21.15.42:6825/1216866101","active_change":"2024-02-16T00:10:49.661718+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":334156942}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2748206674}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1637561687}]}]} 2024-02-16T00:10:55.816 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-16T00:10:55.817 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-16T00:10:55.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.914+0000 7f8268fe6640 1 Processor -- start 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8268fe6640 1 -- start start 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8268fe6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f826412dcb0 0x7f82641300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8268fe6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8264095270 con 0x7f82640956a0 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8268fe6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8264096190 con 0x7f826412dcb0 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8261d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f826412dcb0 0x7f82641300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:55.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f826259c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82640956a0 0x7f8264095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55220/0 (socket says 172.21.15.2:55220) 2024-02-16T00:10:55.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f826259c640 1 -- 172.21.15.2:0/2461070548 learned_addr learned my addr 172.21.15.2:0/2461070548 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:55.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8261d9b640 1 -- 172.21.15.2:0/2461070548 >> v1:172.21.15.2:6789/0 conn(0x7f82640956a0 legacy=0x7f8264095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f826159a640 1 -- 172.21.15.2:0/2461070548 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712482020 0 0) 0x7f8264095270 con 0x7f82640956a0 2024-02-16T00:10:55.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.915+0000 7f8261d9b640 1 -- 172.21.15.2:0/2461070548 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640954a0 con 0x7f826412dcb0 2024-02-16T00:10:55.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.916+0000 7f8261d9b640 1 --2- 172.21.15.2:0/2461070548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826412dcb0 0x7f82641300a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f824c009720 tx=0x7f824c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e73c91f0d9fa44 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:55.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.916+0000 7f826159a640 1 -- 172.21.15.2:0/2461070548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f824c02e070 con 0x7f826412dcb0 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.916+0000 7f826159a640 1 -- 172.21.15.2:0/2461070548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c0316d0 con 0x7f826412dcb0 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.916+0000 7f826159a640 1 -- 172.21.15.2:0/2461070548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f824c031990 con 0x7f826412dcb0 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 -- 172.21.15.2:0/2461070548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826412dcb0 msgr2=0x7f82641300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 --2- 172.21.15.2:0/2461070548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826412dcb0 0x7f82641300a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f824c009720 tx=0x7f824c02b840 comp rx=0 tx=0).stop 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 -- 172.21.15.2:0/2461070548 shutdown_connections 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 --2- 172.21.15.2:0/2461070548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f826412dcb0 0x7f82641300a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 -- 172.21.15.2:0/2461070548 >> 172.21.15.2:0/2461070548 conn(0x7f826409a300 msgr2=0x7f826409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 -- 172.21.15.2:0/2461070548 shutdown_connections 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.917+0000 7f8268fe6640 1 -- 172.21.15.2:0/2461070548 wait complete. 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.918+0000 7f8268fe6640 1 Processor -- start 2024-02-16T00:10:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.918+0000 7f8268fe6640 1 -- start start 2024-02-16T00:10:55.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.918+0000 7f8268fe6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 0x7f82641c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:55.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.918+0000 7f8268fe6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640707e0 con 0x7f82640956a0 2024-02-16T00:10:55.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.918+0000 7f826259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 0x7f82641c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.918+0000 7f826259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 0x7f82641c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44960/0 (socket says 172.21.15.2:44960) 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f826259c640 1 -- 172.21.15.2:0/69078452 learned_addr learned my addr 172.21.15.2:0/69078452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f826259c640 1 -- 172.21.15.2:0/69078452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c009400 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f826259c640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 0x7f82641c2b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c370 tx=0x7f825c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825c007410 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c007590 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82641c2740 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825c004950 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.919+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8264070310 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.920+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7f825c004ab0 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.920+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8264071d90 con 0x7f82640956a0 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.920+0000 7f825affd640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8244037eb0 0x7f824403a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:55.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.920+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f825c04a600 con 0x7f82640956a0 2024-02-16T00:10:55.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.920+0000 7f8261d9b640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8244037eb0 0x7f824403a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:55.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.921+0000 7f8261d9b640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8244037eb0 0x7f824403a370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f824c036000 tx=0x7f824c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:55.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:55.925+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f825c0102c0 con 0x7f82640956a0 2024-02-16T00:10:56.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.107+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f826412ff60 con 0x7f82640956a0 2024-02-16T00:10:56.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.108+0000 7f825affd640 1 -- 172.21.15.2:0/69078452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+9721 (secure 0 0 0) 0x7f825c01bbd0 con 0x7f82640956a0 2024-02-16T00:10:56.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:56.111 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"fsid":"b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57","created":"2024-02-16T00:10:45.367875+0000","modified":"2024-02-16T00:10:55.429097+0000","last_up_change":"2024-02-16T00:10:53.427469+0000","last_in_change":"2024-02-16T00:10:46.498824+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T00:10:53.708168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T00:10:54.306098+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5f3c90d-053a-47b1-9fae-357476ad3c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6801","nonce":1783370926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6803","nonce":1783370926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6807","nonce":1783370926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6805","nonce":1783370926}]},"public_addr":"172.21.15.2:6801/1783370926","cluster_addr":"172.21.15.2:6803/1783370926","heartbeat_back_addr":"172.21.15.2:6807/1783370926","heartbeat_front_addr":"172.21.15.2:6805/1783370926","state":["exists","up"]},{"osd":1,"uuid":"9ada2c50-de0c-45de-aa91-91b6bb010c01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6801","nonce":2950936693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6803","nonce":2950936693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6807","nonce":2950936693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6805","nonce":2950936693}]},"public_addr":"172.21.15.42:6801/2950936693","cluster_addr":"172.21.15.42:6803/2950936693","heartbeat_back_addr":"172.21.15.42:6807/2950936693","heartbeat_front_addr":"172.21.15.42:6805/2950936693","state":["exists","up"]},{"osd":2,"uuid":"3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6809","nonce":1288904824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6814","nonce":1288904824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6822","nonce":1288904824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6819","nonce":1288904824}]},"public_addr":"172.21.15.42:6809/1288904824","cluster_addr":"172.21.15.42:6814/1288904824","heartbeat_back_addr":"172.21.15.42:6822/1288904824","heartbeat_front_addr":"172.21.15.42:6819/1288904824","state":["exists","up"]},{"osd":3,"uuid":"c55010bc-d742-4bfc-9ac4-190a4e687fdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6811","nonce":474355007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6815","nonce":474355007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6823","nonce":474355007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6818","nonce":474355007}]},"public_addr":"172.21.15.42:6811/474355007","cluster_addr":"172.21.15.42:6815/474355007","heartbeat_back_addr":"172.21.15.42:6823/474355007","heartbeat_front_addr":"172.21.15.42:6818/474355007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.521740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.603798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.608173+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.642745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T00:10:56.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8244037eb0 msgr2=0x7f824403a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8244037eb0 0x7f824403a370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f824c036000 tx=0x7f824c008030 comp rx=0 tx=0).stop 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 msgr2=0x7f82641c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 0x7f82641c2b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c370 tx=0x7f825c00c830 comp rx=0 tx=0).stop 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 shutdown_connections 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8244037eb0 0x7f824403a370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 --2- 172.21.15.2:0/69078452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82640956a0 0x7f82641c2b00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 >> 172.21.15.2:0/69078452 conn(0x7f826409a300 msgr2=0x7f82641210a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 shutdown_connections 2024-02-16T00:10:56.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.110+0000 7f8268fe6640 1 -- 172.21.15.2:0/69078452 wait complete. 2024-02-16T00:10:56.123 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-16T00:10:56.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T00:10:56.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.221+0000 7f40f243e640 1 Processor -- start 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.221+0000 7f40f243e640 1 -- start start 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40f243e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40ec09a270 0x7f40ec130e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40f243e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec09b130 con 0x7f40ec12aea0 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40f243e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec12b990 con 0x7f40ec09a270 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40eb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40ec09a270 0x7f40ec130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40ebfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f40ec12aea0 0x7f40ec12b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55228/0 (socket says 172.21.15.2:55228) 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40eb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40ec09a270 0x7f40ec130e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44968/0 (socket says 172.21.15.2:44968) 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40ebfff640 1 -- 172.21.15.2:0/3537035496 learned_addr learned my addr 172.21.15.2:0/3537035496 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40eb7fe640 1 -- 172.21.15.2:0/3537035496 >> v1:172.21.15.2:6789/0 conn(0x7f40ec12aea0 legacy=0x7f40ec12b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40eb7fe640 1 -- 172.21.15.2:0/3537035496 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec09dd90 con 0x7f40ec09a270 2024-02-16T00:10:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.222+0000 7f40eaffd640 1 -- 172.21.15.2:0/3537035496 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130187743 0 0) 0x7f40ec09b130 con 0x7f40ec12aea0 2024-02-16T00:10:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40eb7fe640 1 --2- 172.21.15.2:0/3537035496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec130e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009720 tx=0x7f40dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e553d72e31dae8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40eaffd640 1 -- 172.21.15.2:0/3537035496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40dc02e070 con 0x7f40ec09a270 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40eaffd640 1 -- 172.21.15.2:0/3537035496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0316d0 con 0x7f40ec09a270 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40eaffd640 1 -- 172.21.15.2:0/3537035496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40dc031990 con 0x7f40ec09a270 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40f243e640 1 -- 172.21.15.2:0/3537035496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 msgr2=0x7f40ec130e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40f243e640 1 --2- 172.21.15.2:0/3537035496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec130e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009720 tx=0x7f40dc02b840 comp rx=0 tx=0).stop 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40f243e640 1 -- 172.21.15.2:0/3537035496 shutdown_connections 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40f243e640 1 --2- 172.21.15.2:0/3537035496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec130e60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40f243e640 1 -- 172.21.15.2:0/3537035496 >> 172.21.15.2:0/3537035496 conn(0x7f40ec09c210 msgr2=0x7f40ec071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.223+0000 7f40f243e640 1 -- 172.21.15.2:0/3537035496 shutdown_connections 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.224+0000 7f40f243e640 1 -- 172.21.15.2:0/3537035496 wait complete. 2024-02-16T00:10:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.224+0000 7f40f243e640 1 Processor -- start 2024-02-16T00:10:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.224+0000 7f40f243e640 1 -- start start 2024-02-16T00:10:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40f243e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec129250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40f243e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec11af30 con 0x7f40ec09a270 2024-02-16T00:10:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec129250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec129250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44972/0 (socket says 172.21.15.2:44972) 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40ebfff640 1 -- 172.21.15.2:0/2087916971 learned_addr learned my addr 172.21.15.2:0/2087916971 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40ebfff640 1 -- 172.21.15.2:0/2087916971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc009400 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.225+0000 7f40ebfff640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec129250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c420 tx=0x7f40d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40d40074d0 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4007630 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec11cb80 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40d4004950 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec0718d0 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7f40d4004b70 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.226+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec0627b0 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.227+0000 7f40e8ff9640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f40cc037dc0 0x7f40cc03a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.227+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f40d4049e10 con 0x7f40ec09a270 2024-02-16T00:10:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.227+0000 7f40eb7fe640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f40cc037dc0 0x7f40cc03a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.227+0000 7f40eb7fe640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f40cc037dc0 0x7f40cc03a280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009720 tx=0x7f40dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.231+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40d400e280 con 0x7f40ec09a270 2024-02-16T00:10:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.415+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40ec073050 con 0x7f40ec09a270 2024-02-16T00:10:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.416+0000 7f40e8ff9640 1 -- 172.21.15.2:0/2087916971 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+9721 (secure 0 0 0) 0x7f40d401ab50 con 0x7f40ec09a270 2024-02-16T00:10:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:56.418 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"fsid":"b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57","created":"2024-02-16T00:10:45.367875+0000","modified":"2024-02-16T00:10:55.429097+0000","last_up_change":"2024-02-16T00:10:53.427469+0000","last_in_change":"2024-02-16T00:10:46.498824+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T00:10:53.708168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T00:10:54.306098+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5f3c90d-053a-47b1-9fae-357476ad3c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6801","nonce":1783370926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6803","nonce":1783370926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6807","nonce":1783370926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6805","nonce":1783370926}]},"public_addr":"172.21.15.2:6801/1783370926","cluster_addr":"172.21.15.2:6803/1783370926","heartbeat_back_addr":"172.21.15.2:6807/1783370926","heartbeat_front_addr":"172.21.15.2:6805/1783370926","state":["exists","up"]},{"osd":1,"uuid":"9ada2c50-de0c-45de-aa91-91b6bb010c01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6801","nonce":2950936693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6803","nonce":2950936693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6807","nonce":2950936693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6805","nonce":2950936693}]},"public_addr":"172.21.15.42:6801/2950936693","cluster_addr":"172.21.15.42:6803/2950936693","heartbeat_back_addr":"172.21.15.42:6807/2950936693","heartbeat_front_addr":"172.21.15.42:6805/2950936693","state":["exists","up"]},{"osd":2,"uuid":"3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6809","nonce":1288904824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6814","nonce":1288904824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6822","nonce":1288904824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6819","nonce":1288904824}]},"public_addr":"172.21.15.42:6809/1288904824","cluster_addr":"172.21.15.42:6814/1288904824","heartbeat_back_addr":"172.21.15.42:6822/1288904824","heartbeat_front_addr":"172.21.15.42:6819/1288904824","state":["exists","up"]},{"osd":3,"uuid":"c55010bc-d742-4bfc-9ac4-190a4e687fdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6811","nonce":474355007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6815","nonce":474355007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6823","nonce":474355007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6818","nonce":474355007}]},"public_addr":"172.21.15.42:6811/474355007","cluster_addr":"172.21.15.42:6815/474355007","heartbeat_back_addr":"172.21.15.42:6823/474355007","heartbeat_front_addr":"172.21.15.42:6818/474355007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.521740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.603798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.608173+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.642745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f40cc037dc0 msgr2=0x7f40cc03a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f40cc037dc0 0x7f40cc03a280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009720 tx=0x7f40dc008030 comp rx=0 tx=0).stop 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 msgr2=0x7f40ec129250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec129250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c420 tx=0x7f40d400c8e0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 shutdown_connections 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f40cc037dc0 0x7f40cc03a280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 --2- 172.21.15.2:0/2087916971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40ec09a270 0x7f40ec129250 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 >> 172.21.15.2:0/2087916971 conn(0x7f40ec09c210 msgr2=0x7f40ec12ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 shutdown_connections 2024-02-16T00:10:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.417+0000 7f40f243e640 1 -- 172.21.15.2:0/2087916971 wait complete. 2024-02-16T00:10:56.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-16T00:10:56.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-16T00:10:56.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-16T00:10:56.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-16T00:10:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.534+0000 7efc5259d640 1 Processor -- start 2024-02-16T00:10:56.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.534+0000 7f6adb7c6640 1 Processor -- start 2024-02-16T00:10:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.534+0000 7efc5259d640 1 -- start start 2024-02-16T00:10:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.534+0000 7f58aefa8640 1 Processor -- start 2024-02-16T00:10:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.534+0000 7f3c25d1c640 1 Processor -- start 2024-02-16T00:10:56.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.534+0000 7f58aefa8640 1 -- start start 2024-02-16T00:10:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c25d1c640 1 -- start start 2024-02-16T00:10:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6adb7c6640 1 -- start start 2024-02-16T00:10:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc5259d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc4c0989f0 0x7efc4c1331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc5259d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c06bdf0 con 0x7efc4c097f00 2024-02-16T00:10:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc5259d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c0672c0 con 0x7efc4c0989f0 2024-02-16T00:10:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f58aefa8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58a806c020 0x7f58a806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc4bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efc4c097f00 0x7efc4c0982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55238/0 (socket says 172.21.15.2:55238) 2024-02-16T00:10:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc4b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc4c0989f0 0x7efc4c1331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc4bfff640 1 -- 172.21.15.2:0/2253571734 learned_addr learned my addr 172.21.15.2:0/2253571734 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c25d1c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c2012aed0 0x7f3c2012f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f58aefa8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a8095680 con 0x7f58a806c940 2024-02-16T00:10:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f58aefa8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a809a8e0 con 0x7f58a806c020 2024-02-16T00:10:56.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6adb7c6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ad4098a60 0x7f6ad4098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c25d1c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2006f260 con 0x7f3c2012a3e0 2024-02-16T00:10:56.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c25d1c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2009d810 con 0x7f3c2012aed0 2024-02-16T00:10:56.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6adb7c6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad4099cc0 con 0x7f6ad4099380 2024-02-16T00:10:56.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f58acd44640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58a806c020 0x7f58a806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c1f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c2012a3e0 0x7f3c2012a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55246/0 (socket says 172.21.15.2:55246) 2024-02-16T00:10:56.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c1effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c2012aed0 0x7f3c2012f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6adb7c6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad409a470 con 0x7f6ad4098a60 2024-02-16T00:10:56.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6ad9562640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ad4098a60 0x7f6ad4098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/8096687 learned_addr learned my addr 172.21.15.2:0/8096687 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6ad9562640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ad4098a60 0x7f6ad4098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45012/0 (socket says 172.21.15.2:45012) 2024-02-16T00:10:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6ad8d61640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6ad4099380 0x7f6ad412bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55250/0 (socket says 172.21.15.2:55250) 2024-02-16T00:10:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f6ad9562640 1 -- 172.21.15.2:0/4021438813 learned_addr learned my addr 172.21.15.2:0/4021438813 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f58acd44640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58a806c020 0x7f58a806c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44994/0 (socket says 172.21.15.2:44994) 2024-02-16T00:10:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7f58acd44640 1 -- 172.21.15.2:0/740474870 learned_addr learned my addr 172.21.15.2:0/740474870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc4affd640 1 -- 172.21.15.2:0/2253571734 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619362993 0 0) 0x7efc4c06bdf0 con 0x7efc4c097f00 2024-02-16T00:10:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.535+0000 7efc4affd640 1 -- 172.21.15.2:0/2253571734 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc34003520 con 0x7efc4c097f00 2024-02-16T00:10:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7efc4b7fe640 1 -- 172.21.15.2:0/2253571734 >> v1:172.21.15.2:6789/0 conn(0x7efc4c097f00 legacy=0x7efc4c0982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7efc4b7fe640 1 -- 172.21.15.2:0/2253571734 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c09a5c0 con 0x7efc4c0989f0 2024-02-16T00:10:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7f6ad9562640 1 -- 172.21.15.2:0/4021438813 >> v1:172.21.15.2:6789/0 conn(0x7f6ad4099380 legacy=0x7f6ad412bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7f6ad9562640 1 -- 172.21.15.2:0/4021438813 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad409aa30 con 0x7f6ad4098a60 2024-02-16T00:10:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7f3c1effd640 1 -- 172.21.15.2:0/8096687 >> v1:172.21.15.2:6789/0 conn(0x7f3c2012a3e0 legacy=0x7f3c2012a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7f3c1effd640 1 -- 172.21.15.2:0/8096687 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20071bf0 con 0x7f3c2012aed0 2024-02-16T00:10:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7f58acd44640 1 -- 172.21.15.2:0/740474870 >> v1:172.21.15.2:6789/0 conn(0x7f58a806c940 legacy=0x7f58a8093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.536+0000 7f58acd44640 1 -- 172.21.15.2:0/740474870 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a809df00 con 0x7f58a806c020 2024-02-16T00:10:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7efc4b7fe640 1 --2- 172.21.15.2:0/2253571734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c0989f0 0x7efc4c1331d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc40009720 tx=0x7efc4002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3deaf80d2313884 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f6ad9562640 1 --2- 172.21.15.2:0/4021438813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad4098e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00097f0 tx=0x7f6ad002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43b9ef81b97a1c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f58acd44640 1 --2- 172.21.15.2:0/740474870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a806c400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f589c0097f0 tx=0x7f589c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2b37d3f8131095 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f3c1effd640 1 --2- 172.21.15.2:0/8096687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012aed0 0x7f3c2012f700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009720 tx=0x7f3c1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682ec7bb0dbc202a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7efc4affd640 1 -- 172.21.15.2:0/2253571734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc40031760 con 0x7efc4c0989f0 2024-02-16T00:10:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7efc4affd640 1 -- 172.21.15.2:0/2253571734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400318c0 con 0x7efc4c0989f0 2024-02-16T00:10:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7efc4affd640 1 -- 172.21.15.2:0/2253571734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc40031b60 con 0x7efc4c0989f0 2024-02-16T00:10:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f58a77fe640 1 -- 172.21.15.2:0/740474870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c030790 con 0x7f58a806c020 2024-02-16T00:10:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f58a77fe640 1 -- 172.21.15.2:0/740474870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c0308f0 con 0x7f58a806c020 2024-02-16T00:10:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f58a77fe640 1 -- 172.21.15.2:0/740474870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c030bb0 con 0x7f58a806c020 2024-02-16T00:10:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f3c1e7fc640 1 -- 172.21.15.2:0/8096687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c1402e070 con 0x7f3c2012aed0 2024-02-16T00:10:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f6acbfff640 1 -- 172.21.15.2:0/4021438813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad00317a0 con 0x7f6ad4098a60 2024-02-16T00:10:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f3c1e7fc640 1 -- 172.21.15.2:0/8096687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c140316d0 con 0x7f3c2012aed0 2024-02-16T00:10:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f3c1e7fc640 1 -- 172.21.15.2:0/8096687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c14031990 con 0x7f3c2012aed0 2024-02-16T00:10:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f6acbfff640 1 -- 172.21.15.2:0/4021438813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0031900 con 0x7f6ad4098a60 2024-02-16T00:10:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.537+0000 7f6acbfff640 1 -- 172.21.15.2:0/4021438813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0031bc0 con 0x7f6ad4098a60 2024-02-16T00:10:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 -- 172.21.15.2:0/2253571734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c0989f0 msgr2=0x7efc4c1331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 --2- 172.21.15.2:0/2253571734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c0989f0 0x7efc4c1331d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc40009720 tx=0x7efc4002b8d0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 -- 172.21.15.2:0/740474870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 msgr2=0x7f58a806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 --2- 172.21.15.2:0/740474870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a806c400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f589c0097f0 tx=0x7f589c02b9a0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 -- 172.21.15.2:0/2253571734 shutdown_connections 2024-02-16T00:10:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 --2- 172.21.15.2:0/2253571734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c0989f0 0x7efc4c1331d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 -- 172.21.15.2:0/2253571734 >> 172.21.15.2:0/2253571734 conn(0x7efc4c09e640 msgr2=0x7efc4c09ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 -- 172.21.15.2:0/2253571734 shutdown_connections 2024-02-16T00:10:56.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7efc5259d640 1 -- 172.21.15.2:0/2253571734 wait complete. 2024-02-16T00:10:56.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 -- 172.21.15.2:0/740474870 shutdown_connections 2024-02-16T00:10:56.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 --2- 172.21.15.2:0/740474870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a806c400 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 -- 172.21.15.2:0/8096687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012aed0 msgr2=0x7f3c2012f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/8096687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012aed0 0x7f3c2012f700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009720 tx=0x7f3c1402b840 comp rx=0 tx=0).stop 2024-02-16T00:10:56.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 -- 172.21.15.2:0/740474870 >> 172.21.15.2:0/740474870 conn(0x7f58a809d700 msgr2=0x7f58a8099bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 -- 172.21.15.2:0/4021438813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 msgr2=0x7f6ad4098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/4021438813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad4098e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00097f0 tx=0x7f6ad002b910 comp rx=0 tx=0).stop 2024-02-16T00:10:56.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 -- 172.21.15.2:0/740474870 shutdown_connections 2024-02-16T00:10:56.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f58aefa8640 1 -- 172.21.15.2:0/740474870 wait complete. 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 -- 172.21.15.2:0/8096687 shutdown_connections 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/8096687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012aed0 0x7f3c2012f700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 -- 172.21.15.2:0/8096687 >> 172.21.15.2:0/8096687 conn(0x7f3c2009ccf0 msgr2=0x7f3c2009d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 -- 172.21.15.2:0/4021438813 shutdown_connections 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/4021438813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad4098e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 -- 172.21.15.2:0/4021438813 >> 172.21.15.2:0/4021438813 conn(0x7f6ad409c500 msgr2=0x7f6ad4071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 -- 172.21.15.2:0/8096687 shutdown_connections 2024-02-16T00:10:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f3c25d1c640 1 -- 172.21.15.2:0/8096687 wait complete. 2024-02-16T00:10:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 -- 172.21.15.2:0/4021438813 shutdown_connections 2024-02-16T00:10:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.538+0000 7f6adb7c6640 1 -- 172.21.15.2:0/4021438813 wait complete. 2024-02-16T00:10:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7efc5259d640 1 Processor -- start 2024-02-16T00:10:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7f58aefa8640 1 Processor -- start 2024-02-16T00:10:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7efc5259d640 1 -- start start 2024-02-16T00:10:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7f58aefa8640 1 -- start start 2024-02-16T00:10:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7f3c25d1c640 1 Processor -- start 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7efc5259d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 0x7efc4c12ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7efc5259d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c130dd0 con 0x7efc4c097f00 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7f6adb7c6640 1 Processor -- start 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7f6adb7c6640 1 -- start start 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.539+0000 7efc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 0x7efc4c12ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7efc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 0x7efc4c12ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45016/0 (socket says 172.21.15.2:45016) 2024-02-16T00:10:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7efc4bfff640 1 -- 172.21.15.2:0/3944344297 learned_addr learned my addr 172.21.15.2:0/3944344297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f58aefa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a808e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f58aefa8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8091610 con 0x7f58a806c020 2024-02-16T00:10:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7efc4bfff640 1 -- 172.21.15.2:0/3944344297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009400 con 0x7efc4c097f00 2024-02-16T00:10:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f58acd44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a808e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f58acd44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a808e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45018/0 (socket says 172.21.15.2:45018) 2024-02-16T00:10:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f58acd44640 1 -- 172.21.15.2:0/4178248839 learned_addr learned my addr 172.21.15.2:0/4178248839 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f6adb7c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f6adb7c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad41ad2e0 con 0x7f6ad4098a60 2024-02-16T00:10:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7efc4bfff640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 0x7efc4c12ef80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00c3b0 tx=0x7efc3c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f58acd44640 1 -- 172.21.15.2:0/4178248839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c0094d0 con 0x7f58a806c020 2024-02-16T00:10:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f6ad9562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f6ad9562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45028/0 (socket says 172.21.15.2:45028) 2024-02-16T00:10:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f6ad9562640 1 -- 172.21.15.2:0/1969700155 learned_addr learned my addr 172.21.15.2:0/1969700155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7f3c25d1c640 1 -- start start 2024-02-16T00:10:56.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc3c005c10 con 0x7efc4c097f00 2024-02-16T00:10:56.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.540+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c127860 con 0x7efc4c097f00 2024-02-16T00:10:56.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f6ad9562640 1 -- 172.21.15.2:0/1969700155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad00094d0 con 0x7f6ad4098a60 2024-02-16T00:10:56.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f58acd44640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a808e400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f589c0090b0 tx=0x7f589c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c1310e0 con 0x7efc4c097f00 2024-02-16T00:10:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c005d70 con 0x7efc4c097f00 2024-02-16T00:10:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c030b90 con 0x7f58a806c020 2024-02-16T00:10:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c043400 con 0x7f58a806c020 2024-02-16T00:10:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589c0436a0 con 0x7f58a806c020 2024-02-16T00:10:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f6ad9562640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad406d3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ad002b950 tx=0x7f6ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a8090b60 con 0x7f58a806c020 2024-02-16T00:10:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f3c25d1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 0x7f3c2008a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a808f850 con 0x7f58a806c020 2024-02-16T00:10:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0031a70 con 0x7f6ad4098a60 2024-02-16T00:10:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad406e210 con 0x7f6ad4098a60 2024-02-16T00:10:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0031bd0 con 0x7f6ad4098a60 2024-02-16T00:10:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f3c25d1c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2008d710 con 0x7f3c2012a3e0 2024-02-16T00:10:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 0x7f3c2008a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc3c007220 con 0x7efc4c097f00 2024-02-16T00:10:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 0x7f3c2008a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45042/0 (socket says 172.21.15.2:45042) 2024-02-16T00:10:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.541+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0044550 con 0x7f6ad4098a60 2024-02-16T00:10:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/2744777656 learned_addr learned my addr 172.21.15.2:0/2744777656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad41a2d00 con 0x7f6ad4098a60 2024-02-16T00:10:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc2c000f80 con 0x7efc4c097f00 2024-02-16T00:10:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58a80908e0 con 0x7f58a806c020 2024-02-16T00:10:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7f589c043800 con 0x7f58a806c020 2024-02-16T00:10:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7f3c1f7fe640 1 -- 172.21.15.2:0/2744777656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c14009400 con 0x7f3c2012a3e0 2024-02-16T00:10:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.542+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7efc3c007380 con 0x7efc4c097f00 2024-02-16T00:10:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58a57fa640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f588c037f00 0x7f588c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f589c03e070 con 0x7f58a806c020 2024-02-16T00:10:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58a57fa640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7f588c03d700 0x7f588c03fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc48ff9640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc38037eb0 0x7efc3803a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f3c1f7fe640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 0x7f3c2008a260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c4a0 tx=0x7f3c1000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f588c040210 con 0x7f588c03d700 2024-02-16T00:10:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589c06fde0 con 0x7f58a806c020 2024-02-16T00:10:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58a7fff640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f588c037f00 0x7f588c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ad4072390 con 0x7f6ad4098a60 2024-02-16T00:10:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c10005c10 con 0x7f3c2012a3e0 2024-02-16T00:10:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7f6ad0042070 con 0x7f6ad4098a60 2024-02-16T00:10:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10005d70 con 0x7f3c2012a3e0 2024-02-16T00:10:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c100071a0 con 0x7f3c2012a3e0 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7efc3c04a460 con 0x7efc4c097f00 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc48ff9640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7efc3803d630 0x7efc3803fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc38040140 con 0x7efc3803d630 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc3c04a790 con 0x7efc4c097f00 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc4b7fe640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc38037eb0 0x7efc3803a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc50b3a640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7efc3803d630 0x7efc3803fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2008c640 con 0x7f3c2012a3e0 2024-02-16T00:10:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f58ad545640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7f588c03d700 0x7f588c03fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2008b2c0 con 0x7f3c2012a3e0 2024-02-16T00:10:56.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f6ac9ffb640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ab8037e10 0x7f6ab803a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6ad002d040 con 0x7f6ad4098a60 2024-02-16T00:10:56.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.543+0000 7efc4b7fe640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc38037eb0 0x7efc3803a370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc40036000 tx=0x7efc40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7efc50b3a640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7efc3803d630 0x7efc3803fa70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ac9ffb640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6ab803d590 0x7f6ab803f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ab80400a0 con 0x7f6ab803d590 2024-02-16T00:10:56.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad006f410 con 0x7f6ad4098a60 2024-02-16T00:10:56.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f58ad545640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7f588c03d700 0x7f588c03fb40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ad8d61640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ab8037e10 0x7f6ab803a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ad9d63640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6ab803d590 0x7f6ab803f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f58a7fff640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f588c037f00 0x7f588c03a3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5894001560 tx=0x7f5894007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ad8d61640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ab8037e10 0x7f6ab803a2d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40015f0 tx=0x7f6ac4007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f6ad9d63640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6ab803d590 0x7f6ab803f9d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc38040140 con 0x7efc3803d630 2024-02-16T00:10:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.544+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7f3c10007300 con 0x7f3c2012a3e0 2024-02-16T00:10:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c20098bc0 con 0x7f3c2012a3e0 2024-02-16T00:10:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c07fff640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c0c037eb0 0x7f3c0c03a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f3c10049d30 con 0x7f3c2012a3e0 2024-02-16T00:10:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f588c040210 con 0x7f588c03d700 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c07fff640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7f3c0c03d630 0x7f3c0c03fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c1effd640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c0c037eb0 0x7f3c0c03a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c0c040140 con 0x7f3c0c03d630 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c100108f0 con 0x7f3c2012a3e0 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c1ffff640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7f3c0c03d630 0x7f3c0c03fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f3c1effd640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c0c037eb0 0x7f3c0c03a370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c14036000 tx=0x7f3c14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.545+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6ab80400a0 con 0x7f6ab803d590 2024-02-16T00:10:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.546+0000 7f3c1ffff640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7f3c0c03d630 0x7f3c0c03fa70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.546+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3c0c040140 con 0x7f3c0c03d630 2024-02-16T00:10:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.559+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc2c002bd0 con 0x7efc3803d630 2024-02-16T00:10:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.559+0000 7efc48ff9640 1 -- 172.21.15.2:0/3944344297 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc2c002bd0 con 0x7efc3803d630 2024-02-16T00:10:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.560+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7efc3803d630 msgr2=0x7efc3803fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.560+0000 7efc5259d640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7efc3803d630 0x7efc3803fa70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.560+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc38037eb0 msgr2=0x7efc3803a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.560+0000 7efc5259d640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc38037eb0 0x7efc3803a370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc40036000 tx=0x7efc40008030 comp rx=0 tx=0).stop 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.560+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 msgr2=0x7efc4c12ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.560+0000 7efc5259d640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 0x7efc4c12ef80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00c3b0 tx=0x7efc3c00c870 comp rx=0 tx=0).stop 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 shutdown_connections 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7efc3803d630 0x7efc3803fa70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc38037eb0 0x7efc3803a370 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 --2- 172.21.15.2:0/3944344297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4c097f00 0x7efc4c12ef80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 >> 172.21.15.2:0/3944344297 conn(0x7efc4c09e640 msgr2=0x7efc4c096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c2012b2d0 con 0x7f3c0c03d630 2024-02-16T00:10:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 shutdown_connections 2024-02-16T00:10:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7efc5259d640 1 -- 172.21.15.2:0/3944344297 wait complete. 2024-02-16T00:10:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c07fff640 1 -- 172.21.15.2:0/2744777656 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c18011040 con 0x7f3c0c03d630 2024-02-16T00:10:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7f3c0c03d630 msgr2=0x7f3c0c03fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7f3c0c03d630 0x7f3c0c03fa70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c0c037eb0 msgr2=0x7f3c0c03a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c0c037eb0 0x7f3c0c03a370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c14036000 tx=0x7f3c14008030 comp rx=0 tx=0).stop 2024-02-16T00:10:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 msgr2=0x7f3c2008a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 0x7f3c2008a260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c4a0 tx=0x7f3c1000c960 comp rx=0 tx=0).stop 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 shutdown_connections 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c0c037eb0 0x7f3c0c03a370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7f3c0c03d630 0x7f3c0c03fa70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 --2- 172.21.15.2:0/2744777656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c2012a3e0 0x7f3c2008a260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.561+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 >> 172.21.15.2:0/2744777656 conn(0x7f3c2009ccf0 msgr2=0x7f3c2006fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.562+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 shutdown_connections 2024-02-16T00:10:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.562+0000 7f3c25d1c640 1 -- 172.21.15.2:0/2744777656 wait complete. 2024-02-16T00:10:56.585 INFO:teuthology.orchestra.run.smithi002.stdout:38654705666 2024-02-16T00:10:56.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-16T00:10:56.586 INFO:teuthology.orchestra.run.smithi002.stdout:38654705666 2024-02-16T00:10:56.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-16T00:10:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.578+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58a806cda0 con 0x7f588c03d700 2024-02-16T00:10:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ad409acd0 con 0x7f6ab803d590 2024-02-16T00:10:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58a57fa640 1 -- 172.21.15.2:0/4178248839 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58a0011040 con 0x7f588c03d700 2024-02-16T00:10:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f6ac9ffb640 1 -- 172.21.15.2:0/1969700155 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6acc011040 con 0x7f6ab803d590 2024-02-16T00:10:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7f588c03d700 msgr2=0x7f588c03fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7f588c03d700 0x7f588c03fb40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f588c037f00 msgr2=0x7f588c03a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f588c037f00 0x7f588c03a3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5894001560 tx=0x7f5894007a50 comp rx=0 tx=0).stop 2024-02-16T00:10:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 msgr2=0x7f58a808e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a808e400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f589c0090b0 tx=0x7f589c004730 comp rx=0 tx=0).stop 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 shutdown_connections 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7f588c03d700 0x7f588c03fb40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f588c037f00 0x7f588c03a3c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 --2- 172.21.15.2:0/4178248839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58a806c020 0x7f58a808e400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 >> 172.21.15.2:0/4178248839 conn(0x7f58a809d700 msgr2=0x7f58a8093980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6ab803d590 msgr2=0x7f6ab803f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6ab803d590 0x7f6ab803f9d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 shutdown_connections 2024-02-16T00:10:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.579+0000 7f58aefa8640 1 -- 172.21.15.2:0/4178248839 wait complete. 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ab8037e10 msgr2=0x7f6ab803a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ab8037e10 0x7f6ab803a2d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40015f0 tx=0x7f6ac4007a40 comp rx=0 tx=0).stop 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 msgr2=0x7f6ad406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad406d3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ad002b950 tx=0x7f6ad00046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 shutdown_connections 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6ab803d590 0x7f6ab803f9d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ab8037e10 0x7f6ab803a2d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 --2- 172.21.15.2:0/1969700155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ad4098a60 0x7f6ad406d3d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 >> 172.21.15.2:0/1969700155 conn(0x7f6ad409c500 msgr2=0x7f6ad40701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 shutdown_connections 2024-02-16T00:10:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.580+0000 7f6adb7c6640 1 -- 172.21.15.2:0/1969700155 wait complete. 2024-02-16T00:10:56.597 INFO:teuthology.orchestra.run.smithi002.stdout:38654705667 2024-02-16T00:10:56.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-16T00:10:56.598 INFO:teuthology.orchestra.run.smithi002.stdout:38654705667 2024-02-16T00:10:56.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-16T00:10:56.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.699+0000 7f8ca1cc5640 1 Processor -- start 2024-02-16T00:10:56.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.699+0000 7f8ca1cc5640 1 -- start start 2024-02-16T00:10:56.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.699+0000 7f8ca1cc5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c9c0989f0 0x7f8c9c1331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.699+0000 7f8ca1cc5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c06bdf0 con 0x7f8c9c097f00 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.699+0000 7f8ca1cc5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c0672c0 con 0x7f8c9c0989f0 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.700+0000 7f8c9affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c9c0989f0 0x7f8c9c1331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.700+0000 7f8c9b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8c9c097f00 0x7f8c9c0982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55252/0 (socket says 172.21.15.2:55252) 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.700+0000 7f8c9b7fe640 1 -- 172.21.15.2:0/63246833 learned_addr learned my addr 172.21.15.2:0/63246833 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.700+0000 7f8c9affd640 1 -- 172.21.15.2:0/63246833 >> v1:172.21.15.2:6789/0 conn(0x7f8c9c097f00 legacy=0x7f8c9c0982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.700+0000 7f8c9affd640 1 -- 172.21.15.2:0/63246833 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c09a5c0 con 0x7f8c9c0989f0 2024-02-16T00:10:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.700+0000 7f8c9a7fc640 1 -- 172.21.15.2:0/63246833 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343756247 0 0) 0x7f8c9c06bdf0 con 0x7f8c9c097f00 2024-02-16T00:10:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.701+0000 7f8c9affd640 1 --2- 172.21.15.2:0/63246833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c0989f0 0x7f8c9c1331d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009720 tx=0x7f8c9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729cfe8bf7a4f647 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.701+0000 7f8c9a7fc640 1 -- 172.21.15.2:0/63246833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c90031760 con 0x7f8c9c0989f0 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.701+0000 7f8c9a7fc640 1 -- 172.21.15.2:0/63246833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c900318c0 con 0x7f8c9c0989f0 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.701+0000 7f8c9a7fc640 1 -- 172.21.15.2:0/63246833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c90031b80 con 0x7f8c9c0989f0 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/63246833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c0989f0 msgr2=0x7f8c9c1331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 --2- 172.21.15.2:0/63246833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c0989f0 0x7f8c9c1331d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009720 tx=0x7f8c9002b8d0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/63246833 shutdown_connections 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 --2- 172.21.15.2:0/63246833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c0989f0 0x7f8c9c1331d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/63246833 >> 172.21.15.2:0/63246833 conn(0x7f8c9c09e640 msgr2=0x7f8c9c09ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/63246833 shutdown_connections 2024-02-16T00:10:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.702+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/63246833 wait complete. 2024-02-16T00:10:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.703+0000 7f8ca1cc5640 1 Processor -- start 2024-02-16T00:10:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.703+0000 7f8ca1cc5640 1 -- start start 2024-02-16T00:10:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.703+0000 7f8ca1cc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 0x7f8c9c12ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.703+0000 7f8ca1cc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c130dd0 con 0x7f8c9c097f00 2024-02-16T00:10:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.703+0000 7f8c9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 0x7f8c9c12ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.703+0000 7f8c9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 0x7f8c9c12ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45054/0 (socket says 172.21.15.2:45054) 2024-02-16T00:10:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8c9b7fe640 1 -- 172.21.15.2:0/1774535667 learned_addr learned my addr 172.21.15.2:0/1774535667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8c9b7fe640 1 -- 172.21.15.2:0/1774535667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009400 con 0x7f8c9c097f00 2024-02-16T00:10:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8c9b7fe640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 0x7f8c9c12ef80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c420 tx=0x7f8c8c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c8c0074d0 con 0x7f8c9c097f00 2024-02-16T00:10:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c007630 con 0x7f8c9c097f00 2024-02-16T00:10:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c127860 con 0x7f8c9c097f00 2024-02-16T00:10:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c8c004950 con 0x7f8c9c097f00 2024-02-16T00:10:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.704+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c1310e0 con 0x7f8c9c097f00 2024-02-16T00:10:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.706+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c8c004b70 con 0x7f8c9c097f00 2024-02-16T00:10:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.706+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c130490 con 0x7f8c9c097f00 2024-02-16T00:10:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.706+0000 7f8c83fff640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c88037ea0 0x7f8c8803a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.706+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f8c8c049ee0 con 0x7f8c9c097f00 2024-02-16T00:10:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.706+0000 7f8c9affd640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c88037ea0 0x7f8c8803a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.706+0000 7f8c9affd640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c88037ea0 0x7f8c8803a360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c90036000 tx=0x7f8c90008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.711+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c8c01aba0 con 0x7f8c9c097f00 2024-02-16T00:10:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fa9f1182640 1 Processor -- start 2024-02-16T00:10:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fa9f1182640 1 -- start start 2024-02-16T00:10:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7f1b51ff6640 1 Processor -- start 2024-02-16T00:10:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fc59f25c640 1 Processor -- start 2024-02-16T00:10:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7f1b51ff6640 1 -- start start 2024-02-16T00:10:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fc59f25c640 1 -- start start 2024-02-16T00:10:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fa9f1182640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9ec097f00 0x7fa9ec0982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fa9f1182640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec06bdf0 con 0x7fa9ec098820 2024-02-16T00:10:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.741+0000 7fa9f1182640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec0672c0 con 0x7fa9ec097f00 2024-02-16T00:10:56.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc59f25c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc598093f10 0x7fc5980942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fa9ead9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9ec097f00 0x7fa9ec0982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fa9ead9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9ec097f00 0x7fa9ec0982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45060/0 (socket says 172.21.15.2:45060) 2024-02-16T00:10:56.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc59f25c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59809c290 con 0x7fc598094830 2024-02-16T00:10:56.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc59f25c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc598095230 con 0x7fc598093f10 2024-02-16T00:10:56.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fa9ead9d640 1 -- 172.21.15.2:0/3887067020 learned_addr learned my addr 172.21.15.2:0/3887067020 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b51ff6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b4c099550 0x7f1b4c1310a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc597fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc598094830 0x7fc59812a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55278/0 (socket says 172.21.15.2:55278) 2024-02-16T00:10:56.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc597fff640 1 -- 172.21.15.2:0/1318816430 learned_addr learned my addr 172.21.15.2:0/1318816430 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:56.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1b4c098a60 0x7f1b4c098e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55282/0 (socket says 172.21.15.2:55282) 2024-02-16T00:10:56.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4b7fe640 1 -- 172.21.15.2:0/113670075 learned_addr learned my addr 172.21.15.2:0/113670075 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:56.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4affd640 1 --2- 172.21.15.2:0/113670075 >> v2:172.21.15.2:3300/0 conn(0x7f1b4c099550 0x7f1b4c1310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc59cff8640 1 --2- 172.21.15.2:0/1318816430 >> v2:172.21.15.2:3300/0 conn(0x7fc598093f10 0x7fc5980942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b51ff6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c099cc0 con 0x7f1b4c098a60 2024-02-16T00:10:56.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b51ff6640 1 -- 172.21.15.2:0/113670075 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c09a470 con 0x7f1b4c099550 2024-02-16T00:10:56.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fa9ead9d640 1 -- 172.21.15.2:0/3887067020 >> v1:172.21.15.2:6789/0 conn(0x7fa9ec098820 legacy=0x7fa9ec12deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fa9e9d9b640 1 -- 172.21.15.2:0/3887067020 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363152305 0 0) 0x7fa9ec06bdf0 con 0x7fa9ec098820 2024-02-16T00:10:56.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fa9ead9d640 1 -- 172.21.15.2:0/3887067020 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec09a5c0 con 0x7fa9ec097f00 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4a7fc640 1 -- 172.21.15.2:0/113670075 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78648439 0 0) 0x7f1b4c099cc0 con 0x7f1b4c098a60 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4a7fc640 1 -- 172.21.15.2:0/113670075 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b34003520 con 0x7f1b4c098a60 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4affd640 1 -- 172.21.15.2:0/113670075 >> v1:172.21.15.2:6789/0 conn(0x7f1b4c098a60 legacy=0x7f1b4c098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7f1b4affd640 1 -- 172.21.15.2:0/113670075 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c09aa30 con 0x7f1b4c099550 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc5977fe640 1 -- 172.21.15.2:0/1318816430 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074021614 0 0) 0x7fc584001110 con 0x7fc598094830 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.742+0000 7fc5977fe640 1 -- 172.21.15.2:0/1318816430 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc588003520 con 0x7fc598094830 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7fc59cff8640 1 -- 172.21.15.2:0/1318816430 >> v1:172.21.15.2:6789/0 conn(0x7fc598094830 legacy=0x7fc59812a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7fc59cff8640 1 -- 172.21.15.2:0/1318816430 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598095fe0 con 0x7fc598093f10 2024-02-16T00:10:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7fa9ead9d640 1 --2- 172.21.15.2:0/3887067020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec0982e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0097f0 tx=0x7fa9dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9ba6b09f4b33a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7f1b4affd640 1 --2- 172.21.15.2:0/113670075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c099550 0x7f1b4c1310a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009720 tx=0x7f1b4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e25c1a9c905c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7fa9e9d9b640 1 -- 172.21.15.2:0/3887067020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc0317a0 con 0x7fa9ec097f00 2024-02-16T00:10:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7fa9e9d9b640 1 -- 172.21.15.2:0/3887067020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc031900 con 0x7fa9ec097f00 2024-02-16T00:10:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.743+0000 7fa9e9d9b640 1 -- 172.21.15.2:0/3887067020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc0317a0 con 0x7fa9ec097f00 2024-02-16T00:10:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fc59cff8640 1 --2- 172.21.15.2:0/1318816430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5980942f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00a8f0 tx=0x7fc58c02cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a285548734d7f69 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7f1b4a7fc640 1 -- 172.21.15.2:0/113670075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b4002e070 con 0x7f1b4c099550 2024-02-16T00:10:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7f1b4a7fc640 1 -- 172.21.15.2:0/113670075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b400316d0 con 0x7f1b4c099550 2024-02-16T00:10:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7f1b4a7fc640 1 -- 172.21.15.2:0/113670075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b40031990 con 0x7f1b4c099550 2024-02-16T00:10:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fc5977fe640 1 -- 172.21.15.2:0/1318816430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc58c02d9e0 con 0x7fc598093f10 2024-02-16T00:10:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fc5977fe640 1 -- 172.21.15.2:0/1318816430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c02db40 con 0x7fc598093f10 2024-02-16T00:10:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fc5977fe640 1 -- 172.21.15.2:0/1318816430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc58c02de00 con 0x7fc598093f10 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fa9f1182640 1 -- 172.21.15.2:0/3887067020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 msgr2=0x7fa9ec0982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fa9f1182640 1 --2- 172.21.15.2:0/3887067020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec0982e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0097f0 tx=0x7fa9dc02b910 comp rx=0 tx=0).stop 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fa9f1182640 1 -- 172.21.15.2:0/3887067020 shutdown_connections 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fa9f1182640 1 --2- 172.21.15.2:0/3887067020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec0982e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fa9f1182640 1 -- 172.21.15.2:0/3887067020 >> 172.21.15.2:0/3887067020 conn(0x7fa9ec09e640 msgr2=0x7fa9ec09ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.744+0000 7fa9f1182640 1 -- 172.21.15.2:0/3887067020 shutdown_connections 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fa9f1182640 1 -- 172.21.15.2:0/3887067020 wait complete. 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 -- 172.21.15.2:0/113670075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c099550 msgr2=0x7f1b4c1310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 --2- 172.21.15.2:0/113670075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c099550 0x7f1b4c1310a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009720 tx=0x7f1b4002b840 comp rx=0 tx=0).stop 2024-02-16T00:10:56.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 -- 172.21.15.2:0/1318816430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 msgr2=0x7fc5980942f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 -- 172.21.15.2:0/113670075 shutdown_connections 2024-02-16T00:10:56.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 --2- 172.21.15.2:0/113670075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c099550 0x7f1b4c1310a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 -- 172.21.15.2:0/113670075 >> 172.21.15.2:0/113670075 conn(0x7f1b4c09c500 msgr2=0x7f1b4c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 --2- 172.21.15.2:0/1318816430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5980942f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00a8f0 tx=0x7fc58c02cd00 comp rx=0 tx=0).stop 2024-02-16T00:10:56.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 -- 172.21.15.2:0/1318816430 shutdown_connections 2024-02-16T00:10:56.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 --2- 172.21.15.2:0/1318816430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5980942f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 -- 172.21.15.2:0/113670075 shutdown_connections 2024-02-16T00:10:56.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 -- 172.21.15.2:0/1318816430 >> 172.21.15.2:0/1318816430 conn(0x7fc59809a050 msgr2=0x7fc59809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7f1b51ff6640 1 -- 172.21.15.2:0/113670075 wait complete. 2024-02-16T00:10:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 -- 172.21.15.2:0/1318816430 shutdown_connections 2024-02-16T00:10:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.745+0000 7fc59f25c640 1 -- 172.21.15.2:0/1318816430 wait complete. 2024-02-16T00:10:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fc59f25c640 1 Processor -- start 2024-02-16T00:10:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7f1b51ff6640 1 Processor -- start 2024-02-16T00:10:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fc59f25c640 1 -- start start 2024-02-16T00:10:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fa9f1182640 1 Processor -- start 2024-02-16T00:10:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7f1b51ff6640 1 -- start start 2024-02-16T00:10:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fa9f1182640 1 -- start start 2024-02-16T00:10:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fc59f25c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5981bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fc59f25c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5981aa590 con 0x7fc598093f10 2024-02-16T00:10:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.746+0000 7fa9f1182640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec08a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7f1b51ff6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 0x7f1b4c12ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9f1182640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec08e2b0 con 0x7fa9ec097f00 2024-02-16T00:10:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7f1b51ff6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c11b4e0 con 0x7f1b4c098a60 2024-02-16T00:10:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec08a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec08a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45108/0 (socket says 172.21.15.2:45108) 2024-02-16T00:10:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9ead9d640 1 -- 172.21.15.2:0/4286259439 learned_addr learned my addr 172.21.15.2:0/4286259439 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fc59cff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5981bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7f1b4b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 0x7f1b4c12ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fc59cff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5981bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45102/0 (socket says 172.21.15.2:45102) 2024-02-16T00:10:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fc59cff8640 1 -- 172.21.15.2:0/2517223751 learned_addr learned my addr 172.21.15.2:0/2517223751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7f1b4b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 0x7f1b4c12ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45120/0 (socket says 172.21.15.2:45120) 2024-02-16T00:10:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7f1b4b7fe640 1 -- 172.21.15.2:0/2433309322 learned_addr learned my addr 172.21.15.2:0/2433309322 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9ead9d640 1 -- 172.21.15.2:0/4286259439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0094d0 con 0x7fa9ec097f00 2024-02-16T00:10:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9ead9d640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec08a260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009910 tx=0x7fa9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fc59cff8640 1 -- 172.21.15.2:0/2517223751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c00a5a0 con 0x7fc598093f10 2024-02-16T00:10:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7f1b4b7fe640 1 -- 172.21.15.2:0/2433309322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40009400 con 0x7f1b4c098a60 2024-02-16T00:10:56.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.747+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc003950 con 0x7fa9ec097f00 2024-02-16T00:10:56.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc003ab0 con 0x7fa9ec097f00 2024-02-16T00:10:56.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec099a10 con 0x7fa9ec097f00 2024-02-16T00:10:56.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc003d90 con 0x7fa9ec097f00 2024-02-16T00:10:56.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7f1b4b7fe640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 0x7f1b4c12ad10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00c480 tx=0x7f1b3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec08b5f0 con 0x7fa9ec097f00 2024-02-16T00:10:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fc59cff8640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5981bf0b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc58c000c00 tx=0x7fc58c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c005c10 con 0x7f1b4c098a60 2024-02-16T00:10:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c005d70 con 0x7f1b4c098a60 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c0071e0 con 0x7f1b4c098a60 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc58c03e540 con 0x7fc598093f10 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c03e6a0 con 0x7fc598093f10 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc58c03e960 con 0x7fc598093f10 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc598091a70 con 0x7fc598093f10 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c12eb50 con 0x7f1b4c098a60 2024-02-16T00:10:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.748+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c06f0f0 con 0x7f1b4c098a60 2024-02-16T00:10:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5981aa7c0 con 0x7fc598093f10 2024-02-16T00:10:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa9dc04e450 con 0x7fa9ec097f00 2024-02-16T00:10:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec0627b0 con 0x7fa9ec097f00 2024-02-16T00:10:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7fa9d37fe640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa9d8037f40 0x7fa9d803a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa9dc02d040 con 0x7fa9ec097f00 2024-02-16T00:10:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7fa9ea59c640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa9d8037f40 0x7fa9d803a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.749+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1b3c007340 con 0x7f1b4c098a60 2024-02-16T00:10:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc58c03c040 con 0x7fc598093f10 2024-02-16T00:10:56.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7f1b33fff640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b38037ef0 0x7f1b3803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f1b3c049e30 con 0x7f1b4c098a60 2024-02-16T00:10:56.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c11b300 con 0x7f1b4c098a60 2024-02-16T00:10:56.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7f1b4affd640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b38037ef0 0x7f1b3803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7fc5957fa640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc57c037f90 0x7fc57c03a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7fa9ea59c640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa9d8037f40 0x7fa9d803a400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0007fd0 tx=0x7fa9e0007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fc58c06cc20 con 0x7fc598093f10 2024-02-16T00:10:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7fc597fff640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc57c037f90 0x7fc57c03a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc578005080 con 0x7fc598093f10 2024-02-16T00:10:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.750+0000 7f1b4affd640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b38037ef0 0x7f1b3803a3b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009720 tx=0x7f1b40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.751+0000 7fc597fff640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc57c037f90 0x7fc57c03a450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc584007fd0 tx=0x7fc584001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.755+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9dc04d9a0 con 0x7fa9ec097f00 2024-02-16T00:10:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.759+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b3c017020 con 0x7f1b4c098a60 2024-02-16T00:10:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.763+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc58c03a020 con 0x7fc598093f10 2024-02-16T00:10:56.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.914+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c9c0627b0 con 0x7f8c9c097f00 2024-02-16T00:10:56.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.915+0000 7f8c83fff640 1 -- 172.21.15.2:0/1774535667 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c8c018070 con 0x7f8c9c097f00 2024-02-16T00:10:56.917 INFO:teuthology.orchestra.run.smithi002.stdout:38654705665 2024-02-16T00:10:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.916+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c88037ea0 msgr2=0x7f8c8803a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.916+0000 7f8ca1cc5640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c88037ea0 0x7f8c8803a360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c90036000 tx=0x7f8c90008030 comp rx=0 tx=0).stop 2024-02-16T00:10:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.916+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 msgr2=0x7f8c9c12ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.916+0000 7f8ca1cc5640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 0x7f8c9c12ef80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c420 tx=0x7f8c8c00c8e0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.917+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 shutdown_connections 2024-02-16T00:10:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.917+0000 7f8ca1cc5640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c88037ea0 0x7f8c8803a360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.917+0000 7f8ca1cc5640 1 --2- 172.21.15.2:0/1774535667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c097f00 0x7f8c9c12ef80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.917+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 >> 172.21.15.2:0/1774535667 conn(0x7f8c9c09e640 msgr2=0x7f8c9c096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.917+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 shutdown_connections 2024-02-16T00:10:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.917+0000 7f8ca1cc5640 1 -- 172.21.15.2:0/1774535667 wait complete. 2024-02-16T00:10:56.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.1 2024-02-16T00:10:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.941+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9ec073050 con 0x7fa9ec097f00 2024-02-16T00:10:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.941+0000 7fa9d37fe640 1 -- 172.21.15.2:0/4286259439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9dc04d3b0 con 0x7fa9ec097f00 2024-02-16T00:10:56.944 INFO:teuthology.orchestra.run.smithi002.stdout:38654705665 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa9d8037f40 msgr2=0x7fa9d803a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa9d8037f40 0x7fa9d803a400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0007fd0 tx=0x7fa9e0007900 comp rx=0 tx=0).stop 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 msgr2=0x7fa9ec08a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec08a260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009910 tx=0x7fa9dc0046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 shutdown_connections 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa9d8037f40 0x7fa9d803a400 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 --2- 172.21.15.2:0/4286259439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9ec097f00 0x7fa9ec08a260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 >> 172.21.15.2:0/4286259439 conn(0x7fa9ec09e640 msgr2=0x7fa9ec096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 shutdown_connections 2024-02-16T00:10:56.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.943+0000 7fa9f1182640 1 -- 172.21.15.2:0/4286259439 wait complete. 2024-02-16T00:10:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.944+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b4c0627b0 con 0x7f1b4c098a60 2024-02-16T00:10:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.944+0000 7f1b33fff640 1 -- 172.21.15.2:0/2433309322 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b3c019dc0 con 0x7f1b4c098a60 2024-02-16T00:10:56.947 INFO:teuthology.orchestra.run.smithi002.stdout:38654705666 2024-02-16T00:10:56.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b38037ef0 msgr2=0x7f1b3803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b38037ef0 0x7f1b3803a3b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009720 tx=0x7f1b40008030 comp rx=0 tx=0).stop 2024-02-16T00:10:56.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 msgr2=0x7f1b4c12ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 0x7f1b4c12ad10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00c480 tx=0x7f1b3c00c940 comp rx=0 tx=0).stop 2024-02-16T00:10:56.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 shutdown_connections 2024-02-16T00:10:56.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b38037ef0 0x7f1b3803a3b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 --2- 172.21.15.2:0/2433309322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b4c098a60 0x7f1b4c12ad10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 >> 172.21.15.2:0/2433309322 conn(0x7f1b4c09c500 msgr2=0x7f1b4c12b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 shutdown_connections 2024-02-16T00:10:56.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.947+0000 7f1b51ff6640 1 -- 172.21.15.2:0/2433309322 wait complete. 2024-02-16T00:10:56.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.3 2024-02-16T00:10:56.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2024-02-16T00:10:56.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.965+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc578005330 con 0x7fc598093f10 2024-02-16T00:10:56.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.966+0000 7fc5957fa640 1 -- 172.21.15.2:0/2517223751 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc58c045dd0 con 0x7fc598093f10 2024-02-16T00:10:56.971 INFO:teuthology.orchestra.run.smithi002.stdout:38654705666 2024-02-16T00:10:56.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc57c037f90 msgr2=0x7fc57c03a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc57c037f90 0x7fc57c03a450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc584007fd0 tx=0x7fc584001150 comp rx=0 tx=0).stop 2024-02-16T00:10:56.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 msgr2=0x7fc5981bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:56.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5981bf0b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc58c000c00 tx=0x7fc58c0046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 shutdown_connections 2024-02-16T00:10:56.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc57c037f90 0x7fc57c03a450 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 --2- 172.21.15.2:0/2517223751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc598093f10 0x7fc5981bf0b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:56.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 >> 172.21.15.2:0/2517223751 conn(0x7fc59809a050 msgr2=0x7fc59806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:56.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 shutdown_connections 2024-02-16T00:10:56.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:56.968+0000 7fc59f25c640 1 -- 172.21.15.2:0/2517223751 wait complete. 2024-02-16T00:10:56.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.2 2024-02-16T00:10:57.931 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-16T00:10:57.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-16T00:10:57.964 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-16T00:10:57.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-16T00:10:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.045+0000 7f14e0e25640 1 Processor -- start 2024-02-16T00:10:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.045+0000 7f14e0e25640 1 -- start start 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14e0e25640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14dc06cb10 0x7f14dc131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14e0e25640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc06cf20 con 0x7f14dc06c020 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14e0e25640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc096260 con 0x7f14dc06cb10 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14d9d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14dc06cb10 0x7f14dc131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14da59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f14dc06c020 0x7f14dc06c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55288/0 (socket says 172.21.15.2:55288) 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14da59c640 1 -- 172.21.15.2:0/1726284620 learned_addr learned my addr 172.21.15.2:0/1726284620 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14d9d9b640 1 -- 172.21.15.2:0/1726284620 >> v1:172.21.15.2:6789/0 conn(0x7f14dc06c020 legacy=0x7f14dc06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.046+0000 7f14d9d9b640 1 -- 172.21.15.2:0/1726284620 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc09a810 con 0x7f14dc06cb10 2024-02-16T00:10:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.047+0000 7f14d9d9b640 1 --2- 172.21.15.2:0/1726284620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06cb10 0x7f14dc131180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009720 tx=0x7f14d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371bde77b0e67284 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.047+0000 7f14d959a640 1 -- 172.21.15.2:0/1726284620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14d002e070 con 0x7f14dc06cb10 2024-02-16T00:10:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.047+0000 7f14d959a640 1 -- 172.21.15.2:0/1726284620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d00316d0 con 0x7f14dc06cb10 2024-02-16T00:10:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.047+0000 7f14d959a640 1 -- 172.21.15.2:0/1726284620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14d0031990 con 0x7f14dc06cb10 2024-02-16T00:10:58.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 -- 172.21.15.2:0/1726284620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06cb10 msgr2=0x7f14dc131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 --2- 172.21.15.2:0/1726284620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06cb10 0x7f14dc131180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009720 tx=0x7f14d002b840 comp rx=0 tx=0).stop 2024-02-16T00:10:58.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 -- 172.21.15.2:0/1726284620 shutdown_connections 2024-02-16T00:10:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 --2- 172.21.15.2:0/1726284620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06cb10 0x7f14dc131180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 -- 172.21.15.2:0/1726284620 >> 172.21.15.2:0/1726284620 conn(0x7f14dc09d620 msgr2=0x7f14dc099af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 -- 172.21.15.2:0/1726284620 shutdown_connections 2024-02-16T00:10:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.048+0000 7f14e0e25640 1 -- 172.21.15.2:0/1726284620 wait complete. 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.049+0000 7f14e0e25640 1 Processor -- start 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.049+0000 7f14e0e25640 1 -- start start 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.050+0000 7f14e0e25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 0x7f14dc092480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.050+0000 7f14e0e25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc071e50 con 0x7f14dc06c020 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.050+0000 7f14da59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 0x7f14dc092480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.050+0000 7f14da59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 0x7f14dc092480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45140/0 (socket says 172.21.15.2:45140) 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.050+0000 7f14da59c640 1 -- 172.21.15.2:0/2113596061 learned_addr learned my addr 172.21.15.2:0/2113596061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.050+0000 7f14da59c640 1 -- 172.21.15.2:0/2113596061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0009400 con 0x7f14dc06c020 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.051+0000 7f14da59c640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 0x7f14dc092480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c4a0 tx=0x7f14cc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.051+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14cc005c10 con 0x7f14dc06c020 2024-02-16T00:10:58.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.051+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc005d70 con 0x7f14dc06c020 2024-02-16T00:10:58.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.051+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14cc0071a0 con 0x7f14dc06c020 2024-02-16T00:10:58.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.051+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc123b70 con 0x7f14dc06c020 2024-02-16T00:10:58.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.051+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc122b00 con 0x7f14dc06c020 2024-02-16T00:10:58.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.052+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc122e80 con 0x7f14dc06c020 2024-02-16T00:10:58.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.052+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f14cc007300 con 0x7f14dc06c020 2024-02-16T00:10:58.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.053+0000 7f14caffd640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f14bc037ef0 0x7f14bc03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.053+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f14cc049e40 con 0x7f14dc06c020 2024-02-16T00:10:58.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.053+0000 7f14d9d9b640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f14bc037ef0 0x7f14bc03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.054+0000 7f14d9d9b640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f14bc037ef0 0x7f14bc03a3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14d0036000 tx=0x7f14d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.062+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14cc012400 con 0x7f14dc06c020 2024-02-16T00:10:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.084+0000 7fecb5c06640 1 Processor -- start 2024-02-16T00:10:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.084+0000 7fecb5c06640 1 -- start start 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecb5c06640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fecb0097f00 0x7fecb00982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecb5c06640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb006bdf0 con 0x7fecb0098820 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecb5c06640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00672c0 con 0x7fecb0097f00 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecaeffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fecb0098820 0x7fecb012deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55294/0 (socket says 172.21.15.2:55294) 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecaeffd640 1 -- 172.21.15.2:0/1366175233 learned_addr learned my addr 172.21.15.2:0/1366175233 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecaf7fe640 1 --2- 172.21.15.2:0/1366175233 >> v2:172.21.15.2:3300/0 conn(0x7fecb0097f00 0x7fecb00982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.085+0000 7fecae7fc640 1 -- 172.21.15.2:0/1366175233 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172493028 0 0) 0x7fecb006bdf0 con 0x7fecb0098820 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.086+0000 7fecae7fc640 1 -- 172.21.15.2:0/1366175233 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec98003520 con 0x7fecb0098820 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.086+0000 7fecae7fc640 1 -- 172.21.15.2:0/1366175233 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146736500 0 0) 0x7fec98003520 con 0x7fecb0098820 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.086+0000 7fecaf7fe640 1 -- 172.21.15.2:0/1366175233 >> v1:172.21.15.2:6789/0 conn(0x7fecb0098820 legacy=0x7fecb012deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.086+0000 7fecaf7fe640 1 -- 172.21.15.2:0/1366175233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb009a5c0 con 0x7fecb0097f00 2024-02-16T00:10:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.087+0000 7fecaf7fe640 1 --2- 172.21.15.2:0/1366175233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0097f00 0x7fecb00982e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feca0009980 tx=0x7feca002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d5f74a5966080a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.087+0000 7fecae7fc640 1 -- 172.21.15.2:0/1366175233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca40015a0 con 0x7fecb0097f00 2024-02-16T00:10:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.087+0000 7fecae7fc640 1 -- 172.21.15.2:0/1366175233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca0031450 con 0x7fecb0097f00 2024-02-16T00:10:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.087+0000 7fecae7fc640 1 -- 172.21.15.2:0/1366175233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca0031710 con 0x7fecb0097f00 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.087+0000 7f67e6855640 1 Processor -- start 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67e6855640 1 -- start start 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67e6855640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f67e00998e0 0x7f67e0127ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67e6855640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e009a260 con 0x7f67e0127c10 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67e6855640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e009a590 con 0x7f67e00998e0 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67dffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f67e0127c10 0x7f67e0097ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55298/0 (socket says 172.21.15.2:55298) 2024-02-16T00:10:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67dffff640 1 -- 172.21.15.2:0/3750493967 learned_addr learned my addr 172.21.15.2:0/3750493967 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7fecb5c06640 1 -- 172.21.15.2:0/1366175233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0097f00 msgr2=0x7fecb00982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7fecb5c06640 1 --2- 172.21.15.2:0/1366175233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0097f00 0x7fecb00982e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feca0009980 tx=0x7feca002b980 comp rx=0 tx=0).stop 2024-02-16T00:10:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7fecb5c06640 1 -- 172.21.15.2:0/1366175233 shutdown_connections 2024-02-16T00:10:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7f67df7fe640 1 --2- 172.21.15.2:0/3750493967 >> v2:172.21.15.2:3300/0 conn(0x7f67e00998e0 0x7f67e0127ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7fecb5c06640 1 --2- 172.21.15.2:0/1366175233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0097f00 0x7fecb00982e0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feca0009980 tx=0x7feca002b980 comp rx=0 tx=0).stop 2024-02-16T00:10:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7fecb5c06640 1 -- 172.21.15.2:0/1366175233 >> 172.21.15.2:0/1366175233 conn(0x7fecb009e640 msgr2=0x7fecb009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.088+0000 7fecb5c06640 1 -- 172.21.15.2:0/1366175233 shutdown_connections 2024-02-16T00:10:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.089+0000 7fecb5c06640 1 -- 172.21.15.2:0/1366175233 wait complete. 2024-02-16T00:10:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.089+0000 7f67deffd640 1 -- 172.21.15.2:0/3750493967 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302418187 0 0) 0x7f67e009a260 con 0x7f67e0127c10 2024-02-16T00:10:58.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.089+0000 7f67deffd640 1 -- 172.21.15.2:0/3750493967 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c8003520 con 0x7f67e0127c10 2024-02-16T00:10:58.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.089+0000 7f67df7fe640 1 -- 172.21.15.2:0/3750493967 >> v1:172.21.15.2:6789/0 conn(0x7f67e0127c10 legacy=0x7f67e0097ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.089+0000 7f67df7fe640 1 -- 172.21.15.2:0/3750493967 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e009a7a0 con 0x7f67e00998e0 2024-02-16T00:10:58.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.089+0000 7f67df7fe640 1 --2- 172.21.15.2:0/3750493967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e0127ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009720 tx=0x7f67d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18ea6e3f2a5ff4a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7fecb5c06640 1 Processor -- start 2024-02-16T00:10:58.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7f67deffd640 1 -- 172.21.15.2:0/3750493967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67d402e070 con 0x7f67e00998e0 2024-02-16T00:10:58.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7f67deffd640 1 -- 172.21.15.2:0/3750493967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d40316d0 con 0x7f67e00998e0 2024-02-16T00:10:58.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7f67deffd640 1 -- 172.21.15.2:0/3750493967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67d4031990 con 0x7f67e00998e0 2024-02-16T00:10:58.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7fecb5c06640 1 -- start start 2024-02-16T00:10:58.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7fecb5c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 0x7fecb006c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7fecb5c06640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb012dc70 con 0x7fecb0098820 2024-02-16T00:10:58.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.090+0000 7fecaf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 0x7fecb006c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fecaf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 0x7fecb006c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45174/0 (socket says 172.21.15.2:45174) 2024-02-16T00:10:58.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fecaf7fe640 1 -- 172.21.15.2:0/2098018382 learned_addr learned my addr 172.21.15.2:0/2098018382 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:58.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 -- 172.21.15.2:0/3750493967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 msgr2=0x7f67e0127ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 --2- 172.21.15.2:0/3750493967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e0127ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009720 tx=0x7f67d402b840 comp rx=0 tx=0).stop 2024-02-16T00:10:58.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 -- 172.21.15.2:0/3750493967 shutdown_connections 2024-02-16T00:10:58.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 --2- 172.21.15.2:0/3750493967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e0127ff0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fecaf7fe640 1 -- 172.21.15.2:0/2098018382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009400 con 0x7fecb0098820 2024-02-16T00:10:58.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 -- 172.21.15.2:0/3750493967 >> 172.21.15.2:0/3750493967 conn(0x7f67e00a07a0 msgr2=0x7f67e00a0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 -- 172.21.15.2:0/3750493967 shutdown_connections 2024-02-16T00:10:58.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7f67e6855640 1 -- 172.21.15.2:0/3750493967 wait complete. 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fecaf7fe640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 0x7fecb006c4d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feca002bf10 tx=0x7feca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca0003e50 con 0x7fecb0098820 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00315c0 con 0x7fecb0098820 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca0031880 con 0x7fecb0098820 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.091+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb0099a10 con 0x7fecb0098820 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.092+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb006f800 con 0x7fecb0098820 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.092+0000 7f67e6855640 1 Processor -- start 2024-02-16T00:10:58.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.092+0000 7f67e6855640 1 -- start start 2024-02-16T00:10:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feca00319e0 con 0x7fecb0098820 2024-02-16T00:10:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb006f660 con 0x7fecb0098820 2024-02-16T00:10:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7fec97fff640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec9c037ef0 0x7fec9c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7feca006ce10 con 0x7fecb0098820 2024-02-16T00:10:58.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7fecaeffd640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec9c037ef0 0x7fec9c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7f67e6855640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e01c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7f67dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e01c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7f67dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e01c2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45186/0 (socket says 172.21.15.2:45186) 2024-02-16T00:10:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7f67dffff640 1 -- 172.21.15.2:0/2798476200 learned_addr learned my addr 172.21.15.2:0/2798476200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:58.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.093+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e006dd00 con 0x7f67e00998e0 2024-02-16T00:10:58.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.094+0000 7fecaeffd640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec9c037ef0 0x7fec9c03a3b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feca4001380 tx=0x7feca40010c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.094+0000 7f67dffff640 1 -- 172.21.15.2:0/2798476200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009400 con 0x7f67e00998e0 2024-02-16T00:10:58.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.094+0000 7f67dffff640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e01c2560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67d800cb40 tx=0x7f67d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.102+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fecb006f660 con 0x7fecb0098820 2024-02-16T00:10:58.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.102+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67d800abf0 con 0x7f67e00998e0 2024-02-16T00:10:58.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.102+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800ad50 con 0x7f67e00998e0 2024-02-16T00:10:58.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.102+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67d8012400 con 0x7f67e00998e0 2024-02-16T00:10:58.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.103+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e006e300 con 0x7f67e00998e0 2024-02-16T00:10:58.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.103+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e006e930 con 0x7f67e00998e0 2024-02-16T00:10:58.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.104+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e006e0b0 con 0x7f67e00998e0 2024-02-16T00:10:58.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.104+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f67d8007070 con 0x7f67e00998e0 2024-02-16T00:10:58.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.105+0000 7f67dcff9640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67cc037f40 0x7f67cc03a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.105+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f67d804abc0 con 0x7f67e00998e0 2024-02-16T00:10:58.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.105+0000 7f67df7fe640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67cc037f40 0x7f67cc03a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.105+0000 7f67df7fe640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67cc037f40 0x7f67cc03a400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67d4036000 tx=0x7f67d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.113+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67d80192c0 con 0x7f67e00998e0 2024-02-16T00:10:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.126+0000 7f2f0be25640 1 Processor -- start 2024-02-16T00:10:58.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.126+0000 7f2f0be25640 1 -- start start 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f0be25640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f04097f00 0x7f2f040982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f0be25640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0406bdf0 con 0x7f2f04098820 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f0be25640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f040672c0 con 0x7f2f04097f00 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f09bc1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f04097f00 0x7f2f040982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f093c0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2f04098820 0x7f2f0412deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55300/0 (socket says 172.21.15.2:55300) 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f093c0640 1 -- 172.21.15.2:0/822637979 learned_addr learned my addr 172.21.15.2:0/822637979 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f08bbf640 1 -- 172.21.15.2:0/822637979 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492247517 0 0) 0x7f2f0406bdf0 con 0x7f2f04098820 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f08bbf640 1 -- 172.21.15.2:0/822637979 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef0003520 con 0x7f2f04098820 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f09bc1640 1 -- 172.21.15.2:0/822637979 >> v1:172.21.15.2:6789/0 conn(0x7f2f04098820 legacy=0x7f2f0412deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.127+0000 7f2f09bc1640 1 -- 172.21.15.2:0/822637979 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0409a5c0 con 0x7f2f04097f00 2024-02-16T00:10:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.128+0000 7f2f09bc1640 1 --2- 172.21.15.2:0/822637979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f040982e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009720 tx=0x7f2f0002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e386cfe2c15cba7e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.128+0000 7f2f08bbf640 1 -- 172.21.15.2:0/822637979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f0002e070 con 0x7f2f04097f00 2024-02-16T00:10:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.128+0000 7f2f08bbf640 1 -- 172.21.15.2:0/822637979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f000316d0 con 0x7f2f04097f00 2024-02-16T00:10:58.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.129+0000 7f2f08bbf640 1 -- 172.21.15.2:0/822637979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f00031970 con 0x7f2f04097f00 2024-02-16T00:10:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.129+0000 7f2f0be25640 1 -- 172.21.15.2:0/822637979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 msgr2=0x7f2f040982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.129+0000 7f2f0be25640 1 --2- 172.21.15.2:0/822637979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f040982e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009720 tx=0x7f2f0002b840 comp rx=0 tx=0).stop 2024-02-16T00:10:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.129+0000 7f2f0be25640 1 -- 172.21.15.2:0/822637979 shutdown_connections 2024-02-16T00:10:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.129+0000 7f2f0be25640 1 --2- 172.21.15.2:0/822637979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f040982e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.129+0000 7f2f0be25640 1 -- 172.21.15.2:0/822637979 >> 172.21.15.2:0/822637979 conn(0x7f2f0409e640 msgr2=0x7f2f0409ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.132+0000 7f2f0be25640 1 -- 172.21.15.2:0/822637979 shutdown_connections 2024-02-16T00:10:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.132+0000 7f2f0be25640 1 -- 172.21.15.2:0/822637979 wait complete. 2024-02-16T00:10:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.132+0000 7f2f0be25640 1 Processor -- start 2024-02-16T00:10:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.132+0000 7f2f0be25640 1 -- start start 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.133+0000 7f2f0be25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f041c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.133+0000 7f2f0be25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0406ed40 con 0x7f2f04097f00 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.133+0000 7f2f09bc1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f041c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.133+0000 7f2f09bc1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f041c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45208/0 (socket says 172.21.15.2:45208) 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.133+0000 7f2f09bc1640 1 -- 172.21.15.2:0/3947259949 learned_addr learned my addr 172.21.15.2:0/3947259949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.133+0000 7f2f09bc1640 1 -- 172.21.15.2:0/3947259949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00009400 con 0x7f2f04097f00 2024-02-16T00:10:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.134+0000 7f2f09bc1640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f041c2520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009720 tx=0x7f2f000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.134+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f00003740 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.134+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00040070 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.134+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f000039f0 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.134+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f04099a10 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.134+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0406d8a0 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.135+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2f00003b50 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.135+0000 7f2efa7fc640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ee8037ef0 0x7f2ee803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.135+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f2f00042070 con 0x7f2f04097f00 2024-02-16T00:10:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.135+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f040627b0 con 0x7f2f04097f00 2024-02-16T00:10:58.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.136+0000 7f2f093c0640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ee8037ef0 0x7f2ee803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.136+0000 7f2f093c0640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ee8037ef0 0x7f2ee803a3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001610 tx=0x7f2ef4007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.140+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f000467d0 con 0x7f2f04097f00 2024-02-16T00:10:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.258+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14dc093f70 con 0x7f14dc06c020 2024-02-16T00:10:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.259+0000 7f14caffd640 1 -- 172.21.15.2:0/2113596061 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14cc017030 con 0x7f14dc06c020 2024-02-16T00:10:58.262 INFO:teuthology.orchestra.run.smithi002.stdout:38654705666 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f14bc037ef0 msgr2=0x7f14bc03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f14bc037ef0 0x7f14bc03a3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14d0036000 tx=0x7f14d0008030 comp rx=0 tx=0).stop 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 msgr2=0x7f14dc092480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 0x7f14dc092480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c4a0 tx=0x7f14cc00c960 comp rx=0 tx=0).stop 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 shutdown_connections 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f14bc037ef0 0x7f14bc03a3b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 --2- 172.21.15.2:0/2113596061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14dc06c020 0x7f14dc092480 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 >> 172.21.15.2:0/2113596061 conn(0x7f14dc09d620 msgr2=0x7f14dc0979f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 shutdown_connections 2024-02-16T00:10:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.261+0000 7f14e0e25640 1 -- 172.21.15.2:0/2113596061 wait complete. 2024-02-16T00:10:58.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.1 2024-02-16T00:10:58.275 DEBUG:teuthology.parallel:result is None 2024-02-16T00:10:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.287+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecb006f660 con 0x7fecb0098820 2024-02-16T00:10:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.288+0000 7fec97fff640 1 -- 172.21.15.2:0/2098018382 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecb006f660 con 0x7fecb0098820 2024-02-16T00:10:58.290 INFO:teuthology.orchestra.run.smithi002.stdout:38654705666 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec9c037ef0 msgr2=0x7fec9c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec9c037ef0 0x7fec9c03a3b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feca4001380 tx=0x7feca40010c0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 msgr2=0x7fecb006c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 0x7fecb006c4d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feca002bf10 tx=0x7feca00046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 shutdown_connections 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec9c037ef0 0x7fec9c03a3b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 --2- 172.21.15.2:0/2098018382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb0098820 0x7fecb006c4d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.289+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 >> 172.21.15.2:0/2098018382 conn(0x7fecb009e640 msgr2=0x7fecb009bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.290+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 shutdown_connections 2024-02-16T00:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.290+0000 7fecb5c06640 1 -- 172.21.15.2:0/2098018382 wait complete. 2024-02-16T00:10:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.298+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67e006e300 con 0x7f67e00998e0 2024-02-16T00:10:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.298+0000 7f67dcff9640 1 -- 172.21.15.2:0/2798476200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67e006e300 con 0x7f67e00998e0 2024-02-16T00:10:58.301 INFO:teuthology.orchestra.run.smithi002.stdout:38654705667 2024-02-16T00:10:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67cc037f40 msgr2=0x7f67cc03a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67cc037f40 0x7f67cc03a400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67d4036000 tx=0x7f67d4008030 comp rx=0 tx=0).stop 2024-02-16T00:10:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 msgr2=0x7f67e01c2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e01c2560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67d800cb40 tx=0x7f67d800a060 comp rx=0 tx=0).stop 2024-02-16T00:10:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 shutdown_connections 2024-02-16T00:10:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67cc037f40 0x7f67cc03a400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.300+0000 7f67e6855640 1 --2- 172.21.15.2:0/2798476200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e00998e0 0x7f67e01c2560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.301+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 >> 172.21.15.2:0/2798476200 conn(0x7f67e00a07a0 msgr2=0x7f67e01b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.301+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 shutdown_connections 2024-02-16T00:10:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.301+0000 7f67e6855640 1 -- 172.21.15.2:0/2798476200 wait complete. 2024-02-16T00:10:58.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.3 2024-02-16T00:10:58.305 DEBUG:teuthology.parallel:result is None 2024-02-16T00:10:58.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2024-02-16T00:10:58.314 DEBUG:teuthology.parallel:result is None 2024-02-16T00:10:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.324+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f04073050 con 0x7f2f04097f00 2024-02-16T00:10:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.324+0000 7f2efa7fc640 1 -- 172.21.15.2:0/3947259949 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f0003b400 con 0x7f2f04097f00 2024-02-16T00:10:58.326 INFO:teuthology.orchestra.run.smithi002.stdout:38654705667 2024-02-16T00:10:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ee8037ef0 msgr2=0x7f2ee803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ee8037ef0 0x7f2ee803a3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001610 tx=0x7f2ef4007970 comp rx=0 tx=0).stop 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 msgr2=0x7f2f041c2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f041c2520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009720 tx=0x7f2f000046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 shutdown_connections 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ee8037ef0 0x7f2ee803a3b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 --2- 172.21.15.2:0/3947259949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f04097f00 0x7f2f041c2520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 >> 172.21.15.2:0/3947259949 conn(0x7f2f0409e640 msgr2=0x7f2f0409be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 shutdown_connections 2024-02-16T00:10:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.326+0000 7f2f0be25640 1 -- 172.21.15.2:0/3947259949 wait complete. 2024-02-16T00:10:58.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.2 2024-02-16T00:10:58.338 DEBUG:teuthology.parallel:result is None 2024-02-16T00:10:58.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-16T00:10:58.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:10:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.476+0000 7f3067806640 1 Processor -- start 2024-02-16T00:10:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f3067806640 1 -- start start 2024-02-16T00:10:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f3067806640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f306012aea0 0x7f306012b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f3067806640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306009b130 con 0x7f306009a270 2024-02-16T00:10:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f3067806640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306009dd90 con 0x7f306012aea0 2024-02-16T00:10:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f30655a2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f306012aea0 0x7f306012b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f3064da1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f306009a270 0x7f306012bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55302/0 (socket says 172.21.15.2:55302) 2024-02-16T00:10:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f3064da1640 1 -- 172.21.15.2:0/4043659058 learned_addr learned my addr 172.21.15.2:0/4043659058 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f30655a2640 1 -- 172.21.15.2:0/4043659058 >> v1:172.21.15.2:6789/0 conn(0x7f306009a270 legacy=0x7f306012bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.477+0000 7f30655a2640 1 -- 172.21.15.2:0/4043659058 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306009ae20 con 0x7f306012aea0 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.478+0000 7f30655a2640 1 --2- 172.21.15.2:0/4043659058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306012aea0 0x7f306012b280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3058009720 tx=0x7f305802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc779643aca004c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.478+0000 7f3057fff640 1 -- 172.21.15.2:0/4043659058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f305802e070 con 0x7f306012aea0 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.478+0000 7f3057fff640 1 -- 172.21.15.2:0/4043659058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30580316d0 con 0x7f306012aea0 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.478+0000 7f3057fff640 1 -- 172.21.15.2:0/4043659058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058031990 con 0x7f306012aea0 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 -- 172.21.15.2:0/4043659058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306012aea0 msgr2=0x7f306012b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 --2- 172.21.15.2:0/4043659058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306012aea0 0x7f306012b280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3058009720 tx=0x7f305802b840 comp rx=0 tx=0).stop 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 -- 172.21.15.2:0/4043659058 shutdown_connections 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 --2- 172.21.15.2:0/4043659058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306012aea0 0x7f306012b280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 -- 172.21.15.2:0/4043659058 >> 172.21.15.2:0/4043659058 conn(0x7f306009c210 msgr2=0x7f3060071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 -- 172.21.15.2:0/4043659058 shutdown_connections 2024-02-16T00:10:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.479+0000 7f3067806640 1 -- 172.21.15.2:0/4043659058 wait complete. 2024-02-16T00:10:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f3067806640 1 Processor -- start 2024-02-16T00:10:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f3067806640 1 -- start start 2024-02-16T00:10:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f3067806640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 0x7f30601199e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f3067806640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306011d150 con 0x7f306009a270 2024-02-16T00:10:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f30655a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 0x7f30601199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f30655a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 0x7f30601199e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45238/0 (socket says 172.21.15.2:45238) 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f30655a2640 1 -- 172.21.15.2:0/507419461 learned_addr learned my addr 172.21.15.2:0/507419461 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.480+0000 7f30655a2640 1 -- 172.21.15.2:0/507419461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058009400 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.481+0000 7f30655a2640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 0x7f30601199e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3058034040 tx=0x7f30580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.481+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058032830 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.481+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058032990 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.481+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3058032c50 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.481+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306012b940 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.481+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3060129db0 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.482+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f305804e450 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.482+0000 7f3055ffb640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3044037ef0 0x7f304403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.482+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f305806c900 con 0x7f306009a270 2024-02-16T00:10:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.482+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3060129db0 con 0x7f306009a270 2024-02-16T00:10:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.482+0000 7f3064da1640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3044037ef0 0x7f304403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.483+0000 7f3064da1640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3044037ef0 0x7f304403a3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3050007fd0 tx=0x7f3050007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.487+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3060129db0 con 0x7f306009a270 2024-02-16T00:10:58.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.664+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f306012b7c0 con 0x7f3044037ef0 2024-02-16T00:10:58.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.666+0000 7f3055ffb640 1 -- 172.21.15.2:0/507419461 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34612 (secure 0 0 0) 0x7f30500012f0 con 0x7f3044037ef0 2024-02-16T00:10:58.669 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:58.669 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:10:58.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3044037ef0 msgr2=0x7f304403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3044037ef0 0x7f304403a3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3050007fd0 tx=0x7f3050007ac0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 msgr2=0x7f30601199e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 0x7f30601199e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3058034040 tx=0x7f30580046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 shutdown_connections 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3044037ef0 0x7f304403a3b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 --2- 172.21.15.2:0/507419461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f306009a270 0x7f30601199e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 >> 172.21.15.2:0/507419461 conn(0x7f306009c210 msgr2=0x7f30601b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 shutdown_connections 2024-02-16T00:10:58.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.668+0000 7f3067806640 1 -- 172.21.15.2:0/507419461 wait complete. 2024-02-16T00:10:58.681 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-02-16T00:10:57.666835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131048,"kb_used_data":1288,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377356312,"statfs":{"total":386547056640,"available":386412863488,"internally_reserved":0,"allocated":1318912,"data_stored":1025204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":131917591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432550+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:10:56.432550+0000","last_peered":"2024-02-16T00:10:56.432550+0000","last_clean":"2024-02-16T00:10:56.432550+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:10:56.432550+0000","last_undegraded":"2024-02-16T00:10:56.432550+0000","last_fullsized":"2024-02-16T00:10:56.432550+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:06.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:55.438250+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:10:55.438250+0000","last_peered":"2024-02-16T00:10:55.438250+0000","last_clean":"2024-02-16T00:10:55.438250+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:10:55.438250+0000","last_undegraded":"2024-02-16T00:10:55.438250+0000","last_fullsized":"2024-02-16T00:10:55.438250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:55.484965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432630+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:10:56.432630+0000","last_peered":"2024-02-16T00:10:56.432630+0000","last_clean":"2024-02-16T00:10:56.432630+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:10:56.432630+0000","last_undegraded":"2024-02-16T00:10:56.432630+0000","last_fullsized":"2024-02-16T00:10:56.432630+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:11:13.167891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:55.437584+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:10:55.437584+0000","last_peered":"2024-02-16T00:10:55.437584+0000","last_clean":"2024-02-16T00:10:55.437584+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:10:55.437584+0000","last_undegraded":"2024-02-16T00:10:55.437584+0000","last_fullsized":"2024-02-16T00:10:55.437584+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:56:14.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432521+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:10:56.432521+0000","last_peered":"2024-02-16T00:10:56.432521+0000","last_clean":"2024-02-16T00:10:56.432521+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:10:56.432521+0000","last_undegraded":"2024-02-16T00:10:56.432521+0000","last_fullsized":"2024-02-16T00:10:56.432521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:16.627592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:55.438375+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:10:55.438375+0000","last_peered":"2024-02-16T00:10:55.438375+0000","last_clean":"2024-02-16T00:10:55.438375+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:10:55.438375+0000","last_undegraded":"2024-02-16T00:10:55.438375+0000","last_fullsized":"2024-02-16T00:10:55.438375+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:56:14.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432530+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:10:56.432530+0000","last_peered":"2024-02-16T00:10:56.432530+0000","last_clean":"2024-02-16T00:10:56.432530+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:10:56.432530+0000","last_undegraded":"2024-02-16T00:10:56.432530+0000","last_fullsized":"2024-02-16T00:10:56.432530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:37.927052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432553+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:10:56.432553+0000","last_peered":"2024-02-16T00:10:56.432553+0000","last_clean":"2024-02-16T00:10:56.432553+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:10:56.432553+0000","last_undegraded":"2024-02-16T00:10:56.432553+0000","last_fullsized":"2024-02-16T00:10:56.432553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:10.324975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":159,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.074452+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:10:56.074452+0000","last_peered":"2024-02-16T00:10:56.074452+0000","last_clean":"2024-02-16T00:10:56.074452+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:10:56.074452+0000","last_undegraded":"2024-02-16T00:10:56.074452+0000","last_fullsized":"2024-02-16T00:10:56.074452+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:56:14.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":561152,"data_stored":485941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":561152,"data_stored":485941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35444,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336396,"statfs":{"total":96636764160,"available":96600469504,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:10:58.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:10:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.782+0000 7f2d56aa8640 1 Processor -- start 2024-02-16T00:10:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.782+0000 7f2d56aa8640 1 -- start start 2024-02-16T00:10:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d56aa8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d5012dcb0 0x7f2d501300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d56aa8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d50095270 con 0x7f2d500956a0 2024-02-16T00:10:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d56aa8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d50096190 con 0x7f2d5012dcb0 2024-02-16T00:10:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d4ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d5012dcb0 0x7f2d501300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d54844640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2d500956a0 0x7f2d50095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55318/0 (socket says 172.21.15.2:55318) 2024-02-16T00:10:58.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d54844640 1 -- 172.21.15.2:0/3675897990 learned_addr learned my addr 172.21.15.2:0/3675897990 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:58.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d4ffff640 1 -- 172.21.15.2:0/3675897990 >> v1:172.21.15.2:6789/0 conn(0x7f2d500956a0 legacy=0x7f2d50095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d4ffff640 1 -- 172.21.15.2:0/3675897990 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500954a0 con 0x7f2d5012dcb0 2024-02-16T00:10:58.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.783+0000 7f2d4f7fe640 1 -- 172.21.15.2:0/3675897990 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878118891 0 0) 0x7f2d50095270 con 0x7f2d500956a0 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d4ffff640 1 --2- 172.21.15.2:0/3675897990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d5012dcb0 0x7f2d501300a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009720 tx=0x7f2d3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621d840f771d8638 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d4f7fe640 1 -- 172.21.15.2:0/3675897990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c02e070 con 0x7f2d5012dcb0 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d4f7fe640 1 -- 172.21.15.2:0/3675897990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0316d0 con 0x7f2d5012dcb0 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d4f7fe640 1 -- 172.21.15.2:0/3675897990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d3c031990 con 0x7f2d5012dcb0 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3675897990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d5012dcb0 msgr2=0x7f2d501300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 --2- 172.21.15.2:0/3675897990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d5012dcb0 0x7f2d501300a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009720 tx=0x7f2d3c02b840 comp rx=0 tx=0).stop 2024-02-16T00:10:58.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3675897990 shutdown_connections 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 --2- 172.21.15.2:0/3675897990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d5012dcb0 0x7f2d501300a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3675897990 >> 172.21.15.2:0/3675897990 conn(0x7f2d5009a300 msgr2=0x7f2d5009a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3675897990 shutdown_connections 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.784+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3675897990 wait complete. 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.785+0000 7f2d56aa8640 1 Processor -- start 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.785+0000 7f2d56aa8640 1 -- start start 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d56aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 0x7f2d501c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d56aa8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5012baa0 con 0x7f2d500956a0 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d54844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 0x7f2d501c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d54844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 0x7f2d501c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45256/0 (socket says 172.21.15.2:45256) 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d54844640 1 -- 172.21.15.2:0/3770863603 learned_addr learned my addr 172.21.15.2:0/3770863603 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:58.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d54844640 1 -- 172.21.15.2:0/3770863603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009400 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d54844640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 0x7f2d501c25c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c370 tx=0x7f2d4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d44007410 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d44007590 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5012d960 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d44004950 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.786+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5012b4a0 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.787+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2d44004ab0 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.787+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d50071d80 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.787+0000 7f2d4d7fa640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2d34037ef0 0x7f2d3403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.787+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f2d4404a680 con 0x7f2d500956a0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.788+0000 7f2d4ffff640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2d34037ef0 0x7f2d3403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:58.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.788+0000 7f2d4ffff640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2d34037ef0 0x7f2d3403a3b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c036000 tx=0x7f2d3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:58.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.792+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d440102c0 con 0x7f2d500956a0 2024-02-16T00:10:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.966+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d50098570 con 0x7f2d34037ef0 2024-02-16T00:10:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.969+0000 7f2d4d7fa640 1 -- 172.21.15.2:0/3770863603 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34612 (secure 0 0 0) 0x7f2d50098570 con 0x7f2d34037ef0 2024-02-16T00:10:58.971 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:58.971 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:10:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2d34037ef0 msgr2=0x7f2d3403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2d34037ef0 0x7f2d3403a3b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c036000 tx=0x7f2d3c008030 comp rx=0 tx=0).stop 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 msgr2=0x7f2d501c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 0x7f2d501c25c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c370 tx=0x7f2d4400c830 comp rx=0 tx=0).stop 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 shutdown_connections 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2d34037ef0 0x7f2d3403a3b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 --2- 172.21.15.2:0/3770863603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d500956a0 0x7f2d501c25c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 >> 172.21.15.2:0/3770863603 conn(0x7f2d5009a300 msgr2=0x7f2d501210a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 shutdown_connections 2024-02-16T00:10:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:58.970+0000 7f2d56aa8640 1 -- 172.21.15.2:0/3770863603 wait complete. 2024-02-16T00:10:58.983 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-02-16T00:10:57.666835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131048,"kb_used_data":1288,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377356312,"statfs":{"total":386547056640,"available":386412863488,"internally_reserved":0,"allocated":1318912,"data_stored":1025204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":131917591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432550+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:10:56.432550+0000","last_peered":"2024-02-16T00:10:56.432550+0000","last_clean":"2024-02-16T00:10:56.432550+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:10:56.432550+0000","last_undegraded":"2024-02-16T00:10:56.432550+0000","last_fullsized":"2024-02-16T00:10:56.432550+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:06.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:55.438250+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:10:55.438250+0000","last_peered":"2024-02-16T00:10:55.438250+0000","last_clean":"2024-02-16T00:10:55.438250+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:10:55.438250+0000","last_undegraded":"2024-02-16T00:10:55.438250+0000","last_fullsized":"2024-02-16T00:10:55.438250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:55.484965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432630+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:10:56.432630+0000","last_peered":"2024-02-16T00:10:56.432630+0000","last_clean":"2024-02-16T00:10:56.432630+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:10:56.432630+0000","last_undegraded":"2024-02-16T00:10:56.432630+0000","last_fullsized":"2024-02-16T00:10:56.432630+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:11:13.167891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:55.437584+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:10:55.437584+0000","last_peered":"2024-02-16T00:10:55.437584+0000","last_clean":"2024-02-16T00:10:55.437584+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:10:55.437584+0000","last_undegraded":"2024-02-16T00:10:55.437584+0000","last_fullsized":"2024-02-16T00:10:55.437584+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:56:14.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432521+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:10:56.432521+0000","last_peered":"2024-02-16T00:10:56.432521+0000","last_clean":"2024-02-16T00:10:56.432521+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:10:56.432521+0000","last_undegraded":"2024-02-16T00:10:56.432521+0000","last_fullsized":"2024-02-16T00:10:56.432521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:16.627592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:55.438375+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:10:55.438375+0000","last_peered":"2024-02-16T00:10:55.438375+0000","last_clean":"2024-02-16T00:10:55.438375+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:10:55.438375+0000","last_undegraded":"2024-02-16T00:10:55.438375+0000","last_fullsized":"2024-02-16T00:10:55.438375+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:56:14.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432530+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:10:56.432530+0000","last_peered":"2024-02-16T00:10:56.432530+0000","last_clean":"2024-02-16T00:10:56.432530+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:10:56.432530+0000","last_undegraded":"2024-02-16T00:10:56.432530+0000","last_fullsized":"2024-02-16T00:10:56.432530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:37.927052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.432553+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:10:56.432553+0000","last_peered":"2024-02-16T00:10:56.432553+0000","last_clean":"2024-02-16T00:10:56.432553+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:10:56.432553+0000","last_undegraded":"2024-02-16T00:10:56.432553+0000","last_fullsized":"2024-02-16T00:10:56.432553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:10.324975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":159,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-02-16T00:10:56.074452+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:10:56.074452+0000","last_peered":"2024-02-16T00:10:56.074452+0000","last_clean":"2024-02-16T00:10:56.074452+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:10:56.074452+0000","last_undegraded":"2024-02-16T00:10:56.074452+0000","last_fullsized":"2024-02-16T00:10:56.074452+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:56:14.577436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":561152,"data_stored":485941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":561152,"data_stored":485941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35444,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336396,"statfs":{"total":96636764160,"available":96600469504,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:10:58.984 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-16T00:10:58.984 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-16T00:10:58.984 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-16T00:10:58.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbb2132640 1 Processor -- start 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbb2132640 1 -- start start 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbb2132640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbac06d130 0x7fdbac06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbb2132640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac09bfd0 con 0x7fdbac06da50 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbb2132640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac06f0e0 con 0x7fdbac06d130 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbab7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbac06d130 0x7fdbac06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbaaffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdbac06da50 0x7fdbac12de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55320/0 (socket says 172.21.15.2:55320) 2024-02-16T00:10:59.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbaaffd640 1 -- 172.21.15.2:0/3719649579 learned_addr learned my addr 172.21.15.2:0/3719649579 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:10:59.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbab7fe640 1 -- 172.21.15.2:0/3719649579 >> v1:172.21.15.2:6789/0 conn(0x7fdbac06da50 legacy=0x7fdbac12de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.081+0000 7fdbab7fe640 1 -- 172.21.15.2:0/3719649579 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac09dd20 con 0x7fdbac06d130 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.082+0000 7fdbab7fe640 1 --2- 172.21.15.2:0/3719649579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac06d510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009720 tx=0x7fdb9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5728e99921992c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.082+0000 7fdbaa7fc640 1 -- 172.21.15.2:0/3719649579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb9c02e070 con 0x7fdbac06d130 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.082+0000 7fdbaa7fc640 1 -- 172.21.15.2:0/3719649579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c0316d0 con 0x7fdbac06d130 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.082+0000 7fdbaa7fc640 1 -- 172.21.15.2:0/3719649579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb9c031990 con 0x7fdbac06d130 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 -- 172.21.15.2:0/3719649579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 msgr2=0x7fdbac06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 --2- 172.21.15.2:0/3719649579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac06d510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009720 tx=0x7fdb9c02b840 comp rx=0 tx=0).stop 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 -- 172.21.15.2:0/3719649579 shutdown_connections 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 --2- 172.21.15.2:0/3719649579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac06d510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 -- 172.21.15.2:0/3719649579 >> 172.21.15.2:0/3719649579 conn(0x7fdbac09c210 msgr2=0x7fdbac071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 -- 172.21.15.2:0/3719649579 shutdown_connections 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.083+0000 7fdbb2132640 1 -- 172.21.15.2:0/3719649579 wait complete. 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbb2132640 1 Processor -- start 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbb2132640 1 -- start start 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbb2132640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac1c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbb2132640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac124e10 con 0x7fdbac06d130 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac1c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac1c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45280/0 (socket says 172.21.15.2:45280) 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.084+0000 7fdbab7fe640 1 -- 172.21.15.2:0/555843645 learned_addr learned my addr 172.21.15.2:0/555843645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdbab7fe640 1 -- 172.21.15.2:0/555843645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c009400 con 0x7fdbac06d130 2024-02-16T00:10:59.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdbab7fe640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac1c2930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009840 tx=0x7fdb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb9c0328b0 con 0x7fdbac06d130 2024-02-16T00:10:59.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c032a10 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb9c032cf0 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac1233e0 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.085+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac124070 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.086+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdb9c04d3f0 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.086+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac0627b0 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.086+0000 7fdb93fff640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdb98037f20 0x7fdb9803a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.086+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fdb9c06c8c0 con 0x7fdbac06d130 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.086+0000 7fdbaaffd640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdb98037f20 0x7fdb9803a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.087+0000 7fdbaaffd640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdb98037f20 0x7fdb9803a3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdba0007fd0 tx=0x7fdba0007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.091+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb9c0306b0 con 0x7fdbac06d130 2024-02-16T00:10:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.307+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdbac12ddd0 con 0x7fdbac06d130 2024-02-16T00:10:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.307+0000 7fdb93fff640 1 -- 172.21.15.2:0/555843645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdb9c0302f0 con 0x7fdbac06d130 2024-02-16T00:10:59.310 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:10:59.310 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdb98037f20 msgr2=0x7fdb9803a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdb98037f20 0x7fdb9803a3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdba0007fd0 tx=0x7fdba0007ac0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 msgr2=0x7fdbac1c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac1c2930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009840 tx=0x7fdb9c0046c0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 shutdown_connections 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdb98037f20 0x7fdb9803a3e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 --2- 172.21.15.2:0/555843645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbac06d130 0x7fdbac1c2930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 >> 172.21.15.2:0/555843645 conn(0x7fdbac09c210 msgr2=0x7fdbac11ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 shutdown_connections 2024-02-16T00:10:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:10:59.309+0000 7fdbb2132640 1 -- 172.21.15.2:0/555843645 wait complete. 2024-02-16T00:10:59.322 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-16T00:10:59.322 INFO:teuthology.run_tasks:Running task rgw... 2024-02-16T00:10:59.400 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-16T00:10:59.400 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-16T00:10:59.400 INFO:tasks.rgw:Creating data pools 2024-02-16T00:10:59.400 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-16T00:10:59.401 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-02-16T00:10:59.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1709020640 1 Processor -- start 2024-02-16T00:10:59.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1709020640 1 -- start start 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1709020640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f170410f190 0x7f170410ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1709020640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170410e7a0 con 0x7f170410e2f0 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1709020640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170410e930 con 0x7f170410f190 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1702d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f170410f190 0x7f170410ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1702d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f170410f190 0x7f170410ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35154/0 (socket says 172.21.15.42:35154) 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.513+0000 7f1702d9d640 1 -- 172.21.15.42:0/950537177 learned_addr learned my addr 172.21.15.42:0/950537177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.514+0000 7f1702d9d640 1 -- 172.21.15.42:0/950537177 >> v1:172.21.15.2:6789/0 conn(0x7f170410e2f0 legacy=0x7f17041199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.514+0000 7f1702d9d640 1 -- 172.21.15.42:0/950537177 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170410eaa0 con 0x7f170410f190 2024-02-16T00:10:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.514+0000 7f1701d9b640 1 -- 172.21.15.42:0/950537177 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453815456 0 0) 0x7f170410e7a0 con 0x7f170410e2f0 2024-02-16T00:10:59.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.514+0000 7f1702d9d640 1 --2- 172.21.15.42:0/950537177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410f190 0x7f170410ddb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009e50 tx=0x7f16fc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841f5f8b3ef8123f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1701d9b640 1 -- 172.21.15.42:0/950537177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc02c8a0 con 0x7f170410f190 2024-02-16T00:10:59.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1701d9b640 1 -- 172.21.15.42:0/950537177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc02ca00 con 0x7f170410f190 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1701d9b640 1 -- 172.21.15.42:0/950537177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc02ccc0 con 0x7f170410f190 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 -- 172.21.15.42:0/950537177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410f190 msgr2=0x7f170410ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 --2- 172.21.15.42:0/950537177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410f190 0x7f170410ddb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009e50 tx=0x7f16fc02bf80 comp rx=0 tx=0).stop 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 -- 172.21.15.42:0/950537177 shutdown_connections 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 --2- 172.21.15.42:0/950537177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410f190 0x7f170410ddb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 -- 172.21.15.42:0/950537177 >> 172.21.15.42:0/950537177 conn(0x7f170406e9f0 msgr2=0x7f1704070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 -- 172.21.15.42:0/950537177 shutdown_connections 2024-02-16T00:10:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.515+0000 7f1709020640 1 -- 172.21.15.42:0/950537177 wait complete. 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.516+0000 7f1709020640 1 Processor -- start 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.516+0000 7f1709020640 1 -- start start 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.516+0000 7f1709020640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 0x7f17041a3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.516+0000 7f1709020640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17041a40d0 con 0x7f170410e2f0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1702d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 0x7f17041a3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1702d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 0x7f17041a3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35162/0 (socket says 172.21.15.42:35162) 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1702d9d640 1 -- 172.21.15.42:0/1280340656 learned_addr learned my addr 172.21.15.42:0/1280340656 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1702d9d640 1 -- 172.21.15.42:0/1280340656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc009b30 con 0x7f170410e2f0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1702d9d640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 0x7f17041a3b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16fc036040 tx=0x7f16fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc02c8a0 con 0x7f170410e2f0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc003990 con 0x7f170410e2f0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17041a42d0 con 0x7f170410e2f0 2024-02-16T00:10:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc003c70 con 0x7f170410e2f0 2024-02-16T00:10:59.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.517+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17041a8410 con 0x7f170410e2f0 2024-02-16T00:10:59.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.518+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f16fc004030 con 0x7f170410e2f0 2024-02-16T00:10:59.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.518+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17040627b0 con 0x7f170410e2f0 2024-02-16T00:10:59.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.518+0000 7f16eb7fe640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f16f0037ea0 0x7f16f003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.518+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f16fc06dfa0 con 0x7f170410e2f0 2024-02-16T00:10:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.519+0000 7f170259c640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f16f0037ea0 0x7f16f003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.519+0000 7f170259c640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f16f0037ea0 0x7f16f003a360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007fd0 tx=0x7f16f8007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.523+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16fc0333a0 con 0x7f170410e2f0 2024-02-16T00:10:59.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.712+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f17040627b0 con 0x7f170410e2f0 2024-02-16T00:10:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.770+0000 7f16eb7fe640 1 -- 172.21.15.42:0/1280340656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v13) v1 ==== 151+0+0 (secure 0 0 0) 0x7f16fc03dc40 con 0x7f170410e2f0 2024-02-16T00:10:59.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f16f0037ea0 msgr2=0x7f16f003a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f16f0037ea0 0x7f16f003a360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007fd0 tx=0x7f16f8007900 comp rx=0 tx=0).stop 2024-02-16T00:10:59.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 msgr2=0x7f17041a3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 0x7f17041a3b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16fc036040 tx=0x7f16fc004a40 comp rx=0 tx=0).stop 2024-02-16T00:10:59.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 shutdown_connections 2024-02-16T00:10:59.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f16f0037ea0 0x7f16f003a360 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 --2- 172.21.15.42:0/1280340656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f170410e2f0 0x7f17041a3b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 >> 172.21.15.42:0/1280340656 conn(0x7f170406e9f0 msgr2=0x7f1704116e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:59.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 shutdown_connections 2024-02-16T00:10:59.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.772+0000 7f1709020640 1 -- 172.21.15.42:0/1280340656 wait complete. 2024-02-16T00:10:59.784 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.885+0000 7f686ac0f640 1 Processor -- start 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.885+0000 7f686ac0f640 1 -- start start 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.885+0000 7f686ac0f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68641164b0 0x7f6864116890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.885+0000 7f686ac0f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6864116ef0 con 0x7f68641113a0 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.885+0000 7f686ac0f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6864111f40 con 0x7f68641164b0 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.886+0000 7f68689ab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68641164b0 0x7f6864116890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.886+0000 7f68689ab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68641164b0 0x7f6864116890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35174/0 (socket says 172.21.15.42:35174) 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.886+0000 7f68689ab640 1 -- 172.21.15.42:0/4291934293 learned_addr learned my addr 172.21.15.42:0/4291934293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.886+0000 7f6863fff640 1 --1- 172.21.15.42:0/4291934293 >> v1:172.21.15.2:6789/0 conn(0x7f68641113a0 0x7f6864111830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:56358/0 (socket says 172.21.15.42:56358) 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.886+0000 7f68689ab640 1 -- 172.21.15.42:0/4291934293 >> v1:172.21.15.2:6789/0 conn(0x7f68641113a0 legacy=0x7f6864111830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.886+0000 7f68689ab640 1 -- 172.21.15.42:0/4291934293 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68641120b0 con 0x7f68641164b0 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f68689ab640 1 --2- 172.21.15.42:0/4291934293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641164b0 0x7f6864116890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f685c009e50 tx=0x7f685c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fc96b06821f1cd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f68637fe640 1 -- 172.21.15.42:0/4291934293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f685c02c8a0 con 0x7f68641164b0 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f68637fe640 1 -- 172.21.15.42:0/4291934293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c02ca00 con 0x7f68641164b0 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f68637fe640 1 -- 172.21.15.42:0/4291934293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f685c02ccc0 con 0x7f68641164b0 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 -- 172.21.15.42:0/4291934293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641164b0 msgr2=0x7f6864116890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 --2- 172.21.15.42:0/4291934293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641164b0 0x7f6864116890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f685c009e50 tx=0x7f685c02bf80 comp rx=0 tx=0).stop 2024-02-16T00:10:59.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 -- 172.21.15.42:0/4291934293 shutdown_connections 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 --2- 172.21.15.42:0/4291934293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641164b0 0x7f6864116890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 -- 172.21.15.42:0/4291934293 >> 172.21.15.42:0/4291934293 conn(0x7f686406daf0 msgr2=0x7f686406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 -- 172.21.15.42:0/4291934293 shutdown_connections 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.887+0000 7f686ac0f640 1 -- 172.21.15.42:0/4291934293 wait complete. 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.888+0000 7f686ac0f640 1 Processor -- start 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.888+0000 7f686ac0f640 1 -- start start 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.888+0000 7f686ac0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 0x7f68641abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.888+0000 7f686ac0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641ac310 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.889+0000 7f68689ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 0x7f68641abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.889+0000 7f68689ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 0x7f68641abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35176/0 (socket says 172.21.15.42:35176) 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.889+0000 7f68689ab640 1 -- 172.21.15.42:0/2078973142 learned_addr learned my addr 172.21.15.42:0/2078973142 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.889+0000 7f68689ab640 1 -- 172.21.15.42:0/2078973142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009b30 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.889+0000 7f68689ab640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 0x7f68641abd40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f685c000f80 tx=0x7f685c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.890+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f685c007d80 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.890+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c03e450 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.890+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68641ac4b0 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.890+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f685c03e730 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.890+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68641a5bc0 con 0x7f68641113a0 2024-02-16T00:10:59.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.890+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f685c03e890 con 0x7f68641113a0 2024-02-16T00:10:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.891+0000 7f68617fa640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6844037ef0 0x7f684403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:10:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.891+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68640627b0 con 0x7f68641113a0 2024-02-16T00:10:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.891+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f685c06d990 con 0x7f68641113a0 2024-02-16T00:10:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.891+0000 7f6863fff640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6844037ef0 0x7f684403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:10:59.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.891+0000 7f6863fff640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6844037ef0 0x7f684403a3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68540015f0 tx=0x7f6854007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:10:59.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:10:59.896+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f685c047c40 con 0x7f68641113a0 2024-02-16T00:11:00.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:00.076+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f68641164b0 con 0x7f68641113a0 2024-02-16T00:11:01.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.776+0000 7f68617fa640 1 -- 172.21.15.42:0/2078973142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v15) v1 ==== 227+0+0 (secure 0 0 0) 0x7f685c043020 con 0x7f68641113a0 2024-02-16T00:11:01.778 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'default.rgw.buckets.data' created 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.779+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6844037ef0 msgr2=0x7f684403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.779+0000 7f686ac0f640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6844037ef0 0x7f684403a3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68540015f0 tx=0x7f6854007a40 comp rx=0 tx=0).stop 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.779+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 msgr2=0x7f68641abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.779+0000 7f686ac0f640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 0x7f68641abd40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f685c000f80 tx=0x7f685c004a40 comp rx=0 tx=0).stop 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.780+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 shutdown_connections 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.780+0000 7f686ac0f640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6844037ef0 0x7f684403a3b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.780+0000 7f686ac0f640 1 --2- 172.21.15.42:0/2078973142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68641113a0 0x7f68641abd40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:01.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.780+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 >> 172.21.15.42:0/2078973142 conn(0x7f686406daf0 msgr2=0x7f686411a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:01.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.781+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 shutdown_connections 2024-02-16T00:11:01.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.781+0000 7f686ac0f640 1 -- 172.21.15.42:0/2078973142 wait complete. 2024-02-16T00:11:01.804 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-16T00:11:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef79dd6640 1 Processor -- start 2024-02-16T00:11:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef79dd6640 1 -- start start 2024-02-16T00:11:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef79dd6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef7410e4c0 0x7fef7411a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef79dd6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7410ea00 con 0x7fef7410f270 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef79dd6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7410eb90 con 0x7fef7410e4c0 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef72ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef7410e4c0 0x7fef7411a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef737fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fef7410f270 0x7fef7410ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:56370/0 (socket says 172.21.15.42:56370) 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef737fe640 1 -- 172.21.15.42:0/1007842677 learned_addr learned my addr 172.21.15.42:0/1007842677 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef72ffd640 1 -- 172.21.15.42:0/1007842677 >> v1:172.21.15.2:6789/0 conn(0x7fef7410f270 legacy=0x7fef7410ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.909+0000 7fef72ffd640 1 -- 172.21.15.42:0/1007842677 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7411bf20 con 0x7fef7410e4c0 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.910+0000 7fef72ffd640 1 --2- 172.21.15.42:0/1007842677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7411a9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef68009720 tx=0x7fef6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e10e246d4ad249c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.910+0000 7fef727fc640 1 -- 172.21.15.42:0/1007842677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6802e070 con 0x7fef7410e4c0 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef727fc640 1 -- 172.21.15.42:0/1007842677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef680316d0 con 0x7fef7410e4c0 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef727fc640 1 -- 172.21.15.42:0/1007842677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef68031990 con 0x7fef7410e4c0 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 -- 172.21.15.42:0/1007842677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 msgr2=0x7fef7411a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 --2- 172.21.15.42:0/1007842677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7411a9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef68009720 tx=0x7fef6802b840 comp rx=0 tx=0).stop 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 -- 172.21.15.42:0/1007842677 shutdown_connections 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 --2- 172.21.15.42:0/1007842677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7411a9d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 -- 172.21.15.42:0/1007842677 >> 172.21.15.42:0/1007842677 conn(0x7fef7406ea90 msgr2=0x7fef74070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 -- 172.21.15.42:0/1007842677 shutdown_connections 2024-02-16T00:11:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.911+0000 7fef79dd6640 1 -- 172.21.15.42:0/1007842677 wait complete. 2024-02-16T00:11:01.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef79dd6640 1 Processor -- start 2024-02-16T00:11:01.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef79dd6640 1 -- start start 2024-02-16T00:11:01.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef79dd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7410f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:01.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef79dd6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7410fe80 con 0x7fef7410e4c0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7410f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7410f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35194/0 (socket says 172.21.15.42:35194) 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.912+0000 7fef737fe640 1 -- 172.21.15.42:0/258635596 learned_addr learned my addr 172.21.15.42:0/258635596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef737fe640 1 -- 172.21.15.42:0/258635596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68009400 con 0x7fef7410e4c0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef737fe640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7410f8b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c340 tx=0x7fef64001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64005c10 con 0x7fef7410e4c0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64005d70 con 0x7fef7410e4c0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef74110020 con 0x7fef7410e4c0 2024-02-16T00:11:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64004930 con 0x7fef7410e4c0 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.913+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef741104b0 con 0x7fef7410e4c0 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.914+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740627b0 con 0x7fef7410e4c0 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.914+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fef64004ba0 con 0x7fef7410e4c0 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.914+0000 7fef5bfff640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fef60037ea0 0x7fef6003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.914+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4249+0+0 (secure 0 0 0) 0x7fef6404a5e0 con 0x7fef7410e4c0 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.914+0000 7fef72ffd640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fef60037ea0 0x7fef6003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:01.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.915+0000 7fef72ffd640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fef60037ea0 0x7fef6003a360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef68036000 tx=0x7fef68008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:01.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:01.920+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef6401a310 con 0x7fef7410e4c0 2024-02-16T00:11:02.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.098+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7fef74067570 con 0x7fef7410e4c0 2024-02-16T00:11:02.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.779+0000 7fef5bfff640 1 -- 172.21.15.42:0/258635596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v16) v1 ==== 185+0+0 (secure 0 0 0) 0x7fef64011bf0 con 0x7fef7410e4c0 2024-02-16T00:11:02.781 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-16T00:11:02.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.785+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fef60037ea0 msgr2=0x7fef6003a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:02.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.785+0000 7fef79dd6640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fef60037ea0 0x7fef6003a360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef68036000 tx=0x7fef68008030 comp rx=0 tx=0).stop 2024-02-16T00:11:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.785+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 msgr2=0x7fef7410f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.785+0000 7fef79dd6640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7410f8b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c340 tx=0x7fef64001e70 comp rx=0 tx=0).stop 2024-02-16T00:11:02.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.788+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 shutdown_connections 2024-02-16T00:11:02.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.788+0000 7fef79dd6640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fef60037ea0 0x7fef6003a360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:02.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.788+0000 7fef79dd6640 1 --2- 172.21.15.42:0/258635596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef7410e4c0 0x7fef7410f8b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:02.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.788+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 >> 172.21.15.42:0/258635596 conn(0x7fef7406ea90 msgr2=0x7fef74112090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:02.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.788+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 shutdown_connections 2024-02-16T00:11:02.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.790+0000 7fef79dd6640 1 -- 172.21.15.42:0/258635596 wait complete. 2024-02-16T00:11:02.822 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.927+0000 7fceebd6d640 1 Processor -- start 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.927+0000 7fceebd6d640 1 -- start start 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.927+0000 7fceebd6d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcee411a390 0x7fcee411c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.927+0000 7fceebd6d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee411ccc0 con 0x7fcee41164e0 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.927+0000 7fceebd6d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee411de60 con 0x7fcee411a390 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.928+0000 7fcee9308640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcee411a390 0x7fcee411c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.928+0000 7fcee9308640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcee411a390 0x7fcee411c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35204/0 (socket says 172.21.15.42:35204) 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.928+0000 7fcee9b09640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcee41164e0 0x7fcee41168c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:56374/0 (socket says 172.21.15.42:56374) 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.928+0000 7fcee9308640 1 -- 172.21.15.42:0/1111925277 learned_addr learned my addr 172.21.15.42:0/1111925277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.928+0000 7fcee9308640 1 -- 172.21.15.42:0/1111925277 >> v1:172.21.15.2:6789/0 conn(0x7fcee41164e0 legacy=0x7fcee41168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:02.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.928+0000 7fcee9308640 1 -- 172.21.15.42:0/1111925277 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee411dfd0 con 0x7fcee411a390 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.929+0000 7fcee9308640 1 --2- 172.21.15.42:0/1111925277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee411a390 0x7fcee411c780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fced80097f0 tx=0x7fced802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f48e97f5a922c49 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.929+0000 7fcee8b07640 1 -- 172.21.15.42:0/1111925277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fced80317a0 con 0x7fcee411a390 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.929+0000 7fcee8b07640 1 -- 172.21.15.42:0/1111925277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8031900 con 0x7fcee411a390 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.929+0000 7fcee8b07640 1 -- 172.21.15.42:0/1111925277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fced8031bc0 con 0x7fcee411a390 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.929+0000 7fceebd6d640 1 -- 172.21.15.42:0/1111925277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee411a390 msgr2=0x7fcee411c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.929+0000 7fceebd6d640 1 --2- 172.21.15.42:0/1111925277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee411a390 0x7fcee411c780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fced80097f0 tx=0x7fced802b910 comp rx=0 tx=0).stop 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 -- 172.21.15.42:0/1111925277 shutdown_connections 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 --2- 172.21.15.42:0/1111925277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee411a390 0x7fcee411c780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 -- 172.21.15.42:0/1111925277 >> 172.21.15.42:0/1111925277 conn(0x7fcee406db10 msgr2=0x7fcee406df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 -- 172.21.15.42:0/1111925277 shutdown_connections 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 -- 172.21.15.42:0/1111925277 wait complete. 2024-02-16T00:11:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 Processor -- start 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 -- start start 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 0x7fcee41abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.930+0000 7fceebd6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41ac410 con 0x7fcee41164e0 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee9b09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 0x7fcee41abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee9b09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 0x7fcee41abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35208/0 (socket says 172.21.15.42:35208) 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee9b09640 1 -- 172.21.15.42:0/4069802174 learned_addr learned my addr 172.21.15.42:0/4069802174 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee9b09640 1 -- 172.21.15.42:0/4069802174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80094d0 con 0x7fcee41164e0 2024-02-16T00:11:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee9b09640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 0x7fcee41abe40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fced400c780 tx=0x7fced400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fced4005da0 con 0x7fcee41164e0 2024-02-16T00:11:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400a660 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee41ac610 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.931+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fced400a900 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.932+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee41a5cc0 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.932+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee40627b0 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.932+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fced400aa60 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.933+0000 7fcee27fc640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fced0037ea0 0x7fced003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.933+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4260+0+0 (secure 0 0 0) 0x7fced404a480 con 0x7fcee41164e0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.933+0000 7fcee9308640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fced0037ea0 0x7fced003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.933+0000 7fcee9308640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fced0037ea0 0x7fced003a360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fced8036000 tx=0x7fced8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:02.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:02.938+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fced4007070 con 0x7fcee41164e0 2024-02-16T00:11:03.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.117+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7fcee411a390 con 0x7fcee41164e0 2024-02-16T00:11:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.783+0000 7fcee27fc640 1 -- 172.21.15.42:0/4069802174 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v17) v1 ==== 169+0+0 (secure 0 0 0) 0x7fced4017070 con 0x7fcee41164e0 2024-02-16T00:11:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'default.rgw.buckets.index' created 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.786+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fced0037ea0 msgr2=0x7fced003a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.786+0000 7fceebd6d640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fced0037ea0 0x7fced003a360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fced8036000 tx=0x7fced8008030 comp rx=0 tx=0).stop 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.786+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 msgr2=0x7fcee41abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.786+0000 7fceebd6d640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 0x7fcee41abe40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fced400c780 tx=0x7fced400cc40 comp rx=0 tx=0).stop 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.787+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 shutdown_connections 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.787+0000 7fceebd6d640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fced0037ea0 0x7fced003a360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.787+0000 7fceebd6d640 1 --2- 172.21.15.42:0/4069802174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee41164e0 0x7fcee41abe40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.787+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 >> 172.21.15.42:0/4069802174 conn(0x7fcee406db10 msgr2=0x7fcee410ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.787+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 shutdown_connections 2024-02-16T00:11:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.787+0000 7fceebd6d640 1 -- 172.21.15.42:0/4069802174 wait complete. 2024-02-16T00:11:03.809 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.913+0000 7f4b7a62a640 1 Processor -- start 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.913+0000 7f4b7a62a640 1 -- start start 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.913+0000 7f4b7a62a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b7406c8c0 0x7f4b7406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.913+0000 7f4b7a62a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7411ccd0 con 0x7f4b7406d1e0 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.913+0000 7f4b7a62a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7411de90 con 0x7f4b7406c8c0 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.914+0000 7f4b73fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b7406c8c0 0x7f4b7406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.914+0000 7f4b73fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b7406c8c0 0x7f4b7406cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35224/0 (socket says 172.21.15.42:35224) 2024-02-16T00:11:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.914+0000 7f4b73fff640 1 -- 172.21.15.42:0/1116358834 learned_addr learned my addr 172.21.15.42:0/1116358834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.914+0000 7f4b737fe640 1 --1- 172.21.15.42:0/1116358834 >> v1:172.21.15.2:6789/0 conn(0x7f4b7406d1e0 0x7f4b7411b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:56376/0 (socket says 172.21.15.42:56376) 2024-02-16T00:11:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.914+0000 7f4b73fff640 1 -- 172.21.15.42:0/1116358834 >> v1:172.21.15.2:6789/0 conn(0x7f4b7406d1e0 legacy=0x7f4b7411b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.914+0000 7f4b73fff640 1 -- 172.21.15.42:0/1116358834 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7411e000 con 0x7f4b7406c8c0 2024-02-16T00:11:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b73fff640 1 --2- 172.21.15.42:0/1116358834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b7406cca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4b680097f0 tx=0x7f4b6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655e95ebb41088cc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b72ffd640 1 -- 172.21.15.42:0/1116358834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b680317a0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b72ffd640 1 -- 172.21.15.42:0/1116358834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68031900 con 0x7f4b7406c8c0 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b72ffd640 1 -- 172.21.15.42:0/1116358834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b68031bc0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 -- 172.21.15.42:0/1116358834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 msgr2=0x7f4b7406cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 --2- 172.21.15.42:0/1116358834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b7406cca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4b680097f0 tx=0x7f4b6802b910 comp rx=0 tx=0).stop 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 -- 172.21.15.42:0/1116358834 shutdown_connections 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 --2- 172.21.15.42:0/1116358834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b7406cca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 -- 172.21.15.42:0/1116358834 >> 172.21.15.42:0/1116358834 conn(0x7f4b740701e0 msgr2=0x7f4b74072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 -- 172.21.15.42:0/1116358834 shutdown_connections 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.915+0000 7f4b7a62a640 1 -- 172.21.15.42:0/1116358834 wait complete. 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.916+0000 7f4b7a62a640 1 Processor -- start 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.916+0000 7f4b7a62a640 1 -- start start 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.916+0000 7f4b7a62a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b741abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.916+0000 7f4b7a62a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741ac440 con 0x7f4b7406c8c0 2024-02-16T00:11:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b741abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b741abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:35234/0 (socket says 172.21.15.42:35234) 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b73fff640 1 -- 172.21.15.42:0/3638344738 learned_addr learned my addr 172.21.15.42:0/3638344738 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b73fff640 1 -- 172.21.15.42:0/3638344738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680094d0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b73fff640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b741abe70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b680097f0 tx=0x7f4b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b6803ac00 con 0x7f4b7406c8c0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6803ad60 con 0x7f4b7406c8c0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b741ac5e0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b680443f0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.917+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b741ac9b0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.918+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b6804d450 con 0x7f4b7406c8c0 2024-02-16T00:11:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.918+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b740627b0 con 0x7f4b7406c8c0 2024-02-16T00:11:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.918+0000 7f4b70ff9640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4b60037ef0 0x7f4b6003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.918+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4624+0+0 (secure 0 0 0) 0x7f4b6802d040 con 0x7f4b7406c8c0 2024-02-16T00:11:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.919+0000 7f4b737fe640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4b60037ef0 0x7f4b6003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.919+0000 7f4b737fe640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4b60037ef0 0x7f4b6003a3b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b7406d630 tx=0x7f4b64007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:03.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:03.923+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4b6804b940 con 0x7f4b7406c8c0 2024-02-16T00:11:04.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.102+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f4b7406d1e0 con 0x7f4b7406c8c0 2024-02-16T00:11:04.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.784+0000 7f4b70ff9640 1 -- 172.21.15.42:0/3638344738 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v18) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4b6804b350 con 0x7f4b7406c8c0 2024-02-16T00:11:04.786 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-16T00:11:04.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.790+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4b60037ef0 msgr2=0x7f4b6003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:04.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4b60037ef0 0x7f4b6003a3b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b7406d630 tx=0x7f4b64007a00 comp rx=0 tx=0).stop 2024-02-16T00:11:04.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 msgr2=0x7f4b741abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:04.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b741abe70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b680097f0 tx=0x7f4b680046c0 comp rx=0 tx=0).stop 2024-02-16T00:11:04.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 shutdown_connections 2024-02-16T00:11:04.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4b60037ef0 0x7f4b6003a3b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:04.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 --2- 172.21.15.42:0/3638344738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7406c8c0 0x7f4b741abe70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:04.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.792+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 >> 172.21.15.42:0/3638344738 conn(0x7f4b740701e0 msgr2=0x7f4b741196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:04.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.793+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 shutdown_connections 2024-02-16T00:11:04.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:04.794+0000 7f4b7a62a640 1 -- 172.21.15.42:0/3638344738 wait complete. 2024-02-16T00:11:04.822 DEBUG:tasks.rgw:Pools created 2024-02-16T00:11:04.822 INFO:tasks.rgw:Starting rgw... 2024-02-16T00:11:04.822 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-16T00:11:04.822 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-16T00:11:04.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo echo -n http://smithi042.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-02-16T00:11:04.852 INFO:teuthology.orchestra.run.smithi042.stdout:http://smithi042.front.sepia.ceph.com:80 2024-02-16T00:11:04.852 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-02-16T00:11:04.920 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-16T00:11:04.921 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-16T00:11:04.963 INFO:tasks.rgw.client.0:Started 2024-02-16T00:11:04.963 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi042.front.sepia.ceph.com:80/ 2024-02-16T00:11:04.963 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-02-16T00:11:04.991 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T00:11:04.991 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T00:11:04.991 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-02-16T00:11:04.991 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T00:11:04.991 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80: Connection refused 2024-02-16T00:11:05.992 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-02-16T00:11:06.014 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T00:11:06.014 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-02-16T00:11:06.014 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T00:11:06.015 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T00:11:06.015 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80: Connection refused 2024-02-16T00:11:08.017 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-02-16T00:11:08.039 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T00:11:08.040 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T00:11:08.040 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-02-16T00:11:08.040 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T00:11:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80: Connection refused 2024-02-16T00:11:12.041 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-02-16T00:11:12.062 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T00:11:12.063 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-02-16T00:11:12.063 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T00:11:12.063 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T00:11:12.064 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80: Connection refused 2024-02-16T00:11:20.064 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-02-16T00:11:20.086 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T00:11:20.086 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-02-16T00:11:20.088 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2024-02-16T00:11:20.088 INFO:teuthology.orchestra.run.smithi042.stdout:anonymous 2024-02-16T00:11:20.089 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-02-16T00:11:20.179 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-02-16T00:11:20.179 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-16T00:11:20.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-16T00:11:20.180 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-16T00:11:20.226 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:20.227 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:20.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.224+0000 7f6d781dc800 1 Processor -- start 2024-02-16T00:11:20.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.224+0000 7f6d781dc800 1 -- start start 2024-02-16T00:11:20.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d781dc800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5611c1dc32f0 0x5611c1dc56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d781dc800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5611c1d0aba0 con 0x5611c1dbee60 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d781dc800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5611c1cc2450 con 0x5611c1dc32f0 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d754da640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5611c1dc32f0 0x5611c1dc56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d75cdb640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5611c1dbee60 0x5611c1dbf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60068/0 (socket says 172.21.15.42:60068) 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d75cdb640 1 -- 172.21.15.42:0/1637954019 learned_addr learned my addr 172.21.15.42:0/1637954019 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d754da640 1 -- 172.21.15.42:0/1637954019 >> v1:172.21.15.2:6789/0 conn(0x5611c1dbee60 legacy=0x5611c1dbf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.225+0000 7f6d754da640 1 -- 172.21.15.42:0/1637954019 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1dc6d10 con 0x5611c1dc32f0 2024-02-16T00:11:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.227+0000 7f6d754da640 1 --2- 172.21.15.42:0/1637954019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dc32f0 0x5611c1dc56e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000a470 tx=0x7f6d6001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c821b9551e21b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.227+0000 7f6d74cd9640 1 -- 172.21.15.42:0/1637954019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d60052570 con 0x5611c1dc32f0 2024-02-16T00:11:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.227+0000 7f6d74cd9640 1 -- 172.21.15.42:0/1637954019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d600526d0 con 0x5611c1dc32f0 2024-02-16T00:11:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.227+0000 7f6d74cd9640 1 -- 172.21.15.42:0/1637954019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d60052990 con 0x5611c1dc32f0 2024-02-16T00:11:20.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 -- 172.21.15.42:0/1637954019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dc32f0 msgr2=0x5611c1dc56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1637954019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dc32f0 0x5611c1dc56e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000a470 tx=0x7f6d6001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:20.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 -- 172.21.15.42:0/1637954019 shutdown_connections 2024-02-16T00:11:20.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1637954019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dc32f0 0x5611c1dc56e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 -- 172.21.15.42:0/1637954019 >> 172.21.15.42:0/1637954019 conn(0x5611c1dba4c0 msgr2=0x5611c1dbc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 -- 172.21.15.42:0/1637954019 shutdown_connections 2024-02-16T00:11:20.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.228+0000 7f6d781dc800 1 -- 172.21.15.42:0/1637954019 wait complete. 2024-02-16T00:11:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d781dc800 1 Processor -- start 2024-02-16T00:11:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d781dc800 1 -- start start 2024-02-16T00:11:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d781dc800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eaeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d781dc800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1cbf980 con 0x5611c1dbee60 2024-02-16T00:11:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d75cdb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eaeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d75cdb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eaeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57726/0 (socket says 172.21.15.42:57726) 2024-02-16T00:11:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.242+0000 7f6d75cdb640 1 -- 172.21.15.42:0/541269855 learned_addr learned my addr 172.21.15.42:0/541269855 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.243+0000 7f6d75cdb640 1 -- 172.21.15.42:0/541269855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d60005d20 con 0x5611c1dbee60 2024-02-16T00:11:20.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.243+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/541269855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eaeee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d680014d0 tx=0x7f6d68001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f18558050fedf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.243+0000 7f6c63e07640 1 -- 172.21.15.42:0/541269855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d68004520 con 0x5611c1dbee60 2024-02-16T00:11:20.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.243+0000 7f6c63e07640 1 -- 172.21.15.42:0/541269855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68004680 con 0x5611c1dbee60 2024-02-16T00:11:20.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.243+0000 7f6c63e07640 1 -- 172.21.15.42:0/541269855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d68004980 con 0x5611c1dbee60 2024-02-16T00:11:20.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 -- 172.21.15.42:0/541269855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 msgr2=0x5611c1eaeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 --2- 172.21.15.42:0/541269855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eaeee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d680014d0 tx=0x7f6d68001990 comp rx=0 tx=0).stop 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 -- 172.21.15.42:0/541269855 shutdown_connections 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 --2- 172.21.15.42:0/541269855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eaeee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 -- 172.21.15.42:0/541269855 >> 172.21.15.42:0/541269855 conn(0x5611c1dba4c0 msgr2=0x5611c1eaa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 -- 172.21.15.42:0/541269855 shutdown_connections 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 -- 172.21.15.42:0/541269855 wait complete. 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 Processor -- start 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.244+0000 7f6d781dc800 1 -- start start 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d781dc800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eb7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d781dc800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1cbb160 con 0x5611c1dbee60 2024-02-16T00:11:20.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d75cdb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eb7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d75cdb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eb7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57742/0 (socket says 172.21.15.42:57742) 2024-02-16T00:11:20.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d75cdb640 1 -- 172.21.15.42:0/1820323290 learned_addr learned my addr 172.21.15.42:0/1820323290 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d75cdb640 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1d0aba0 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.245+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eb7660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d680014d0 tx=0x7f6d68001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.246+0000 7f6c62604640 1 -- 172.21.15.42:0/1820323290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d68014870 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.246+0000 7f6c62604640 1 -- 172.21.15.42:0/1820323290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d680149f0 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.246+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611c1eb7ba0 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.246+0000 7f6c62604640 1 -- 172.21.15.42:0/1820323290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d68014cd0 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.246+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611c1eb8080 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6c62604640 1 -- 172.21.15.42:0/1820323290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6d6801e3f0 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6c62604640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c5c036790 0x7f6c5c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6c62604640 1 -- 172.21.15.42:0/1820323290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6d6804c3e0 con 0x5611c1dbee60 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6d754da640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c5c036790 0x7f6c5c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1dc32f0 0x5611c1ebe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ebe950 con 0x5611c1dc32f0 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.247+0000 7f6d764dc640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1dc32f0 0x5611c1ebe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d754da640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c5c036790 0x7f6c5c038c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d60054000 tx=0x7f6d6004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d764dc640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1dc32f0 0x5611c1ebe380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d764dc640 1 -- 172.21.15.42:0/1820323290 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6d700083e0 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ebba30 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d764dc640 1 -- 172.21.15.42:0/1820323290 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6d700083e0 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ec0b90 0x5611c1ec2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.248+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ec3670 con 0x5611c1ec0b90 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.249+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ec0b90 0x5611c1ec2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.249+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ec0b90 0x5611c1ec2f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.249+0000 7f6d75cdb640 1 -- 172.21.15.42:0/1820323290 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1ec0b90 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.249+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ebfb10 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d764dc640 1 -- 172.21.15.42:0/1820323290 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6d700083e0 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ebff00 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d764dc640 1 -- 172.21.15.42:0/1820323290 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6d700083e0 con 0x5611c1dc32f0 2024-02-16T00:11:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d781dc800 1 Processor -- start 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d781dc800 1 -- start start 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d781dc800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 0x5611c1ed2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.250+0000 7f6d781dc800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1c5de80 con 0x5611c1ed2450 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.251+0000 7f6d764dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 0x5611c1ed2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.251+0000 7f6d764dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 0x5611c1ed2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57752/0 (socket says 172.21.15.42:57752) 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.251+0000 7f6d764dc640 1 -- 172.21.15.42:0/3758817189 learned_addr learned my addr 172.21.15.42:0/3758817189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.251+0000 7f6d764dc640 1 -- 172.21.15.42:0/3758817189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1ed2db0 con 0x5611c1ed2450 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.251+0000 7f6d764dc640 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 0x5611c1ed2870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5611c1eb8a60 tx=0x7f6d7000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.252+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/3758817189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d7000f040 con 0x5611c1ed2450 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.252+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/3758817189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70007d00 con 0x5611c1ed2450 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.252+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/3758817189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d70019420 con 0x5611c1ed2450 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.252+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611c1ed3820 con 0x5611c1ed2450 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.252+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611c1ed3ce0 con 0x5611c1ed2450 2024-02-16T00:11:20.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.252+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/3758817189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6d70019580 con 0x5611c1ed2450 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6c5b7fe640 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c500367e0 0x7f6c50038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6c5b7fe640 1 -- 172.21.15.42:0/3758817189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6d7004dff0 con 0x5611c1ed2450 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c500367e0 0x7f6c50038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6d781dc800 1 Processor -- start 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6d781dc800 1 -- start start 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c500367e0 0x7f6c50038ca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x5611c1ebed50 tx=0x7f6d6804a700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6d781dc800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1edfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.253+0000 7f6d781dc800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1c335d0 con 0x5611c1edf6d0 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6d764dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1edfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6d764dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1edfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57758/0 (socket says 172.21.15.42:57758) 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6d764dc640 1 -- 172.21.15.42:0/4079699542 learned_addr learned my addr 172.21.15.42:0/4079699542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6d764dc640 1 -- 172.21.15.42:0/4079699542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1ee00c0 con 0x5611c1edf6d0 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6d764dc640 1 --2- 172.21.15.42:0/4079699542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1edfaf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6d7004c570 tx=0x7f6d70014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e125f329cff8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6c597fa640 1 -- 172.21.15.42:0/4079699542 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d70017de0 con 0x5611c1edf6d0 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6c597fa640 1 -- 172.21.15.42:0/4079699542 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70040ac0 con 0x5611c1edf6d0 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.254+0000 7f6c597fa640 1 -- 172.21.15.42:0/4079699542 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d70040dc0 con 0x5611c1edf6d0 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- 172.21.15.42:0/4079699542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 msgr2=0x5611c1edfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 --2- 172.21.15.42:0/4079699542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1edfaf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6d7004c570 tx=0x7f6d70014ef0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- 172.21.15.42:0/4079699542 shutdown_connections 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 --2- 172.21.15.42:0/4079699542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1edfaf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- 172.21.15.42:0/4079699542 >> 172.21.15.42:0/4079699542 conn(0x5611c1edba30 msgr2=0x5611c1ed9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- 172.21.15.42:0/4079699542 shutdown_connections 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- 172.21.15.42:0/4079699542 wait complete. 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 Processor -- start 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- start start 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1ee6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.255+0000 7f6d781dc800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1ee6b70 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.256+0000 7f6d764dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1ee6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.256+0000 7f6d764dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1ee6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57762/0 (socket says 172.21.15.42:57762) 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.256+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 learned_addr learned my addr 172.21.15.42:0/3441562107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.256+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1ed3ce0 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.256+0000 7f6d764dc640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1ee6630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6d7004b250 tx=0x7f6d7004c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.257+0000 7f6c477fe640 1 -- 172.21.15.42:0/3441562107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d70040050 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.257+0000 7f6c477fe640 1 -- 172.21.15.42:0/3441562107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70017de0 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.257+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611c1ee6d70 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.257+0000 7f6c477fe640 1 -- 172.21.15.42:0/3441562107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d70019be0 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.257+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611c1ee71d0 con 0x5611c1edf6d0 2024-02-16T00:11:20.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6c477fe640 1 -- 172.21.15.42:0/3441562107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6d7004f030 con 0x5611c1edf6d0 2024-02-16T00:11:20.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6c477fe640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c40036790 0x7f6c40038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6c477fe640 1 -- 172.21.15.42:0/3441562107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6d70037c60 con 0x5611c1edf6d0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c40036790 0x7f6c40038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1ef2350 0x5611c1ef47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ef4f40 con 0x5611c1ef2350 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6d754da640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1ef2350 0x5611c1ef47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.258+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c40036790 0x7f6c40038c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d6804aa90 tx=0x7f6d68032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d754da640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1ef2350 0x5611c1ef47f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 realm 2024-02-16T00:11:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ef52d0 con 0x5611c1ef2350 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ef5b20 con 0x5611c1ef2350 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.259+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ef5e80 con 0x5611c1ef2350 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d781dc800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ef6b90 0x5611c1ef8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ef9500 con 0x5611c1ef6b90 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d764dc640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ef6b90 0x5611c1ef8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.260+0000 7f6d764dc640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ef6b90 0x5611c1ef8f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6d700083e0 con 0x5611c1ef6b90 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d781dc800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d781dc800 20 searching for the correct realm 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5611c1efb220 0x5611c1efd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efdd00 con 0x5611c1efb220 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5611c1efb220 0x5611c1efd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.261+0000 7f6d75cdb640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5611c1efb220 0x5611c1efd630 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.262+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.262+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efdd00 con 0x5611c1ef6b90 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.262+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d700083e0 con 0x5611c1ef6b90 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.262+0000 7f6d764dc640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6d70047040 0x7f6d700250d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.262+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.262+0000 7f6d754da640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6d70047040 0x7f6d700250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.263+0000 7f6d754da640 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6d70047040 0x7f6d700250d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.263+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.263+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.263+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.263+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.264+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.265+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.266+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.266+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.266+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.266+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.266+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.266+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.267+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.268+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.268+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.268+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.268+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.268+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.268+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.269+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.269+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.269+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.269+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.269+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.269+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.270+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.271+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1ef9cc0 con 0x5611c1ef2350 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efa070 con 0x5611c1ef2350 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.272+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efa450 con 0x5611c1ef2350 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 zone default found 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 4 Realm: () 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 zonegroup default 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efe140 con 0x7f6d70047040 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efa960 con 0x5611c1efb220 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.273+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f000b0 con 0x5611c1efb220 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.274+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.274+0000 7f6d781dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.274+0000 7f6d781dc800 20 started sync module instance, tier type = 2024-02-16T00:11:20.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.274+0000 7f6d781dc800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.274+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1eff590 con 0x5611c1ef6b90 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.275+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.275+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634268162672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f004d0 con 0x5611c1ef6b90 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.275+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f00cd0 con 0x5611c1ef2350 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.276+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634268162672] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.276+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.276+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634268165408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f00de0 con 0x5611c1ef2350 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.276+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f01750 con 0x5611c1efb220 2024-02-16T00:11:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.278+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634268165408] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.278+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.278+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634268168880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f01b00 con 0x5611c1efb220 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.278+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f02500 con 0x5611c1ef6b90 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.279+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634268168880] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.279+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.279+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634268172288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f028e0 con 0x5611c1ef6b90 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.279+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f032e0 con 0x5611c1ef2350 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.280+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634268172288] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.280+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.280+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634268175840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f032a0 con 0x5611c1ef2350 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.280+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f03d00 con 0x7f6d70047040 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.282+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.282+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634268178464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f03ca0 con 0x7f6d70047040 2024-02-16T00:11:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.282+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f04cc0 con 0x7f6d70047040 2024-02-16T00:11:20.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.282+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634268175840] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.283+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634268178464] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.283+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.283+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634268180704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f00940 con 0x7f6d70047040 2024-02-16T00:11:20.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.283+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f05290 con 0x7f6d70047040 2024-02-16T00:11:20.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634268180704] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634268182432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f05290 con 0x7f6d70047040 2024-02-16T00:11:20.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=0 2024-02-16T00:11:20.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=1 2024-02-16T00:11:20.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=2 2024-02-16T00:11:20.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=3 2024-02-16T00:11:20.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=4 2024-02-16T00:11:20.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=5 2024-02-16T00:11:20.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.284+0000 7f6d781dc800 20 add_watcher() i=6 2024-02-16T00:11:20.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.286+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634268182432] v27'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.286+0000 7f6d781dc800 20 add_watcher() i=7 2024-02-16T00:11:20.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.286+0000 7f6d781dc800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:20.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.286+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f08690 con 0x5611c1ef2350 2024-02-16T00:11:20.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.286+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.286+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634268197104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f05400 con 0x5611c1ef2350 2024-02-16T00:11:20.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.287+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634268197104] v27'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.287+0000 7f6c277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6d781dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:20.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6d781dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:20.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6d781dc800 5 note: GC not initialized 2024-02-16T00:11:20.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6c267fc640 20 reqs_thread_entry: start 2024-02-16T00:11:20.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6d781dc800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:20.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6d781dc800 20 Filter name: none 2024-02-16T00:11:20.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6b97fff640 20 reqs_thread_entry: start 2024-02-16T00:11:20.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.288+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f39d00 con 0x5611c1efb220 2024-02-16T00:11:20.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.289+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.289+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f39d00 con 0x5611c1efb220 2024-02-16T00:11:20.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.289+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.289+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f39d00 con 0x5611c1ef2350 2024-02-16T00:11:20.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.289+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.289+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efa450 con 0x5611c1ef2350 2024-02-16T00:11:20.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efa450 con 0x5611c1ef6b90 2024-02-16T00:11:20.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.290+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.291+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.291+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.291+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.291+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.291+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.291+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.292+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.292+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.292+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.292+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.292+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.292+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.293+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(80 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.294+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.295+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.295+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.295+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.295+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.295+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.295+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.296+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.296+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.296+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.296+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.296+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.296+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.297+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.297+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.297+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.297+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x7f6d70047040 2024-02-16T00:11:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.297+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.297+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef2350 2024-02-16T00:11:20.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.298+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.298+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1efb220 2024-02-16T00:11:20.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.298+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.298+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6d70035070 con 0x5611c1ef6b90 2024-02-16T00:11:20.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.298+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.299+0000 7f6c277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.299+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634268197104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1efa450 con 0x5611c1ef2350 2024-02-16T00:11:20.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.300+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94634268197104] v27'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.300+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634268162672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f39cc0 con 0x5611c1ef6b90 2024-02-16T00:11:20.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.301+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94634268162672] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.301+0000 7f6d781dc800 20 remove_watcher() i=0 2024-02-16T00:11:20.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.301+0000 7f6d781dc800 2 removed watcher, disabling cache 2024-02-16T00:11:20.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.301+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634268165408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f39cc0 con 0x5611c1ef2350 2024-02-16T00:11:20.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.303+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94634268165408] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.303+0000 7f6d781dc800 20 remove_watcher() i=1 2024-02-16T00:11:20.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.303+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634268168880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f39cc0 con 0x5611c1efb220 2024-02-16T00:11:20.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.304+0000 7f6d75cdb640 1 -- 172.21.15.42:0/3441562107 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94634268168880] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d68024070 con 0x5611c1efb220 2024-02-16T00:11:20.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.304+0000 7f6d781dc800 20 remove_watcher() i=2 2024-02-16T00:11:20.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.304+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634268172288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f012b0 con 0x5611c1ef6b90 2024-02-16T00:11:20.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.305+0000 7f6d764dc640 1 -- 172.21.15.42:0/3441562107 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94634268172288] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d7005d040 con 0x5611c1ef6b90 2024-02-16T00:11:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.305+0000 7f6d781dc800 20 remove_watcher() i=3 2024-02-16T00:11:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.305+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634268175840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1effa70 con 0x5611c1ef2350 2024-02-16T00:11:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.306+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94634268175840] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x5611c1ef2350 2024-02-16T00:11:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.306+0000 7f6d781dc800 20 remove_watcher() i=4 2024-02-16T00:11:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.306+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634268178464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1effa70 con 0x7f6d70047040 2024-02-16T00:11:20.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.307+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94634268178464] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.307+0000 7f6d781dc800 20 remove_watcher() i=5 2024-02-16T00:11:20.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.307+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634268180704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1f03820 con 0x7f6d70047040 2024-02-16T00:11:20.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.308+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94634268180704] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.308+0000 7f6d781dc800 20 remove_watcher() i=6 2024-02-16T00:11:20.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.308+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634268182432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611c1effa70 con 0x7f6d70047040 2024-02-16T00:11:20.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.309+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94634268182432] v27'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6d60059040 con 0x7f6d70047040 2024-02-16T00:11:20.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.309+0000 7f6d781dc800 20 remove_watcher() i=7 2024-02-16T00:11:20.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6d70047040 msgr2=0x7f6d700250d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6d70047040 0x7f6d700250d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1ef2350 msgr2=0x5611c1ef47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1ef2350 0x5611c1ef47f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ef6b90 msgr2=0x5611c1ef8f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ef6b90 0x5611c1ef8f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5611c1efb220 msgr2=0x5611c1efd630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5611c1efb220 0x5611c1efd630 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c40036790 msgr2=0x7f6c40038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c40036790 0x7f6c40038c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d6804aa90 tx=0x7f6d68032000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 msgr2=0x5611c1ee6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1ee6630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6d7004b250 tx=0x7f6d7004c310 comp rx=0 tx=0).stop 2024-02-16T00:11:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d754da640 1 -- 172.21.15.42:0/3441562107 reap_dead start 2024-02-16T00:11:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 shutdown_connections 2024-02-16T00:11:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3441562107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1edf6d0 0x5611c1ee6630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 >> 172.21.15.42:0/3441562107 conn(0x5611c1edba30 msgr2=0x5611c1ed9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 shutdown_connections 2024-02-16T00:11:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3441562107 wait complete. 2024-02-16T00:11:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c500367e0 msgr2=0x7f6c50038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c500367e0 0x7f6c50038ca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x5611c1ebed50 tx=0x7f6d6804a700 comp rx=0 tx=0).stop 2024-02-16T00:11:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 msgr2=0x5611c1ed2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 0x5611c1ed2870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5611c1eb8a60 tx=0x7f6d7000aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 shutdown_connections 2024-02-16T00:11:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c500367e0 0x7f6c50038ca0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 --2- 172.21.15.42:0/3758817189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1ed2450 0x5611c1ed2870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 >> 172.21.15.42:0/3758817189 conn(0x5611c1ec64f0 msgr2=0x5611c1ec68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 shutdown_connections 2024-02-16T00:11:20.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.310+0000 7f6d781dc800 1 -- 172.21.15.42:0/3758817189 wait complete. 2024-02-16T00:11:20.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1dc32f0 msgr2=0x5611c1ebe380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1dc32f0 0x5611c1ebe380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ec0b90 msgr2=0x5611c1ec2f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ec0b90 0x5611c1ec2f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c5c036790 msgr2=0x7f6c5c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c5c036790 0x7f6c5c038c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d60054000 tx=0x7f6d6004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 msgr2=0x5611c1eb7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eb7660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d680014d0 tx=0x7f6d68001250 comp rx=0 tx=0).stop 2024-02-16T00:11:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 shutdown_connections 2024-02-16T00:11:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5611c1ec0b90 0x5611c1ec2f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5611c1dc32f0 0x5611c1ebe380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6c5c036790 0x7f6c5c038c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 --2- 172.21.15.42:0/1820323290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611c1dbee60 0x5611c1eb7660 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 >> 172.21.15.42:0/1820323290 conn(0x5611c1dba4c0 msgr2=0x5611c1ea9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 shutdown_connections 2024-02-16T00:11:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.311+0000 7f6d781dc800 1 -- 172.21.15.42:0/1820323290 wait complete. 2024-02-16T00:11:20.354 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-02-16T00:11:20.355 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T00:11:20.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-02-16T00:11:20.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-02-16T00:11:20.356 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-02-16T00:11:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d1ea11800 1 Processor -- start 2024-02-16T00:11:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d1ea11800 1 -- start start 2024-02-16T00:11:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d1ea11800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564e4f38a280 0x564e4f38c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d1ea11800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564e4f2d0bb0 con 0x564e4f2f9100 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d1ea11800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x564e4f288450 con 0x564e4f38a280 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d19871640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564e4f38a280 0x564e4f38c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d19871640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564e4f38a280 0x564e4f38c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57772/0 (socket says 172.21.15.42:57772) 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d19871640 1 -- 172.21.15.42:0/2977521590 learned_addr learned my addr 172.21.15.42:0/2977521590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d1a072640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564e4f2f9100 0x564e4f388b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60074/0 (socket says 172.21.15.42:60074) 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d19871640 1 -- 172.21.15.42:0/2977521590 >> v1:172.21.15.2:6789/0 conn(0x564e4f2f9100 legacy=0x564e4f388b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.397+0000 7f8d19871640 1 -- 172.21.15.42:0/2977521590 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e4f38de50 con 0x564e4f38a280 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.399+0000 7f8d19871640 1 --2- 172.21.15.42:0/2977521590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f38a280 0x564e4f38c740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000a520 tx=0x7f8d1001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829d9cf8e8e4dada server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.399+0000 7f8d19070640 1 -- 172.21.15.42:0/2977521590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d10052570 con 0x564e4f38a280 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d19070640 1 -- 172.21.15.42:0/2977521590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d100526d0 con 0x564e4f38a280 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d19070640 1 -- 172.21.15.42:0/2977521590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d10052990 con 0x564e4f38a280 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2977521590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f38a280 msgr2=0x564e4f38c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/2977521590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f38a280 0x564e4f38c740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000a520 tx=0x7f8d1001cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2977521590 shutdown_connections 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/2977521590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f38a280 0x564e4f38c740 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2977521590 >> 172.21.15.42:0/2977521590 conn(0x564e4f3804d0 msgr2=0x564e4f3828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2977521590 shutdown_connections 2024-02-16T00:11:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.400+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2977521590 wait complete. 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.411+0000 7f8d1ea11800 1 Processor -- start 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1ea11800 1 -- start start 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1ea11800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f386460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1ea11800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e4f285980 con 0x564e4f2f9100 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1a072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f386460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1a072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f386460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57784/0 (socket says 172.21.15.42:57784) 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1a072640 1 -- 172.21.15.42:0/236263835 learned_addr learned my addr 172.21.15.42:0/236263835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.412+0000 7f8d1a072640 1 -- 172.21.15.42:0/236263835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d10005de0 con 0x564e4f2f9100 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.413+0000 7f8d1a072640 1 --2- 172.21.15.42:0/236263835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f386460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c001d00 tx=0x7f8d0c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e44d26117c7df5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.413+0000 7f8c08608640 1 -- 172.21.15.42:0/236263835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d0c014070 con 0x564e4f2f9100 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.413+0000 7f8c08608640 1 -- 172.21.15.42:0/236263835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00f450 con 0x564e4f2f9100 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.413+0000 7f8c08608640 1 -- 172.21.15.42:0/236263835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d0c00f730 con 0x564e4f2f9100 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- 172.21.15.42:0/236263835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 msgr2=0x564e4f386460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/236263835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f386460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c001d00 tx=0x7f8d0c00b600 comp rx=0 tx=0).stop 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- 172.21.15.42:0/236263835 shutdown_connections 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/236263835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f386460 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- 172.21.15.42:0/236263835 >> 172.21.15.42:0/236263835 conn(0x564e4f3804d0 msgr2=0x564e4f471900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- 172.21.15.42:0/236263835 shutdown_connections 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- 172.21.15.42:0/236263835 wait complete. 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 Processor -- start 2024-02-16T00:11:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- start start 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f47f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1ea11800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e4f281160 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1a072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f47f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1a072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f47f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57796/0 (socket says 172.21.15.42:57796) 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.414+0000 7f8d1a072640 1 -- 172.21.15.42:0/3033543674 learned_addr learned my addr 172.21.15.42:0/3033543674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8d1a072640 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e4f2d0bb0 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8d1a072640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f47f900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x564e4f385a90 tx=0x7f8d0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8c06e05640 1 -- 172.21.15.42:0/3033543674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d0c014050 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8c06e05640 1 -- 172.21.15.42:0/3033543674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c01ba30 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e4f47fe40 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8c06e05640 1 -- 172.21.15.42:0/3033543674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d0c01bcd0 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.415+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e4f480320 con 0x564e4f2f9100 2024-02-16T00:11:20.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8c06e05640 1 -- 172.21.15.42:0/3033543674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8d0c022020 con 0x564e4f2f9100 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8c06e05640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c000367e0 0x7f8c00038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8c06e05640 1 -- 172.21.15.42:0/3033543674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8d0c008030 con 0x564e4f2f9100 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8d19871640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c000367e0 0x7f8c00038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f38a280 0x564e4f486640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f486c80 con 0x564e4f38a280 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.416+0000 7f8d1a873640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f38a280 0x564e4f486640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d19871640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c000367e0 0x7f8c00038ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8d10054000 tx=0x7f8d1004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1a873640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f38a280 0x564e4f486640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1a873640 1 -- 172.21.15.42:0/3033543674 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f38a280 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f483cf0 con 0x564e4f38a280 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1a873640 1 -- 172.21.15.42:0/3033543674 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f38a280 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f488e90 0x564e4f48b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f48b980 con 0x564e4f488e90 2024-02-16T00:11:20.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.417+0000 7f8d1a072640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f488e90 0x564e4f48b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.418+0000 7f8d1a072640 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f488e90 0x564e4f48b280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.418+0000 7f8d1a072640 1 -- 172.21.15.42:0/3033543674 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f488e90 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.418+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f487e10 con 0x564e4f38a280 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.418+0000 7f8d1a873640 1 -- 172.21.15.42:0/3033543674 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f38a280 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.418+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f488200 con 0x564e4f38a280 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1a873640 1 -- 172.21.15.42:0/3033543674 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f38a280 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1ea11800 1 Processor -- start 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1ea11800 1 -- start start 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1ea11800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 0x564e4f49ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1ea11800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e4f223e80 con 0x564e4f49a6e0 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1a873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 0x564e4f49ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1a873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 0x564e4f49ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57800/0 (socket says 172.21.15.42:57800) 2024-02-16T00:11:20.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.419+0000 7f8d1a873640 1 -- 172.21.15.42:0/3975840514 learned_addr learned my addr 172.21.15.42:0/3975840514 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8d1a873640 1 -- 172.21.15.42:0/3975840514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e4f49b040 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8d1a873640 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 0x564e4f49ab00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x564e4f4804d0 tx=0x7f8d14018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8bfffff640 1 -- 172.21.15.42:0/3975840514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d1401d070 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8bfffff640 1 -- 172.21.15.42:0/3975840514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d140182e0 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e4f49bab0 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8bfffff640 1 -- 172.21.15.42:0/3975840514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d140145a0 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.420+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e4f49bf70 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.421+0000 7f8bfffff640 1 -- 172.21.15.42:0/3975840514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8d14020020 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.421+0000 7f8bfffff640 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8bf40367e0 0x7f8bf4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.421+0000 7f8bfffff640 1 -- 172.21.15.42:0/3975840514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8d1404dc70 con 0x564e4f49a6e0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.421+0000 7f8d1a072640 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8bf40367e0 0x7f8bf4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.421+0000 7f8d1ea11800 1 Processor -- start 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.421+0000 7f8d1a072640 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8bf40367e0 0x7f8bf4038ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x564e4f487050 tx=0x7f8d0c040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1ea11800 1 -- start start 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1ea11800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1ea11800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e4f1f95d0 con 0x564e4f4a7920 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1a873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1a873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57802/0 (socket says 172.21.15.42:57802) 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1a873640 1 -- 172.21.15.42:0/2522690477 learned_addr learned my addr 172.21.15.42:0/2522690477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1a873640 1 -- 172.21.15.42:0/2522690477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e4f4a8310 con 0x564e4f4a7920 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8d1a873640 1 --2- 172.21.15.42:0/2522690477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4a7d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d1404bfc0 tx=0x7f8d14011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4dc65ccefdb117 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.422+0000 7f8bfdffb640 1 -- 172.21.15.42:0/2522690477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d14040440 con 0x564e4f4a7920 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8bfdffb640 1 -- 172.21.15.42:0/2522690477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14014ad0 con 0x564e4f4a7920 2024-02-16T00:11:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8bfdffb640 1 -- 172.21.15.42:0/2522690477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d1402b350 con 0x564e4f4a7920 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2522690477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 msgr2=0x564e4f4a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/2522690477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4a7d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d1404bfc0 tx=0x7f8d14011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2522690477 shutdown_connections 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/2522690477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4a7d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2522690477 >> 172.21.15.42:0/2522690477 conn(0x564e4f4a3c80 msgr2=0x564e4f4a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2522690477 shutdown_connections 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- 172.21.15.42:0/2522690477 wait complete. 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 Processor -- start 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- start start 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.423+0000 7f8d1ea11800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e4f4aed90 con 0x564e4f4a7920 2024-02-16T00:11:20.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1a873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1a873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57804/0 (socket says 172.21.15.42:57804) 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 learned_addr learned my addr 172.21.15.42:0/821820097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e4f49bf70 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1a873640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4ae850 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8d14014a50 tx=0x7f8d1404bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8bebfff640 1 -- 172.21.15.42:0/821820097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d14022c80 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8bebfff640 1 -- 172.21.15.42:0/821820097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14022de0 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e4f4aef90 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8bebfff640 1 -- 172.21.15.42:0/821820097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d1402b810 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.424+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e4f4af3f0 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.425+0000 7f8bebfff640 1 -- 172.21.15.42:0/821820097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8d1402b970 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.425+0000 7f8bebfff640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8be40367e0 0x7f8be4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.425+0000 7f8bebfff640 1 -- 172.21.15.42:0/821820097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8d14038c30 con 0x564e4f4a7920 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d1a072640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8be40367e0 0x7f8be4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f4ba5b0 0x564e4f4bca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4bd1c0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d1a072640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8be40367e0 0x7f8be4038ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c018500 tx=0x7f8d0c032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d19871640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f4ba5b0 0x564e4f4bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.426+0000 7f8d19871640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f4ba5b0 0x564e4f4bca70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 realm 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4bd550 con 0x564e4f4ba5b0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4bdd50 con 0x564e4f4ba5b0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4be0b0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f4bedc0 0x564e4f4c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c17c0 con 0x564e4f4bedc0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.427+0000 7f8d1a873640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f4bedc0 0x564e4f4c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1a873640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f4bedc0 0x564e4f4c11b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1ea11800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1ea11800 20 searching for the correct realm 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564e4f4c3730 0x564e4f4c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c62c0 con 0x564e4f4c3730 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1a072640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564e4f4c3730 0x564e4f4c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.428+0000 7f8d1a072640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564e4f4c3730 0x564e4f4c5bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.429+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.429+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c62c0 con 0x564e4f4bedc0 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.429+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.429+0000 7f8d1a873640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8d14014070 0x7f8d1402c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.429+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.429+0000 7f8d19871640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8d14014070 0x7f8d1402c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8d14014070 0x7f8d1402c5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.430+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.431+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.431+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.431+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.431+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4bedc0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.431+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.431+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.432+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4bedc0 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.433+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.434+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.435+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.435+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.435+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.435+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4bedc0 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.435+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.435+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.436+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.436+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.436+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.436+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.436+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.436+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4bedc0 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4c3730 2024-02-16T00:11:20.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x7f8d14014070 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.437+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4ba5b0 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d14058040 con 0x564e4f4bedc0 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:20.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c1b30 con 0x564e4f4ba5b0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c1ee0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.438+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c22c0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 zone default found 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 4 Realm: () 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 zonegroup default 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c6700 con 0x7f8d14014070 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c8580 con 0x564e4f4c3730 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.439+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c88e0 con 0x564e4f4c3730 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.440+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.440+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.440+0000 7f8d1ea11800 20 started sync module instance, tier type = 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.440+0000 7f8d1ea11800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.440+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c7a10 con 0x564e4f4bedc0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.441+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.441+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94894337851136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c7a10 con 0x564e4f4bedc0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.441+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c9290 con 0x564e4f4ba5b0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.442+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94894337851136] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.442+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.442+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94894337854896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c7a10 con 0x564e4f4ba5b0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.442+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c9cb0 con 0x564e4f4c3730 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.443+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94894337854896] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.443+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.443+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94894337848688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c7990 con 0x564e4f4c3730 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.443+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cab40 con 0x564e4f4bedc0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.444+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94894337848688] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.445+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.445+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94894337861280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4caf60 con 0x564e4f4bedc0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.445+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cb8d0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.446+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94894337861280] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.446+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.446+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94894337865232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4caf60 con 0x564e4f4ba5b0 2024-02-16T00:11:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.446+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cc340 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.447+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.447+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94894337867296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cc300 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.447+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cd250 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.447+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94894337865232] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.448+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.448+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94894337862336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cd250 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.448+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cdc60 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.448+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94894337867296] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94894337862336] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94894337873744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4ccdb0 con 0x7f8d14014070 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=0 2024-02-16T00:11:20.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=1 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=2 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=3 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=4 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=5 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.449+0000 7f8d1ea11800 20 add_watcher() i=6 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.450+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94894337873744] v27'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.450+0000 7f8d1ea11800 20 add_watcher() i=7 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.450+0000 7f8d1ea11800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.450+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d0d60 con 0x564e4f4ba5b0 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.451+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.451+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94894337869552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4ce1d0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.452+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94894337869552] v27'32 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.452+0000 7f8bd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.452+0000 7f8d1ea11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.452+0000 7f8d1ea11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.452+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d95b0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.453+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'40 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.453+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d9bc0 con 0x7f8d14014070 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.454+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'16 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.454+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4da0f0 con 0x564e4f4c3730 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.455+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'16 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.455+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4da620 con 0x564e4f4ba5b0 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.456+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'33 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.456+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dab50 con 0x564e4f4bedc0 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.457+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'26 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.457+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4db080 con 0x564e4f4c3730 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.458+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'25 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.458+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4db5b0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.459+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.459+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dba50 con 0x7f8d14014070 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.460+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'19 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.460+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4db080 con 0x564e4f4bedc0 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.461+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.462+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dbc20 con 0x564e4f4c3730 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.462+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.463+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dc150 con 0x564e4f4bedc0 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.463+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'27 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.463+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dc680 con 0x7f8d14014070 2024-02-16T00:11:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.465+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.465+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dcb20 con 0x564e4f4bedc0 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.466+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.466+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dc7c0 con 0x7f8d14014070 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.467+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.467+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dc5f0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.468+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'34 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.468+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4dc5f0 con 0x564e4f4c3730 2024-02-16T00:11:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.469+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.469+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d7630 con 0x564e4f4bedc0 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.470+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'28 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.470+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d7be0 con 0x564e4f4c3730 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.471+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.471+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d7be0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.473+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.473+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d7190 con 0x564e4f4ba5b0 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.474+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.474+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8bf0 con 0x564e4f4c3730 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.475+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.475+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d7190 con 0x564e4f4bedc0 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.476+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'28 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.476+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.477+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.477+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.478+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.478+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.479+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.479+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.480+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.480+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x7f8d14014070 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.481+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.481+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4c3730 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.482+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.482+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x7f8d14014070 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.483+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'20 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.483+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4c3730 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.484+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.484+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x7f8d14014070 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.485+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'32 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.485+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4d8dc0 con 0x564e4f4bedc0 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.486+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8b4b7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 20 Filter name: none 2024-02-16T00:11:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8b497fa640 20 reqs_thread_entry: start 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f506210 con 0x564e4f4bedc0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.487+0000 7f8d1ea11800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.488+0000 7f8bd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.488+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94894337869552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4b7770 con 0x564e4f4ba5b0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.489+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94894337869552] v27'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.489+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94894337851136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cc6f0 con 0x564e4f4bedc0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.490+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94894337851136] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.490+0000 7f8d1ea11800 20 remove_watcher() i=0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.490+0000 7f8d1ea11800 2 removed watcher, disabling cache 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.490+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94894337854896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c7f00 con 0x564e4f4ba5b0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.491+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94894337854896] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.491+0000 7f8d1ea11800 20 remove_watcher() i=1 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.491+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94894337848688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c8db0 con 0x564e4f4c3730 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.492+0000 7f8d1a072640 1 -- 172.21.15.42:0/821820097 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94894337848688] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d0c016070 con 0x564e4f4c3730 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.492+0000 7f8d1ea11800 20 remove_watcher() i=2 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.492+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94894337861280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c8db0 con 0x564e4f4bedc0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.493+0000 7f8d1a873640 1 -- 172.21.15.42:0/821820097 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94894337861280] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d1400a4a0 con 0x564e4f4bedc0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.493+0000 7f8d1ea11800 20 remove_watcher() i=3 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.493+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94894337865232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4ca6a0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.494+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94894337865232] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x564e4f4ba5b0 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.494+0000 7f8d1ea11800 20 remove_watcher() i=4 2024-02-16T00:11:20.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.494+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94894337867296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4c8db0 con 0x7f8d14014070 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.495+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94894337867296] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.495+0000 7f8d1ea11800 20 remove_watcher() i=5 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.495+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94894337862336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4ca6a0 con 0x7f8d14014070 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.496+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94894337862336] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.496+0000 7f8d1ea11800 20 remove_watcher() i=6 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.496+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94894337873744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564e4f4cbe20 con 0x7f8d14014070 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94894337873744] v27'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d10052aa0 con 0x7f8d14014070 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 20 remove_watcher() i=7 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8d14014070 msgr2=0x7f8d1402c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8d14014070 0x7f8d1402c5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f4ba5b0 msgr2=0x564e4f4bca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f4ba5b0 0x564e4f4bca70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f4bedc0 msgr2=0x564e4f4c11b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f4bedc0 0x564e4f4c11b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564e4f4c3730 msgr2=0x564e4f4c5bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.497+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564e4f4c3730 0x564e4f4c5bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8be40367e0 msgr2=0x7f8be4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8be40367e0 0x7f8be4038ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c018500 tx=0x7f8d0c032000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d19871640 1 -- 172.21.15.42:0/821820097 reap_dead start 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 msgr2=0x564e4f4ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4ae850 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8d14014a50 tx=0x7f8d1404bf50 comp rx=0 tx=0).stop 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 shutdown_connections 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/821820097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f4a7920 0x564e4f4ae850 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 >> 172.21.15.42:0/821820097 conn(0x564e4f4a3c80 msgr2=0x564e4f4a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 shutdown_connections 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/821820097 wait complete. 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8bf40367e0 msgr2=0x7f8bf4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8bf40367e0 0x7f8bf4038ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x564e4f487050 tx=0x7f8d0c040040 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 msgr2=0x564e4f49ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 0x564e4f49ab00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x564e4f4804d0 tx=0x7f8d14018830 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 shutdown_connections 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8bf40367e0 0x7f8bf4038ca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3975840514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f49a6e0 0x564e4f49ab00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 >> 172.21.15.42:0/3975840514 conn(0x564e4f48e780 msgr2=0x564e4f48eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 shutdown_connections 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3975840514 wait complete. 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f38a280 msgr2=0x564e4f486640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f38a280 0x564e4f486640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f488e90 msgr2=0x564e4f48b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.498+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f488e90 0x564e4f48b280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c000367e0 msgr2=0x7f8c00038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c000367e0 0x7f8c00038ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8d10054000 tx=0x7f8d1004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 msgr2=0x564e4f47f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f47f900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x564e4f385a90 tx=0x7f8d0c000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 shutdown_connections 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564e4f488e90 0x564e4f48b280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564e4f38a280 0x564e4f486640 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c000367e0 0x7f8c00038ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 --2- 172.21.15.42:0/3033543674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4f2f9100 0x564e4f47f900 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 >> 172.21.15.42:0/3033543674 conn(0x564e4f3804d0 msgr2=0x564e4f384ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 shutdown_connections 2024-02-16T00:11:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.499+0000 7f8d1ea11800 1 -- 172.21.15.42:0/3033543674 wait complete. 2024-02-16T00:11:20.516 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T00:11:20.516 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-02-16T00:11:20.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-02-16T00:11:20.517 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-02-16T00:11:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:20.599 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda3024800 1 Processor -- start 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda3024800 1 -- start start 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda3024800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d6aa7b8510 0x55d6aa7ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda3024800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d6aa6febb0 con 0x55d6aa7b4a00 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda3024800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d6aa6b6450 con 0x55d6aa7b8510 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda0322640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d6aa7b8510 0x55d6aa7ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda0b23640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55d6aa7b4a00 0x55d6aa7b6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60084/0 (socket says 172.21.15.42:60084) 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda0b23640 1 -- 172.21.15.42:0/3865995177 learned_addr learned my addr 172.21.15.42:0/3865995177 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda0322640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d6aa7b8510 0x55d6aa7ba900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57808/0 (socket says 172.21.15.42:57808) 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda0322640 1 -- 172.21.15.42:0/3865995177 >> v1:172.21.15.2:6789/0 conn(0x55d6aa7b4a00 legacy=0x55d6aa7b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.597+0000 7feda0322640 1 -- 172.21.15.42:0/3865995177 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6aa7bbe50 con 0x55d6aa7b8510 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.599+0000 7feda0322640 1 --2- 172.21.15.42:0/3865995177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b8510 0x55d6aa7ba900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed9400a470 tx=0x7fed9401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5c15e4e5d2e3fd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.599+0000 7fed9fb21640 1 -- 172.21.15.42:0/3865995177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed94052570 con 0x55d6aa7b8510 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.599+0000 7fed9fb21640 1 -- 172.21.15.42:0/3865995177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed940526d0 con 0x55d6aa7b8510 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.599+0000 7fed9fb21640 1 -- 172.21.15.42:0/3865995177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed94052990 con 0x55d6aa7b8510 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 -- 172.21.15.42:0/3865995177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b8510 msgr2=0x55d6aa7ba900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 --2- 172.21.15.42:0/3865995177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b8510 0x55d6aa7ba900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed9400a470 tx=0x7fed9401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 -- 172.21.15.42:0/3865995177 shutdown_connections 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 --2- 172.21.15.42:0/3865995177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b8510 0x55d6aa7ba900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 -- 172.21.15.42:0/3865995177 >> 172.21.15.42:0/3865995177 conn(0x55d6aa7ae4d0 msgr2=0x55d6aa7b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 -- 172.21.15.42:0/3865995177 shutdown_connections 2024-02-16T00:11:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.600+0000 7feda3024800 1 -- 172.21.15.42:0/3865995177 wait complete. 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.611+0000 7feda3024800 1 Processor -- start 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.611+0000 7feda3024800 1 -- start start 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.611+0000 7feda3024800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa7b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.611+0000 7feda3024800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aa6b3980 con 0x55d6aa7b4a00 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7feda0b23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa7b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7feda0b23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa7b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57816/0 (socket says 172.21.15.42:57816) 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7feda0b23640 1 -- 172.21.15.42:0/4268015684 learned_addr learned my addr 172.21.15.42:0/4268015684 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7feda0b23640 1 -- 172.21.15.42:0/4268015684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94005d20 con 0x55d6aa7b4a00 2024-02-16T00:11:20.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7feda0b23640 1 --2- 172.21.15.42:0/4268015684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa7b4340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed900014a0 tx=0x7fed90001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59655ea036bade31 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7fec8ee0d640 1 -- 172.21.15.42:0/4268015684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed90004520 con 0x55d6aa7b4a00 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7fec8ee0d640 1 -- 172.21.15.42:0/4268015684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90004680 con 0x55d6aa7b4a00 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.612+0000 7fec8ee0d640 1 -- 172.21.15.42:0/4268015684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed90004980 con 0x55d6aa7b4a00 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 -- 172.21.15.42:0/4268015684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 msgr2=0x55d6aa7b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 --2- 172.21.15.42:0/4268015684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa7b4340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed900014a0 tx=0x7fed90001960 comp rx=0 tx=0).stop 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 -- 172.21.15.42:0/4268015684 shutdown_connections 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 --2- 172.21.15.42:0/4268015684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa7b4340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 -- 172.21.15.42:0/4268015684 >> 172.21.15.42:0/4268015684 conn(0x55d6aa7ae4d0 msgr2=0x55d6aa89f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 -- 172.21.15.42:0/4268015684 shutdown_connections 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 -- 172.21.15.42:0/4268015684 wait complete. 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 Processor -- start 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.613+0000 7feda3024800 1 -- start start 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda3024800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa8ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda3024800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aa6af160 con 0x55d6aa7b4a00 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda0b23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa8ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda0b23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa8ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57826/0 (socket says 172.21.15.42:57826) 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda0b23640 1 -- 172.21.15.42:0/42635784 learned_addr learned my addr 172.21.15.42:0/42635784 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda0b23640 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6aa6febb0 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda0b23640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa8ad820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed900014a0 tx=0x7fed90001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7fec8d60a640 1 -- 172.21.15.42:0/42635784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed900148b0 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7fec8d60a640 1 -- 172.21.15.42:0/42635784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90014a30 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d6aa8add60 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7fec8d60a640 1 -- 172.21.15.42:0/42635784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed90014d10 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.614+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6aa8ae240 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.615+0000 7fec8d60a640 1 -- 172.21.15.42:0/42635784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fed9001e3f0 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.615+0000 7fec8d60a640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec880367e0 0x7fec88038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.615+0000 7fec8d60a640 1 -- 172.21.15.42:0/42635784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fed9004c360 con 0x55d6aa7b4a00 2024-02-16T00:11:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda0322640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec880367e0 0x7fec88038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa7b8510 0x55d6aa8b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8b4b30 con 0x55d6aa7b8510 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda1324640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa7b8510 0x55d6aa8b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda0322640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec880367e0 0x7fec88038ca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed94054000 tx=0x7fed9404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda1324640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa7b8510 0x55d6aa8b4560 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda1324640 1 -- 172.21.15.42:0/42635784 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa7b8510 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.616+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8b1c10 con 0x55d6aa7b8510 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda1324640 1 -- 172.21.15.42:0/42635784 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa7b8510 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8b6d70 0x55d6aa8b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8b9860 con 0x55d6aa8b6d70 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda0b23640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8b6d70 0x55d6aa8b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda0b23640 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8b6d70 0x55d6aa8b9160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda0b23640 1 -- 172.21.15.42:0/42635784 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8b6d70 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.617+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8b5cc0 con 0x55d6aa7b8510 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda1324640 1 -- 172.21.15.42:0/42635784 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa7b8510 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8b60b0 con 0x55d6aa7b8510 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda1324640 1 -- 172.21.15.42:0/42635784 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa7b8510 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda3024800 1 Processor -- start 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda3024800 1 -- start start 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda3024800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 0x55d6aa8c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.618+0000 7feda3024800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aa651e80 con 0x55d6aa8c8630 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda1324640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 0x55d6aa8c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda1324640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 0x55d6aa8c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57832/0 (socket says 172.21.15.42:57832) 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda1324640 1 -- 172.21.15.42:0/1134582681 learned_addr learned my addr 172.21.15.42:0/1134582681 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda1324640 1 -- 172.21.15.42:0/1134582681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6aa8c8f90 con 0x55d6aa8c8630 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda1324640 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 0x55d6aa8c8a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55d6aa8aec20 tx=0x7fed9800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7fec867fc640 1 -- 172.21.15.42:0/1134582681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed9800f040 con 0x55d6aa8c8630 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7fec867fc640 1 -- 172.21.15.42:0/1134582681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed98007d20 con 0x55d6aa8c8630 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d6aa8c9a00 con 0x55d6aa8c8630 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7fec867fc640 1 -- 172.21.15.42:0/1134582681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed98019420 con 0x55d6aa8c8630 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.619+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6aa8c9ec0 con 0x55d6aa8c8630 2024-02-16T00:11:20.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.620+0000 7fec867fc640 1 -- 172.21.15.42:0/1134582681 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fed98019580 con 0x55d6aa8c8630 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.620+0000 7fec867fc640 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec78036830 0x7fec78038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.620+0000 7fec867fc640 1 -- 172.21.15.42:0/1134582681 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fed9804e050 con 0x55d6aa8c8630 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.620+0000 7feda0b23640 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec78036830 0x7fec78038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda3024800 1 Processor -- start 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda3024800 1 -- start start 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda0b23640 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec78036830 0x7fec78038cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed9004a770 tx=0x7fed90040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda3024800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda3024800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aa6275d0 con 0x55d6aa8d5860 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda1324640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda1324640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8d5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57844/0 (socket says 172.21.15.42:57844) 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda1324640 1 -- 172.21.15.42:0/3174634278 learned_addr learned my addr 172.21.15.42:0/3174634278 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda1324640 1 -- 172.21.15.42:0/3174634278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6aa8d6250 con 0x55d6aa8d5860 2024-02-16T00:11:20.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.621+0000 7feda1324640 1 --2- 172.21.15.42:0/3174634278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8d5c80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed9804c3d0 tx=0x7fed98014460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b69f42784c2d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7fec77fff640 1 -- 172.21.15.42:0/3174634278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed98019ce0 con 0x55d6aa8d5860 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7fec77fff640 1 -- 172.21.15.42:0/3174634278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed980173b0 con 0x55d6aa8d5860 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7fec77fff640 1 -- 172.21.15.42:0/3174634278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed98017ca0 con 0x55d6aa8d5860 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 -- 172.21.15.42:0/3174634278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 msgr2=0x55d6aa8d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 --2- 172.21.15.42:0/3174634278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8d5c80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed9804c3d0 tx=0x7fed98014460 comp rx=0 tx=0).stop 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 -- 172.21.15.42:0/3174634278 shutdown_connections 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 --2- 172.21.15.42:0/3174634278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8d5c80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 -- 172.21.15.42:0/3174634278 >> 172.21.15.42:0/3174634278 conn(0x55d6aa8d1b30 msgr2=0x55d6aa8cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 -- 172.21.15.42:0/3174634278 shutdown_connections 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 -- 172.21.15.42:0/3174634278 wait complete. 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.622+0000 7feda3024800 1 Processor -- start 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda3024800 1 -- start start 2024-02-16T00:11:20.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda3024800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8dc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda3024800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6aa8dcd10 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda1324640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8dc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda1324640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8dc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57856/0 (socket says 172.21.15.42:57856) 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 learned_addr learned my addr 172.21.15.42:0/933605866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6aa8c9ec0 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7feda1324640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8dc7d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed9800afd0 tx=0x7fed9804c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.623+0000 7fec767fc640 1 -- 172.21.15.42:0/933605866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed98040070 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.624+0000 7fec767fc640 1 -- 172.21.15.42:0/933605866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed98031070 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.624+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d6aa8dcf10 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.624+0000 7fec767fc640 1 -- 172.21.15.42:0/933605866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed98017a50 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.624+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6aa8dd370 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.624+0000 7fec767fc640 1 -- 172.21.15.42:0/933605866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fed9803b170 con 0x55d6aa8d5860 2024-02-16T00:11:20.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.624+0000 7fec767fc640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec6c0367e0 0x7fec6c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7fec767fc640 1 -- 172.21.15.42:0/933605866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fed98038c70 con 0x55d6aa8d5860 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda0b23640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec6c0367e0 0x7fec6c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa8e8590 0x55d6aa8eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda0b23640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec6c0367e0 0x7fec6c038ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed9004a9d0 tx=0x7fed9004c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8eb1a0 con 0x55d6aa8e8590 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda0322640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa8e8590 0x55d6aa8eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.625+0000 7feda0322640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa8e8590 0x55d6aa8eaa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fed94059040 con 0x55d6aa8e8590 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 realm 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8eb590 con 0x55d6aa8e8590 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fed94059040 con 0x55d6aa8e8590 2024-02-16T00:11:20.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8ebe10 con 0x55d6aa8e8590 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fed94059040 con 0x55d6aa8e8590 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8ec170 con 0x55d6aa8e8590 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.626+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fed94059040 con 0x55d6aa8e8590 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8ece80 0x55d6aa8ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8ef880 con 0x55d6aa8ece80 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda1324640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8ece80 0x55d6aa8ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda1324640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8ece80 0x55d6aa8ef270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 20 searching for the correct realm 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d6aa8f1b50 0x55d6aa8f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.627+0000 7feda0b23640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d6aa8f1b50 0x55d6aa8f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.628+0000 7feda0b23640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d6aa8f1b50 0x55d6aa8f4010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.628+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.628+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.628+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.628+0000 7feda1324640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fed980153e0 0x7fed980517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.628+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.629+0000 7feda0322640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fed980153e0 0x7fed980517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.629+0000 7feda0322640 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fed980153e0 0x7fed980517d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.629+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.629+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.630+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.631+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.632+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.633+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.633+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.634+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.635+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.636+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.636+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.636+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.636+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.637+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.637+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.637+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.637+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.637+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.637+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x7fed980153e0 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8e8590 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f46e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f10b0 con 0x55d6aa8e8590 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.638+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f0070 con 0x55d6aa8e8590 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f0960 con 0x55d6aa8e8590 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 zone default found 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 4 Realm: () 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 zonegroup default 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f4fc0 con 0x7fed980153e0 2024-02-16T00:11:20.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.639+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f69d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f6e40 con 0x55d6aa8f1b50 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 20 started sync module instance, tier type = 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.640+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f5f70 con 0x55d6aa8ece80 2024-02-16T00:11:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.641+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.641+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94380472886352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7260 con 0x55d6aa8ece80 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.641+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7a60 con 0x55d6aa8e8590 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.642+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94380472886352] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.642+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.642+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94380472889952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7b20 con 0x55d6aa8e8590 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.642+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f8490 con 0x55d6aa8f1b50 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.643+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94380472889952] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.643+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.643+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94380472891008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7aa0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.643+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f92f0 con 0x55d6aa8ece80 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.644+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94380472891008] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.645+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.645+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94380472897104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f9710 con 0x55d6aa8ece80 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.645+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fa080 con 0x55d6aa8e8590 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.646+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94380472897104] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.646+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.646+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94380472901056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f9710 con 0x55d6aa8e8590 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.646+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8faaa0 con 0x7fed980153e0 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.647+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.647+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94380472903072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8faa60 con 0x7fed980153e0 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.647+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fba00 con 0x7fed980153e0 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.647+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94380472901056] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.648+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94380472903072] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.648+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.648+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94380472905296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f9270 con 0x7fed980153e0 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.648+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fbea0 con 0x7fed980153e0 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94380472905296] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94380472907072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fbea0 con 0x7fed980153e0 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=0 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=1 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=2 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=3 2024-02-16T00:11:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=4 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=5 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.649+0000 7feda3024800 20 add_watcher() i=6 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.650+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94380472907072] v27'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.650+0000 7feda3024800 20 add_watcher() i=7 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.650+0000 7feda3024800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.650+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fbe80 con 0x55d6aa8e8590 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.650+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.650+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94380472910480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fcb50 con 0x55d6aa8e8590 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.652+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94380472910480] v27'37 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.652+0000 7fec56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.652+0000 7feda3024800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.652+0000 7feda3024800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.652+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fef10 con 0x55d6aa8e8590 2024-02-16T00:11:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.653+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'41 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.653+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fef10 con 0x7fed980153e0 2024-02-16T00:11:20.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.654+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'17 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.654+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa908850 con 0x55d6aa8f1b50 2024-02-16T00:11:20.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.655+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'17 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.655+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa909090 con 0x55d6aa8e8590 2024-02-16T00:11:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.656+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'38 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.656+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa9095c0 con 0x55d6aa8ece80 2024-02-16T00:11:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.657+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.657+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa909a60 con 0x55d6aa8f1b50 2024-02-16T00:11:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.658+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'27 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.658+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90a260 con 0x55d6aa8e8590 2024-02-16T00:11:20.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.659+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.659+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa907c20 con 0x7fed980153e0 2024-02-16T00:11:20.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.661+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'21 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.661+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa907c20 con 0x55d6aa8ece80 2024-02-16T00:11:20.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.662+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.662+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa907c20 con 0x55d6aa8f1b50 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.663+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.663+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90afa0 con 0x55d6aa8ece80 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.664+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'30 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.664+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa907bb0 con 0x7fed980153e0 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.665+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.665+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b440 con 0x55d6aa8ece80 2024-02-16T00:11:20.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.666+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'17 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.666+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b440 con 0x7fed980153e0 2024-02-16T00:11:20.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.667+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'33 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.667+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b440 con 0x55d6aa8e8590 2024-02-16T00:11:20.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.668+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'39 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.668+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b440 con 0x55d6aa8f1b50 2024-02-16T00:11:20.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.669+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.669+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8ece80 2024-02-16T00:11:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.670+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'31 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.670+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.671+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.671+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8e8590 2024-02-16T00:11:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.672+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.672+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8e8590 2024-02-16T00:11:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.673+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'40 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.673+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.674+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.674+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8ece80 2024-02-16T00:11:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.675+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'29 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.675+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.676+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.676+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.677+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.677+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.678+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.678+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.679+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.679+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x7fed980153e0 2024-02-16T00:11:20.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.680+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.680+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.681+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.681+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x7fed980153e0 2024-02-16T00:11:20.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.683+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'22 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.683+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8f1b50 2024-02-16T00:11:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.684+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.684+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x7fed980153e0 2024-02-16T00:11:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.685+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'34 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.685+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90b4d0 con 0x55d6aa8ece80 2024-02-16T00:11:20.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7fec55fe3640 20 reqs_thread_entry: start 2024-02-16T00:11:20.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda3024800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:20.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda3024800 20 Filter name: none 2024-02-16T00:11:20.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7febc77fe640 20 reqs_thread_entry: start 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda3024800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda3024800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa935370 con 0x7fed980153e0 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.686+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.687+0000 7feda3024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.687+0000 7feda3024800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.687+0000 7feda3024800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T00:11:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T00:11:20.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.687+0000 7fec56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.687+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94380472910480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa90a260 con 0x55d6aa8e8590 2024-02-16T00:11:20.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.688+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94380472910480] v27'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.688+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94380472886352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fc290 con 0x55d6aa8ece80 2024-02-16T00:11:20.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.689+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94380472886352] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.689+0000 7feda3024800 20 remove_watcher() i=0 2024-02-16T00:11:20.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.689+0000 7feda3024800 2 removed watcher, disabling cache 2024-02-16T00:11:20.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.689+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94380472889952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8fc290 con 0x55d6aa8e8590 2024-02-16T00:11:20.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.691+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94380472889952] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.691+0000 7feda3024800 20 remove_watcher() i=1 2024-02-16T00:11:20.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.691+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94380472891008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7260 con 0x55d6aa8f1b50 2024-02-16T00:11:20.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.692+0000 7feda0b23640 1 -- 172.21.15.42:0/933605866 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94380472891008] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed90024070 con 0x55d6aa8f1b50 2024-02-16T00:11:20.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.692+0000 7feda3024800 20 remove_watcher() i=2 2024-02-16T00:11:20.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.692+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94380472897104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7700 con 0x55d6aa8ece80 2024-02-16T00:11:20.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.693+0000 7feda1324640 1 -- 172.21.15.42:0/933605866 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94380472897104] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed980083e0 con 0x55d6aa8ece80 2024-02-16T00:11:20.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.693+0000 7feda3024800 20 remove_watcher() i=3 2024-02-16T00:11:20.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.693+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94380472901056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7700 con 0x55d6aa8e8590 2024-02-16T00:11:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.694+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94380472901056] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x55d6aa8e8590 2024-02-16T00:11:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.694+0000 7feda3024800 20 remove_watcher() i=4 2024-02-16T00:11:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.694+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94380472903072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7700 con 0x7fed980153e0 2024-02-16T00:11:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.695+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94380472903072] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.695+0000 7feda3024800 20 remove_watcher() i=5 2024-02-16T00:11:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.695+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94380472905296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7700 con 0x7fed980153e0 2024-02-16T00:11:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.696+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94380472905296] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.696+0000 7feda3024800 20 remove_watcher() i=6 2024-02-16T00:11:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.696+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94380472907072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d6aa8f7700 con 0x7fed980153e0 2024-02-16T00:11:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94380472907072] v27'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fed94071040 con 0x7fed980153e0 2024-02-16T00:11:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 20 remove_watcher() i=7 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fed980153e0 msgr2=0x7fed980517d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fed980153e0 0x7fed980517d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa8e8590 msgr2=0x55d6aa8eaa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa8e8590 0x55d6aa8eaa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8ece80 msgr2=0x55d6aa8ef270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8ece80 0x55d6aa8ef270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d6aa8f1b50 msgr2=0x55d6aa8f4010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d6aa8f1b50 0x55d6aa8f4010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec6c0367e0 msgr2=0x7fec6c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec6c0367e0 0x7fec6c038ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed9004a9d0 tx=0x7fed9004c040 comp rx=0 tx=0).stop 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 msgr2=0x55d6aa8dc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 --2- 172.21.15.42:0/933605866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8d5860 0x55d6aa8dc7d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed9800afd0 tx=0x7fed9804c330 comp rx=0 tx=0).stop 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda0322640 1 -- 172.21.15.42:0/933605866 reap_dead start 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 shutdown_connections 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 >> 172.21.15.42:0/933605866 conn(0x55d6aa8d1b30 msgr2=0x55d6aa8cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 shutdown_connections 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.697+0000 7feda3024800 1 -- 172.21.15.42:0/933605866 wait complete. 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec78036830 msgr2=0x7fec78038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec78036830 0x7fec78038cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed9004a770 tx=0x7fed90040040 comp rx=0 tx=0).stop 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 msgr2=0x55d6aa8c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 0x55d6aa8c8a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55d6aa8aec20 tx=0x7fed9800aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 shutdown_connections 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec78036830 0x7fec78038cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/1134582681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa8c8630 0x55d6aa8c8a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 >> 172.21.15.42:0/1134582681 conn(0x55d6aa8bc6d0 msgr2=0x55d6aa8bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 shutdown_connections 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/1134582681 wait complete. 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa7b8510 msgr2=0x55d6aa8b4560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa7b8510 0x55d6aa8b4560 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8b6d70 msgr2=0x55d6aa8b9160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8b6d70 0x55d6aa8b9160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec880367e0 msgr2=0x7fec88038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec880367e0 0x7fec88038ca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed94054000 tx=0x7fed9404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 msgr2=0x55d6aa8ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa8ad820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed900014a0 tx=0x7fed90001250 comp rx=0 tx=0).stop 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 shutdown_connections 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d6aa8b6d70 0x55d6aa8b9160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d6aa7b8510 0x55d6aa8b4560 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fec880367e0 0x7fec88038ca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 --2- 172.21.15.42:0/42635784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6aa7b4a00 0x55d6aa8ad820 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 >> 172.21.15.42:0/42635784 conn(0x55d6aa7ae4d0 msgr2=0x55d6aa7b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 shutdown_connections 2024-02-16T00:11:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.698+0000 7feda3024800 1 -- 172.21.15.42:0/42635784 wait complete. 2024-02-16T00:11:20.711 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T00:11:20.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T00:11:20.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T00:11:20.712 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T00:11:20.794 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:20.794 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:20.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.791+0000 7f5cfa210800 1 Processor -- start 2024-02-16T00:11:20.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.791+0000 7f5cfa210800 1 -- start start 2024-02-16T00:11:20.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cfa210800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557dedb5c890 0x557dedb5ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cfa210800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557dedaa8bb0 con 0x557dedb5d1f0 2024-02-16T00:11:20.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cfa210800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x557deda60450 con 0x557dedb5c890 2024-02-16T00:11:20.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cf59be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557dedb5c890 0x557dedb5ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cf59be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557dedb5c890 0x557dedb5ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57858/0 (socket says 172.21.15.42:57858) 2024-02-16T00:11:20.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cf51bd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x557dedb5d1f0 0x557dedb5d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60090/0 (socket says 172.21.15.42:60090) 2024-02-16T00:11:20.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cf59be640 1 -- 172.21.15.42:0/3814077641 learned_addr learned my addr 172.21.15.42:0/3814077641 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cf59be640 1 -- 172.21.15.42:0/3814077641 >> v1:172.21.15.2:6789/0 conn(0x557dedb5d1f0 legacy=0x557dedb5d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.792+0000 7f5cf59be640 1 -- 172.21.15.42:0/3814077641 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dedad1310 con 0x557dedb5c890 2024-02-16T00:11:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.794+0000 7f5cf59be640 1 --2- 172.21.15.42:0/3814077641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedb5ccb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800a520 tx=0x7f5ce801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bd29582ad84f23 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.794+0000 7f5cf49bc640 1 -- 172.21.15.42:0/3814077641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce8052570 con 0x557dedb5c890 2024-02-16T00:11:20.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.794+0000 7f5cf49bc640 1 -- 172.21.15.42:0/3814077641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80526d0 con 0x557dedb5c890 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.794+0000 7f5cf49bc640 1 -- 172.21.15.42:0/3814077641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce8052990 con 0x557dedb5c890 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 -- 172.21.15.42:0/3814077641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 msgr2=0x557dedb5ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3814077641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedb5ccb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800a520 tx=0x7f5ce801cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 -- 172.21.15.42:0/3814077641 shutdown_connections 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3814077641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedb5ccb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 -- 172.21.15.42:0/3814077641 >> 172.21.15.42:0/3814077641 conn(0x557dedb584d0 msgr2=0x557dedb5a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 -- 172.21.15.42:0/3814077641 shutdown_connections 2024-02-16T00:11:20.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.795+0000 7f5cfa210800 1 -- 172.21.15.42:0/3814077641 wait complete. 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.807+0000 7f5cfa210800 1 Processor -- start 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cfa210800 1 -- start start 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cfa210800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cfa210800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deda5d980 con 0x557dedb5c890 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cf59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cf59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57860/0 (socket says 172.21.15.42:57860) 2024-02-16T00:11:20.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cf59be640 1 -- 172.21.15.42:0/1106899015 learned_addr learned my addr 172.21.15.42:0/1106899015 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.808+0000 7f5cf59be640 1 -- 172.21.15.42:0/1106899015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8005de0 con 0x557dedb5c890 2024-02-16T00:11:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.809+0000 7f5cf59be640 1 --2- 172.21.15.42:0/1106899015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc501e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8055040 tx=0x7f5ce804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a035b742cc50b23f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.809+0000 7f5be3e07640 1 -- 172.21.15.42:0/1106899015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce8052840 con 0x557dedb5c890 2024-02-16T00:11:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.809+0000 7f5be3e07640 1 -- 172.21.15.42:0/1106899015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80529c0 con 0x557dedb5c890 2024-02-16T00:11:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.809+0000 7f5be3e07640 1 -- 172.21.15.42:0/1106899015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce8052ca0 con 0x557dedb5c890 2024-02-16T00:11:20.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- 172.21.15.42:0/1106899015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 msgr2=0x557dedc501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 --2- 172.21.15.42:0/1106899015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc501e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8055040 tx=0x7f5ce804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- 172.21.15.42:0/1106899015 shutdown_connections 2024-02-16T00:11:20.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 --2- 172.21.15.42:0/1106899015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc501e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- 172.21.15.42:0/1106899015 >> 172.21.15.42:0/1106899015 conn(0x557dedb584d0 msgr2=0x557dedc4bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- 172.21.15.42:0/1106899015 shutdown_connections 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- 172.21.15.42:0/1106899015 wait complete. 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 Processor -- start 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- start start 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc57810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cfa210800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deda59160 con 0x557dedb5c890 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cf59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc57810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cf59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc57810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57872/0 (socket says 172.21.15.42:57872) 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.810+0000 7f5cf59be640 1 -- 172.21.15.42:0/2862183361 learned_addr learned my addr 172.21.15.42:0/2862183361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5cf59be640 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dedad1310 con 0x557dedb5c890 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5cf59be640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc57810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ce801ceb0 tx=0x7f5ce8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5be2604640 1 -- 172.21.15.42:0/2862183361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce806c070 con 0x557dedb5c890 2024-02-16T00:11:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5be2604640 1 -- 172.21.15.42:0/2862183361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce805d690 con 0x557dedb5c890 2024-02-16T00:11:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557dedc57d50 con 0x557dedb5c890 2024-02-16T00:11:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5be2604640 1 -- 172.21.15.42:0/2862183361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce805d970 con 0x557dedb5c890 2024-02-16T00:11:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.811+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dedc58290 con 0x557dedb5c890 2024-02-16T00:11:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.812+0000 7f5be2604640 1 -- 172.21.15.42:0/2862183361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5ce8059040 con 0x557dedb5c890 2024-02-16T00:11:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.812+0000 7f5be2604640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bdc0367e0 0x7f5bdc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.812+0000 7f5be2604640 1 -- 172.21.15.42:0/2862183361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5ce808d8d0 con 0x557dedb5c890 2024-02-16T00:11:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.812+0000 7f5cf51bd640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bdc0367e0 0x7f5bdc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.812+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedb5d1f0 0x557dedc5e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc5ebc0 con 0x557dedb5d1f0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedb5d1f0 0x557dedc5e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cf51bd640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bdc0367e0 0x7f5bdc038ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000f60 tx=0x7f5cec001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedb5d1f0 0x557dedc5e640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cf61bf640 1 -- 172.21.15.42:0/2862183361 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedb5d1f0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc5bc00 con 0x557dedb5d1f0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.813+0000 7f5cf61bf640 1 -- 172.21.15.42:0/2862183361 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedb5d1f0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.814+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc60dd0 0x557dedc631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.814+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc63890 con 0x557dedc60dd0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.814+0000 7f5cf59be640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc60dd0 0x557dedc631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.814+0000 7f5cf59be640 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc60dd0 0x557dedc631c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.814+0000 7f5cf59be640 1 -- 172.21.15.42:0/2862183361 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5ce8078360 con 0x557dedc60dd0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.814+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc5fd50 con 0x557dedb5d1f0 2024-02-16T00:11:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.815+0000 7f5cf61bf640 1 -- 172.21.15.42:0/2862183361 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedb5d1f0 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.815+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc60160 con 0x557dedb5d1f0 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.815+0000 7f5cf61bf640 1 -- 172.21.15.42:0/2862183361 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedb5d1f0 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.815+0000 7f5cfa210800 1 Processor -- start 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.815+0000 7f5cfa210800 1 -- start start 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cfa210800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 0x557dedc72a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cfa210800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ded9fbe80 con 0x557dedc72610 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cf61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 0x557dedc72a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cf61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 0x557dedc72a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57874/0 (socket says 172.21.15.42:57874) 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cf61bf640 1 -- 172.21.15.42:0/2916303323 learned_addr learned my addr 172.21.15.42:0/2916303323 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cf61bf640 1 -- 172.21.15.42:0/2916303323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dedc72f70 con 0x557dedc72610 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 0x557dedc72a30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x557dedc58600 tx=0x7f5cf0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5bdb7fe640 1 -- 172.21.15.42:0/2916303323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf001d070 con 0x557dedc72610 2024-02-16T00:11:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5bdb7fe640 1 -- 172.21.15.42:0/2916303323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf00182e0 con 0x557dedc72610 2024-02-16T00:11:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557dedc739e0 con 0x557dedc72610 2024-02-16T00:11:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.816+0000 7f5bdb7fe640 1 -- 172.21.15.42:0/2916303323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf00145e0 con 0x557dedc72610 2024-02-16T00:11:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.817+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dedc73de0 con 0x557dedc72610 2024-02-16T00:11:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.817+0000 7f5bdb7fe640 1 -- 172.21.15.42:0/2916303323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5cf0020020 con 0x557dedc72610 2024-02-16T00:11:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.818+0000 7f5bdb7fe640 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bd00367e0 0x7f5bd0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.818+0000 7f5cf59be640 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bd00367e0 0x7f5bd0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.818+0000 7f5cf59be640 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bd00367e0 0x7f5bd0038ca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x557dedc5ef60 tx=0x7f5ce808bc50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.819+0000 7f5bdb7fe640 1 -- 172.21.15.42:0/2916303323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5cf00137b0 con 0x557dedc72610 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.819+0000 7f5cfa210800 1 Processor -- start 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.819+0000 7f5cfa210800 1 -- start start 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cfa210800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc7fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cfa210800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ded9d15d0 con 0x557dedc7f860 2024-02-16T00:11:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cf61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc7fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cf61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc7fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57876/0 (socket says 172.21.15.42:57876) 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3087668819 learned_addr learned my addr 172.21.15.42:0/3087668819 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3087668819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dedc80250 con 0x557dedc7f860 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/3087668819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc7fc80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000b010 tx=0x7f5cf0016550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ff2aa958998856 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5bd97fa640 1 -- 172.21.15.42:0/3087668819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf0034070 con 0x557dedc7f860 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5bd97fa640 1 -- 172.21.15.42:0/3087668819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf002b350 con 0x557dedc7f860 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.820+0000 7f5bd97fa640 1 -- 172.21.15.42:0/3087668819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf002bc70 con 0x557dedc7f860 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 -- 172.21.15.42:0/3087668819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 msgr2=0x557dedc7fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3087668819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc7fc80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000b010 tx=0x7f5cf0016550 comp rx=0 tx=0).stop 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 -- 172.21.15.42:0/3087668819 shutdown_connections 2024-02-16T00:11:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3087668819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc7fc80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 -- 172.21.15.42:0/3087668819 >> 172.21.15.42:0/3087668819 conn(0x557dedc7bb30 msgr2=0x557dedc79b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 -- 172.21.15.42:0/3087668819 shutdown_connections 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 -- 172.21.15.42:0/3087668819 wait complete. 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 Processor -- start 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.821+0000 7f5cfa210800 1 -- start start 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.822+0000 7f5cfa210800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc86710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.822+0000 7f5cfa210800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dedc86c50 con 0x557dedc7f860 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.822+0000 7f5cf61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc86710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.822+0000 7f5cf61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc86710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57884/0 (socket says 172.21.15.42:57884) 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.822+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 learned_addr learned my addr 172.21.15.42:0/3222071989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.822+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dedc73de0 con 0x557dedc7f860 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc86710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0011ae0 tx=0x7f5cf00059f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5bc77fe640 1 -- 172.21.15.42:0/3222071989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf0041040 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5bc77fe640 1 -- 172.21.15.42:0/3222071989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf0022c30 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557dedc86e50 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5bc77fe640 1 -- 172.21.15.42:0/3222071989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf002d450 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dedc871f0 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.823+0000 7f5bc77fe640 1 -- 172.21.15.42:0/3222071989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5cf002d5b0 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.824+0000 7f5bc77fe640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bc00367e0 0x7f5bc0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.824+0000 7f5bc77fe640 1 -- 172.21.15.42:0/3222071989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5cf0007050 con 0x557dedc7f860 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.824+0000 7f5cf59be640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bc00367e0 0x7f5bc0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.824+0000 7f5cf59be640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bc00367e0 0x7f5bc0038ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ce808bd20 tx=0x7f5ce808a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedc92470 0x557dedc94930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc95080 con 0x557dedc92470 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cf51bd640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedc92470 0x557dedc94930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cf51bd640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedc92470 0x557dedc94930 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 20 realm 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc918d0 con 0x557dedc92470 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.825+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc95b00 con 0x557dedc92470 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc96380 con 0x557dedc92470 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc96d60 0x557dedc99150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc99850 con 0x557dedc96d60 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.826+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc96d60 0x557dedc99150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc96d60 0x557dedc99150 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cfa210800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cfa210800 20 searching for the correct realm 2024-02-16T00:11:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557dedc9b7d0 0x557dedc9dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9e360 con 0x557dedc9b7d0 2024-02-16T00:11:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cf59be640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557dedc9b7d0 0x557dedc9dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.827+0000 7f5cf59be640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557dedc9b7d0 0x557dedc9dc90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.828+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.828+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9e360 con 0x557dedc96d60 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.828+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.828+0000 7f5cf61bf640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5cf00133b0 0x7f5cf002da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.828+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.828+0000 7f5cf51bd640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5cf00133b0 0x7f5cf002da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5cf00133b0 0x7f5cf002da40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.829+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc96d60 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.830+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.831+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.831+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.831+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.831+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.831+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.831+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc96d60 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.832+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.832+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.832+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.832+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.832+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.832+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.833+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.834+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.834+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.834+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.834+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc96d60 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.834+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.834+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.835+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc96d60 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc9b7d0 2024-02-16T00:11:20.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x7f5cf00133b0 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc92470 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.836+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5cf0039030 con 0x557dedc96d60 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9a0c0 con 0x557dedc92470 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9a470 con 0x557dedc92470 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.837+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9a850 con 0x557dedc92470 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 zone default found 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 4 Realm: () 2024-02-16T00:11:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 zonegroup default 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9ac40 con 0x7f5cf00133b0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca0180 con 0x557dedc9b7d0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca04e0 con 0x557dedc9b7d0 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 started sync module instance, tier type = 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.838+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9fa60 con 0x557dedc96d60 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.839+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.840+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93999348708800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedc9fe10 con 0x557dedc96d60 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.840+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca11d0 con 0x557dedc92470 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.841+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93999348708800] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.841+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.841+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93999348713888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca1300 con 0x557dedc92470 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.841+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca1dd0 con 0x557dedc9b7d0 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.842+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.842+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93999348717744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca2660 con 0x557dedc9b7d0 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.842+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca3100 con 0x557dedc96d60 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.843+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93999348713888] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.843+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.843+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93999348722656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca34b0 con 0x557dedc96d60 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.843+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93999348717744] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.843+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca3ce0 con 0x557dedc92470 2024-02-16T00:11:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.844+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93999348722656] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.845+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.845+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93999348720000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca0ed0 con 0x557dedc92470 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.845+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca4400 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.845+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.845+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93999348727552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca43c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.846+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca5330 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.846+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93999348720000] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.846+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93999348727552] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.847+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.847+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93999348731472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca45a0 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.847+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca5b80 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.847+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93999348731472] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93999348725824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca45a0 con 0x7f5cf00133b0 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=0 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=1 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=2 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=3 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=4 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=5 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.848+0000 7f5cfa210800 20 add_watcher() i=6 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.849+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93999348725824] v27'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.849+0000 7f5cfa210800 20 add_watcher() i=7 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.849+0000 7f5cfa210800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.849+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca8d00 con 0x557dedc92470 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.849+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.849+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93999348733664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca6050 con 0x557dedc92470 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.850+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93999348733664] v27'42 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.850+0000 7f5ba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.850+0000 7f5cfa210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.850+0000 7f5cfa210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.850+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca8310 con 0x557dedc92470 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.851+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'42 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.851+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedca82d0 con 0x7f5cf00133b0 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.852+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'18 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.853+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb20b0 con 0x557dedc9b7d0 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.853+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'18 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.853+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb2950 con 0x557dedc92470 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.854+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'43 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.854+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb1540 con 0x557dedc96d60 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.855+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'32 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.855+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb1540 con 0x557dedc9b7d0 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.856+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'29 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.856+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3480 con 0x557dedc92470 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.857+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.858+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3510 con 0x7f5cf00133b0 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.859+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'23 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.859+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb36e0 con 0x557dedc96d60 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.860+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.860+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc9b7d0 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.861+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.861+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3ff0 con 0x557dedc96d60 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.862+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'33 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.862+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb43d0 con 0x7f5cf00133b0 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.863+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.863+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4370 con 0x557dedc96d60 2024-02-16T00:11:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.864+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.864+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4460 con 0x7f5cf00133b0 2024-02-16T00:11:20.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.865+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.865+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4460 con 0x557dedc92470 2024-02-16T00:11:20.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.866+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'44 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.866+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb48c0 con 0x557dedc9b7d0 2024-02-16T00:11:20.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.867+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'26 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.867+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4950 con 0x557dedc96d60 2024-02-16T00:11:20.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.868+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'34 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.868+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4950 con 0x557dedc9b7d0 2024-02-16T00:11:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.869+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.869+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4b20 con 0x557dedc92470 2024-02-16T00:11:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.870+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.870+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4b20 con 0x557dedc92470 2024-02-16T00:11:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.871+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'45 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.871+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4f60 con 0x557dedc9b7d0 2024-02-16T00:11:20.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.872+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.872+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4f60 con 0x557dedc96d60 2024-02-16T00:11:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.873+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'30 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.873+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb4f60 con 0x557dedc9b7d0 2024-02-16T00:11:20.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.874+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.874+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc9b7d0 2024-02-16T00:11:20.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.875+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.875+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc9b7d0 2024-02-16T00:11:20.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.876+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.876+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc9b7d0 2024-02-16T00:11:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.877+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.877+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x7f5cf00133b0 2024-02-16T00:11:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.878+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.878+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc9b7d0 2024-02-16T00:11:20.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.879+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.879+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x7f5cf00133b0 2024-02-16T00:11:20.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.880+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.880+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc9b7d0 2024-02-16T00:11:20.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.882+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.882+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x7f5cf00133b0 2024-02-16T00:11:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.883+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'36 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.883+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcb3c70 con 0x557dedc96d60 2024-02-16T00:11:20.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5ba67fc640 20 reqs_thread_entry: start 2024-02-16T00:11:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5cfa210800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5cfa210800 20 Filter name: none 2024-02-16T00:11:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5b17fff640 20 reqs_thread_entry: start 2024-02-16T00:11:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5cfa210800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5cfa210800 20 rados->read ofs=0 len=0 2024-02-16T00:11:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.884+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde550 con 0x7f5cf00133b0 2024-02-16T00:11:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.885+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.885+0000 7f5cfa210800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.885+0000 7f5cfa210800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T00:11:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.885+0000 7f5cfa210800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T00:11:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.886+0000 7f5ba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.886+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93999348733664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde550 con 0x557dedc92470 2024-02-16T00:11:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.887+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93999348733664] v27'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.887+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93999348708800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde550 con 0x557dedc96d60 2024-02-16T00:11:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.887+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93999348708800] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.887+0000 7f5cfa210800 20 remove_watcher() i=0 2024-02-16T00:11:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.887+0000 7f5cfa210800 2 removed watcher, disabling cache 2024-02-16T00:11:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.887+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93999348713888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x557dedc92470 2024-02-16T00:11:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.889+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93999348713888] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.889+0000 7f5cfa210800 20 remove_watcher() i=1 2024-02-16T00:11:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.889+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93999348717744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x557dedc9b7d0 2024-02-16T00:11:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.890+0000 7f5cf59be640 1 -- 172.21.15.42:0/3222071989 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93999348717744] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ce80a1040 con 0x557dedc9b7d0 2024-02-16T00:11:20.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.890+0000 7f5cfa210800 20 remove_watcher() i=2 2024-02-16T00:11:20.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.890+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93999348722656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x557dedc96d60 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.891+0000 7f5cf61bf640 1 -- 172.21.15.42:0/3222071989 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93999348722656] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf000a4a0 con 0x557dedc96d60 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.891+0000 7f5cfa210800 20 remove_watcher() i=3 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.891+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93999348720000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x557dedc92470 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.892+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93999348720000] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x557dedc92470 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.892+0000 7f5cfa210800 20 remove_watcher() i=4 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.892+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93999348727552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x7f5cf00133b0 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.892+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93999348727552] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.892+0000 7f5cfa210800 20 remove_watcher() i=5 2024-02-16T00:11:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.892+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93999348731472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x7f5cf00133b0 2024-02-16T00:11:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.894+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93999348731472] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.894+0000 7f5cfa210800 20 remove_watcher() i=6 2024-02-16T00:11:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.894+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93999348725824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557dedcde510 con 0x7f5cf00133b0 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93999348725824] v27'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cec00f5c0 con 0x7f5cf00133b0 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 20 remove_watcher() i=7 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5cf00133b0 msgr2=0x7f5cf002da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5cf00133b0 0x7f5cf002da40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedc92470 msgr2=0x557dedc94930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedc92470 0x557dedc94930 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc96d60 msgr2=0x557dedc99150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc96d60 0x557dedc99150 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557dedc9b7d0 msgr2=0x557dedc9dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557dedc9b7d0 0x557dedc9dc90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bc00367e0 msgr2=0x7f5bc0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bc00367e0 0x7f5bc0038ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ce808bd20 tx=0x7f5ce808a000 comp rx=0 tx=0).stop 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 msgr2=0x557dedc86710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/3222071989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc7f860 0x557dedc86710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0011ae0 tx=0x7f5cf00059f0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 reap_dead start 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cf51bd640 1 -- 172.21.15.42:0/3222071989 reap_dead start 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 shutdown_connections 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 >> 172.21.15.42:0/3222071989 conn(0x557dedc7bb30 msgr2=0x557dedc79190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 shutdown_connections 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/3222071989 wait complete. 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bd00367e0 msgr2=0x7f5bd0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bd00367e0 0x7f5bd0038ca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x557dedc5ef60 tx=0x7f5ce808bc50 comp rx=0 tx=0).stop 2024-02-16T00:11:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 msgr2=0x557dedc72a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 0x557dedc72a30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x557dedc58600 tx=0x7f5cf0018830 comp rx=0 tx=0).stop 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 shutdown_connections 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bd00367e0 0x7f5bd0038ca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2916303323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedc72610 0x557dedc72a30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 >> 172.21.15.42:0/2916303323 conn(0x557dedc666b0 msgr2=0x557dedc66ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 shutdown_connections 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.895+0000 7f5cfa210800 1 -- 172.21.15.42:0/2916303323 wait complete. 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedb5d1f0 msgr2=0x557dedc5e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedb5d1f0 0x557dedc5e640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc60dd0 msgr2=0x557dedc631c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc60dd0 0x557dedc631c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bdc0367e0 msgr2=0x7f5bdc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bdc0367e0 0x7f5bdc038ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000f60 tx=0x7f5cec001370 comp rx=0 tx=0).stop 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 msgr2=0x557dedc57810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc57810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ce801ceb0 tx=0x7f5ce8002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 shutdown_connections 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557dedc60dd0 0x557dedc631c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557dedb5d1f0 0x557dedc5e640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5bdc0367e0 0x7f5bdc038ca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 --2- 172.21.15.42:0/2862183361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557dedb5c890 0x557dedc57810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 >> 172.21.15.42:0/2862183361 conn(0x557dedb584d0 msgr2=0x557dedc4a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 shutdown_connections 2024-02-16T00:11:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.896+0000 7f5cfa210800 1 -- 172.21.15.42:0/2862183361 wait complete. 2024-02-16T00:11:20.906 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T00:11:20.907 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T00:11:20.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T00:11:20.907 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T00:11:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.987+0000 7f3230309800 1 Processor -- start 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.987+0000 7f3230309800 1 -- start start 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.987+0000 7f3230309800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cce9905300 0x55cce99076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.987+0000 7f3230309800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cce984cbb0 con 0x55cce9900e70 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.987+0000 7f3230309800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cce9804450 con 0x55cce9905300 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.988+0000 7f322d607640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cce9905300 0x55cce99076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.988+0000 7f322de08640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55cce9900e70 0x55cce9901290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60092/0 (socket says 172.21.15.42:60092) 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.988+0000 7f322de08640 1 -- 172.21.15.42:0/725414050 learned_addr learned my addr 172.21.15.42:0/725414050 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.988+0000 7f322d607640 1 -- 172.21.15.42:0/725414050 >> v1:172.21.15.2:6789/0 conn(0x55cce9900e70 legacy=0x55cce9901290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.988+0000 7f322ce06640 1 -- 172.21.15.42:0/725414050 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415704347 0 0) 0x55cce984cbb0 con 0x55cce9900e70 2024-02-16T00:11:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.988+0000 7f322d607640 1 -- 172.21.15.42:0/725414050 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce9908d20 con 0x55cce9905300 2024-02-16T00:11:20.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f322d607640 1 --2- 172.21.15.42:0/725414050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9905300 0x55cce99076f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f321800a470 tx=0x7f321801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748f79769ca27f8f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f322ce06640 1 -- 172.21.15.42:0/725414050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3218052570 con 0x55cce9905300 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f322ce06640 1 -- 172.21.15.42:0/725414050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32180526d0 con 0x55cce9905300 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f322ce06640 1 -- 172.21.15.42:0/725414050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3218052990 con 0x55cce9905300 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f3230309800 1 -- 172.21.15.42:0/725414050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9905300 msgr2=0x55cce99076f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f3230309800 1 --2- 172.21.15.42:0/725414050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9905300 0x55cce99076f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f321800a470 tx=0x7f321801cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f3230309800 1 -- 172.21.15.42:0/725414050 shutdown_connections 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f3230309800 1 --2- 172.21.15.42:0/725414050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9905300 0x55cce99076f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.990+0000 7f3230309800 1 -- 172.21.15.42:0/725414050 >> 172.21.15.42:0/725414050 conn(0x55cce98fc4d0 msgr2=0x55cce98fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.991+0000 7f3230309800 1 -- 172.21.15.42:0/725414050 shutdown_connections 2024-02-16T00:11:20.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:20.991+0000 7f3230309800 1 -- 172.21.15.42:0/725414050 wait complete. 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f3230309800 1 Processor -- start 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f3230309800 1 -- start start 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f3230309800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce99f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f3230309800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce9801980 con 0x55cce9900e70 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f322de08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce99f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f322de08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce99f0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57894/0 (socket says 172.21.15.42:57894) 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.002+0000 7f322de08640 1 -- 172.21.15.42:0/851647859 learned_addr learned my addr 172.21.15.42:0/851647859 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.003+0000 7f322de08640 1 -- 172.21.15.42:0/851647859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3218005d20 con 0x55cce9900e70 2024-02-16T00:11:21.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.003+0000 7f322de08640 1 --2- 172.21.15.42:0/851647859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce99f0ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3220001660 tx=0x7f3220001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b4618dd61148e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.003+0000 7f311be07640 1 -- 172.21.15.42:0/851647859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3220003450 con 0x55cce9900e70 2024-02-16T00:11:21.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.003+0000 7f311be07640 1 -- 172.21.15.42:0/851647859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32200035d0 con 0x55cce9900e70 2024-02-16T00:11:21.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.003+0000 7f311be07640 1 -- 172.21.15.42:0/851647859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3220003930 con 0x55cce9900e70 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- 172.21.15.42:0/851647859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 msgr2=0x55cce99f0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 --2- 172.21.15.42:0/851647859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce99f0ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3220001660 tx=0x7f3220001b20 comp rx=0 tx=0).stop 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- 172.21.15.42:0/851647859 shutdown_connections 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 --2- 172.21.15.42:0/851647859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce99f0ef0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- 172.21.15.42:0/851647859 >> 172.21.15.42:0/851647859 conn(0x55cce98fc4d0 msgr2=0x55cce99ec690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- 172.21.15.42:0/851647859 shutdown_connections 2024-02-16T00:11:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- 172.21.15.42:0/851647859 wait complete. 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 Processor -- start 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- start start 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce9874f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.004+0000 7f3230309800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce97fd160 con 0x55cce9900e70 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f322de08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce9874f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f322de08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce9874f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57902/0 (socket says 172.21.15.42:57902) 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f322de08640 1 -- 172.21.15.42:0/2305401092 learned_addr learned my addr 172.21.15.42:0/2305401092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f322de08640 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3220006ce0 con 0x55cce9900e70 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f322de08640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce9874f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32200012e0 tx=0x7f3220001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f311a604640 1 -- 172.21.15.42:0/2305401092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3220013820 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f311a604640 1 -- 172.21.15.42:0/2305401092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220013980 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f311a604640 1 -- 172.21.15.42:0/2305401092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3220013c20 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cce99fc100 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.005+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce99fc640 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f311a604640 1 -- 172.21.15.42:0/2305401092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f322001e3e0 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f311a604640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f31140367e0 0x7f3114038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f311a604640 1 -- 172.21.15.42:0/2305401092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f322004bb50 con 0x55cce9900e70 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f322d607640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f31140367e0 0x7f3114038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9905300 0x55cce9a001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a00800 con 0x55cce9905300 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.006+0000 7f322e609640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9905300 0x55cce9a001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f322d607640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f31140367e0 0x7f3114038ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3218054000 tx=0x7f321804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f322e609640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9905300 0x55cce9a001e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f322e609640 1 -- 172.21.15.42:0/2305401092 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f32280083e0 con 0x55cce9905300 2024-02-16T00:11:21.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce99fd7a0 con 0x55cce9905300 2024-02-16T00:11:21.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f322e609640 1 -- 172.21.15.42:0/2305401092 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f32280083e0 con 0x55cce9905300 2024-02-16T00:11:21.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a02a40 0x55cce9a04e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.007+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a05530 con 0x55cce9a02a40 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.008+0000 7f322de08640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a02a40 0x55cce9a04e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.008+0000 7f322de08640 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a02a40 0x55cce9a04e30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.008+0000 7f322de08640 1 -- 172.21.15.42:0/2305401092 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a02a40 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.008+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a019c0 con 0x55cce9905300 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.008+0000 7f322e609640 1 -- 172.21.15.42:0/2305401092 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f32280083e0 con 0x55cce9905300 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.008+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a01db0 con 0x55cce9905300 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f322e609640 1 -- 172.21.15.42:0/2305401092 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f32280083e0 con 0x55cce9905300 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f3230309800 1 Processor -- start 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f3230309800 1 -- start start 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f3230309800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 0x55cce9a14730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f3230309800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce979fe80 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f322e609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 0x55cce9a14730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f322e609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 0x55cce9a14730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57904/0 (socket says 172.21.15.42:57904) 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.009+0000 7f322e609640 1 -- 172.21.15.42:0/855194125 learned_addr learned my addr 172.21.15.42:0/855194125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f322e609640 1 -- 172.21.15.42:0/855194125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce9a14c70 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f322e609640 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 0x55cce9a14730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55cce9874cb0 tx=0x7f322800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f31137fe640 1 -- 172.21.15.42:0/855194125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322800f040 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f31137fe640 1 -- 172.21.15.42:0/855194125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228007d00 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f31137fe640 1 -- 172.21.15.42:0/855194125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3228019420 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cce9a156e0 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.010+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce9a15ba0 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f31137fe640 1 -- 172.21.15.42:0/855194125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3228019580 con 0x55cce9a14310 2024-02-16T00:11:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f31137fe640 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3108036830 0x7f3108038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f31137fe640 1 -- 172.21.15.42:0/855194125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f322804e030 con 0x55cce9a14310 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f322de08640 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3108036830 0x7f3108038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f3230309800 1 Processor -- start 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f3230309800 1 -- start start 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.011+0000 7f322de08640 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3108036830 0x7f3108038cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55cce9a00c00 tx=0x7f3220010360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f3230309800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a219b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f3230309800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce97755d0 con 0x55cce9a21590 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f322e609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f322e609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a219b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57906/0 (socket says 172.21.15.42:57906) 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f322e609640 1 -- 172.21.15.42:0/2643045344 learned_addr learned my addr 172.21.15.42:0/2643045344 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f322e609640 1 -- 172.21.15.42:0/2643045344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce9a21f80 con 0x55cce9a21590 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f322e609640 1 --2- 172.21.15.42:0/2643045344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a219b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3228017d40 tx=0x7f3228014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59700d9431584cc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f31117fa640 1 -- 172.21.15.42:0/2643045344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3228040bf0 con 0x55cce9a21590 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f31117fa640 1 -- 172.21.15.42:0/2643045344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228040d50 con 0x55cce9a21590 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.012+0000 7f31117fa640 1 -- 172.21.15.42:0/2643045344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32280153e0 con 0x55cce9a21590 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- 172.21.15.42:0/2643045344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 msgr2=0x55cce9a219b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 --2- 172.21.15.42:0/2643045344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a219b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3228017d40 tx=0x7f3228014ef0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- 172.21.15.42:0/2643045344 shutdown_connections 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 --2- 172.21.15.42:0/2643045344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a219b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- 172.21.15.42:0/2643045344 >> 172.21.15.42:0/2643045344 conn(0x55cce9a1d8f0 msgr2=0x55cce9a1b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- 172.21.15.42:0/2643045344 shutdown_connections 2024-02-16T00:11:21.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- 172.21.15.42:0/2643045344 wait complete. 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 Processor -- start 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- start start 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a28510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f3230309800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce9a28a50 con 0x55cce9a21590 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f322e609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a28510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f322e609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a28510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57908/0 (socket says 172.21.15.42:57908) 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.013+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 learned_addr learned my addr 172.21.15.42:0/992967372 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce9a15ba0 con 0x55cce9a21590 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f322e609640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a28510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3228017d40 tx=0x7f322804c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f30ff7fe640 1 -- 172.21.15.42:0/992967372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3228040050 con 0x55cce9a21590 2024-02-16T00:11:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f30ff7fe640 1 -- 172.21.15.42:0/992967372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228023410 con 0x55cce9a21590 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cce9a28c50 con 0x55cce9a21590 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f30ff7fe640 1 -- 172.21.15.42:0/992967372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32280236b0 con 0x55cce9a21590 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.014+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce9a290b0 con 0x55cce9a21590 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f30ff7fe640 1 -- 172.21.15.42:0/992967372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f322804f030 con 0x55cce9a21590 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f30ff7fe640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f30f80367e0 0x7f30f8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f30ff7fe640 1 -- 172.21.15.42:0/992967372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3228037c60 con 0x55cce9a21590 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f322de08640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f30f80367e0 0x7f30f8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f322de08640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f30f80367e0 0x7f30f8038ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32200103f0 tx=0x7f3220047000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9a34290 0x55cce9a36750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a36ea0 con 0x55cce9a34290 2024-02-16T00:11:21.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.015+0000 7f322d607640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9a34290 0x55cce9a36750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f322d607640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9a34290 0x55cce9a36750 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 realm 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a37230 con 0x55cce9a34290 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a37ab0 con 0x55cce9a34290 2024-02-16T00:11:21.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.016+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a37e10 con 0x55cce9a34290 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a38b20 0x55cce9a3af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a3b520 con 0x55cce9a38b20 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f322e609640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a38b20 0x55cce9a3af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f322e609640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a38b20 0x55cce9a3af10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f32280083e0 con 0x55cce9a38b20 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 20 searching for the correct realm 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cce9a3d490 0x55cce9a3f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.017+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a40020 con 0x55cce9a3d490 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.018+0000 7f322de08640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cce9a3d490 0x55cce9a3f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.018+0000 7f322de08640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cce9a3d490 0x55cce9a3f950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.018+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.018+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a40020 con 0x55cce9a38b20 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32280083e0 con 0x55cce9a38b20 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322e609640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3228047040 0x7f322801a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322d607640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3228047040 0x7f322801a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322d607640 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3228047040 0x7f322801a070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.019+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.020+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a38b20 2024-02-16T00:11:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.021+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a38b20 2024-02-16T00:11:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.022+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.023+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a38b20 2024-02-16T00:11:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.024+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.025+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a38b20 2024-02-16T00:11:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.026+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.026+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a3d490 2024-02-16T00:11:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.026+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.026+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x7f3228047040 2024-02-16T00:11:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.026+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.026+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a34290 2024-02-16T00:11:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3228035070 con 0x55cce9a38b20 2024-02-16T00:11:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a3b870 con 0x55cce9a34290 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a3bc20 con 0x55cce9a34290 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.027+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a3c000 con 0x55cce9a34290 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 zone default found 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 4 Realm: () 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 zonegroup default 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a40460 con 0x7f3228047040 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a422e0 con 0x55cce9a3d490 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a42640 con 0x55cce9a3d490 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 started sync module instance, tier type = 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.028+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a418b0 con 0x55cce9a38b20 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.029+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.029+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338581536160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a418b0 con 0x55cce9a38b20 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.029+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a43060 con 0x55cce9a34290 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.030+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338581536160] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.030+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.031+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338581539648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a418b0 con 0x55cce9a34290 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.031+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a43ad0 con 0x55cce9a3d490 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.031+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.032+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338581542320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a44320 con 0x55cce9a3d490 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.032+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a44df0 con 0x55cce9a38b20 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.032+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338581539648] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.033+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.033+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338581547216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a451a0 con 0x55cce9a38b20 2024-02-16T00:11:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.033+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a45bf0 con 0x55cce9a34290 2024-02-16T00:11:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.033+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338581542320] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.034+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.034+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338581550832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a45bb0 con 0x55cce9a34290 2024-02-16T00:11:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.034+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a46640 con 0x7f3228047040 2024-02-16T00:11:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.034+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338581547216] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.035+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.035+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338581553472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a46600 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.035+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a47050 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.035+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338581550832] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.036+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338581553472] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.036+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.036+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338581533712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a43e80 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.036+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a474b0 con 0x7f3228047040 2024-02-16T00:11:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338581533712] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338581556016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a474b0 con 0x7f3228047040 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=0 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=1 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=2 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=3 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=4 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=5 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.037+0000 7f3230309800 20 add_watcher() i=6 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.038+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338581556016] v27'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.038+0000 7f3230309800 20 add_watcher() i=7 2024-02-16T00:11:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.038+0000 7f3230309800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.038+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a47490 con 0x55cce9a34290 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.038+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.038+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338581559504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a48190 con 0x55cce9a34290 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.039+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338581559504] v27'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.039+0000 7f30df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.039+0000 7f3230309800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.039+0000 7f3230309800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.039+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a4a530 con 0x55cce9a34290 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.040+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'43 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.040+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a4a530 con 0x7f3228047040 2024-02-16T00:11:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.041+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'19 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.041+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a53e90 con 0x55cce9a3d490 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.042+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'19 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.042+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a546d0 con 0x55cce9a34290 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.043+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'48 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.043+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a54c00 con 0x55cce9a38b20 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.044+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'35 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.044+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a550a0 con 0x55cce9a3d490 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.045+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'31 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.045+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a558a0 con 0x55cce9a34290 2024-02-16T00:11:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.046+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.046+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a558a0 con 0x7f3228047040 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.047+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'25 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.047+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a55990 con 0x55cce9a38b20 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.048+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.048+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a56000 con 0x55cce9a3d490 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.049+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.049+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a56530 con 0x55cce9a38b20 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.050+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'36 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.050+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a56a60 con 0x7f3228047040 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.051+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.051+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a56a60 con 0x55cce9a38b20 2024-02-16T00:11:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.052+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.052+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a56ba0 con 0x7f3228047040 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.053+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'37 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.053+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a569d0 con 0x55cce9a34290 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.054+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'49 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.054+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a569d0 con 0x55cce9a3d490 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.055+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'29 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.055+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a53260 con 0x55cce9a38b20 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.056+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'37 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.056+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.057+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.057+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a34290 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.058+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.058+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a34290 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.059+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'50 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.059+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.060+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'30 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.060+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a38b20 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.061+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'31 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.061+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.062+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.062+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.063+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'31 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.063+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.064+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.064+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.065+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.065+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x7f3228047040 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.066+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.066+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.067+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.067+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x7f3228047040 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.068+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'26 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.068+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a3d490 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.069+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.069+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x7f3228047040 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.070+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'38 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.070+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a537f0 con 0x55cce9a38b20 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.071+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.071+0000 7f30de7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.071+0000 7f3230309800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 20 Filter name: none 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f304ffff640 20 reqs_thread_entry: start 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a80950 con 0x55cce9a34290 2024-02-16T00:11:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.072+0000 7f3230309800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.073+0000 7f30df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.073+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338581559504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a304f0 con 0x55cce9a34290 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.074+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94338581559504] v27'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.074+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338581536160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a478d0 con 0x55cce9a38b20 2024-02-16T00:11:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.075+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94338581536160] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.075+0000 7f3230309800 20 remove_watcher() i=0 2024-02-16T00:11:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.075+0000 7f3230309800 2 removed watcher, disabling cache 2024-02-16T00:11:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.075+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338581539648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a478d0 con 0x55cce9a34290 2024-02-16T00:11:21.096 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T00:11:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.076+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94338581539648] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.076+0000 7f3230309800 20 remove_watcher() i=1 2024-02-16T00:11:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.076+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338581542320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a478d0 con 0x55cce9a3d490 2024-02-16T00:11:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.077+0000 7f322de08640 1 -- 172.21.15.42:0/992967372 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94338581542320] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3220013d80 con 0x55cce9a3d490 2024-02-16T00:11:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.077+0000 7f3230309800 20 remove_watcher() i=2 2024-02-16T00:11:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.077+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338581547216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a478d0 con 0x55cce9a38b20 2024-02-16T00:11:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.078+0000 7f322e609640 1 -- 172.21.15.42:0/992967372 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94338581547216] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322805d040 con 0x55cce9a38b20 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.078+0000 7f3230309800 20 remove_watcher() i=3 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.078+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338581550832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a448d0 con 0x55cce9a34290 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.079+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94338581550832] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x55cce9a34290 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.079+0000 7f3230309800 20 remove_watcher() i=4 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.079+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338581553472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a478d0 con 0x7f3228047040 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.080+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94338581553472] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.080+0000 7f3230309800 20 remove_watcher() i=5 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.080+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338581533712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a456f0 con 0x7f3228047040 2024-02-16T00:11:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.081+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94338581533712] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.081+0000 7f3230309800 20 remove_watcher() i=6 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.081+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338581556016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55cce9a46140 con 0x7f3228047040 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94338581556016] v27'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3218059040 con 0x7f3228047040 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 20 remove_watcher() i=7 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3228047040 msgr2=0x7f322801a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3228047040 0x7f322801a070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9a34290 msgr2=0x55cce9a36750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9a34290 0x55cce9a36750 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a38b20 msgr2=0x55cce9a3af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a38b20 0x55cce9a3af10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cce9a3d490 msgr2=0x55cce9a3f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cce9a3d490 0x55cce9a3f950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f30f80367e0 msgr2=0x7f30f8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f30f80367e0 0x7f30f8038ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32200103f0 tx=0x7f3220047000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 msgr2=0x55cce9a28510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a28510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3228017d40 tx=0x7f322804c310 comp rx=0 tx=0).stop 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f322d607640 1 -- 172.21.15.42:0/992967372 reap_dead start 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 shutdown_connections 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 --2- 172.21.15.42:0/992967372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a21590 0x55cce9a28510 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 >> 172.21.15.42:0/992967372 conn(0x55cce9a1d8f0 msgr2=0x55cce9a1af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 shutdown_connections 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.082+0000 7f3230309800 1 -- 172.21.15.42:0/992967372 wait complete. 2024-02-16T00:11:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3108036830 msgr2=0x7f3108038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3108036830 0x7f3108038cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55cce9a00c00 tx=0x7f3220010360 comp rx=0 tx=0).stop 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 msgr2=0x55cce9a14730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 0x55cce9a14730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55cce9874cb0 tx=0x7f322800aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 shutdown_connections 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3108036830 0x7f3108038cf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/855194125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9a14310 0x55cce9a14730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 >> 172.21.15.42:0/855194125 conn(0x55cce9a083b0 msgr2=0x55cce9a087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 shutdown_connections 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/855194125 wait complete. 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9905300 msgr2=0x55cce9a001e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9905300 0x55cce9a001e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a02a40 msgr2=0x55cce9a04e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a02a40 0x55cce9a04e30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f31140367e0 msgr2=0x7f3114038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f31140367e0 0x7f3114038ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3218054000 tx=0x7f321804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 msgr2=0x55cce9874f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce9874f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32200012e0 tx=0x7f3220001250 comp rx=0 tx=0).stop 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 shutdown_connections 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cce9a02a40 0x55cce9a04e30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cce9905300 0x55cce9a001e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f31140367e0 0x7f3114038ca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 --2- 172.21.15.42:0/2305401092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cce9900e70 0x55cce9874f70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 >> 172.21.15.42:0/2305401092 conn(0x55cce98fc4d0 msgr2=0x55cce99eaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 shutdown_connections 2024-02-16T00:11:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.083+0000 7f3230309800 1 -- 172.21.15.42:0/2305401092 wait complete. 2024-02-16T00:11:21.105 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T00:11:21.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T00:11:21.105 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-16T00:11:21.181 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:21.181 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa06352f800 1 Processor -- start 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa06352f800 1 -- start start 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa06352f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627abf543a0 0x5627abf56790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa06352f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5627abe9bc50 con 0x5627abf4ff10 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa06352f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5627abe53450 con 0x5627abf543a0 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa05eaf1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627abf543a0 0x5627abf56790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.179+0000 7fa05f2f2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5627abf4ff10 0x5627abf50330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60104/0 (socket says 172.21.15.42:60104) 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.180+0000 7fa05f2f2640 1 -- 172.21.15.42:0/3276101574 learned_addr learned my addr 172.21.15.42:0/3276101574 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.180+0000 7fa05eaf1640 1 -- 172.21.15.42:0/3276101574 >> v1:172.21.15.2:6789/0 conn(0x5627abf4ff10 legacy=0x5627abf50330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.180+0000 7fa05eaf1640 1 -- 172.21.15.42:0/3276101574 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627abf57dc0 con 0x5627abf543a0 2024-02-16T00:11:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.180+0000 7fa05e2f0640 1 -- 172.21.15.42:0/3276101574 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720508635 0 0) 0x5627abe9bc50 con 0x5627abf4ff10 2024-02-16T00:11:21.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa05eaf1640 1 --2- 172.21.15.42:0/3276101574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf543a0 0x5627abf56790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa05400a470 tx=0x7fa05401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cae4b54daf6041 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa05e2f0640 1 -- 172.21.15.42:0/3276101574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa054052570 con 0x5627abf543a0 2024-02-16T00:11:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa05e2f0640 1 -- 172.21.15.42:0/3276101574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540526d0 con 0x5627abf543a0 2024-02-16T00:11:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa05e2f0640 1 -- 172.21.15.42:0/3276101574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa054052990 con 0x5627abf543a0 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 -- 172.21.15.42:0/3276101574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf543a0 msgr2=0x5627abf56790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 --2- 172.21.15.42:0/3276101574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf543a0 0x5627abf56790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa05400a470 tx=0x7fa05401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 -- 172.21.15.42:0/3276101574 shutdown_connections 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 --2- 172.21.15.42:0/3276101574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf543a0 0x5627abf56790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 -- 172.21.15.42:0/3276101574 >> 172.21.15.42:0/3276101574 conn(0x5627abf4b590 msgr2=0x5627abf4d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 -- 172.21.15.42:0/3276101574 shutdown_connections 2024-02-16T00:11:21.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.182+0000 7fa06352f800 1 -- 172.21.15.42:0/3276101574 wait complete. 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa06352f800 1 Processor -- start 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa06352f800 1 -- start start 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa06352f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac03ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa06352f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627abe50980 con 0x5627abf4ff10 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa05f2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac03ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa05f2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac03ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57922/0 (socket says 172.21.15.42:57922) 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa05f2f2640 1 -- 172.21.15.42:0/3934820463 learned_addr learned my addr 172.21.15.42:0/3934820463 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.194+0000 7fa05f2f2640 1 -- 172.21.15.42:0/3934820463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054005d20 con 0x5627abf4ff10 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.195+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/3934820463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac03ffa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b240 tx=0x7fa05000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa31477869d40e19 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.195+0000 7f9f4d60a640 1 -- 172.21.15.42:0/3934820463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050014070 con 0x5627abf4ff10 2024-02-16T00:11:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.195+0000 7f9f4d60a640 1 -- 172.21.15.42:0/3934820463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000d500 con 0x5627abf4ff10 2024-02-16T00:11:21.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.195+0000 7f9f4d60a640 1 -- 172.21.15.42:0/3934820463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa05000d820 con 0x5627abf4ff10 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- 172.21.15.42:0/3934820463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 msgr2=0x5627ac03ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 --2- 172.21.15.42:0/3934820463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac03ffa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b240 tx=0x7fa05000b700 comp rx=0 tx=0).stop 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- 172.21.15.42:0/3934820463 shutdown_connections 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 --2- 172.21.15.42:0/3934820463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac03ffa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- 172.21.15.42:0/3934820463 >> 172.21.15.42:0/3934820463 conn(0x5627abf4b590 msgr2=0x5627ac03b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- 172.21.15.42:0/3934820463 shutdown_connections 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- 172.21.15.42:0/3934820463 wait complete. 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 Processor -- start 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- start start 2024-02-16T00:11:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac04b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa06352f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627abe4c160 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa05f2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac04b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa05f2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac04b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57924/0 (socket says 172.21.15.42:57924) 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.196+0000 7fa05f2f2640 1 -- 172.21.15.42:0/1411886647 learned_addr learned my addr 172.21.15.42:0/1411886647 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7fa05f2f2640 1 -- 172.21.15.42:0/1411886647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050001ba0 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac04b1d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f60 tx=0x7fa050000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7f9f4be07640 1 -- 172.21.15.42:0/1411886647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050019870 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7f9f4be07640 1 -- 172.21.15.42:0/1411886647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050020070 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627abec4100 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7f9f4be07640 1 -- 172.21.15.42:0/1411886647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050019b20 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.197+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627ac04b710 con 0x5627abf4ff10 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa06352f800 1 Processor -- start 2024-02-16T00:11:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa06352f800 1 -- start start 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa06352f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac055dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa06352f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627abdeee80 con 0x5627ac0559a0 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7f9f4be07640 1 -- 172.21.15.42:0/1411886647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa05000d040 con 0x5627abf4ff10 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7f9f4be07640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f44036790 0x7f9f44038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa05faf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac055dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7f9f4be07640 1 -- 172.21.15.42:0/1411886647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa05000a040 con 0x5627abf4ff10 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa05faf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac055dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57930/0 (socket says 172.21.15.42:57930) 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa05faf3640 1 -- 172.21.15.42:0/640142331 learned_addr learned my addr 172.21.15.42:0/640142331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.198+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f44036790 0x7f9f44038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa05faf3640 1 -- 172.21.15.42:0/640142331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627ac056300 con 0x5627ac0559a0 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f44036790 0x7f9f44038c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa05001cf90 tx=0x7fa050033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa05faf3640 1 --2- 172.21.15.42:0/640142331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac055dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa05800a430 tx=0x7fa05800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0bc09efcf979a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7f9f49e03640 1 -- 172.21.15.42:0/640142331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa058001650 con 0x5627ac0559a0 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7f9f49e03640 1 -- 172.21.15.42:0/640142331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0580017d0 con 0x5627ac0559a0 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7f9f49e03640 1 -- 172.21.15.42:0/640142331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa058001ab0 con 0x5627ac0559a0 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 -- 172.21.15.42:0/640142331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 msgr2=0x5627ac055dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 --2- 172.21.15.42:0/640142331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac055dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa05800a430 tx=0x7fa05800a8f0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 -- 172.21.15.42:0/640142331 shutdown_connections 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 --2- 172.21.15.42:0/640142331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac055dc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 -- 172.21.15.42:0/640142331 >> 172.21.15.42:0/640142331 conn(0x5627abf543a0 msgr2=0x5627ac052440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 -- 172.21.15.42:0/640142331 shutdown_connections 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.199+0000 7fa06352f800 1 -- 172.21.15.42:0/640142331 wait complete. 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa06352f800 1 Processor -- start 2024-02-16T00:11:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa06352f800 1 -- start start 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa06352f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac05c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa06352f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627abdc45d0 con 0x5627ac0559a0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa05faf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac05c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa05faf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac05c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57942/0 (socket says 172.21.15.42:57942) 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.200+0000 7fa05faf3640 1 -- 172.21.15.42:0/2097441593 learned_addr learned my addr 172.21.15.42:0/2097441593 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7fa05faf3640 1 -- 172.21.15.42:0/2097441593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05800a0e0 con 0x5627ac0559a0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7fa05faf3640 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac05c9b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa058000f80 tx=0x7fa058003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7f9f3bfff640 1 -- 172.21.15.42:0/2097441593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa058010a40 con 0x5627ac0559a0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7f9f3bfff640 1 -- 172.21.15.42:0/2097441593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058010ba0 con 0x5627ac0559a0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627ac05cef0 con 0x5627ac0559a0 2024-02-16T00:11:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7f9f3bfff640 1 -- 172.21.15.42:0/2097441593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa058010e80 con 0x5627ac0559a0 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.201+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627ac05d350 con 0x5627ac0559a0 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7f9f3bfff640 1 -- 172.21.15.42:0/2097441593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa058017070 con 0x5627ac0559a0 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7f9f3bfff640 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f40036790 0x7f9f40038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7f9f3bfff640 1 -- 172.21.15.42:0/2097441593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa05804bf80 con 0x5627ac0559a0 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7fa06352f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7fa06352f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7fa05eaf1640 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f40036790 0x7f9f40038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7fa06352f800 1 Processor -- start 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.202+0000 7fa06352f800 1 -- start start 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa05eaf1640 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f40036790 0x7f9f40038c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa054054000 tx=0x7fa05404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa06352f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 0x5627ac0471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa06352f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627ac0476f0 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa05f2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 0x5627ac0471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa05f2f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 0x5627ac0471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57954/0 (socket says 172.21.15.42:57954) 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa05f2f2640 1 -- 172.21.15.42:0/3000491617 learned_addr learned my addr 172.21.15.42:0/3000491617 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa05f2f2640 1 -- 172.21.15.42:0/3000491617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627ac047830 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 0x5627ac0471b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa05004aa80 tx=0x7fa05000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7f9ecffff640 1 -- 172.21.15.42:0/3000491617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa05004c3f0 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7f9ecffff640 1 -- 172.21.15.42:0/3000491617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05001c8d0 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627ac047a20 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7f9ecffff640 1 -- 172.21.15.42:0/3000491617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050018e80 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.203+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627ac047ee0 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.204+0000 7f9ecffff640 1 -- 172.21.15.42:0/3000491617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa05000f7f0 con 0x5627ac048d40 2024-02-16T00:11:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.204+0000 7f9ecffff640 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9e98036740 0x7f9e98038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.204+0000 7f9ecffff640 1 -- 172.21.15.42:0/3000491617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa05001d040 con 0x5627ac048d40 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.204+0000 7fa05eaf1640 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9e98036740 0x7f9e98038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7f9ecdffb640 20 reqs_thread_entry: start 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627ac085e00 0x5627ac0881f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627ac0888a0 con 0x5627ac085e00 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa05eaf1640 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9e98036740 0x7f9e98038c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa05401cda0 tx=0x7fa054005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa05faf3640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627ac085e00 0x5627ac0881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa05faf3640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627ac085e00 0x5627ac0881f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa05faf3640 1 -- 172.21.15.42:0/1411886647 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa05801b390 con 0x5627ac085e00 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627ac08a610 0x5627ac08ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.205+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:2 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627ac08d0d0 con 0x5627ac08a610 2024-02-16T00:11:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.206+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627ac08a610 0x5627ac08ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.206+0000 7fa05f2f2640 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627ac08a610 0x5627ac08ca00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.206+0000 7fa05f2f2640 1 -- 172.21.15.42:0/1411886647 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(2 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa050016070 con 0x5627ac08a610 2024-02-16T00:11:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.206+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627ac091ff0 con 0x5627ac08a610 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.207+0000 7fa05f2f2640 1 -- 172.21.15.42:0/1411886647 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [stat,call,call,writefull 0~875] v27'2 uv2 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7fa050016070 con 0x5627ac08a610 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f40036790 msgr2=0x7f9f40038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f40036790 0x7f9f40038c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa054054000 tx=0x7fa05404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 msgr2=0x5627ac05c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac05c9b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa058000f80 tx=0x7fa058003370 comp rx=0 tx=0).stop 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 shutdown_connections 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f40036790 0x7f9f40038c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 --2- 172.21.15.42:0/2097441593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac0559a0 0x5627ac05c9b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 >> 172.21.15.42:0/2097441593 conn(0x5627abf543a0 msgr2=0x5627ac04fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 shutdown_connections 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/2097441593 wait complete. 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9e98036740 msgr2=0x7f9e98038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9e98036740 0x7f9e98038c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa05401cda0 tx=0x7fa054005a00 comp rx=0 tx=0).stop 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 msgr2=0x5627ac0471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.208+0000 7fa06352f800 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 0x5627ac0471b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa05004aa80 tx=0x7fa05000e990 comp rx=0 tx=0).stop 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 shutdown_connections 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9e98036740 0x7f9e98038c00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/3000491617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627ac048d40 0x5627ac0471b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 >> 172.21.15.42:0/3000491617 conn(0x5627ac06bac0 msgr2=0x5627ac06c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 shutdown_connections 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/3000491617 wait complete. 2024-02-16T00:11:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627ac085e00 msgr2=0x5627ac0881f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627ac085e00 0x5627ac0881f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627ac08a610 msgr2=0x5627ac08ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627ac08a610 0x5627ac08ca00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f44036790 msgr2=0x7f9f44038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f44036790 0x7f9f44038c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa05001cf90 tx=0x7fa050033040 comp rx=0 tx=0).stop 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 msgr2=0x5627ac04b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac04b1d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f60 tx=0x7fa050000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 shutdown_connections 2024-02-16T00:11:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627ac08a610 0x5627ac08ca00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627ac085e00 0x5627ac0881f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f44036790 0x7f9f44038c50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 --2- 172.21.15.42:0/1411886647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627abf4ff10 0x5627ac04b1d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 >> 172.21.15.42:0/1411886647 conn(0x5627abf4b590 msgr2=0x5627ac03a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 shutdown_connections 2024-02-16T00:11:21.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.209+0000 7fa06352f800 1 -- 172.21.15.42:0/1411886647 wait complete. 2024-02-16T00:11:21.225 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T00:11:21.226 DEBUG:tasks.util.rgw: json result: {'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T00:11:21.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-16T00:11:21.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-16T00:11:21.228 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-16T00:11:21.268 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:21.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.266+0000 7f1f47e16800 1 Processor -- start 2024-02-16T00:11:21.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.266+0000 7f1f47e16800 1 -- start start 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.266+0000 7f1f47e16800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56285fcba2f0 0x56285fcbc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.266+0000 7f1f47e16800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56285fc01ba0 con 0x56285fcb5e60 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.266+0000 7f1f47e16800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x56285fbb9450 con 0x56285fcba2f0 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f42d60640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56285fcba2f0 0x56285fcbc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f42d60640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56285fcba2f0 0x56285fcbc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57970/0 (socket says 172.21.15.42:57970) 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f43561640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56285fcb5e60 0x56285fcb6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60114/0 (socket says 172.21.15.42:60114) 2024-02-16T00:11:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f42d60640 1 -- 172.21.15.42:0/2680793143 learned_addr learned my addr 172.21.15.42:0/2680793143 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f42d60640 1 -- 172.21.15.42:0/2680793143 >> v1:172.21.15.2:6789/0 conn(0x56285fcb5e60 legacy=0x56285fcb6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f4255f640 1 -- 172.21.15.42:0/2680793143 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487335937 0 0) 0x56285fc01ba0 con 0x56285fcb5e60 2024-02-16T00:11:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.267+0000 7f1f42d60640 1 -- 172.21.15.42:0/2680793143 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285fcbdd10 con 0x56285fcba2f0 2024-02-16T00:11:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f42d60640 1 --2- 172.21.15.42:0/2680793143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcba2f0 0x56285fcbc6e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800a520 tx=0x7f1f3801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f57f53811eb3ad3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f4255f640 1 -- 172.21.15.42:0/2680793143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f38052570 con 0x56285fcba2f0 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f4255f640 1 -- 172.21.15.42:0/2680793143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f380526d0 con 0x56285fcba2f0 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f4255f640 1 -- 172.21.15.42:0/2680793143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f38052990 con 0x56285fcba2f0 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f47e16800 1 -- 172.21.15.42:0/2680793143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcba2f0 msgr2=0x56285fcbc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f47e16800 1 --2- 172.21.15.42:0/2680793143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcba2f0 0x56285fcbc6e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800a520 tx=0x7f1f3801cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f47e16800 1 -- 172.21.15.42:0/2680793143 shutdown_connections 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f47e16800 1 --2- 172.21.15.42:0/2680793143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcba2f0 0x56285fcbc6e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f47e16800 1 -- 172.21.15.42:0/2680793143 >> 172.21.15.42:0/2680793143 conn(0x56285fcb14c0 msgr2=0x56285fcb38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.269+0000 7f1f47e16800 1 -- 172.21.15.42:0/2680793143 shutdown_connections 2024-02-16T00:11:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.270+0000 7f1f47e16800 1 -- 172.21.15.42:0/2680793143 wait complete. 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f47e16800 1 Processor -- start 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f47e16800 1 -- start start 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f47e16800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fcc1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f47e16800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285fbb6980 con 0x56285fcb5e60 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f43561640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fcc1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f43561640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fcc1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57984/0 (socket says 172.21.15.42:57984) 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f43561640 1 -- 172.21.15.42:0/3874193307 learned_addr learned my addr 172.21.15.42:0/3874193307 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.281+0000 7f1f43561640 1 -- 172.21.15.42:0/3874193307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38005de0 con 0x56285fcb5e60 2024-02-16T00:11:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.282+0000 7f1f43561640 1 --2- 172.21.15.42:0/3874193307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fcc1ac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400b240 tx=0x7f1f3400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5e5484a4853c9e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.282+0000 7f1e3160a640 1 -- 172.21.15.42:0/3874193307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f34014070 con 0x56285fcb5e60 2024-02-16T00:11:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.282+0000 7f1e3160a640 1 -- 172.21.15.42:0/3874193307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400d500 con 0x56285fcb5e60 2024-02-16T00:11:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.282+0000 7f1e3160a640 1 -- 172.21.15.42:0/3874193307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3400d820 con 0x56285fcb5e60 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- 172.21.15.42:0/3874193307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 msgr2=0x56285fcc1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3874193307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fcc1ac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400b240 tx=0x7f1f3400b700 comp rx=0 tx=0).stop 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- 172.21.15.42:0/3874193307 shutdown_connections 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3874193307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fcc1ac0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- 172.21.15.42:0/3874193307 >> 172.21.15.42:0/3874193307 conn(0x56285fcb14c0 msgr2=0x56285fda27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- 172.21.15.42:0/3874193307 shutdown_connections 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- 172.21.15.42:0/3874193307 wait complete. 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 Processor -- start 2024-02-16T00:11:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- start start 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fdb07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f47e16800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285fbb2160 con 0x56285fcb5e60 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f43561640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fdb07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f43561640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fdb07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:57990/0 (socket says 172.21.15.42:57990) 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.283+0000 7f1f43561640 1 -- 172.21.15.42:0/3537971684 learned_addr learned my addr 172.21.15.42:0/3537971684 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1f43561640 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34001ba0 con 0x56285fcb5e60 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1f43561640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fdb07c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56285fcc10f0 tx=0x7f1f34000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1e2fe07640 1 -- 172.21.15.42:0/3537971684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f34019870 con 0x56285fcb5e60 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1e2fe07640 1 -- 172.21.15.42:0/3537971684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34020070 con 0x56285fcb5e60 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56285fdb0d00 con 0x56285fcb5e60 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1e2fe07640 1 -- 172.21.15.42:0/3537971684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f34019b00 con 0x56285fcb5e60 2024-02-16T00:11:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.284+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56285fdb11e0 con 0x56285fcb5e60 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1e2fe07640 1 -- 172.21.15.42:0/3537971684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1f3400d040 con 0x56285fcb5e60 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1e2fe07640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e280367e0 0x7f1e28038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1e2fe07640 1 -- 172.21.15.42:0/3537971684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1f3400a040 con 0x56285fcb5e60 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1f42d60640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e280367e0 0x7f1e28038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fcba2f0 0x56285fdb7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdb7af0 con 0x56285fcba2f0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fcba2f0 0x56285fdb7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1f42d60640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e280367e0 0x7f1e28038ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f38054000 tx=0x7f1f3804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.285+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fcba2f0 0x56285fdb7520 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f43d62640 1 -- 172.21.15.42:0/3537971684 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fcba2f0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdb4bb0 con 0x56285fcba2f0 2024-02-16T00:11:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f43d62640 1 -- 172.21.15.42:0/3537971684 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fcba2f0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdb9d30 0x56285fdbc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdbc7f0 con 0x56285fdb9d30 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f43561640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdb9d30 0x56285fdbc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.286+0000 7f1f43561640 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdb9d30 0x56285fdbc120 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.287+0000 7f1f43561640 1 -- 172.21.15.42:0/3537971684 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdb9d30 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.287+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdb8cb0 con 0x56285fcba2f0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.287+0000 7f1f43d62640 1 -- 172.21.15.42:0/3537971684 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fcba2f0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.287+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdb90c0 con 0x56285fcba2f0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.287+0000 7f1f43d62640 1 -- 172.21.15.42:0/3537971684 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fcba2f0 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f47e16800 1 Processor -- start 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f47e16800 1 -- start start 2024-02-16T00:11:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f47e16800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 0x56285fdcb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f47e16800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285fb54e80 con 0x56285fdcb570 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f43d62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 0x56285fdcb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f43d62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 0x56285fdcb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58004/0 (socket says 172.21.15.42:58004) 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f43d62640 1 -- 172.21.15.42:0/1919991561 learned_addr learned my addr 172.21.15.42:0/1919991561 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.288+0000 7f1f43d62640 1 -- 172.21.15.42:0/1919991561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285fdcbed0 con 0x56285fdcb570 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.289+0000 7f1f43d62640 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 0x56285fdcb990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x56285fdb7e50 tx=0x7f1f3c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.289+0000 7f1e2d602640 1 -- 172.21.15.42:0/1919991561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c01d070 con 0x56285fdcb570 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.289+0000 7f1e2d602640 1 -- 172.21.15.42:0/1919991561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0182e0 con 0x56285fdcb570 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.289+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56285fdcc940 con 0x56285fdcb570 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.289+0000 7f1e2d602640 1 -- 172.21.15.42:0/1919991561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c0145e0 con 0x56285fdcb570 2024-02-16T00:11:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.289+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56285fdcce00 con 0x56285fdcb570 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1e2d602640 1 -- 172.21.15.42:0/1919991561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1f3c020020 con 0x56285fdcb570 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1e2d602640 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e1c0367e0 0x7f1e1c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1e2d602640 1 -- 172.21.15.42:0/1919991561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1f3c04dc50 con 0x56285fdcb570 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1f43561640 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e1c0367e0 0x7f1e1c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1f47e16800 1 Processor -- start 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1f47e16800 1 -- start start 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1f43561640 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e1c0367e0 0x7f1e1c038ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x56285fdb7ec0 tx=0x7f1f3401b4e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1f47e16800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fdd8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.290+0000 7f1f47e16800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285fb2a5d0 con 0x56285fdd87e0 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1f43d62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fdd8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1f43d62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fdd8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58016/0 (socket says 172.21.15.42:58016) 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1f43d62640 1 -- 172.21.15.42:0/3805153212 learned_addr learned my addr 172.21.15.42:0/3805153212 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1f43d62640 1 -- 172.21.15.42:0/3805153212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285fdd91d0 con 0x56285fdd87e0 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3805153212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fdd8c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c013010 tx=0x7f1f3c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d360d67e27c3e3bb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1e26ffd640 1 -- 172.21.15.42:0/3805153212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c016440 con 0x56285fdd87e0 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1e26ffd640 1 -- 172.21.15.42:0/3805153212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0165a0 con 0x56285fdd87e0 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.291+0000 7f1e26ffd640 1 -- 172.21.15.42:0/3805153212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c014bf0 con 0x56285fdd87e0 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- 172.21.15.42:0/3805153212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 msgr2=0x56285fdd8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3805153212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fdd8c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c013010 tx=0x7f1f3c011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- 172.21.15.42:0/3805153212 shutdown_connections 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3805153212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fdd8c00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- 172.21.15.42:0/3805153212 >> 172.21.15.42:0/3805153212 conn(0x56285fdd4af0 msgr2=0x56285fdd2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- 172.21.15.42:0/3805153212 shutdown_connections 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- 172.21.15.42:0/3805153212 wait complete. 2024-02-16T00:11:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 Processor -- start 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- start start 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fddf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f47e16800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285fddfc80 con 0x56285fdd87e0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f43d62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fddf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f43d62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fddf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58030/0 (socket says 172.21.15.42:58030) 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.292+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 learned_addr learned my addr 172.21.15.42:0/3641646337 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285fdcce00 con 0x56285fdd87e0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fddf740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c011ae0 tx=0x7f1f3c04bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1e257fa640 1 -- 172.21.15.42:0/3641646337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c0116f0 con 0x56285fdd87e0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1e257fa640 1 -- 172.21.15.42:0/3641646337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0148c0 con 0x56285fdd87e0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56285fddfe80 con 0x56285fdd87e0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1e257fa640 1 -- 172.21.15.42:0/3641646337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c0134e0 con 0x56285fdd87e0 2024-02-16T00:11:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.293+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56285fde02e0 con 0x56285fdd87e0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1e257fa640 1 -- 172.21.15.42:0/3641646337 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1f3c013640 con 0x56285fdd87e0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1e257fa640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e0c036790 0x7f1e0c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1e257fa640 1 -- 172.21.15.42:0/3641646337 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1f3c038c80 con 0x56285fdd87e0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1f43561640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e0c036790 0x7f1e0c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fdeb340 0x56285fded800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdedf50 con 0x56285fdeb340 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.294+0000 7f1f42d60640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fdeb340 0x56285fded800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f43561640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e0c036790 0x7f1e0c038c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400bc50 tx=0x7f1f34042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f42d60640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fdeb340 0x56285fded800 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 realm 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdee2e0 con 0x56285fdeb340 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdeeae0 con 0x56285fdeb340 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.295+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdeee40 con 0x56285fdeb340 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdef8f0 0x56285fdf1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdef8f0 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdef8f0 0x56285fdf1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdef8f0 0x56285fdf1ce0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 20 searching for the correct realm 2024-02-16T00:11:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56285fdf4400 0x56285fdf68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf6f70 con 0x56285fdf4400 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.296+0000 7f1f43561640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56285fdf4400 0x56285fdf68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.297+0000 7f1f43561640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56285fdf4400 0x56285fdf68a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.297+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.297+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf6f70 con 0x56285fdef8f0 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.297+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.297+0000 7f1f43d62640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1f3c04d070 0x7f1f3c02d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.297+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.298+0000 7f1f42d60640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1f3c04d070 0x7f1f3c02d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.298+0000 7f1f42d60640 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1f3c04d070 0x7f1f3c02d8d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.298+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.298+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.299+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdef8f0 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.300+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdef8f0 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.301+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.302+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdef8f0 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.303+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.304+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdef8f0 2024-02-16T00:11:21.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.305+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.305+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdf4400 2024-02-16T00:11:21.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.305+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.305+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x7f1f3c04d070 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.305+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.305+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdeb340 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2420 con 0x56285fdef8f0 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf2d20 con 0x56285fdeb340 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.306+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf30d0 con 0x56285fdeb340 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf34b0 con 0x56285fdeb340 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 zone default found 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 4 Realm: () 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 zonegroup default 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf73b0 con 0x7f1f3c04d070 2024-02-16T00:11:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf9230 con 0x56285fdf4400 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.307+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf9590 con 0x56285fdf4400 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.308+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.308+0000 7f1f47e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.308+0000 7f1f47e16800 20 started sync module instance, tier type = 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.308+0000 7f1f47e16800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:21.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.308+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf86c0 con 0x56285fdef8f0 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.309+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.309+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94731407166368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf86c0 con 0x56285fdef8f0 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.309+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf9fb0 con 0x56285fdeb340 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.310+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94731407166368] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.310+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.310+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94731407170192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf86c0 con 0x56285fdeb340 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.310+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfaa50 con 0x56285fdf4400 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.311+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94731407170192] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.311+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.311+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94731407163936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf8640 con 0x56285fdf4400 2024-02-16T00:11:21.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.311+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfb8b0 con 0x56285fdef8f0 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.312+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94731407163936] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.312+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.312+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94731407176720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfbcd0 con 0x56285fdef8f0 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.312+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfc640 con 0x56285fdeb340 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.313+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.313+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94731407180192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfc600 con 0x56285fdeb340 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.313+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94731407176720] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.313+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfd5c0 con 0x7f1f3c04d070 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.314+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.314+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94731407184096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfd5c0 con 0x7f1f3c04d070 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.314+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfdf80 con 0x7f1f3c04d070 2024-02-16T00:11:21.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.315+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94731407180192] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.315+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94731407184096] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.315+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.315+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94731407177776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfdae0 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.315+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfe450 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94731407177776] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94731407187888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfe870 con 0x7f1f3c04d070 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=0 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=1 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=2 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=3 2024-02-16T00:11:21.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=4 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=5 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.316+0000 7f1f47e16800 20 add_watcher() i=6 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.317+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94731407187888] v27'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.317+0000 7f1f47e16800 20 add_watcher() i=7 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.317+0000 7f1f47e16800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.317+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe01cb0 con 0x56285fdeb340 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.317+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.318+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94731407188944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdff120 con 0x56285fdeb340 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.318+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94731407188944] v27'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 5 note: GC not initialized 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1df8fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 20 Filter name: none 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1d727fc640 20 reqs_thread_entry: start 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.319+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdef8f0 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.320+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.321+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.322+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.322+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.322+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.322+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdef8f0 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.322+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.322+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.323+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.324+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdef8f0 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.325+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdeb340 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.326+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.327+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.327+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x56285fdf4400 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.327+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.327+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe33f20 con 0x7f1f3c04d070 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.327+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.328+0000 7f1df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.328+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94731407188944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fe32f10 con 0x56285fdeb340 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.329+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94731407188944] v27'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.329+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94731407166368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfe3d0 con 0x56285fdef8f0 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.330+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94731407166368] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.330+0000 7f1f47e16800 20 remove_watcher() i=0 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.330+0000 7f1f47e16800 2 removed watcher, disabling cache 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.330+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94731407170192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfe3d0 con 0x56285fdeb340 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.331+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94731407170192] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.331+0000 7f1f47e16800 20 remove_watcher() i=1 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.331+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94731407163936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfe3d0 con 0x56285fdf4400 2024-02-16T00:11:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.332+0000 7f1f43561640 1 -- 172.21.15.42:0/3641646337 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94731407163936] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f34016070 con 0x56285fdf4400 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.332+0000 7f1f47e16800 20 remove_watcher() i=2 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.332+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94731407176720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf8220 con 0x56285fdef8f0 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.333+0000 7f1f43d62640 1 -- 172.21.15.42:0/3641646337 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94731407176720] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f3c00a4a0 con 0x56285fdef8f0 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.333+0000 7f1f47e16800 20 remove_watcher() i=3 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.333+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94731407180192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfe3d0 con 0x56285fdeb340 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.334+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94731407180192] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x56285fdeb340 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.334+0000 7f1f47e16800 20 remove_watcher() i=4 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.334+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94731407184096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdfb410 con 0x7f1f3c04d070 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.335+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94731407184096] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.335+0000 7f1f47e16800 20 remove_watcher() i=5 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.335+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94731407177776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf8220 con 0x7f1f3c04d070 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.336+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94731407177776] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.336+0000 7f1f47e16800 20 remove_watcher() i=6 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.336+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94731407187888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56285fdf8220 con 0x7f1f3c04d070 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94731407187888] v27'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1f38052aa0 con 0x7f1f3c04d070 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 20 remove_watcher() i=7 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1f3c04d070 msgr2=0x7f1f3c02d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1f3c04d070 0x7f1f3c02d8d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fdeb340 msgr2=0x56285fded800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fdeb340 0x56285fded800 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdef8f0 msgr2=0x56285fdf1ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdef8f0 0x56285fdf1ce0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56285fdf4400 msgr2=0x56285fdf68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56285fdf4400 0x56285fdf68a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e0c036790 msgr2=0x7f1e0c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e0c036790 0x7f1e0c038c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400bc50 tx=0x7f1f34042000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 msgr2=0x56285fddf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3641646337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdd87e0 0x56285fddf740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c011ae0 tx=0x7f1f3c04bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 reap_dead start 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f42d60640 1 -- 172.21.15.42:0/3641646337 reap_dead start 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 shutdown_connections 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 >> 172.21.15.42:0/3641646337 conn(0x56285fdd4af0 msgr2=0x56285fdd2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 shutdown_connections 2024-02-16T00:11:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.337+0000 7f1f47e16800 1 -- 172.21.15.42:0/3641646337 wait complete. 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e1c0367e0 msgr2=0x7f1e1c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e1c0367e0 0x7f1e1c038ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x56285fdb7ec0 tx=0x7f1f3401b4e0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 msgr2=0x56285fdcb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 0x56285fdcb990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x56285fdb7e50 tx=0x7f1f3c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 shutdown_connections 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e1c0367e0 0x7f1e1c038ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/1919991561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fdcb570 0x56285fdcb990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 >> 172.21.15.42:0/1919991561 conn(0x56285fdbf610 msgr2=0x56285fdbfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 shutdown_connections 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/1919991561 wait complete. 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fcba2f0 msgr2=0x56285fdb7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fcba2f0 0x56285fdb7520 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdb9d30 msgr2=0x56285fdbc120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdb9d30 0x56285fdbc120 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e280367e0 msgr2=0x7f1e28038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e280367e0 0x7f1e28038ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f38054000 tx=0x7f1f3804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 msgr2=0x56285fdb07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fdb07c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56285fcc10f0 tx=0x7f1f34000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 shutdown_connections 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56285fdb9d30 0x56285fdbc120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56285fcba2f0 0x56285fdb7520 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1e280367e0 0x7f1e28038ca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 --2- 172.21.15.42:0/3537971684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56285fcb5e60 0x56285fdb07c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 >> 172.21.15.42:0/3537971684 conn(0x56285fcb14c0 msgr2=0x56285fcc0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 shutdown_connections 2024-02-16T00:11:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.338+0000 7f1f47e16800 1 -- 172.21.15.42:0/3537971684 wait complete. 2024-02-16T00:11:21.370 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[],"summary":[]} 2024-02-16T00:11:21.370 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-16T00:11:21.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:21.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:21.370 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:21.451 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:21.452 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.449+0000 7fbec5a10800 1 Processor -- start 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.449+0000 7fbec5a10800 1 -- start start 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec5a10800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561fcc0ece70 0x561fcc0ed290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec5a10800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561fcc038bb0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec5a10800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x561fcbff0450 con 0x561fcc0ece70 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec11be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561fcc0ece70 0x561fcc0ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec09bd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561fcc0ee0d0 0x561fcc0ee550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60124/0 (socket says 172.21.15.42:60124) 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec11be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561fcc0ece70 0x561fcc0ed290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58042/0 (socket says 172.21.15.42:58042) 2024-02-16T00:11:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec09bd640 1 -- 172.21.15.42:0/2980564558 learned_addr learned my addr 172.21.15.42:0/2980564558 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:21.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec11be640 1 -- 172.21.15.42:0/2980564558 >> v1:172.21.15.2:6789/0 conn(0x561fcc0ee0d0 legacy=0x561fcc0ee550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.450+0000 7fbec11be640 1 -- 172.21.15.42:0/2980564558 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fcc0ed960 con 0x561fcc0ece70 2024-02-16T00:11:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.452+0000 7fbec11be640 1 --2- 172.21.15.42:0/2980564558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc0ed290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400a470 tx=0x7fbeb401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29973b4a6949aa8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.452+0000 7fbeb3fff640 1 -- 172.21.15.42:0/2980564558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbeb4052570 con 0x561fcc0ece70 2024-02-16T00:11:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.452+0000 7fbeb3fff640 1 -- 172.21.15.42:0/2980564558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb40526d0 con 0x561fcc0ece70 2024-02-16T00:11:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.452+0000 7fbeb3fff640 1 -- 172.21.15.42:0/2980564558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbeb4052990 con 0x561fcc0ece70 2024-02-16T00:11:21.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 -- 172.21.15.42:0/2980564558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 msgr2=0x561fcc0ed290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 --2- 172.21.15.42:0/2980564558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc0ed290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400a470 tx=0x7fbeb401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:21.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 -- 172.21.15.42:0/2980564558 shutdown_connections 2024-02-16T00:11:21.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 --2- 172.21.15.42:0/2980564558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc0ed290 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 -- 172.21.15.42:0/2980564558 >> 172.21.15.42:0/2980564558 conn(0x561fcc0e84d0 msgr2=0x561fcc0ea8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 -- 172.21.15.42:0/2980564558 shutdown_connections 2024-02-16T00:11:21.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.453+0000 7fbec5a10800 1 -- 172.21.15.42:0/2980564558 wait complete. 2024-02-16T00:11:21.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.464+0000 7fbec5a10800 1 Processor -- start 2024-02-16T00:11:21.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.464+0000 7fbec5a10800 1 -- start start 2024-02-16T00:11:21.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.464+0000 7fbec5a10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc060f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.464+0000 7fbec5a10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcbfed980 con 0x561fcc0ece70 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbec11be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc060f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbec11be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc060f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58050/0 (socket says 172.21.15.42:58050) 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbec11be640 1 -- 172.21.15.42:0/2465881420 learned_addr learned my addr 172.21.15.42:0/2465881420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbec11be640 1 -- 172.21.15.42:0/2465881420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4005d20 con 0x561fcc0ece70 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbec11be640 1 --2- 172.21.15.42:0/2465881420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc060f30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4055040 tx=0x7fbeb404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e03d48ba307b7c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbdaf606640 1 -- 172.21.15.42:0/2465881420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbeb400a180 con 0x561fcc0ece70 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbdaf606640 1 -- 172.21.15.42:0/2465881420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb400a2e0 con 0x561fcc0ece70 2024-02-16T00:11:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.465+0000 7fbdaf606640 1 -- 172.21.15.42:0/2465881420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbeb40529b0 con 0x561fcc0ece70 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 -- 172.21.15.42:0/2465881420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 msgr2=0x561fcc060f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 --2- 172.21.15.42:0/2465881420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc060f30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4055040 tx=0x7fbeb404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 -- 172.21.15.42:0/2465881420 shutdown_connections 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 --2- 172.21.15.42:0/2465881420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc060f30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 -- 172.21.15.42:0/2465881420 >> 172.21.15.42:0/2465881420 conn(0x561fcc0e84d0 msgr2=0x561fcc1d8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 -- 172.21.15.42:0/2465881420 shutdown_connections 2024-02-16T00:11:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 -- 172.21.15.42:0/2465881420 wait complete. 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 Processor -- start 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 -- start start 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.466+0000 7fbec5a10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc1e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec5a10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcbfe9160 con 0x561fcc0ece70 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec11be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc1e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec11be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc1e7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58054/0 (socket says 172.21.15.42:58054) 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec11be640 1 -- 172.21.15.42:0/3311822458 learned_addr learned my addr 172.21.15.42:0/3311822458 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec11be640 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb404e070 con 0x561fcc0ece70 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec11be640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc1e7ad0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005870 tx=0x7fbeb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbdade03640 1 -- 172.21.15.42:0/3311822458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbeb406a070 con 0x561fcc0ece70 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbdade03640 1 -- 172.21.15.42:0/3311822458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb4052e10 con 0x561fcc0ece70 2024-02-16T00:11:21.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbdade03640 1 -- 172.21.15.42:0/3311822458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbeb405d550 con 0x561fcc0ece70 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561fcc1e8010 con 0x561fcc0ece70 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.467+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fcc1e84f0 con 0x561fcc0ece70 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.468+0000 7fbdade03640 1 -- 172.21.15.42:0/3311822458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbeb405d6b0 con 0x561fcc0ece70 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.468+0000 7fbdade03640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbda8036790 0x7fbda8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.468+0000 7fbdade03640 1 -- 172.21.15.42:0/3311822458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbeb408d7a0 con 0x561fcc0ece70 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.468+0000 7fbec09bd640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbda8036790 0x7fbda8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc0ee0d0 0x561fcc1ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc1eecd0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec19bf640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc0ee0d0 0x561fcc1ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec09bd640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbda8036790 0x7fbda8038c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8000f60 tx=0x7fbeb80012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec19bf640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc0ee0d0 0x561fcc1ee790 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec19bf640 1 -- 172.21.15.42:0/3311822458 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbebc00a4a0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.469+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc1ef0c0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec19bf640 1 -- 172.21.15.42:0/3311822458 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbebc00a4a0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc1f0e80 0x561fcc1f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc1f3910 con 0x561fcc1f0e80 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec11be640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc1f0e80 0x561fcc1f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec11be640 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc1f0e80 0x561fcc1f3270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec11be640 1 -- 172.21.15.42:0/3311822458 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc1f0e80 2024-02-16T00:11:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc1efe00 con 0x561fcc0ee0d0 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.470+0000 7fbec19bf640 1 -- 172.21.15.42:0/3311822458 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbebc00a4a0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.471+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc1f01f0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.471+0000 7fbec19bf640 1 -- 172.21.15.42:0/3311822458 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbebc00a4a0 con 0x561fcc0ee0d0 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.471+0000 7fbec5a10800 1 Processor -- start 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.471+0000 7fbec5a10800 1 -- start start 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.471+0000 7fbec5a10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 0x561fcc202b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.471+0000 7fbec5a10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcbf8be80 con 0x561fcc202720 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 0x561fcc202b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 0x561fcc202b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58062/0 (socket says 172.21.15.42:58062) 2024-02-16T00:11:21.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec19bf640 1 -- 172.21.15.42:0/4072069168 learned_addr learned my addr 172.21.15.42:0/4072069168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec19bf640 1 -- 172.21.15.42:0/4072069168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fcc203080 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec19bf640 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 0x561fcc202b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x561fcc1e8850 tx=0x7fbebc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbda6ffd640 1 -- 172.21.15.42:0/4072069168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc01d070 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbda6ffd640 1 -- 172.21.15.42:0/4072069168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0182e0 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561fcc203af0 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbda6ffd640 1 -- 172.21.15.42:0/4072069168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0145e0 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.472+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fcc203fb0 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.473+0000 7fbda6ffd640 1 -- 172.21.15.42:0/4072069168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbebc020020 con 0x561fcc202720 2024-02-16T00:11:21.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.473+0000 7fbda6ffd640 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd9c0367e0 0x7fbd9c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.473+0000 7fbda6ffd640 1 -- 172.21.15.42:0/4072069168 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbebc04dca0 con 0x561fcc202720 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.473+0000 7fbec11be640 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd9c0367e0 0x7fbd9c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec5a10800 1 Processor -- start 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec5a10800 1 -- start start 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec11be640 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd9c0367e0 0x7fbd9c038ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x561fcc1ebe00 tx=0x7fbeb40051b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec5a10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc20fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec5a10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcbf615d0 con 0x561fcc20f960 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc20fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc20fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58066/0 (socket says 172.21.15.42:58066) 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec19bf640 1 -- 172.21.15.42:0/758106946 learned_addr learned my addr 172.21.15.42:0/758106946 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec19bf640 1 -- 172.21.15.42:0/758106946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fcc210350 con 0x561fcc20f960 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbec19bf640 1 --2- 172.21.15.42:0/758106946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc20fd80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbebc04c020 tx=0x7fbebc011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f99ae9806fadeb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.474+0000 7fbda4ff9640 1 -- 172.21.15.42:0/758106946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc04d070 con 0x561fcc20f960 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbda4ff9640 1 -- 172.21.15.42:0/758106946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc016440 con 0x561fcc20f960 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbda4ff9640 1 -- 172.21.15.42:0/758106946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc014b10 con 0x561fcc20f960 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 -- 172.21.15.42:0/758106946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 msgr2=0x561fcc20fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 --2- 172.21.15.42:0/758106946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc20fd80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbebc04c020 tx=0x7fbebc011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 -- 172.21.15.42:0/758106946 shutdown_connections 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 --2- 172.21.15.42:0/758106946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc20fd80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 -- 172.21.15.42:0/758106946 >> 172.21.15.42:0/758106946 conn(0x561fcc20bcc0 msgr2=0x561fcc209d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 -- 172.21.15.42:0/758106946 shutdown_connections 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 -- 172.21.15.42:0/758106946 wait complete. 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 Processor -- start 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 -- start start 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.475+0000 7fbec5a10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc2168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec5a10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcc216df0 con 0x561fcc20f960 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc2168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc2168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58082/0 (socket says 172.21.15.42:58082) 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 learned_addr learned my addr 172.21.15.42:0/3033526917 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fcc203fb0 con 0x561fcc20f960 2024-02-16T00:11:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec19bf640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc2168b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0118b0 tx=0x7fbebc04bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbd92ffd640 1 -- 172.21.15.42:0/3033526917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc033070 con 0x561fcc20f960 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbd92ffd640 1 -- 172.21.15.42:0/3033526917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0116f0 con 0x561fcc20f960 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561fcc216ff0 con 0x561fcc20f960 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbd92ffd640 1 -- 172.21.15.42:0/3033526917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0133b0 con 0x561fcc20f960 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.476+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fcc217450 con 0x561fcc20f960 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.477+0000 7fbd92ffd640 1 -- 172.21.15.42:0/3033526917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbebc013510 con 0x561fcc20f960 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.477+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.477+0000 7fbd92ffd640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd8c036790 0x7fbd8c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.477+0000 7fbd92ffd640 1 -- 172.21.15.42:0/3033526917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbebc039c60 con 0x561fcc20f960 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.477+0000 7fbec11be640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd8c036790 0x7fbd8c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc2225f0 0x561fcc224a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2251e0 con 0x561fcc2225f0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec09bd640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc2225f0 0x561fcc224a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec11be640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd8c036790 0x7fbd8c038c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005680 tx=0x7fbeb4084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec09bd640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc2225f0 0x561fcc224a90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec5a10800 20 realm 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.478+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc221b10 con 0x561fcc2225f0 2024-02-16T00:11:21.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc225c60 con 0x561fcc2225f0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc226170 con 0x561fcc2225f0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc226f20 0x561fcc229310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc226f20 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec19bf640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc226f20 0x561fcc229310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.479+0000 7fbec19bf640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc226f20 0x561fcc229310 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbebc00a4a0 con 0x561fcc226f20 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec5a10800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec5a10800 20 searching for the correct realm 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561fcc22b870 0x561fcc22dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22e3e0 con 0x561fcc22b870 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec11be640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561fcc22b870 0x561fcc22dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.480+0000 7fbec11be640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561fcc22b870 0x561fcc22dd10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.481+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.481+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22e3e0 con 0x561fcc226f20 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.481+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbebc00a4a0 con 0x561fcc226f20 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.481+0000 7fbec19bf640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbebc014070 0x7fbebc02c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.481+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.481+0000 7fbec09bd640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbebc014070 0x7fbebc02c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbebc014070 0x7fbebc02c840 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.482+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc226f20 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.483+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc226f20 2024-02-16T00:11:21.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.484+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.485+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.486+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.486+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.486+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.486+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.486+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.486+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc226f20 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x561fcc2225f0 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.487+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8006070 con 0x7fbebc014070 2024-02-16T00:11:21.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc226f20 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc22b870 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.488+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.489+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x7fbebc014070 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.489+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.489+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc2225f0 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.489+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.489+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc229890 con 0x561fcc226f20 2024-02-16T00:11:21.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22a190 con 0x561fcc2225f0 2024-02-16T00:11:21.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22a540 con 0x561fcc2225f0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22a920 con 0x561fcc2225f0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.490+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 zone default found 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 4 Realm: () 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 zonegroup default 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22e820 con 0x7fbebc014070 2024-02-16T00:11:21.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2306a0 con 0x561fcc22b870 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc230a00 con 0x561fcc22b870 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 started sync module instance, tier type = 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.491+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22fae0 con 0x561fcc226f20 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.492+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.492+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94694568818544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc230330 con 0x561fcc226f20 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.492+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2313f0 con 0x561fcc2225f0 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.493+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94694568818544] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.494+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.494+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94694568824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2317a0 con 0x561fcc2225f0 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.494+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2321f0 con 0x561fcc22b870 2024-02-16T00:11:21.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.495+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94694568824528] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.495+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.495+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94694568828112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2325a0 con 0x561fcc22b870 2024-02-16T00:11:21.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.495+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc232fa0 con 0x561fcc226f20 2024-02-16T00:11:21.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.496+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.496+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94694568831648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc233830 con 0x561fcc226f20 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.496+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94694568828112] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.496+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22feb0 con 0x561fcc2225f0 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.497+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.497+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94694568836576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc22feb0 con 0x561fcc2225f0 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.497+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc234cf0 con 0x7fbebc014070 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.497+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94694568831648] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.498+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.498+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94694568833872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc234cb0 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.498+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc235700 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.498+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94694568836576] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.499+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94694568833872] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.499+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.499+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94694568841792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc234810 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.499+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc235d80 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94694568843488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2361a0 con 0x7fbebc014070 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=0 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=1 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=2 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=3 2024-02-16T00:11:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=4 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=5 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94694568841792] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.500+0000 7fbec5a10800 20 add_watcher() i=6 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.501+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94694568843488] v27'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.501+0000 7fbec5a10800 20 add_watcher() i=7 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.501+0000 7fbec5a10800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.501+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc2391d0 con 0x561fcc2225f0 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.501+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.501+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94694568844544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc236600 con 0x561fcc2225f0 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.502+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94694568844544] v27'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.502+0000 7fbd777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.502+0000 7fbec5a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.502+0000 7fbec5a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.502+0000 7fbec5a10800 5 note: GC not initialized 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbd767e4640 20 reqs_thread_entry: start 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbec5a10800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbec5a10800 20 Filter name: none 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbce7fff640 20 reqs_thread_entry: start 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbec5a10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc26ab70 con 0x561fcc2225f0 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.503+0000 7fbec5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:could not fetch user info: no user info saved 2024-02-16T00:11:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.504+0000 7fbd777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.504+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94694568844544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc26ab30 con 0x561fcc2225f0 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.505+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94694568844544] v27'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.505+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94694568818544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc26ab30 con 0x561fcc226f20 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.506+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94694568818544] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.506+0000 7fbec5a10800 20 remove_watcher() i=0 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.506+0000 7fbec5a10800 2 removed watcher, disabling cache 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.506+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94694568824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc26ab30 con 0x561fcc2225f0 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.507+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94694568824528] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.507+0000 7fbec5a10800 20 remove_watcher() i=1 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.507+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94694568828112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc26ab30 con 0x561fcc22b870 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.508+0000 7fbec11be640 1 -- 172.21.15.42:0/3033526917 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94694568828112] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb4059040 con 0x561fcc22b870 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.508+0000 7fbec5a10800 20 remove_watcher() i=2 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.508+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94694568831648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc231cd0 con 0x561fcc226f20 2024-02-16T00:11:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.509+0000 7fbec19bf640 1 -- 172.21.15.42:0/3033526917 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94694568831648] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbebc061040 con 0x561fcc226f20 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.509+0000 7fbec5a10800 20 remove_watcher() i=3 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.509+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94694568836576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc231cd0 con 0x561fcc2225f0 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.510+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94694568836576] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x561fcc2225f0 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.510+0000 7fbec5a10800 20 remove_watcher() i=4 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.510+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94694568833872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc233de0 con 0x7fbebc014070 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.511+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94694568833872] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.511+0000 7fbec5a10800 20 remove_watcher() i=5 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.511+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94694568841792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc231cd0 con 0x7fbebc014070 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.512+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94694568841792] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.512+0000 7fbec5a10800 20 remove_watcher() i=6 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.512+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94694568843488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561fcc233de0 con 0x7fbebc014070 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94694568843488] v27'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbeb8037040 con 0x7fbebc014070 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 20 remove_watcher() i=7 2024-02-16T00:11:21.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbebc014070 msgr2=0x7fbebc02c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbebc014070 0x7fbebc02c840 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc2225f0 msgr2=0x561fcc224a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc2225f0 0x561fcc224a90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc226f20 msgr2=0x561fcc229310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc226f20 0x561fcc229310 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561fcc22b870 msgr2=0x561fcc22dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561fcc22b870 0x561fcc22dd10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd8c036790 msgr2=0x7fbd8c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd8c036790 0x7fbd8c038c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005680 tx=0x7fbeb4084000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 msgr2=0x561fcc2168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec09bd640 1 -- 172.21.15.42:0/3033526917 reap_dead start 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc2168b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0118b0 tx=0x7fbebc04bf80 comp rx=0 tx=0).stop 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.513+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 shutdown_connections 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3033526917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc20f960 0x561fcc2168b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 >> 172.21.15.42:0/3033526917 conn(0x561fcc20bcc0 msgr2=0x561fcc209320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 shutdown_connections 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3033526917 wait complete. 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd9c0367e0 msgr2=0x7fbd9c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd9c0367e0 0x7fbd9c038ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x561fcc1ebe00 tx=0x7fbeb40051b0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 msgr2=0x561fcc202b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 0x561fcc202b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x561fcc1e8850 tx=0x7fbebc018830 comp rx=0 tx=0).stop 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 shutdown_connections 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbd9c0367e0 0x7fbd9c038ca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/4072069168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc202720 0x561fcc202b40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 >> 172.21.15.42:0/4072069168 conn(0x561fcc1f67c0 msgr2=0x561fcc1f6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 shutdown_connections 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/4072069168 wait complete. 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc0ee0d0 msgr2=0x561fcc1ee790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc0ee0d0 0x561fcc1ee790 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc1f0e80 msgr2=0x561fcc1f3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc1f0e80 0x561fcc1f3270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbda8036790 msgr2=0x7fbda8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbda8036790 0x7fbda8038c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8000f60 tx=0x7fbeb80012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 msgr2=0x561fcc1e7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc1e7ad0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005870 tx=0x7fbeb4002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 shutdown_connections 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561fcc1f0e80 0x561fcc1f3270 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561fcc0ee0d0 0x561fcc1ee790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbda8036790 0x7fbda8038c50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 --2- 172.21.15.42:0/3311822458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fcc0ece70 0x561fcc1e7ad0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 >> 172.21.15.42:0/3311822458 conn(0x561fcc0e84d0 msgr2=0x561fcc1d7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.514+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 shutdown_connections 2024-02-16T00:11:21.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.515+0000 7fbec5a10800 1 -- 172.21.15.42:0/3311822458 wait complete. 2024-02-16T00:11:21.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-16T00:11:21.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-16T00:11:21.548 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-02-16T00:11:21.630 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:21.630 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d82340800 1 Processor -- start 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d82340800 1 -- start start 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d82340800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5565c8e92e10 0x5565c8e93230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d82340800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5565c8ddeb50 con 0x5565c8e94070 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d82340800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5565c8d96450 con 0x5565c8e92e10 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d7e044640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5565c8e92e10 0x5565c8e93230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d7e044640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5565c8e92e10 0x5565c8e93230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58084/0 (socket says 172.21.15.42:58084) 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d7e044640 1 -- 172.21.15.42:0/3229719960 learned_addr learned my addr 172.21.15.42:0/3229719960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.628+0000 7f0d7d843640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5565c8e94070 0x5565c8e944f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60134/0 (socket says 172.21.15.42:60134) 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.629+0000 7f0d7e044640 1 -- 172.21.15.42:0/3229719960 >> v1:172.21.15.2:6789/0 conn(0x5565c8e94070 legacy=0x5565c8e944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.629+0000 7f0d7e044640 1 -- 172.21.15.42:0/3229719960 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565c8e93900 con 0x5565c8e92e10 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d7e044640 1 --2- 172.21.15.42:0/3229719960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e93230 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000a520 tx=0x7f0d7001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e91c4376da10a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d7d042640 1 -- 172.21.15.42:0/3229719960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d70052570 con 0x5565c8e92e10 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d7d042640 1 -- 172.21.15.42:0/3229719960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700526d0 con 0x5565c8e92e10 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d7d042640 1 -- 172.21.15.42:0/3229719960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d70052990 con 0x5565c8e92e10 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 -- 172.21.15.42:0/3229719960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 msgr2=0x5565c8e93230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 --2- 172.21.15.42:0/3229719960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e93230 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000a520 tx=0x7f0d7001cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 -- 172.21.15.42:0/3229719960 shutdown_connections 2024-02-16T00:11:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 --2- 172.21.15.42:0/3229719960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e93230 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 -- 172.21.15.42:0/3229719960 >> 172.21.15.42:0/3229719960 conn(0x5565c8e8e470 msgr2=0x5565c8e90890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 -- 172.21.15.42:0/3229719960 shutdown_connections 2024-02-16T00:11:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.631+0000 7f0d82340800 1 -- 172.21.15.42:0/3229719960 wait complete. 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.642+0000 7f0d82340800 1 Processor -- start 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d82340800 1 -- start start 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d82340800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e06ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d82340800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565c8d93980 con 0x5565c8e92e10 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d7e044640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e06ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d7e044640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e06ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58090/0 (socket says 172.21.15.42:58090) 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d7e044640 1 -- 172.21.15.42:0/3048302810 learned_addr learned my addr 172.21.15.42:0/3048302810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.643+0000 7f0d7e044640 1 -- 172.21.15.42:0/3048302810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70005de0 con 0x5565c8e92e10 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d7e044640 1 --2- 172.21.15.42:0/3048302810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e06ed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001cf20 tx=0x7f0d7004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c1a668e2222d52 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0c6c608640 1 -- 172.21.15.42:0/3048302810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d70052840 con 0x5565c8e92e10 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0c6c608640 1 -- 172.21.15.42:0/3048302810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700529a0 con 0x5565c8e92e10 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0c6c608640 1 -- 172.21.15.42:0/3048302810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d70052c80 con 0x5565c8e92e10 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 -- 172.21.15.42:0/3048302810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 msgr2=0x5565c8e06ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 --2- 172.21.15.42:0/3048302810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e06ed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001cf20 tx=0x7f0d7004c000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 -- 172.21.15.42:0/3048302810 shutdown_connections 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 --2- 172.21.15.42:0/3048302810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8e06ed0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 -- 172.21.15.42:0/3048302810 >> 172.21.15.42:0/3048302810 conn(0x5565c8e8e470 msgr2=0x5565c8f7eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 -- 172.21.15.42:0/3048302810 shutdown_connections 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.644+0000 7f0d82340800 1 -- 172.21.15.42:0/3048302810 wait complete. 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d82340800 1 Processor -- start 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d82340800 1 -- start start 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d82340800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8f849c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d82340800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565c8d8f160 con 0x5565c8e92e10 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d7e044640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8f849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d7e044640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8f849c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58100/0 (socket says 172.21.15.42:58100) 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d7e044640 1 -- 172.21.15.42:0/2833820806 learned_addr learned my addr 172.21.15.42:0/2833820806 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.645+0000 7f0d7e044640 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7004e070 con 0x5565c8e92e10 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.646+0000 7f0d7e044640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8f849c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001ceb0 tx=0x7f0d70002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.646+0000 7f0c6ae05640 1 -- 172.21.15.42:0/2833820806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d7006c070 con 0x5565c8e92e10 2024-02-16T00:11:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.646+0000 7f0c6ae05640 1 -- 172.21.15.42:0/2833820806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7005d5b0 con 0x5565c8e92e10 2024-02-16T00:11:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.646+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565c8f84f00 con 0x5565c8e92e10 2024-02-16T00:11:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.646+0000 7f0c6ae05640 1 -- 172.21.15.42:0/2833820806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d7005d850 con 0x5565c8e92e10 2024-02-16T00:11:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.646+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565c8f83460 con 0x5565c8e92e10 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0c6ae05640 1 -- 172.21.15.42:0/2833820806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0d70059040 con 0x5565c8e92e10 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0c6ae05640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c64036790 0x7f0c64038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0c6ae05640 1 -- 172.21.15.42:0/2833820806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0d7008d460 con 0x5565c8e92e10 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0d7d843640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c64036790 0x7f0c64038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8e94070 0x5565c8f94710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8f94c50 con 0x5565c8e94070 2024-02-16T00:11:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0d7e845640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8e94070 0x5565c8f94710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0d7d843640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c64036790 0x7f0c64038c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d74000f60 tx=0x7f0d74001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.647+0000 7f0d7e845640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8e94070 0x5565c8f94710 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d7e845640 1 -- 172.21.15.42:0/2833820806 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8e94070 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8f94fb0 con 0x5565c8e94070 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d7e845640 1 -- 172.21.15.42:0/2833820806 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8e94070 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8f96d20 0x5565c8f99110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8f997b0 con 0x5565c8f96d20 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d7e044640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8f96d20 0x5565c8f99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.648+0000 7f0d7e044640 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8f96d20 0x5565c8f99110 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.649+0000 7f0d7e044640 1 -- 172.21.15.42:0/2833820806 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0d7006f370 con 0x5565c8f96d20 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.649+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8f95ca0 con 0x5565c8e94070 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.649+0000 7f0d7e845640 1 -- 172.21.15.42:0/2833820806 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8e94070 2024-02-16T00:11:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.649+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8f960b0 con 0x5565c8e94070 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.649+0000 7f0d7e845640 1 -- 172.21.15.42:0/2833820806 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8e94070 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d82340800 1 Processor -- start 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d82340800 1 -- start start 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d82340800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 0x5565c8fa8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d82340800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565c8d31e80 con 0x5565c8fa85e0 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d7e845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 0x5565c8fa8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d7e845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 0x5565c8fa8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58104/0 (socket says 172.21.15.42:58104) 2024-02-16T00:11:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d7e845640 1 -- 172.21.15.42:0/1919426869 learned_addr learned my addr 172.21.15.42:0/1919426869 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.650+0000 7f0d7e845640 1 -- 172.21.15.42:0/1919426869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565c8fa8f40 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.651+0000 7f0d7e845640 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 0x5565c8fa8a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5565c8f84f00 tx=0x7f0d78018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.651+0000 7f0c63fff640 1 -- 172.21.15.42:0/1919426869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d7801d070 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.651+0000 7f0c63fff640 1 -- 172.21.15.42:0/1919426869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d780182e0 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.651+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565c8fa99b0 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.651+0000 7f0c63fff640 1 -- 172.21.15.42:0/1919426869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d780145e0 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.651+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565c8fa9e70 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0c63fff640 1 -- 172.21.15.42:0/1919426869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0d78020020 con 0x5565c8fa85e0 2024-02-16T00:11:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0c63fff640 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c58036790 0x7f0c58038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0c63fff640 1 -- 172.21.15.42:0/1919426869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0d7804dc10 con 0x5565c8fa85e0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0d7e044640 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c58036790 0x7f0c58038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0d82340800 1 Processor -- start 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0d82340800 1 -- start start 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0d7e044640 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c58036790 0x7f0c58038c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5565c8f85070 tx=0x7f0d7005de80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0d82340800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fb5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.652+0000 7f0d82340800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565c8d075d0 con 0x5565c8fb57f0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0d7e845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fb5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0d7e845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fb5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58116/0 (socket says 172.21.15.42:58116) 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0d7e845640 1 -- 172.21.15.42:0/2004529050 learned_addr learned my addr 172.21.15.42:0/2004529050 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0d7e845640 1 -- 172.21.15.42:0/2004529050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565c8fb61e0 con 0x5565c8fb57f0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0d7e845640 1 --2- 172.21.15.42:0/2004529050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fb5c10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d78013010 tx=0x7f0d78011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36917ec839effabb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0c61ffb640 1 -- 172.21.15.42:0/2004529050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d78016440 con 0x5565c8fb57f0 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0c61ffb640 1 -- 172.21.15.42:0/2004529050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d780165a0 con 0x5565c8fb57f0 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.653+0000 7f0c61ffb640 1 -- 172.21.15.42:0/2004529050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d78014bf0 con 0x5565c8fb57f0 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- 172.21.15.42:0/2004529050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 msgr2=0x5565c8fb5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 --2- 172.21.15.42:0/2004529050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fb5c10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d78013010 tx=0x7f0d78011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- 172.21.15.42:0/2004529050 shutdown_connections 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 --2- 172.21.15.42:0/2004529050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fb5c10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- 172.21.15.42:0/2004529050 >> 172.21.15.42:0/2004529050 conn(0x5565c8fb1ba0 msgr2=0x5565c8fafc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- 172.21.15.42:0/2004529050 shutdown_connections 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- 172.21.15.42:0/2004529050 wait complete. 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 Processor -- start 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- start start 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fbc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d82340800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565c8fbcd30 con 0x5565c8fb57f0 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d7e845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fbc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d7e845640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fbc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58118/0 (socket says 172.21.15.42:58118) 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.654+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 learned_addr learned my addr 172.21.15.42:0/654990721 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565c8fa9e70 con 0x5565c8fb57f0 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0d7e845640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fbc7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d78011ae0 tx=0x7f0d7804bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0c4ffff640 1 -- 172.21.15.42:0/654990721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d780148c0 con 0x5565c8fb57f0 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0c4ffff640 1 -- 172.21.15.42:0/654990721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d780133b0 con 0x5565c8fb57f0 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565c8fbcf30 con 0x5565c8fb57f0 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0c4ffff640 1 -- 172.21.15.42:0/654990721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d78013650 con 0x5565c8fb57f0 2024-02-16T00:11:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.655+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565c8fbd390 con 0x5565c8fb57f0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0c4ffff640 1 -- 172.21.15.42:0/654990721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0d7804d410 con 0x5565c8fb57f0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0c4ffff640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c48036790 0x7f0c48038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0c4ffff640 1 -- 172.21.15.42:0/654990721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0d78038c80 con 0x5565c8fb57f0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0d7e044640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c48036790 0x7f0c48038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8fc8390 0x5565c8fca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcafa0 con 0x5565c8fc8390 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0d7e044640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c48036790 0x7f0c48038c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d70067fb0 tx=0x7f0d70057000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.656+0000 7f0d7d843640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8fc8390 0x5565c8fca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d7d843640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8fc8390 0x5565c8fca850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 realm 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fc77f0 con 0x5565c8fc8390 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcba20 con 0x5565c8fc8390 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.657+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcc2a0 con 0x5565c8fc8390 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8fccc80 0x5565c8fcf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fccc80 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d7e845640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8fccc80 0x5565c8fcf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d7e845640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8fccc80 0x5565c8fcf070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 20 searching for the correct realm 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565c8fd1a80 0x5565c8fd3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.658+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd4610 con 0x5565c8fd1a80 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.659+0000 7f0d7e044640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565c8fd1a80 0x5565c8fd3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.659+0000 7f0d7e044640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565c8fd1a80 0x5565c8fd3f40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.659+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.659+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd4610 con 0x5565c8fccc80 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.660+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.660+0000 7f0d7e845640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0d78014070 0x7f0d7804a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.660+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.660+0000 7f0d7d843640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0d78014070 0x7f0d7804a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.660+0000 7f0d7d843640 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0d78014070 0x7f0d7804a290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.661+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fccc80 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.662+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.663+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.663+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.663+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.663+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fccc80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.663+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.663+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.664+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.665+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fccc80 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.666+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.667+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.667+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.667+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.667+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fccc80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fd1a80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x7f0d78014070 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fc8390 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.668+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcf770 con 0x5565c8fccc80 2024-02-16T00:11:21.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fcfe80 con 0x5565c8fc8390 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd0230 con 0x5565c8fc8390 2024-02-16T00:11:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd0610 con 0x5565c8fc8390 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 zone default found 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 4 Realm: () 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 zonegroup default 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.669+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd0a00 con 0x7f0d78014070 2024-02-16T00:11:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd6430 con 0x5565c8fd1a80 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd6790 con 0x5565c8fd1a80 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 started sync module instance, tier type = 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.670+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5d10 con 0x5565c8fccc80 2024-02-16T00:11:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.671+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.671+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93895652104304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5c90 con 0x5565c8fccc80 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.672+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd7480 con 0x5565c8fc8390 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.672+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93895652104304] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.673+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.673+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93895652109120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd7400 con 0x5565c8fc8390 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.673+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd7d70 con 0x5565c8fd1a80 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.674+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93895652109120] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.674+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.674+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93895652110176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd7380 con 0x5565c8fd1a80 2024-02-16T00:11:21.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.674+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd8bd0 con 0x5565c8fccc80 2024-02-16T00:11:21.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.675+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93895652110176] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.675+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.675+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93895652116272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd8ff0 con 0x5565c8fccc80 2024-02-16T00:11:21.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.675+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd9960 con 0x5565c8fc8390 2024-02-16T00:11:21.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.676+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93895652116272] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.676+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.676+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93895652120224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd8ff0 con 0x5565c8fc8390 2024-02-16T00:11:21.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.676+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fda400 con 0x7f0d78014070 2024-02-16T00:11:21.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.677+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93895652120224] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.677+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.677+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93895652122336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd8ff0 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.677+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fdadc0 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.678+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.678+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93895652124960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fdb220 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.678+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fdbcf0 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.678+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93895652122336] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93895652124960] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93895652128720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fdad40 con 0x7f0d78014070 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=0 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=1 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=2 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=3 2024-02-16T00:11:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=4 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=5 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.679+0000 7f0d82340800 20 add_watcher() i=6 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.680+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93895652128720] v27'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.680+0000 7f0d82340800 20 add_watcher() i=7 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.680+0000 7f0d82340800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.680+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fdece0 con 0x5565c8fc8390 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.681+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.681+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93895652117328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fdc1c0 con 0x5565c8fc8390 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.681+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93895652117328] v27'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0c34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 5 note: GC not initialized 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0baf7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 Filter name: none 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0bad7fa640 20 reqs_thread_entry: start 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9010d00 con 0x5565c8fc8390 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.682+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9010d00 con 0x5565c8fc8390 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c900f3d0 con 0x7f0d78014070 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.683+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c900fc50 con 0x5565c8fc8390 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.684+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~358] v27'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.684+0000 7f0d82340800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.684+0000 7f0d82340800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.684+0000 7f0d82340800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.684+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 93895652341680 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9014700 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== watch-notify(notify (1) cookie 93895652120224 notify 115964116992 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f0d74006070 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0c61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 93895652120224 notifier 4285 bl.length()=534 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0c61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0c61ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0c61ffb640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0c44003e90 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(66 notify.4 [notify cookie 93895652341680 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== watch-notify(notify_complete (2) cookie 93895652341680 notify 115964116992 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5565c8ddeb50 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.685+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9012240 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d82340800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d82340800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d82340800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-16T00:11:21.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 93895652341600 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9012240 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== watch-notify(notify (1) cookie 93895652116272 notify 115964116992 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x5565c8fbcf30 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0c617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 93895652116272 notifier 4285 bl.length()=169 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0c617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0c617fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0c617fa640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0bb40033f0 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(69 notify.3 [notify cookie 93895652341600 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.687+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== watch-notify(notify_complete (2) cookie 93895652341600 notify 115964116992 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0d7803b020 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.688+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9012240 con 0x7f0d78014070 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d82340800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d82340800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d82340800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 93895652341552 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c9014700 con 0x5565c8fccc80 2024-02-16T00:11:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== watch-notify(notify (1) cookie 93895652116272 notify 115964116993 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f0d7803b020 con 0x5565c8fccc80 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0c61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 93895652116272 notifier 4285 bl.length()=177 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0c61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0c61ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(72 notify.3 [notify cookie 93895652341552 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0c61ffb640 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0c44003e90 con 0x5565c8fccc80 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.689+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== watch-notify(notify_complete (2) cookie 93895652341552 notify 115964116993 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5565c8fa9e70 con 0x5565c8fccc80 2024-02-16T00:11:21.704 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:21.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.690+0000 7f0c34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.690+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93895652117328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fde7f0 con 0x5565c8fc8390 2024-02-16T00:11:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.691+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 93895652117328] v27'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.691+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93895652104304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd8b50 con 0x5565c8fccc80 2024-02-16T00:11:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.692+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 93895652104304] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.692+0000 7f0d82340800 20 remove_watcher() i=0 2024-02-16T00:11:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.692+0000 7f0d82340800 2 removed watcher, disabling cache 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.692+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93895652109120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5870 con 0x5565c8fc8390 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.693+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 93895652109120] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.693+0000 7f0d82340800 20 remove_watcher() i=1 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.693+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93895652110176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd6b40 con 0x5565c8fd1a80 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.694+0000 7f0d7e044640 1 -- 172.21.15.42:0/654990721 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 93895652110176] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d70095040 con 0x5565c8fd1a80 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.694+0000 7f0d82340800 20 remove_watcher() i=2 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.694+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93895652116272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5870 con 0x5565c8fccc80 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.695+0000 7f0d7e845640 1 -- 172.21.15.42:0/654990721 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 93895652116272] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7800a4a0 con 0x5565c8fccc80 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.695+0000 7f0d82340800 20 remove_watcher() i=3 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.695+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93895652120224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5870 con 0x5565c8fc8390 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.696+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 93895652120224] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x5565c8fc8390 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.696+0000 7f0d82340800 20 remove_watcher() i=4 2024-02-16T00:11:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.696+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93895652122336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5870 con 0x7f0d78014070 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.698+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 93895652122336] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.698+0000 7f0d82340800 20 remove_watcher() i=5 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.698+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93895652124960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5870 con 0x7f0d78014070 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.699+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 93895652124960] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.699+0000 7f0d82340800 20 remove_watcher() i=6 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.699+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93895652128720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565c8fd5870 con 0x7f0d78014070 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.699+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 93895652128720] v27'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d7400f610 con 0x7f0d78014070 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.699+0000 7f0d82340800 20 remove_watcher() i=7 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0d78014070 msgr2=0x7f0d7804a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0d78014070 0x7f0d7804a290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8fc8390 msgr2=0x5565c8fca850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8fc8390 0x5565c8fca850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8fccc80 msgr2=0x5565c8fcf070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8fccc80 0x5565c8fcf070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565c8fd1a80 msgr2=0x5565c8fd3f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565c8fd1a80 0x5565c8fd3f40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c48036790 msgr2=0x7f0c48038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c48036790 0x7f0c48038c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d70067fb0 tx=0x7f0d70057000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 msgr2=0x5565c8fbc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d7d843640 1 -- 172.21.15.42:0/654990721 reap_dead start 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fbc7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d78011ae0 tx=0x7f0d7804bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 shutdown_connections 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/654990721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fb57f0 0x5565c8fbc7f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 >> 172.21.15.42:0/654990721 conn(0x5565c8fb1ba0 msgr2=0x5565c8faf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 shutdown_connections 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/654990721 wait complete. 2024-02-16T00:11:21.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c58036790 msgr2=0x7f0c58038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c58036790 0x7f0c58038c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5565c8f85070 tx=0x7f0d7005de80 comp rx=0 tx=0).stop 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 msgr2=0x5565c8fa8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 0x5565c8fa8a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5565c8f84f00 tx=0x7f0d78018830 comp rx=0 tx=0).stop 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 shutdown_connections 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c58036790 0x7f0c58038c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 --2- 172.21.15.42:0/1919426869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8fa85e0 0x5565c8fa8a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 >> 172.21.15.42:0/1919426869 conn(0x5565c8f9c680 msgr2=0x5565c8f9ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 shutdown_connections 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.700+0000 7f0d82340800 1 -- 172.21.15.42:0/1919426869 wait complete. 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8e94070 msgr2=0x5565c8f94710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8e94070 0x5565c8f94710 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8f96d20 msgr2=0x5565c8f99110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8f96d20 0x5565c8f99110 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c64036790 msgr2=0x7f0c64038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c64036790 0x7f0c64038c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d74000f60 tx=0x7f0d74001370 comp rx=0 tx=0).stop 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 msgr2=0x5565c8f849c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8f849c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001ceb0 tx=0x7f0d70002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 shutdown_connections 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565c8f96d20 0x5565c8f99110 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565c8e94070 0x5565c8f94710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0c64036790 0x7f0c64038c50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 --2- 172.21.15.42:0/2833820806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565c8e92e10 0x5565c8f849c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 >> 172.21.15.42:0/2833820806 conn(0x5565c8e8e470 msgr2=0x5565c8f7d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 shutdown_connections 2024-02-16T00:11:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.701+0000 7f0d82340800 1 -- 172.21.15.42:0/2833820806 wait complete. 2024-02-16T00:11:21.719 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:21.720 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-16T00:11:21.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-16T00:11:21.720 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-02-16T00:11:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f915c211800 1 Processor -- start 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f915c211800 1 -- start start 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f915c211800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b88e3662a0 0x55b88e368760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f915c211800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b88e2acc50 con 0x55b88e2d5120 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f915c211800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b88e264450 con 0x55b88e3662a0 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f9157071640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b88e3662a0 0x55b88e368760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.764+0000 7f9157872640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55b88e2d5120 0x55b88e364b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60140/0 (socket says 172.21.15.42:60140) 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.765+0000 7f9157872640 1 -- 172.21.15.42:0/2793378328 learned_addr learned my addr 172.21.15.42:0/2793378328 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.765+0000 7f9157071640 1 -- 172.21.15.42:0/2793378328 >> v1:172.21.15.2:6789/0 conn(0x55b88e2d5120 legacy=0x55b88e364b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.765+0000 7f9157071640 1 -- 172.21.15.42:0/2793378328 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88e369e70 con 0x55b88e3662a0 2024-02-16T00:11:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f9157071640 1 --2- 172.21.15.42:0/2793378328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e3662a0 0x55b88e368760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f914c00a470 tx=0x7f914c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af4549291e93036 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f9156870640 1 -- 172.21.15.42:0/2793378328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f914c052570 con 0x55b88e3662a0 2024-02-16T00:11:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f9156870640 1 -- 172.21.15.42:0/2793378328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c0526d0 con 0x55b88e3662a0 2024-02-16T00:11:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f9156870640 1 -- 172.21.15.42:0/2793378328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f914c052990 con 0x55b88e3662a0 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 -- 172.21.15.42:0/2793378328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e3662a0 msgr2=0x55b88e368760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 --2- 172.21.15.42:0/2793378328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e3662a0 0x55b88e368760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f914c00a470 tx=0x7f914c01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 -- 172.21.15.42:0/2793378328 shutdown_connections 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 --2- 172.21.15.42:0/2793378328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e3662a0 0x55b88e368760 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 -- 172.21.15.42:0/2793378328 >> 172.21.15.42:0/2793378328 conn(0x55b88e35c4f0 msgr2=0x55b88e35e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 -- 172.21.15.42:0/2793378328 shutdown_connections 2024-02-16T00:11:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.767+0000 7f915c211800 1 -- 172.21.15.42:0/2793378328 wait complete. 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f915c211800 1 Processor -- start 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f915c211800 1 -- start start 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f915c211800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e452000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f915c211800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88e261980 con 0x55b88e2d5120 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f9157872640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e452000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f9157872640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e452000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58136/0 (socket says 172.21.15.42:58136) 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.779+0000 7f9157872640 1 -- 172.21.15.42:0/2736425112 learned_addr learned my addr 172.21.15.42:0/2736425112 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.780+0000 7f9157872640 1 -- 172.21.15.42:0/2736425112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c005d20 con 0x55b88e2d5120 2024-02-16T00:11:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.780+0000 7f9157872640 1 --2- 172.21.15.42:0/2736425112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e452000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9148001c50 tx=0x7f914800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a36a9f60ccc874 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.780+0000 7f9045e0b640 1 -- 172.21.15.42:0/2736425112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f914800e470 con 0x55b88e2d5120 2024-02-16T00:11:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.780+0000 7f9045e0b640 1 -- 172.21.15.42:0/2736425112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914800e5d0 con 0x55b88e2d5120 2024-02-16T00:11:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.780+0000 7f9045e0b640 1 -- 172.21.15.42:0/2736425112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f914800e8d0 con 0x55b88e2d5120 2024-02-16T00:11:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- 172.21.15.42:0/2736425112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 msgr2=0x55b88e452000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 --2- 172.21.15.42:0/2736425112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e452000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9148001c50 tx=0x7f914800b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- 172.21.15.42:0/2736425112 shutdown_connections 2024-02-16T00:11:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 --2- 172.21.15.42:0/2736425112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e452000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- 172.21.15.42:0/2736425112 >> 172.21.15.42:0/2736425112 conn(0x55b88e35c4f0 msgr2=0x55b88e44d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- 172.21.15.42:0/2736425112 shutdown_connections 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- 172.21.15.42:0/2736425112 wait complete. 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 Processor -- start 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- start start 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e459710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f915c211800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88e25d160 con 0x55b88e2d5120 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f9157872640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e459710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f9157872640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e459710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58148/0 (socket says 172.21.15.42:58148) 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.781+0000 7f9157872640 1 -- 172.21.15.42:0/2466436335 learned_addr learned my addr 172.21.15.42:0/2466436335 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f9157872640 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88e2acc50 con 0x55b88e2d5120 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f9157872640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e459710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9148001c50 tx=0x7f9148000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f903ffff640 1 -- 172.21.15.42:0/2466436335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f914801f070 con 0x55b88e2d5120 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f903ffff640 1 -- 172.21.15.42:0/2466436335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148018850 con 0x55b88e2d5120 2024-02-16T00:11:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f903ffff640 1 -- 172.21.15.42:0/2466436335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9148018b30 con 0x55b88e2d5120 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b88e459c50 con 0x55b88e2d5120 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.782+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b88e45a130 con 0x55b88e2d5120 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f903ffff640 1 -- 172.21.15.42:0/2466436335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9148018d20 con 0x55b88e2d5120 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f903ffff640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90400367e0 0x7f9040038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f903ffff640 1 -- 172.21.15.42:0/2466436335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f914804c4c0 con 0x55b88e2d5120 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f9157071640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90400367e0 0x7f9040038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e3662a0 0x55b88e460450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e460a20 con 0x55b88e3662a0 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.783+0000 7f9158073640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e3662a0 0x55b88e460450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f9157071640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90400367e0 0x7f9040038ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f914c054000 tx=0x7f914c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f9158073640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e3662a0 0x55b88e460450 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f9158073640 1 -- 172.21.15.42:0/2466436335 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e3662a0 2024-02-16T00:11:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e45db00 con 0x55b88e3662a0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f9158073640 1 -- 172.21.15.42:0/2466436335 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e3662a0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e462c60 0x55b88e465050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e465720 con 0x55b88e462c60 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.784+0000 7f9157872640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e462c60 0x55b88e465050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.785+0000 7f9157872640 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e462c60 0x55b88e465050 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.785+0000 7f9157872640 1 -- 172.21.15.42:0/2466436335 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9148014070 con 0x55b88e462c60 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.785+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e461be0 con 0x55b88e3662a0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.785+0000 7f9158073640 1 -- 172.21.15.42:0/2466436335 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e3662a0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.785+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e461ff0 con 0x55b88e3662a0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f9158073640 1 -- 172.21.15.42:0/2466436335 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e3662a0 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f915c211800 1 Processor -- start 2024-02-16T00:11:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f915c211800 1 -- start start 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f915c211800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 0x55b88e4748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f915c211800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88e1ffe80 con 0x55b88e4744a0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f9158073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 0x55b88e4748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f9158073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 0x55b88e4748c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58154/0 (socket says 172.21.15.42:58154) 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.786+0000 7f9158073640 1 -- 172.21.15.42:0/1831038684 learned_addr learned my addr 172.21.15.42:0/1831038684 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f9158073640 1 -- 172.21.15.42:0/1831038684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88e474e00 con 0x55b88e4744a0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f9158073640 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 0x55b88e4748c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55b88e460d80 tx=0x7f9150018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f903d7fa640 1 -- 172.21.15.42:0/1831038684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915001d070 con 0x55b88e4744a0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f903d7fa640 1 -- 172.21.15.42:0/1831038684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500182e0 con 0x55b88e4744a0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f903d7fa640 1 -- 172.21.15.42:0/1831038684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91500145e0 con 0x55b88e4744a0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b88e475870 con 0x55b88e4744a0 2024-02-16T00:11:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.787+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b88e475d30 con 0x55b88e4744a0 2024-02-16T00:11:21.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.788+0000 7f903d7fa640 1 -- 172.21.15.42:0/1831038684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9150020020 con 0x55b88e4744a0 2024-02-16T00:11:21.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.788+0000 7f903d7fa640 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9030036790 0x7f9030038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.788+0000 7f903d7fa640 1 -- 172.21.15.42:0/1831038684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f915004dca0 con 0x55b88e4744a0 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.788+0000 7f9157872640 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9030036790 0x7f9030038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.788+0000 7f915c211800 1 Processor -- start 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.788+0000 7f915c211800 1 -- start start 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f9157872640 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9030036790 0x7f9030038c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55b88e460df0 tx=0x7f9148017430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f915c211800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e481be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f915c211800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88e1d55d0 con 0x55b88e4817c0 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f9158073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e481be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f9158073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e481be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58158/0 (socket says 172.21.15.42:58158) 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f9158073640 1 -- 172.21.15.42:0/422872007 learned_addr learned my addr 172.21.15.42:0/422872007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f9158073640 1 -- 172.21.15.42:0/422872007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88e4821b0 con 0x55b88e4817c0 2024-02-16T00:11:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.789+0000 7f9158073640 1 --2- 172.21.15.42:0/422872007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e481be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f915004c020 tx=0x7f9150011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ad3ce72a41df8f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f9036ffd640 1 -- 172.21.15.42:0/422872007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9150016440 con 0x55b88e4817c0 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f9036ffd640 1 -- 172.21.15.42:0/422872007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500165a0 con 0x55b88e4817c0 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f9036ffd640 1 -- 172.21.15.42:0/422872007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9150014b10 con 0x55b88e4817c0 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 -- 172.21.15.42:0/422872007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 msgr2=0x55b88e481be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 --2- 172.21.15.42:0/422872007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e481be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f915004c020 tx=0x7f9150011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 -- 172.21.15.42:0/422872007 shutdown_connections 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 --2- 172.21.15.42:0/422872007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e481be0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 -- 172.21.15.42:0/422872007 >> 172.21.15.42:0/422872007 conn(0x55b88e47da40 msgr2=0x55b88e47baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 -- 172.21.15.42:0/422872007 shutdown_connections 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.790+0000 7f915c211800 1 -- 172.21.15.42:0/422872007 wait complete. 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f915c211800 1 Processor -- start 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f915c211800 1 -- start start 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f915c211800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e4886f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f915c211800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88e488c30 con 0x55b88e4817c0 2024-02-16T00:11:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f9158073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e4886f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f9158073640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e4886f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58160/0 (socket says 172.21.15.42:58160) 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.791+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 learned_addr learned my addr 172.21.15.42:0/2758428357 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88e475d30 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f9158073640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e4886f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9150042040 tx=0x7f915004bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f90357fa640 1 -- 172.21.15.42:0/2758428357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9150032070 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f90357fa640 1 -- 172.21.15.42:0/2758428357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500116f0 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b88e488e30 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f90357fa640 1 -- 172.21.15.42:0/2758428357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9150013730 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.792+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b88e489290 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f90357fa640 1 -- 172.21.15.42:0/2758428357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9150022740 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f90357fa640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90200367e0 0x7f9020038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f90357fa640 1 -- 172.21.15.42:0/2758428357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9150037c50 con 0x55b88e4817c0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f9157872640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90200367e0 0x7f9020038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e494440 0x55b88e496900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e497050 con 0x55b88e494440 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.793+0000 7f9157872640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90200367e0 0x7f9020038ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9148016760 tx=0x7f914804c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f9157071640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e494440 0x55b88e496900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f9157071640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e494440 0x55b88e496900 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 20 realm 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4973e0 con 0x55b88e494440 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.794+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e497c60 con 0x55b88e494440 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e497fc0 con 0x55b88e494440 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e498cd0 0x55b88e49b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e498cd0 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f9158073640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e498cd0 0x55b88e49b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.795+0000 7f9158073640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e498cd0 0x55b88e49b0c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f915c211800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f915c211800 20 searching for the correct realm 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b88e49d9a0 0x55b88e49fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a0530 con 0x55b88e49d9a0 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f9157872640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b88e49d9a0 0x55b88e49fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.796+0000 7f9157872640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b88e49d9a0 0x55b88e49fe60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.797+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.797+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a0530 con 0x55b88e498cd0 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.797+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.797+0000 7f9158073640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9150058040 0x7f9150023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.797+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.797+0000 7f9157071640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9150058040 0x7f9150023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9150058040 0x7f9150023420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.798+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e498cd0 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.799+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.800+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.800+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.800+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.800+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.800+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.800+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e498cd0 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.801+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.802+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.803+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.803+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.803+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.803+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e498cd0 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.803+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.803+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.804+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e498cd0 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.805+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.805+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e49d9a0 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.805+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.805+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x7f9150058040 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.805+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.805+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e494440 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49b6d0 con 0x55b88e498cd0 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49bda0 con 0x55b88e494440 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49c150 con 0x55b88e494440 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.806+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e49c530 con 0x55b88e494440 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 zone default found 2024-02-16T00:11:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 4 Realm: () 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 zonegroup default 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a0970 con 0x7f9150058040 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a27f0 con 0x55b88e49d9a0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.807+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a2b50 con 0x55b88e49d9a0 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.808+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.808+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.808+0000 7f915c211800 20 started sync module instance, tier type = 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.808+0000 7f915c211800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.808+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a1dc0 con 0x55b88e498cd0 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.809+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.809+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94251149566368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a1dc0 con 0x55b88e498cd0 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.809+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a3500 con 0x55b88e494440 2024-02-16T00:11:21.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.810+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94251149566368] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.810+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.810+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94251149570080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a1dc0 con 0x55b88e494440 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.810+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a4020 con 0x55b88e49d9a0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.811+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94251149570080] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.812+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.812+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94251149564192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a1d40 con 0x55b88e49d9a0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.812+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a4e80 con 0x55b88e498cd0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.813+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.813+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94251149577184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a5710 con 0x55b88e498cd0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.813+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a61c0 con 0x55b88e494440 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.813+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94251149564192] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.814+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.814+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94251149581504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a6180 con 0x55b88e494440 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.814+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a6bf0 con 0x7f9150058040 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.814+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94251149577184] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.815+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94251149581504] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.815+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.815+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94251149575120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a6bf0 con 0x7f9150058040 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.815+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a53a0 con 0x7f9150058040 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.816+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94251149575120] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.816+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.816+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94251149584144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a7440 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.816+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a7db0 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94251149584144] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94251149586176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a7f90 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=0 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=1 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=2 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=3 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=4 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=5 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.817+0000 7f915c211800 20 add_watcher() i=6 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.818+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94251149586176] v27'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.818+0000 7f915c211800 20 add_watcher() i=7 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.818+0000 7f915c211800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.818+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4ab2f0 con 0x55b88e494440 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.819+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.819+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94251149602016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a7ff0 con 0x55b88e494440 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94251149602016] v27'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f900dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 5 note: GC not initialized 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f900cfe1640 20 reqs_thread_entry: start 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 20 Filter name: none 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f8f867fc640 20 reqs_thread_entry: start 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.820+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4dd280 con 0x7f9150058040 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4dd280 con 0x55b88e494440 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 20 rados_obj.operate() r=0 bl.length=7 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4de790 con 0x55b88e494440 2024-02-16T00:11:21.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 foo [call out=48b,read 0~358 out=358b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+406 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.821+0000 7f915c211800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.822+0000 7f900dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.822+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94251149602016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4aa2d0 con 0x55b88e494440 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.823+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94251149602016] v27'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.823+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94251149566368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4aace0 con 0x55b88e498cd0 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.824+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94251149566368] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.824+0000 7f915c211800 20 remove_watcher() i=0 2024-02-16T00:11:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.824+0000 7f915c211800 2 removed watcher, disabling cache 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.824+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94251149570080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4aace0 con 0x55b88e494440 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.825+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94251149570080] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.826+0000 7f915c211800 20 remove_watcher() i=1 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.826+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94251149564192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a3020 con 0x55b88e49d9a0 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.827+0000 7f9157872640 1 -- 172.21.15.42:0/2758428357 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94251149564192] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9148033070 con 0x55b88e49d9a0 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.827+0000 7f915c211800 20 remove_watcher() i=2 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.827+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94251149577184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4aace0 con 0x55b88e498cd0 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.827+0000 7f9158073640 1 -- 172.21.15.42:0/2758428357 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94251149577184] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915000a4a0 con 0x55b88e498cd0 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.828+0000 7f915c211800 20 remove_watcher() i=3 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.828+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94251149581504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a1920 con 0x55b88e494440 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.829+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94251149581504] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x55b88e494440 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.829+0000 7f915c211800 20 remove_watcher() i=4 2024-02-16T00:11:21.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.829+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94251149575120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4aace0 con 0x7f9150058040 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.830+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94251149575120] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.830+0000 7f915c211800 20 remove_watcher() i=5 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.830+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94251149584144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4a1920 con 0x7f9150058040 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.831+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94251149584144] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.831+0000 7f915c211800 20 remove_watcher() i=6 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.831+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94251149586176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55b88e4aace0 con 0x7f9150058040 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.831+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94251149586176] v27'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f914c059040 con 0x7f9150058040 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 20 remove_watcher() i=7 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9150058040 msgr2=0x7f9150023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9150058040 0x7f9150023420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e494440 msgr2=0x55b88e496900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e494440 0x55b88e496900 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e498cd0 msgr2=0x55b88e49b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e498cd0 0x55b88e49b0c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b88e49d9a0 msgr2=0x55b88e49fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b88e49d9a0 0x55b88e49fe60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90200367e0 msgr2=0x7f9020038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90200367e0 0x7f9020038ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9148016760 tx=0x7f914804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 msgr2=0x55b88e4886f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/2758428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4817c0 0x55b88e4886f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9150042040 tx=0x7f915004bf80 comp rx=0 tx=0).stop 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 reap_dead start 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f9157071640 1 -- 172.21.15.42:0/2758428357 reap_dead start 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 shutdown_connections 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 >> 172.21.15.42:0/2758428357 conn(0x55b88e47da40 msgr2=0x55b88e47b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 shutdown_connections 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/2758428357 wait complete. 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9030036790 msgr2=0x7f9030038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9030036790 0x7f9030038c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55b88e460df0 tx=0x7f9148017430 comp rx=0 tx=0).stop 2024-02-16T00:11:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 msgr2=0x55b88e4748c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 0x55b88e4748c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55b88e460d80 tx=0x7f9150018830 comp rx=0 tx=0).stop 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 shutdown_connections 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9030036790 0x7f9030038c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 --2- 172.21.15.42:0/1831038684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e4744a0 0x55b88e4748c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 >> 172.21.15.42:0/1831038684 conn(0x55b88e468540 msgr2=0x55b88e468940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 shutdown_connections 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.832+0000 7f915c211800 1 -- 172.21.15.42:0/1831038684 wait complete. 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e3662a0 msgr2=0x55b88e460450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e3662a0 0x55b88e460450 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e462c60 msgr2=0x55b88e465050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e462c60 0x55b88e465050 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90400367e0 msgr2=0x7f9040038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90400367e0 0x7f9040038ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f914c054000 tx=0x7f914c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 msgr2=0x55b88e459710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e459710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9148001c50 tx=0x7f9148000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 shutdown_connections 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88e462c60 0x55b88e465050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b88e3662a0 0x55b88e460450 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90400367e0 0x7f9040038ca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 --2- 172.21.15.42:0/2466436335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88e2d5120 0x55b88e459710 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 >> 172.21.15.42:0/2466436335 conn(0x55b88e35c4f0 msgr2=0x55b88e44c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 shutdown_connections 2024-02-16T00:11:21.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.833+0000 7f915c211800 1 -- 172.21.15.42:0/2466436335 wait complete. 2024-02-16T00:11:21.850 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-02-16T00:11:21.850 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:21.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:21.851 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:21.893 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:21.893 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.890+0000 7f81168e4800 1 Processor -- start 2024-02-16T00:11:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.890+0000 7f81168e4800 1 -- start start 2024-02-16T00:11:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f81168e4800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5565435f7300 0x5565435f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f81168e4800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55654353ebb0 con 0x5565435f2e70 2024-02-16T00:11:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f81168e4800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5565434f6450 con 0x5565435f7300 2024-02-16T00:11:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f8113be2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5565435f7300 0x5565435f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f81143e3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5565435f2e70 0x5565435f3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60154/0 (socket says 172.21.15.42:60154) 2024-02-16T00:11:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f8113be2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5565435f7300 0x5565435f96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58162/0 (socket says 172.21.15.42:58162) 2024-02-16T00:11:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f81143e3640 1 -- 172.21.15.42:0/1689507130 learned_addr learned my addr 172.21.15.42:0/1689507130 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f8113be2640 1 -- 172.21.15.42:0/1689507130 >> v1:172.21.15.2:6789/0 conn(0x5565435f2e70 legacy=0x5565435f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.891+0000 7f8113be2640 1 -- 172.21.15.42:0/1689507130 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565435fad20 con 0x5565435f7300 2024-02-16T00:11:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.893+0000 7f8113be2640 1 --2- 172.21.15.42:0/1689507130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f7300 0x5565435f96f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f810800a470 tx=0x7f810801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555d6c88fb8cd8c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.893+0000 7f81133e1640 1 -- 172.21.15.42:0/1689507130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8108052570 con 0x5565435f7300 2024-02-16T00:11:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.893+0000 7f81133e1640 1 -- 172.21.15.42:0/1689507130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080526d0 con 0x5565435f7300 2024-02-16T00:11:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.893+0000 7f81133e1640 1 -- 172.21.15.42:0/1689507130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8108052990 con 0x5565435f7300 2024-02-16T00:11:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 -- 172.21.15.42:0/1689507130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f7300 msgr2=0x5565435f96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 --2- 172.21.15.42:0/1689507130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f7300 0x5565435f96f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f810800a470 tx=0x7f810801cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 -- 172.21.15.42:0/1689507130 shutdown_connections 2024-02-16T00:11:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 --2- 172.21.15.42:0/1689507130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f7300 0x5565435f96f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 -- 172.21.15.42:0/1689507130 >> 172.21.15.42:0/1689507130 conn(0x5565435ee4d0 msgr2=0x5565435f08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 -- 172.21.15.42:0/1689507130 shutdown_connections 2024-02-16T00:11:21.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.894+0000 7f81168e4800 1 -- 172.21.15.42:0/1689507130 wait complete. 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.905+0000 7f81168e4800 1 Processor -- start 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.905+0000 7f81168e4800 1 -- start start 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.905+0000 7f81168e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x556543566f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.905+0000 7f81168e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565434f3980 con 0x5565435f2e70 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f81143e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x556543566f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f81143e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x556543566f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58168/0 (socket says 172.21.15.42:58168) 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f81143e3640 1 -- 172.21.15.42:0/54156606 learned_addr learned my addr 172.21.15.42:0/54156606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f81143e3640 1 -- 172.21.15.42:0/54156606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108005d20 con 0x5565435f2e70 2024-02-16T00:11:21.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f81143e3640 1 --2- 172.21.15.42:0/54156606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x556543566f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f81040014d0 tx=0x7f8104001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fcfb1a11a0914c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f800260c640 1 -- 172.21.15.42:0/54156606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8104004520 con 0x5565435f2e70 2024-02-16T00:11:21.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f800260c640 1 -- 172.21.15.42:0/54156606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104004680 con 0x5565435f2e70 2024-02-16T00:11:21.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.906+0000 7f800260c640 1 -- 172.21.15.42:0/54156606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8104004980 con 0x5565435f2e70 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 -- 172.21.15.42:0/54156606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 msgr2=0x556543566f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 --2- 172.21.15.42:0/54156606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x556543566f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f81040014d0 tx=0x7f8104001990 comp rx=0 tx=0).stop 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 -- 172.21.15.42:0/54156606 shutdown_connections 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 --2- 172.21.15.42:0/54156606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x556543566f30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 -- 172.21.15.42:0/54156606 >> 172.21.15.42:0/54156606 conn(0x5565435ee4d0 msgr2=0x5565436de810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 -- 172.21.15.42:0/54156606 shutdown_connections 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 -- 172.21.15.42:0/54156606 wait complete. 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 Processor -- start 2024-02-16T00:11:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.907+0000 7f81168e4800 1 -- start start 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81168e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x5565436e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81168e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565434ef160 con 0x5565435f2e70 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81143e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x5565436e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81143e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x5565436e4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58180/0 (socket says 172.21.15.42:58180) 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81143e3640 1 -- 172.21.15.42:0/2034940183 learned_addr learned my addr 172.21.15.42:0/2034940183 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81143e3640 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55654353ebb0 con 0x5565435f2e70 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.908+0000 7f81143e3640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x5565436e4650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f81040014d0 tx=0x7f8104001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.909+0000 7f8000e09640 1 -- 172.21.15.42:0/2034940183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8104013820 con 0x5565435f2e70 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.909+0000 7f8000e09640 1 -- 172.21.15.42:0/2034940183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104013980 con 0x5565435f2e70 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.909+0000 7f8000e09640 1 -- 172.21.15.42:0/2034940183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8104013c40 con 0x5565435f2e70 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.909+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565436e2d40 con 0x5565435f2e70 2024-02-16T00:11:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.909+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565436e3220 con 0x5565435f2e70 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8000e09640 1 -- 172.21.15.42:0/2034940183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8104028460 con 0x5565435f2e70 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8000e09640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ffc0367e0 0x7f7ffc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8000e09640 1 -- 172.21.15.42:0/2034940183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f810404c2c0 con 0x5565435f2e70 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8113be2640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ffc0367e0 0x7f7ffc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565435f7300 0x5565436f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565436f4f60 con 0x5565435f7300 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8114be4640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565435f7300 0x5565436f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8113be2640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ffc0367e0 0x7f7ffc038ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8108054000 tx=0x7f810804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.910+0000 7f8114be4640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565435f7300 0x5565436f4a20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f8114be4640 1 -- 172.21.15.42:0/2034940183 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f810c0083e0 con 0x5565435f7300 2024-02-16T00:11:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565436f52c0 con 0x5565435f7300 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f8114be4640 1 -- 172.21.15.42:0/2034940183 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f810c0083e0 con 0x5565435f7300 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565436f6d40 0x5565436f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565436f9970 con 0x5565436f6d40 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f81143e3640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565436f6d40 0x5565436f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.911+0000 7f81143e3640 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565436f6d40 0x5565436f91e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.912+0000 7f81143e3640 1 -- 172.21.15.42:0/2034940183 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8104024020 con 0x5565436f6d40 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.912+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565436f5ac0 con 0x5565435f7300 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.912+0000 7f8114be4640 1 -- 172.21.15.42:0/2034940183 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f810c0083e0 con 0x5565435f7300 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.912+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565436f5eb0 con 0x5565435f7300 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.912+0000 7f8114be4640 1 -- 172.21.15.42:0/2034940183 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f810c0083e0 con 0x5565435f7300 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f81168e4800 1 Processor -- start 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f81168e4800 1 -- start start 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f81168e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 0x556543708b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f81168e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556543491e80 con 0x5565437086e0 2024-02-16T00:11:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f8114be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 0x556543708b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f8114be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 0x556543708b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58182/0 (socket says 172.21.15.42:58182) 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.913+0000 7f8114be4640 1 -- 172.21.15.42:0/621170479 learned_addr learned my addr 172.21.15.42:0/621170479 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f8114be4640 1 -- 172.21.15.42:0/621170479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556543709040 con 0x5565437086e0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f8114be4640 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 0x556543708b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5565436e4390 tx=0x7f810c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f7ff9ffb640 1 -- 172.21.15.42:0/621170479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f810c00f040 con 0x5565437086e0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f7ff9ffb640 1 -- 172.21.15.42:0/621170479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c007d00 con 0x5565437086e0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f7ff9ffb640 1 -- 172.21.15.42:0/621170479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f810c019420 con 0x5565437086e0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556543709ab0 con 0x5565437086e0 2024-02-16T00:11:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.914+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556543709f70 con 0x5565437086e0 2024-02-16T00:11:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f7ff9ffb640 1 -- 172.21.15.42:0/621170479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f810c0195d0 con 0x5565437086e0 2024-02-16T00:11:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f7ff9ffb640 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fec036790 0x7f7fec038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f7ff9ffb640 1 -- 172.21.15.42:0/621170479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f810c04e080 con 0x5565437086e0 2024-02-16T00:11:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f81143e3640 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fec036790 0x7f7fec038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f81168e4800 1 Processor -- start 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f81168e4800 1 -- start start 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f81143e3640 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fec036790 0x7f7fec038c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5565436e3cc0 tx=0x7f810404a5e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f81168e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x556543715e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.915+0000 7f81168e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565434675d0 con 0x556543715a70 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f8114be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x556543715e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f8114be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x556543715e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58190/0 (socket says 172.21.15.42:58190) 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f8114be4640 1 -- 172.21.15.42:0/2133072754 learned_addr learned my addr 172.21.15.42:0/2133072754 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f8114be4640 1 -- 172.21.15.42:0/2133072754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556543716460 con 0x556543715a70 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f8114be4640 1 --2- 172.21.15.42:0/2133072754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x556543715e90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f810c0148a0 tx=0x7f810c014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98e926f982934d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f7feb7fe640 1 -- 172.21.15.42:0/2133072754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f810c018400 con 0x556543715a70 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f7feb7fe640 1 -- 172.21.15.42:0/2133072754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c018560 con 0x556543715a70 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.916+0000 7f7feb7fe640 1 -- 172.21.15.42:0/2133072754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f810c040c40 con 0x556543715a70 2024-02-16T00:11:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- 172.21.15.42:0/2133072754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 msgr2=0x556543715e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 --2- 172.21.15.42:0/2133072754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x556543715e90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f810c0148a0 tx=0x7f810c014ef0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- 172.21.15.42:0/2133072754 shutdown_connections 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 --2- 172.21.15.42:0/2133072754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x556543715e90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- 172.21.15.42:0/2133072754 >> 172.21.15.42:0/2133072754 conn(0x556543711d40 msgr2=0x55654370fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- 172.21.15.42:0/2133072754 shutdown_connections 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- 172.21.15.42:0/2133072754 wait complete. 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 Processor -- start 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- start start 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x55654371c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f81168e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654371ce20 con 0x556543715a70 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f8114be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x55654371c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f8114be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x55654371c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58196/0 (socket says 172.21.15.42:58196) 2024-02-16T00:11:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.917+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 learned_addr learned my addr 172.21.15.42:0/4285440264 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556543709f70 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f8114be4640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x55654371c8e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f810c014fd0 tx=0x7f810c04c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f7fe9ffb640 1 -- 172.21.15.42:0/4285440264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f810c024e80 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f7fe9ffb640 1 -- 172.21.15.42:0/4285440264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c014340 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55654371d020 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f7fe9ffb640 1 -- 172.21.15.42:0/4285440264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f810c04c910 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.918+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55654371d480 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f7fe9ffb640 1 -- 172.21.15.42:0/4285440264 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f810c03b2f0 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f7fe9ffb640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fdc036790 0x7f7fdc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f7fe9ffb640 1 -- 172.21.15.42:0/4285440264 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f810c042b00 con 0x556543715a70 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f81143e3640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fdc036790 0x7f7fdc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565437284e0 0x55654372a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654372b0d0 con 0x5565437284e0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f8113be2640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565437284e0 0x55654372a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.919+0000 7f81143e3640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fdc036790 0x7f7fdc038c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f810401d8d0 tx=0x7f8104036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f8113be2640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565437284e0 0x55654372a980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8108059040 con 0x5565437284e0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 realm 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654372b4c0 con 0x5565437284e0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8108059040 con 0x5565437284e0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654372bd10 con 0x5565437284e0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8108059040 con 0x5565437284e0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.920+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654372c070 con 0x5565437284e0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8108059040 con 0x5565437284e0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55654372cd80 0x55654372f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654372f6f0 con 0x55654372cd80 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f8114be4640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55654372cd80 0x55654372f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f8114be4640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55654372cd80 0x55654372f170 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f810c0083e0 con 0x55654372cd80 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 20 searching for the correct realm 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565437316a0 0x556543733b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.921+0000 7f81143e3640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565437316a0 0x556543733b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.922+0000 7f81143e3640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565437316a0 0x556543733b30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.922+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.922+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x55654372cd80 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.922+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f810c0083e0 con 0x55654372cd80 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.922+0000 7f8114be4640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f810c019040 0x7f810c022730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.922+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.923+0000 7f8113be2640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f810c019040 0x7f810c022730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.923+0000 7f8113be2640 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f810c019040 0x7f810c022730 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.923+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.923+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.924+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x55654372cd80 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f810c0083e0 con 0x55654372cd80 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.925+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x55654372cd80 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f810c0083e0 con 0x55654372cd80 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.926+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.927+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.928+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.928+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.928+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.928+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x55654372cd80 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.928+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f810c0083e0 con 0x55654372cd80 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.928+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.929+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x55654372cd80 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f810c0083e0 con 0x55654372cd80 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437316a0 2024-02-16T00:11:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x7f810c019040 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x5565437284e0 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.930+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734200 con 0x55654372cd80 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565437300f0 con 0x5565437284e0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654372fd10 con 0x5565437284e0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543730980 con 0x5565437284e0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 zone default found 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 4 Realm: () 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:21.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:21.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 zonegroup default 2024-02-16T00:11:21.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.931+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543734ae0 con 0x7f810c019040 2024-02-16T00:11:21.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565437364f0 con 0x5565437316a0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543736940 con 0x5565437316a0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.932+0000 7f81168e4800 20 started sync module instance, tier type = 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.933+0000 7f81168e4800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.933+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543735a90 con 0x55654372cd80 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.933+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.933+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93893411692400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543736d60 con 0x55654372cd80 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.933+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543737560 con 0x5565437284e0 2024-02-16T00:11:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.934+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93893411692400] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.935+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.935+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93893411695968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543737910 con 0x5565437284e0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.935+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543738110 con 0x5565437316a0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.936+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.936+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93893411699232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543738910 con 0x5565437316a0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.936+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565437392f0 con 0x55654372cd80 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.936+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93893411695968] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.937+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.937+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93893411697024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5565437396d0 con 0x55654372cd80 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.937+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373a0d0 con 0x5565437284e0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.937+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93893411699232] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.938+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93893411697024] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.938+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.938+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93893411704336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373a090 con 0x5565437284e0 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.938+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373a950 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.939+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93893411704336] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.939+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.939+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93893411707856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373a090 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.940+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373b020 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.941+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.941+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93893411711776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373b4c0 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.941+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93893411707856] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.941+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373a480 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93893411711776] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93893411712992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373a480 con 0x7f810c019040 2024-02-16T00:11:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=0 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=1 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=2 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=3 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=4 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=5 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.942+0000 7f81168e4800 20 add_watcher() i=6 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.943+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93893411712992] v27'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.943+0000 7f81168e4800 20 add_watcher() i=7 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.943+0000 7f81168e4800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.943+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373ef80 con 0x5565437284e0 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.943+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.943+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93893411715696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373c440 con 0x5565437284e0 2024-02-16T00:11:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93893411715696] v27'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f7fca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f81168e4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f81168e4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f81168e4800 5 note: GC not initialized 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f7fc97e2640 20 reqs_thread_entry: start 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.944+0000 7f81168e4800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.945+0000 7f81168e4800 20 Filter name: none 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.945+0000 7f7f3affd640 20 reqs_thread_entry: start 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.945+0000 7f81168e4800 20 rados->read ofs=0 len=0 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.945+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543770a30 con 0x5565437284e0 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.945+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.945+0000 7f81168e4800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:21.959 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.946+0000 7f7fca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.946+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93893411715696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373e830 con 0x5565437284e0 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.947+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93893411715696] v27'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.947+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93893411692400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373ba70 con 0x55654372cd80 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.948+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93893411692400] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.948+0000 7f81168e4800 20 remove_watcher() i=0 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.948+0000 7f81168e4800 2 removed watcher, disabling cache 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.948+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93893411695968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373ba70 con 0x5565437284e0 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.949+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93893411695968] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.949+0000 7f81168e4800 20 remove_watcher() i=1 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.949+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93893411699232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373ba70 con 0x5565437316a0 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.950+0000 7f81143e3640 1 -- 172.21.15.42:0/4285440264 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93893411699232] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8104051040 con 0x5565437316a0 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.950+0000 7f81168e4800 20 remove_watcher() i=2 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.950+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93893411697024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55654373ba70 con 0x55654372cd80 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.951+0000 7f8114be4640 1 -- 172.21.15.42:0/4285440264 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93893411697024] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f810c064040 con 0x55654372cd80 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.951+0000 7f81168e4800 20 remove_watcher() i=3 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.951+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93893411704336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543737200 con 0x5565437284e0 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.952+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93893411704336] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x5565437284e0 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.952+0000 7f81168e4800 20 remove_watcher() i=4 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.952+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93893411707856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543737200 con 0x7f810c019040 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.953+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93893411707856] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.953+0000 7f81168e4800 20 remove_watcher() i=5 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.953+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93893411711776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543737200 con 0x7f810c019040 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.954+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93893411711776] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.954+0000 7f81168e4800 20 remove_watcher() i=6 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.954+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93893411712992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x556543737200 con 0x7f810c019040 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93893411712992] v27'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8108071040 con 0x7f810c019040 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 20 remove_watcher() i=7 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f810c019040 msgr2=0x7f810c022730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f810c019040 0x7f810c022730 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565437284e0 msgr2=0x55654372a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565437284e0 0x55654372a980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55654372cd80 msgr2=0x55654372f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55654372cd80 0x55654372f170 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565437316a0 msgr2=0x556543733b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5565437316a0 0x556543733b30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fdc036790 msgr2=0x7f7fdc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fdc036790 0x7f7fdc038c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f810401d8d0 tx=0x7f8104036000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 msgr2=0x55654371c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f8113be2640 1 -- 172.21.15.42:0/4285440264 reap_dead start 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x55654371c8e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f810c014fd0 tx=0x7f810c04c360 comp rx=0 tx=0).stop 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 shutdown_connections 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 --2- 172.21.15.42:0/4285440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556543715a70 0x55654371c8e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 >> 172.21.15.42:0/4285440264 conn(0x556543711d40 msgr2=0x55654370f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 shutdown_connections 2024-02-16T00:11:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.955+0000 7f81168e4800 1 -- 172.21.15.42:0/4285440264 wait complete. 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fec036790 msgr2=0x7f7fec038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fec036790 0x7f7fec038c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5565436e3cc0 tx=0x7f810404a5e0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 msgr2=0x556543708b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 0x556543708b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5565436e4390 tx=0x7f810c00aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 shutdown_connections 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7fec036790 0x7f7fec038c50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/621170479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565437086e0 0x556543708b00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 >> 172.21.15.42:0/621170479 conn(0x5565436fc780 msgr2=0x5565436fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 shutdown_connections 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/621170479 wait complete. 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565435f7300 msgr2=0x5565436f4a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565435f7300 0x5565436f4a20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565436f6d40 msgr2=0x5565436f91e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565436f6d40 0x5565436f91e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ffc0367e0 msgr2=0x7f7ffc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ffc0367e0 0x7f7ffc038ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8108054000 tx=0x7f810804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 msgr2=0x5565436e4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x5565436e4650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f81040014d0 tx=0x7f8104001250 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 shutdown_connections 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5565436f6d40 0x5565436f91e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5565435f7300 0x5565436f4a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ffc0367e0 0x7f7ffc038ca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 --2- 172.21.15.42:0/2034940183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565435f2e70 0x5565436e4650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 >> 172.21.15.42:0/2034940183 conn(0x5565435ee4d0 msgr2=0x5565436dd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 shutdown_connections 2024-02-16T00:11:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:21.956+0000 7f81168e4800 1 -- 172.21.15.42:0/2034940183 wait complete. 2024-02-16T00:11:21.970 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:21.971 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-16T00:11:21.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-16T00:11:21.971 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-16T00:11:22.053 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.053 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.051+0000 7f8dc2e24800 1 Processor -- start 2024-02-16T00:11:22.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.051+0000 7f8dc2e24800 1 -- start start 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.051+0000 7f8dc2e24800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561120256280 0x561120258740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.051+0000 7f8dc2e24800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56112019cbb0 con 0x5611201c5100 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.051+0000 7f8dc2e24800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x561120154450 con 0x561120256280 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.051+0000 7f8dc0122640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561120256280 0x561120258740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.052+0000 7f8dc0923640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5611201c5100 0x561120254b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60162/0 (socket says 172.21.15.42:60162) 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.052+0000 7f8dc0923640 1 -- 172.21.15.42:0/781135212 learned_addr learned my addr 172.21.15.42:0/781135212 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.052+0000 7f8dc0122640 1 -- 172.21.15.42:0/781135212 >> v1:172.21.15.2:6789/0 conn(0x5611201c5100 legacy=0x561120254b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.052+0000 7f8dbf921640 1 -- 172.21.15.42:0/781135212 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046579670 0 0) 0x56112019cbb0 con 0x5611201c5100 2024-02-16T00:11:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.052+0000 7f8dc0122640 1 -- 172.21.15.42:0/781135212 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561120259e50 con 0x561120256280 2024-02-16T00:11:22.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc0122640 1 --2- 172.21.15.42:0/781135212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120256280 0x561120258740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8db400a470 tx=0x7f8db401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639dfad6a307f3ee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dbf921640 1 -- 172.21.15.42:0/781135212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db4052570 con 0x561120256280 2024-02-16T00:11:22.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dbf921640 1 -- 172.21.15.42:0/781135212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db40526d0 con 0x561120256280 2024-02-16T00:11:22.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dbf921640 1 -- 172.21.15.42:0/781135212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db4052990 con 0x561120256280 2024-02-16T00:11:22.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 -- 172.21.15.42:0/781135212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120256280 msgr2=0x561120258740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/781135212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120256280 0x561120258740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8db400a470 tx=0x7f8db401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 -- 172.21.15.42:0/781135212 shutdown_connections 2024-02-16T00:11:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/781135212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120256280 0x561120258740 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 -- 172.21.15.42:0/781135212 >> 172.21.15.42:0/781135212 conn(0x56112024c4d0 msgr2=0x56112024e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 -- 172.21.15.42:0/781135212 shutdown_connections 2024-02-16T00:11:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.054+0000 7f8dc2e24800 1 -- 172.21.15.42:0/781135212 wait complete. 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc2e24800 1 Processor -- start 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc2e24800 1 -- start start 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc2e24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x561120252460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc2e24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561120151980 con 0x5611201c5100 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc0923640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x561120252460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc0923640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x561120252460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58206/0 (socket says 172.21.15.42:58206) 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.066+0000 7f8dc0923640 1 -- 172.21.15.42:0/2163619099 learned_addr learned my addr 172.21.15.42:0/2163619099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.067+0000 7f8dc0923640 1 -- 172.21.15.42:0/2163619099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4005d20 con 0x5611201c5100 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.067+0000 7f8dc0923640 1 --2- 172.21.15.42:0/2163619099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x561120252460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8db0001630 tx=0x7f8db0001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ff8d731f447d60 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.067+0000 7f8caee0d640 1 -- 172.21.15.42:0/2163619099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db0003450 con 0x5611201c5100 2024-02-16T00:11:22.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.067+0000 7f8caee0d640 1 -- 172.21.15.42:0/2163619099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db00035b0 con 0x5611201c5100 2024-02-16T00:11:22.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.067+0000 7f8caee0d640 1 -- 172.21.15.42:0/2163619099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db0003910 con 0x5611201c5100 2024-02-16T00:11:22.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2163619099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 msgr2=0x561120252460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2163619099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x561120252460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8db0001630 tx=0x7f8db0001af0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2163619099 shutdown_connections 2024-02-16T00:11:22.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2163619099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x561120252460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2163619099 >> 172.21.15.42:0/2163619099 conn(0x56112024c4d0 msgr2=0x56112033d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2163619099 shutdown_connections 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2163619099 wait complete. 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 Processor -- start 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- start start 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x56112034b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc2e24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112014d160 con 0x5611201c5100 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc0923640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x56112034b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc0923640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x56112034b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58222/0 (socket says 172.21.15.42:58222) 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.068+0000 7f8dc0923640 1 -- 172.21.15.42:0/2400855022 learned_addr learned my addr 172.21.15.42:0/2400855022 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8dc0923640 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0006cb0 con 0x5611201c5100 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8dc0923640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x56112034b710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8db0006fa0 tx=0x7f8db0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8cad60a640 1 -- 172.21.15.42:0/2400855022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db0013820 con 0x5611201c5100 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8cad60a640 1 -- 172.21.15.42:0/2400855022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0013980 con 0x5611201c5100 2024-02-16T00:11:22.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56112034bc50 con 0x5611201c5100 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8cad60a640 1 -- 172.21.15.42:0/2400855022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db0013c20 con 0x5611201c5100 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.069+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56112034c130 con 0x5611201c5100 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8cad60a640 1 -- 172.21.15.42:0/2400855022 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8db0028460 con 0x5611201c5100 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8cad60a640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ca80367e0 0x7f8ca8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8cad60a640 1 -- 172.21.15.42:0/2400855022 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8db004c4b0 con 0x5611201c5100 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8dc0122640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ca80367e0 0x7f8ca8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120256280 0x561120352540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120352a80 con 0x561120256280 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.070+0000 7f8dc1124640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120256280 0x561120352540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc0122640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ca80367e0 0x7f8ca8038ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8db4054000 tx=0x7f8db404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc1124640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120256280 0x561120352540 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc1124640 1 -- 172.21.15.42:0/2400855022 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8db80083e0 con 0x561120256280 2024-02-16T00:11:22.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112034fae0 con 0x561120256280 2024-02-16T00:11:22.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc1124640 1 -- 172.21.15.42:0/2400855022 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8db80083e0 con 0x561120256280 2024-02-16T00:11:22.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561120354cc0 0x5611203570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120357780 con 0x561120354cc0 2024-02-16T00:11:22.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.071+0000 7f8dc0923640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561120354cc0 0x5611203570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.072+0000 7f8dc0923640 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561120354cc0 0x5611203570b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.072+0000 7f8dc0923640 1 -- 172.21.15.42:0/2400855022 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8db0024020 con 0x561120354cc0 2024-02-16T00:11:22.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.072+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120353c40 con 0x561120256280 2024-02-16T00:11:22.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.072+0000 7f8dc1124640 1 -- 172.21.15.42:0/2400855022 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8db80083e0 con 0x561120256280 2024-02-16T00:11:22.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.072+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120353ff0 con 0x561120256280 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc1124640 1 -- 172.21.15.42:0/2400855022 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8db80083e0 con 0x561120256280 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc2e24800 1 Processor -- start 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc2e24800 1 -- start start 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc2e24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 0x561120366940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc2e24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611200efe80 con 0x561120366520 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc1124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 0x561120366940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc1124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 0x561120366940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58230/0 (socket says 172.21.15.42:58230) 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.073+0000 7f8dc1124640 1 -- 172.21.15.42:0/1950434110 learned_addr learned my addr 172.21.15.42:0/1950434110 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8dc1124640 1 -- 172.21.15.42:0/1950434110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561120366e80 con 0x561120366520 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8dc1124640 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 0x561120366940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56112034cb10 tx=0x7f8db800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8ca67fc640 1 -- 172.21.15.42:0/1950434110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db800f040 con 0x561120366520 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8ca67fc640 1 -- 172.21.15.42:0/1950434110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db8007d00 con 0x561120366520 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8ca67fc640 1 -- 172.21.15.42:0/1950434110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db801a430 con 0x561120366520 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611203678f0 con 0x561120366520 2024-02-16T00:11:22.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.074+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561120367db0 con 0x561120366520 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.075+0000 7f8ca67fc640 1 -- 172.21.15.42:0/1950434110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8db801a5e0 con 0x561120366520 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.075+0000 7f8ca67fc640 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c980367e0 0x7f8c98038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.075+0000 7f8ca67fc640 1 -- 172.21.15.42:0/1950434110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8db804e3c0 con 0x561120366520 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.075+0000 7f8dc0923640 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c980367e0 0x7f8c98038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.075+0000 7f8dc2e24800 1 Processor -- start 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc2e24800 1 -- start start 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc0923640 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c980367e0 0x7f8c98038ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561120352e50 tx=0x7f8db0040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc2e24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x561120373b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc2e24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611200c55d0 con 0x561120373770 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc1124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x561120373b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc1124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x561120373b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58234/0 (socket says 172.21.15.42:58234) 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc1124640 1 -- 172.21.15.42:0/3605030982 learned_addr learned my addr 172.21.15.42:0/3605030982 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc1124640 1 -- 172.21.15.42:0/3605030982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561120374160 con 0x561120373770 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.076+0000 7f8dc1124640 1 --2- 172.21.15.42:0/3605030982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x561120373b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8db804c710 tx=0x7f8db8010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7514609945543936 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8c97fff640 1 -- 172.21.15.42:0/3605030982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db804b380 con 0x561120373770 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8c97fff640 1 -- 172.21.15.42:0/3605030982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db80193c0 con 0x561120373770 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8c97fff640 1 -- 172.21.15.42:0/3605030982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db801ac60 con 0x561120373770 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- 172.21.15.42:0/3605030982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 msgr2=0x561120373b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/3605030982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x561120373b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8db804c710 tx=0x7f8db8010f60 comp rx=0 tx=0).stop 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- 172.21.15.42:0/3605030982 shutdown_connections 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/3605030982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x561120373b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- 172.21.15.42:0/3605030982 >> 172.21.15.42:0/3605030982 conn(0x56112036fa40 msgr2=0x56112036daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- 172.21.15.42:0/3605030982 shutdown_connections 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- 172.21.15.42:0/3605030982 wait complete. 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 Processor -- start 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- start start 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x56112037a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.077+0000 7f8dc2e24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112037ac00 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.078+0000 7f8dc1124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x56112037a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.078+0000 7f8dc1124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x56112037a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58250/0 (socket says 172.21.15.42:58250) 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.078+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 learned_addr learned my addr 172.21.15.42:0/721659488 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.078+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561120367db0 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.078+0000 7f8dc1124640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x56112037a6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8db804b5e0 tx=0x7f8db804c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8c967fc640 1 -- 172.21.15.42:0/721659488 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db8018ce0 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8c967fc640 1 -- 172.21.15.42:0/721659488 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db8018e40 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56112037ae00 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8c967fc640 1 -- 172.21.15.42:0/721659488 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8db8018510 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56112037b260 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8c967fc640 1 -- 172.21.15.42:0/721659488 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8db803b960 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.079+0000 7f8c967fc640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c8c0367e0 0x7f8c8c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8c967fc640 1 -- 172.21.15.42:0/721659488 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8db8041030 con 0x561120373770 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc0923640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c8c0367e0 0x7f8c8c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc0923640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c8c0367e0 0x7f8c8c038ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8db004a8c0 tx=0x7f8db001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120386480 0x561120388940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120389090 con 0x561120386480 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc0122640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120386480 0x561120388940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.080+0000 7f8dc0122640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120386480 0x561120388940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 realm 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120389420 con 0x561120386480 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120389ca0 con 0x561120386480 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.081+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112038a000 con 0x561120386480 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56112038ad10 0x56112038d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112038d710 con 0x56112038ad10 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc1124640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56112038ad10 0x56112038d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc1124640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56112038ad10 0x56112038d100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:22.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 20 searching for the correct realm 2024-02-16T00:11:22.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56112038f9c0 0x561120391e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.082+0000 7f8dc0923640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56112038f9c0 0x561120391e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.083+0000 7f8dc0923640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56112038f9c0 0x561120391e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.083+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.083+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038ad10 2024-02-16T00:11:22.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.083+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.083+0000 7f8dc1124640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8db804e650 0x7f8db804ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.083+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.084+0000 7f8dc0122640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8db804e650 0x7f8db804ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.084+0000 7f8dc0122640 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8db804e650 0x7f8db804ea70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.084+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.084+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.084+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038ad10 2024-02-16T00:11:22.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.085+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.086+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038ad10 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.087+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.087+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.087+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.087+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.087+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.087+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.088+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038ad10 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.089+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.090+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.090+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.090+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.090+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.091+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.091+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038ad10 2024-02-16T00:11:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.091+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.091+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038f9c0 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.091+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.091+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x7f8db804e650 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x561120386480 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392550 con 0x56112038ad10 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112038ef50 con 0x561120386480 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.092+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112038e750 con 0x561120386480 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112038dee0 con 0x561120386480 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 zone default found 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 4 Realm: () 2024-02-16T00:11:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 zonegroup default 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392e30 con 0x7f8db804e650 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.093+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120392a80 con 0x56112038f9c0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203950e0 con 0x56112038f9c0 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 20 started sync module instance, tier type = 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.094+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203945e0 con 0x56112038ad10 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.095+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.095+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94631555058064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120394250 con 0x56112038ad10 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.095+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120396030 con 0x561120386480 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.096+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94631555058064] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.096+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.096+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94631555062544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120395ff0 con 0x561120386480 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.096+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120396ac0 con 0x56112038f9c0 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.097+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.097+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94631555065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120397350 con 0x56112038f9c0 2024-02-16T00:11:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.097+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94631555062544] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.097+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120397e00 con 0x56112038ad10 2024-02-16T00:11:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.098+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94631555065312] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.098+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.098+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94631555070208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120396e70 con 0x56112038ad10 2024-02-16T00:11:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.098+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203987c0 con 0x561120386480 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.099+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94631555070208] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.099+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.100+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94631555060992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203987c0 con 0x561120386480 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.100+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120399130 con 0x7f8db804e650 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.101+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94631555060992] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.101+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.101+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94631555075696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203987c0 con 0x7f8db804e650 2024-02-16T00:11:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.101+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120399af0 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.102+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.102+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94631555077712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120399f50 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.102+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112039aa00 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.102+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94631555075696] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94631555077712] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94631555081472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120399a70 con 0x7f8db804e650 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=0 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=1 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=2 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=3 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=4 2024-02-16T00:11:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=5 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.103+0000 7f8dc2e24800 20 add_watcher() i=6 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.104+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94631555081472] v27'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.104+0000 7f8dc2e24800 20 add_watcher() i=7 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.104+0000 7f8dc2e24800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.104+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112039d9f0 con 0x561120386480 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.104+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.104+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94631555072800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112039aed0 con 0x561120386480 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.105+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94631555072800] v27'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.105+0000 7f8c76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 5 note: GC not initialized 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8c75fe3640 20 reqs_thread_entry: start 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 20 Filter name: none 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8be77fe640 20 reqs_thread_entry: start 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203cf9a0 con 0x561120386480 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.106+0000 7f8dc2e24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.107+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203d1ec0 con 0x56112038ad10 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.107+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.107+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203d5860 con 0x561120386480 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v27'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc2e24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc2e24800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc2e24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94631555323136 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203d2760 con 0x561120386480 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94631555060992 notify 115964116993 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f8db4084040 con 0x561120386480 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8c97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94631555060992 notifier 4306 bl.length()=534 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8c97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8c97fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(65 notify.4 [notify cookie 94631555323136 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8c97fff640 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8c84003e90 con 0x561120386480 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.108+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94631555323136 notify 115964116993 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8db407a040 con 0x561120386480 2024-02-16T00:11:22.119 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.109+0000 7f8c76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.109+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94631555072800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56112039d040 con 0x561120386480 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.110+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94631555072800] v27'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.110+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94631555058064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120398320 con 0x56112038ad10 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.111+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94631555058064] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.111+0000 7f8dc2e24800 20 remove_watcher() i=0 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.111+0000 7f8dc2e24800 2 removed watcher, disabling cache 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.111+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94631555062544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120398320 con 0x561120386480 2024-02-16T00:11:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.112+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94631555062544] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.112+0000 7f8dc2e24800 20 remove_watcher() i=1 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.112+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94631555065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120395b10 con 0x56112038f9c0 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.113+0000 7f8dc0923640 1 -- 172.21.15.42:0/721659488 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94631555065312] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db0051040 con 0x56112038f9c0 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.113+0000 7f8dc2e24800 20 remove_watcher() i=2 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.113+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94631555070208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120398320 con 0x56112038ad10 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.114+0000 7f8dc1124640 1 -- 172.21.15.42:0/721659488 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94631555070208] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db8012070 con 0x56112038ad10 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.114+0000 7f8dc2e24800 20 remove_watcher() i=3 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.114+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94631555060992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203965e0 con 0x561120386480 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.115+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94631555060992] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x561120386480 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.115+0000 7f8dc2e24800 20 remove_watcher() i=4 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.115+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94631555075696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120398320 con 0x7f8db804e650 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.116+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94631555075696] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.116+0000 7f8dc2e24800 20 remove_watcher() i=5 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.116+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94631555077712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561120395500 con 0x7f8db804e650 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.117+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94631555077712] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.117+0000 7f8dc2e24800 20 remove_watcher() i=6 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.117+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94631555081472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5611203965e0 con 0x7f8db804e650 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.118+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94631555081472] v27'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8db4059040 con 0x7f8db804e650 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.118+0000 7f8dc2e24800 20 remove_watcher() i=7 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8db804e650 msgr2=0x7f8db804ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8db804e650 0x7f8db804ea70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120386480 msgr2=0x561120388940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120386480 0x561120388940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56112038ad10 msgr2=0x56112038d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56112038ad10 0x56112038d100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56112038f9c0 msgr2=0x561120391e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56112038f9c0 0x561120391e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c8c0367e0 msgr2=0x7f8c8c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c8c0367e0 0x7f8c8c038ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8db004a8c0 tx=0x7f8db001f000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 msgr2=0x56112037a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/721659488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120373770 0x56112037a6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8db804b5e0 tx=0x7f8db804c6a0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 reap_dead start 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc0122640 1 -- 172.21.15.42:0/721659488 reap_dead start 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 shutdown_connections 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 >> 172.21.15.42:0/721659488 conn(0x56112036fa40 msgr2=0x56112036d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 shutdown_connections 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/721659488 wait complete. 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c980367e0 msgr2=0x7f8c98038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c980367e0 0x7f8c98038ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561120352e50 tx=0x7f8db0040040 comp rx=0 tx=0).stop 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 msgr2=0x561120366940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 0x561120366940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56112034cb10 tx=0x7f8db800aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 shutdown_connections 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8c980367e0 0x7f8c98038ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/1950434110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561120366520 0x561120366940 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 >> 172.21.15.42:0/1950434110 conn(0x56112035a5c0 msgr2=0x56112035a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 shutdown_connections 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.119+0000 7f8dc2e24800 1 -- 172.21.15.42:0/1950434110 wait complete. 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120256280 msgr2=0x561120352540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120256280 0x561120352540 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561120354cc0 msgr2=0x5611203570b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561120354cc0 0x5611203570b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ca80367e0 msgr2=0x7f8ca8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ca80367e0 0x7f8ca8038ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8db4054000 tx=0x7f8db404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 msgr2=0x56112034b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x56112034b710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8db0006fa0 tx=0x7f8db0001250 comp rx=0 tx=0).stop 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 shutdown_connections 2024-02-16T00:11:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561120354cc0 0x5611203570b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561120256280 0x561120352540 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ca80367e0 0x7f8ca8038ca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 --2- 172.21.15.42:0/2400855022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5611201c5100 0x56112034b710 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 >> 172.21.15.42:0/2400855022 conn(0x56112024c4d0 msgr2=0x561120250ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 shutdown_connections 2024-02-16T00:11:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.120+0000 7f8dc2e24800 1 -- 172.21.15.42:0/2400855022 wait complete. 2024-02-16T00:11:22.131 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:22.131 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:22.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:22.131 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:22.213 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.213 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.211+0000 7fafd5da2800 1 Processor -- start 2024-02-16T00:11:22.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.211+0000 7fafd5da2800 1 -- start start 2024-02-16T00:11:22.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.211+0000 7fafd5da2800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564a0ad48aa0 0x564a0ad4ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.211+0000 7fafd5da2800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564a0ac92bb0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.211+0000 7fafd5da2800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x564a0ac4a450 con 0x564a0ad48aa0 2024-02-16T00:11:22.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.212+0000 7fafd38a1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564a0ad48aa0 0x564a0ad4ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.212+0000 7fafd30a0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564a0ad4b3d0 0x564a0ad4d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60174/0 (socket says 172.21.15.42:60174) 2024-02-16T00:11:22.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.212+0000 7fafd30a0640 1 -- 172.21.15.42:0/487526717 learned_addr learned my addr 172.21.15.42:0/487526717 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.212+0000 7fafd38a1640 1 -- 172.21.15.42:0/487526717 >> v1:172.21.15.2:6789/0 conn(0x564a0ad4b3d0 legacy=0x564a0ad4d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.212+0000 7fafd38a1640 1 -- 172.21.15.42:0/487526717 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0ad4fef0 con 0x564a0ad48aa0 2024-02-16T00:11:22.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.214+0000 7fafd38a1640 1 --2- 172.21.15.42:0/487526717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad4ae90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00a470 tx=0x7fafcc01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26b97b881c0ff38 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.214+0000 7fafd289f640 1 -- 172.21.15.42:0/487526717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafcc052570 con 0x564a0ad48aa0 2024-02-16T00:11:22.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.214+0000 7fafd289f640 1 -- 172.21.15.42:0/487526717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0526d0 con 0x564a0ad48aa0 2024-02-16T00:11:22.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.214+0000 7fafd289f640 1 -- 172.21.15.42:0/487526717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafcc052990 con 0x564a0ad48aa0 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 -- 172.21.15.42:0/487526717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 msgr2=0x564a0ad4ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 --2- 172.21.15.42:0/487526717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad4ae90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00a470 tx=0x7fafcc01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 -- 172.21.15.42:0/487526717 shutdown_connections 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 --2- 172.21.15.42:0/487526717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad4ae90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 -- 172.21.15.42:0/487526717 >> 172.21.15.42:0/487526717 conn(0x564a0ad424d0 msgr2=0x564a0ad448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 -- 172.21.15.42:0/487526717 shutdown_connections 2024-02-16T00:11:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.215+0000 7fafd5da2800 1 -- 172.21.15.42:0/487526717 wait complete. 2024-02-16T00:11:22.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.226+0000 7fafd5da2800 1 Processor -- start 2024-02-16T00:11:22.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.226+0000 7fafd5da2800 1 -- start start 2024-02-16T00:11:22.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.226+0000 7fafd5da2800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ae37fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.226+0000 7fafd5da2800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0ac47980 con 0x564a0ad48aa0 2024-02-16T00:11:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7fafd38a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ae37fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7fafd38a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ae37fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58260/0 (socket says 172.21.15.42:58260) 2024-02-16T00:11:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7fafd38a1640 1 -- 172.21.15.42:0/1071588489 learned_addr learned my addr 172.21.15.42:0/1071588489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7fafd38a1640 1 -- 172.21.15.42:0/1071588489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc005d20 con 0x564a0ad48aa0 2024-02-16T00:11:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7fafd38a1640 1 --2- 172.21.15.42:0/1071588489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ae37fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fafcc055040 tx=0x7fafcc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4e01a9af6891ee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7faec1e0b640 1 -- 172.21.15.42:0/1071588489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafcc00a180 con 0x564a0ad48aa0 2024-02-16T00:11:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7faec1e0b640 1 -- 172.21.15.42:0/1071588489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc00a2e0 con 0x564a0ad48aa0 2024-02-16T00:11:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.227+0000 7faec1e0b640 1 -- 172.21.15.42:0/1071588489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafcc0529b0 con 0x564a0ad48aa0 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 -- 172.21.15.42:0/1071588489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 msgr2=0x564a0ae37fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 --2- 172.21.15.42:0/1071588489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ae37fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fafcc055040 tx=0x7fafcc04c000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 -- 172.21.15.42:0/1071588489 shutdown_connections 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 --2- 172.21.15.42:0/1071588489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ae37fe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 -- 172.21.15.42:0/1071588489 >> 172.21.15.42:0/1071588489 conn(0x564a0ad424d0 msgr2=0x564a0ae33900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 -- 172.21.15.42:0/1071588489 shutdown_connections 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 -- 172.21.15.42:0/1071588489 wait complete. 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 Processor -- start 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.228+0000 7fafd5da2800 1 -- start start 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd5da2800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd5da2800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0ac43160 con 0x564a0ad48aa0 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd38a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd38a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58272/0 (socket says 172.21.15.42:58272) 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd38a1640 1 -- 172.21.15.42:0/2581482724 learned_addr learned my addr 172.21.15.42:0/2581482724 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd38a1640 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0ad4fef0 con 0x564a0ad48aa0 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.229+0000 7fafd38a1640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad483e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00a470 tx=0x7fafcc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.230+0000 7faebbfff640 1 -- 172.21.15.42:0/2581482724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafcc06a070 con 0x564a0ad48aa0 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.230+0000 7faebbfff640 1 -- 172.21.15.42:0/2581482724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc05d420 con 0x564a0ad48aa0 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.230+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a0ad46ad0 con 0x564a0ad48aa0 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.230+0000 7faebbfff640 1 -- 172.21.15.42:0/2581482724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafcc05d5d0 con 0x564a0ad48aa0 2024-02-16T00:11:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.230+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a0ad46fb0 con 0x564a0ad48aa0 2024-02-16T00:11:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.230+0000 7faebbfff640 1 -- 172.21.15.42:0/2581482724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fafcc05d730 con 0x564a0ad48aa0 2024-02-16T00:11:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7faebbfff640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faebc0367e0 0x7faebc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7faebbfff640 1 -- 172.21.15.42:0/2581482724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fafcc08daf0 con 0x564a0ad48aa0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd30a0640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faebc0367e0 0x7faebc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ad4b3d0 0x564a0ae48880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ad477a0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd40a2640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ad4b3d0 0x564a0ae48880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd30a0640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faebc0367e0 0x7faebc038ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fafbc001d90 tx=0x7fafbc0012f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd40a2640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ad4b3d0 0x564a0ae48880 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd40a2640 1 -- 172.21.15.42:0/2581482724 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafc400a4a0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.231+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ad472e0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd40a2640 1 -- 172.21.15.42:0/2581482724 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fafc400a4a0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae4aca0 0x564a0ae4d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae4d760 con 0x564a0ae4aca0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd38a1640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae4aca0 0x564a0ae4d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd38a1640 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae4aca0 0x564a0ae4d090 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd38a1640 1 -- 172.21.15.42:0/2581482724 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fafcc07e040 con 0x564a0ae4aca0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.232+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae49bf0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd40a2640 1 -- 172.21.15.42:0/2581482724 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fafc400a4a0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae4a000 con 0x564a0ad4b3d0 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd40a2640 1 -- 172.21.15.42:0/2581482724 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fafc400a4a0 con 0x564a0ad4b3d0 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd5da2800 1 Processor -- start 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd5da2800 1 -- start start 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd5da2800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 0x564a0ae5c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.233+0000 7fafd5da2800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0abe5e80 con 0x564a0ae5c520 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd40a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 0x564a0ae5c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd40a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 0x564a0ae5c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58288/0 (socket says 172.21.15.42:58288) 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd40a2640 1 -- 172.21.15.42:0/2356376884 learned_addr learned my addr 172.21.15.42:0/2356376884 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd40a2640 1 -- 172.21.15.42:0/2356376884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0ae5ce80 con 0x564a0ae5c520 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd40a2640 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 0x564a0ae5c940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x564a0ae48dc0 tx=0x7fafc4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7faeb97fa640 1 -- 172.21.15.42:0/2356376884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafc401d070 con 0x564a0ae5c520 2024-02-16T00:11:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7faeb97fa640 1 -- 172.21.15.42:0/2356376884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40182e0 con 0x564a0ae5c520 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a0ae5d8f0 con 0x564a0ae5c520 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7faeb97fa640 1 -- 172.21.15.42:0/2356376884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafc40145a0 con 0x564a0ae5c520 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.234+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a0ae5ddb0 con 0x564a0ae5c520 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.235+0000 7faeb97fa640 1 -- 172.21.15.42:0/2356376884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fafc4020020 con 0x564a0ae5c520 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.235+0000 7faeb97fa640 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faeac0367e0 0x7faeac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.235+0000 7faeb97fa640 1 -- 172.21.15.42:0/2356376884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fafc404dc30 con 0x564a0ae5c520 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.235+0000 7fafd38a1640 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faeac0367e0 0x7faeac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd5da2800 1 Processor -- start 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd5da2800 1 -- start start 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd38a1640 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faeac0367e0 0x7faeac038ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fafcc06d000 tx=0x7fafcc066eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd5da2800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae69b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd5da2800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0abbb5d0 con 0x564a0ae696e0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd40a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae69b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd40a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae69b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58292/0 (socket says 172.21.15.42:58292) 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd40a2640 1 -- 172.21.15.42:0/769896908 learned_addr learned my addr 172.21.15.42:0/769896908 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.236+0000 7fafd40a2640 1 -- 172.21.15.42:0/769896908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0ae6a0d0 con 0x564a0ae696e0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd40a2640 1 --2- 172.21.15.42:0/769896908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae69b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafc404bfb0 tx=0x7fafc4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22906c6fe57950e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7faeb2ffd640 1 -- 172.21.15.42:0/769896908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafc402b350 con 0x564a0ae696e0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7faeb2ffd640 1 -- 172.21.15.42:0/769896908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc402b4b0 con 0x564a0ae696e0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7faeb2ffd640 1 -- 172.21.15.42:0/769896908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafc4040220 con 0x564a0ae696e0 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 -- 172.21.15.42:0/769896908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 msgr2=0x564a0ae69b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 --2- 172.21.15.42:0/769896908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae69b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafc404bfb0 tx=0x7fafc4011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 -- 172.21.15.42:0/769896908 shutdown_connections 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 --2- 172.21.15.42:0/769896908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae69b00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 -- 172.21.15.42:0/769896908 >> 172.21.15.42:0/769896908 conn(0x564a0ae659f0 msgr2=0x564a0ae63aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 -- 172.21.15.42:0/769896908 shutdown_connections 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.237+0000 7fafd5da2800 1 -- 172.21.15.42:0/769896908 wait complete. 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd5da2800 1 Processor -- start 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd5da2800 1 -- start start 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd5da2800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae70660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd5da2800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0ae70ba0 con 0x564a0ae696e0 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd40a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae70660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd40a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae70660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58298/0 (socket says 172.21.15.42:58298) 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 learned_addr learned my addr 172.21.15.42:0/3586827340 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.238+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0ae5ddb0 con 0x564a0ae696e0 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.239+0000 7fafd40a2640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae70660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafc4043040 tx=0x7fafc404bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.239+0000 7faeb17fa640 1 -- 172.21.15.42:0/3586827340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafc4033070 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.239+0000 7faeb17fa640 1 -- 172.21.15.42:0/3586827340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40116f0 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.239+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a0ae70da0 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.239+0000 7faeb17fa640 1 -- 172.21.15.42:0/3586827340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fafc402b350 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.239+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a0ae71200 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7faeb17fa640 1 -- 172.21.15.42:0/3586827340 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fafc4014910 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7faeb17fa640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fae9c0367b0 0x7fae9c038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7faeb17fa640 1 -- 172.21.15.42:0/3586827340 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fafc4039c60 con 0x564a0ae696e0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd38a1640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fae9c0367b0 0x7fae9c038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ae7c380 0x564a0ae7e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae7ef70 con 0x564a0ae7c380 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd30a0640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ae7c380 0x564a0ae7e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd38a1640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fae9c0367b0 0x7fae9c038c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fafcc044790 tx=0x7fafcc08e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.240+0000 7fafd30a0640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ae7c380 0x564a0ae7e820 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 realm 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae7b8a0 con 0x564a0ae7c380 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae7f9f0 con 0x564a0ae7c380 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae7ff00 con 0x564a0ae7c380 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae80cb0 0x564a0ae830a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.241+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae83660 con 0x564a0ae80cb0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd40a2640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae80cb0 0x564a0ae830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd40a2640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae80cb0 0x564a0ae830a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd5da2800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd5da2800 20 searching for the correct realm 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564a0ae853f0 0x564a0ae877e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae87e90 con 0x564a0ae853f0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd38a1640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564a0ae853f0 0x564a0ae877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.242+0000 7fafd38a1640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564a0ae853f0 0x564a0ae877e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.243+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.243+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae87e90 con 0x564a0ae80cb0 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.243+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.243+0000 7fafd40a2640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fafc4057040 0x7fafc4023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.243+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.244+0000 7fafd30a0640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fafc4057040 0x7fafc4023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.244+0000 7fafd30a0640 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fafc4057040 0x7fafc4023420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.244+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.244+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.244+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.244+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae80cb0 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.245+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.246+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae80cb0 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.247+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.247+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.247+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.247+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.247+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.247+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.248+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae80cb0 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x564a0ae7c380 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.249+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.250+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.250+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.250+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.250+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.250+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc006070 con 0x7fafc4057040 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.250+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae80cb0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.251+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.251+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae853f0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.251+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.251+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x7fafc4057040 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.251+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.251+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae7c380 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fafc4055040 con 0x564a0ae80cb0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:22.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae83ed0 con 0x564a0ae7c380 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae84280 con 0x564a0ae7c380 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae84660 con 0x564a0ae7c380 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.252+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 zone default found 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 4 Realm: () 2024-02-16T00:11:22.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 zonegroup default 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae882d0 con 0x7fafc4057040 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae83b20 con 0x564a0ae853f0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.253+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8a1f0 con 0x564a0ae853f0 2024-02-16T00:11:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.254+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.254+0000 7fafd5da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.254+0000 7fafd5da2800 20 started sync module instance, tier type = 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.254+0000 7fafd5da2800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.254+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae89720 con 0x564a0ae80cb0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.255+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.255+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876010585056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8a610 con 0x564a0ae80cb0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.255+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8ae10 con 0x564a0ae7c380 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.256+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876010585056] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.256+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.256+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876010587664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8b1c0 con 0x564a0ae7c380 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.256+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8b9c0 con 0x564a0ae853f0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.257+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876010587664] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.257+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.257+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876010590656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8b5e0 con 0x564a0ae853f0 2024-02-16T00:11:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.257+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8c6c0 con 0x564a0ae80cb0 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.258+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.258+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876010590656] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.258+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876010593568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8ca70 con 0x564a0ae80cb0 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.258+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8d480 con 0x564a0ae7c380 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.260+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876010593568] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.260+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.260+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876010594624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8d440 con 0x564a0ae7c380 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.260+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8de70 con 0x7fafc4057040 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.261+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.261+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876010600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8e310 con 0x7fafc4057040 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.261+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8ede0 con 0x7fafc4057040 2024-02-16T00:11:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.261+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876010594624] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.262+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.262+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876010604736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8eda0 con 0x7fafc4057040 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.262+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8f7c0 con 0x7fafc4057040 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.262+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876010600912] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876010604736] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876010607264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8cfa0 con 0x7fafc4057040 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=0 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=1 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=2 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=3 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=4 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=5 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.263+0000 7fafd5da2800 20 add_watcher() i=6 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.264+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876010607264] v27'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.264+0000 7fafd5da2800 20 add_watcher() i=7 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.264+0000 7fafd5da2800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.264+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae927b0 con 0x564a0ae7c380 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.264+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.264+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876010601968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8fc90 con 0x564a0ae7c380 2024-02-16T00:11:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.265+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876010601968] v27'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.265+0000 7fae89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.265+0000 7fafd5da2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.265+0000 7fafd5da2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.265+0000 7fafd5da2800 5 note: GC not initialized 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fae88fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fafd5da2800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fafd5da2800 20 Filter name: none 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fae027fc640 20 reqs_thread_entry: start 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fafd5da2800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0aec4270 con 0x564a0ae7c380 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.266+0000 7fafd5da2800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:22.275 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.267+0000 7fae89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.267+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876010601968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae92080 con 0x564a0ae7c380 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.268+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94876010601968] v27'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.268+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876010585056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8ddf0 con 0x564a0ae80cb0 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.269+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94876010585056] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.269+0000 7fafd5da2800 20 remove_watcher() i=0 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.269+0000 7fafd5da2800 2 removed watcher, disabling cache 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.269+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876010587664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8ddf0 con 0x564a0ae7c380 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.270+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94876010587664] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.270+0000 7fafd5da2800 20 remove_watcher() i=1 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.270+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876010590656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8a610 con 0x564a0ae853f0 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.271+0000 7fafd38a1640 1 -- 172.21.15.42:0/3586827340 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94876010590656] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafcc095040 con 0x564a0ae853f0 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.271+0000 7fafd5da2800 20 remove_watcher() i=2 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.271+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876010593568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8ddf0 con 0x564a0ae80cb0 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.272+0000 7fafd40a2640 1 -- 172.21.15.42:0/3586827340 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94876010593568] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafc4047040 con 0x564a0ae80cb0 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.272+0000 7fafd5da2800 20 remove_watcher() i=3 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.272+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876010594624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8b1c0 con 0x564a0ae7c380 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.273+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94876010594624] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x564a0ae7c380 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.274+0000 7fafd5da2800 20 remove_watcher() i=4 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.274+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876010600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8c1c0 con 0x7fafc4057040 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.275+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94876010600912] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.275+0000 7fafd5da2800 20 remove_watcher() i=5 2024-02-16T00:11:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.275+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876010604736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8de70 con 0x7fafc4057040 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.276+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94876010604736] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.276+0000 7fafd5da2800 20 remove_watcher() i=6 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.276+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876010607264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564a0ae8de70 con 0x7fafc4057040 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94876010607264] v27'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fafbc037040 con 0x7fafc4057040 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 20 remove_watcher() i=7 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fafc4057040 msgr2=0x7fafc4023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fafc4057040 0x7fafc4023420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ae7c380 msgr2=0x564a0ae7e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ae7c380 0x564a0ae7e820 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae80cb0 msgr2=0x564a0ae830a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae80cb0 0x564a0ae830a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564a0ae853f0 msgr2=0x564a0ae877e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564a0ae853f0 0x564a0ae877e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fae9c0367b0 msgr2=0x7fae9c038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fae9c0367b0 0x7fae9c038c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fafcc044790 tx=0x7fafcc08e000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 msgr2=0x564a0ae70660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae70660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafc4043040 tx=0x7fafc404bf10 comp rx=0 tx=0).stop 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd30a0640 1 -- 172.21.15.42:0/3586827340 reap_dead start 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 shutdown_connections 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/3586827340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae696e0 0x564a0ae70660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 >> 172.21.15.42:0/3586827340 conn(0x564a0ae659f0 msgr2=0x564a0ae630a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 shutdown_connections 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/3586827340 wait complete. 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faeac0367e0 msgr2=0x7faeac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faeac0367e0 0x7faeac038ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fafcc06d000 tx=0x7fafcc066eb0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 msgr2=0x564a0ae5c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 0x564a0ae5c940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x564a0ae48dc0 tx=0x7fafc4018830 comp rx=0 tx=0).stop 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 shutdown_connections 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faeac0367e0 0x7faeac038ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2356376884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ae5c520 0x564a0ae5c940 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 >> 172.21.15.42:0/2356376884 conn(0x564a0ae505c0 msgr2=0x564a0ae509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 shutdown_connections 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.277+0000 7fafd5da2800 1 -- 172.21.15.42:0/2356376884 wait complete. 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ad4b3d0 msgr2=0x564a0ae48880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ad4b3d0 0x564a0ae48880 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae4aca0 msgr2=0x564a0ae4d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae4aca0 0x564a0ae4d090 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faebc0367e0 msgr2=0x7faebc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faebc0367e0 0x7faebc038ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fafbc001d90 tx=0x7fafbc0012f0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 msgr2=0x564a0ad483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad483e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00a470 tx=0x7fafcc002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 shutdown_connections 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564a0ae4aca0 0x564a0ae4d090 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564a0ad4b3d0 0x564a0ae48880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faebc0367e0 0x7faebc038ca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 --2- 172.21.15.42:0/2581482724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a0ad48aa0 0x564a0ad483e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 >> 172.21.15.42:0/2581482724 conn(0x564a0ad424d0 msgr2=0x564a0ae32180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 shutdown_connections 2024-02-16T00:11:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.278+0000 7fafd5da2800 1 -- 172.21.15.42:0/2581482724 wait complete. 2024-02-16T00:11:22.289 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:22.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-16T00:11:22.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-16T00:11:22.289 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-16T00:11:22.371 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.371 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.369+0000 7ff5b5d31800 1 Processor -- start 2024-02-16T00:11:22.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.369+0000 7ff5b5d31800 1 -- start start 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b5d31800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55db6aaeb020 0x55db6aaeb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b5d31800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55db6aa35bb0 con 0x55db6aaec280 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b5d31800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55db6a9ed450 con 0x55db6aaeb020 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b1a34640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55db6aaeb020 0x55db6aaeb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b1233640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55db6aaec280 0x55db6aaec700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60186/0 (socket says 172.21.15.42:60186) 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b1233640 1 -- 172.21.15.42:0/3134878644 learned_addr learned my addr 172.21.15.42:0/3134878644 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b1a34640 1 -- 172.21.15.42:0/3134878644 >> v1:172.21.15.2:6789/0 conn(0x55db6aaec280 legacy=0x55db6aaec700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.370+0000 7ff5b1a34640 1 -- 172.21.15.42:0/3134878644 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6aaebb10 con 0x55db6aaeb020 2024-02-16T00:11:22.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.372+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/3134878644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aaeb440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4005fd0 tx=0x7ff5a401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938219aa36c00da3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.372+0000 7ff5b0a32640 1 -- 172.21.15.42:0/3134878644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4052560 con 0x55db6aaeb020 2024-02-16T00:11:22.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.372+0000 7ff5b0a32640 1 -- 172.21.15.42:0/3134878644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40526c0 con 0x55db6aaeb020 2024-02-16T00:11:22.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.372+0000 7ff5b0a32640 1 -- 172.21.15.42:0/3134878644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a40529e0 con 0x55db6aaeb020 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3134878644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 msgr2=0x55db6aaeb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3134878644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aaeb440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4005fd0 tx=0x7ff5a401cb90 comp rx=0 tx=0).stop 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3134878644 shutdown_connections 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3134878644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aaeb440 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3134878644 >> 172.21.15.42:0/3134878644 conn(0x55db6aae65c0 msgr2=0x55db6aae89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3134878644 shutdown_connections 2024-02-16T00:11:22.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.373+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3134878644 wait complete. 2024-02-16T00:11:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.384+0000 7ff5b5d31800 1 Processor -- start 2024-02-16T00:11:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.384+0000 7ff5b5d31800 1 -- start start 2024-02-16T00:11:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.384+0000 7ff5b5d31800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6abdb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.384+0000 7ff5b5d31800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6a9ea980 con 0x55db6aaeb020 2024-02-16T00:11:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff5b1a34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6abdb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff5b1a34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6abdb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58330/0 (socket says 172.21.15.42:58330) 2024-02-16T00:11:22.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff5b1a34640 1 -- 172.21.15.42:0/1615474030 learned_addr learned my addr 172.21.15.42:0/1615474030 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff5b1a34640 1 -- 172.21.15.42:0/1615474030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a400a100 con 0x55db6aaeb020 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/1615474030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6abdb360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4054040 tx=0x7ff5a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e297c54f2b0054 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff49fe07640 1 -- 172.21.15.42:0/1615474030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4052960 con 0x55db6aaeb020 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff49fe07640 1 -- 172.21.15.42:0/1615474030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4052ac0 con 0x55db6aaeb020 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.385+0000 7ff49fe07640 1 -- 172.21.15.42:0/1615474030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4052d80 con 0x55db6aaeb020 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1615474030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 msgr2=0x55db6abdb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1615474030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6abdb360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4054040 tx=0x7ff5a404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1615474030 shutdown_connections 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1615474030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6abdb360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1615474030 >> 172.21.15.42:0/1615474030 conn(0x55db6aae65c0 msgr2=0x55db6abd6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1615474030 shutdown_connections 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1615474030 wait complete. 2024-02-16T00:11:22.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.386+0000 7ff5b5d31800 1 Processor -- start 2024-02-16T00:11:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b5d31800 1 -- start start 2024-02-16T00:11:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b5d31800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aa60050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b5d31800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6a9e6160 con 0x55db6aaeb020 2024-02-16T00:11:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b1a34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aa60050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b1a34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aa60050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58336/0 (socket says 172.21.15.42:58336) 2024-02-16T00:11:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b1a34640 1 -- 172.21.15.42:0/3487943443 learned_addr learned my addr 172.21.15.42:0/3487943443 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.387+0000 7ff5b1a34640 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a404e070 con 0x55db6aaeb020 2024-02-16T00:11:22.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.388+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aa60050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff5a401d2c0 tx=0x7ff5a4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.388+0000 7ff49e604640 1 -- 172.21.15.42:0/3487943443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a405cdc0 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.388+0000 7ff49e604640 1 -- 172.21.15.42:0/3487943443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4066410 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.388+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55db6aa5e740 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.388+0000 7ff49e604640 1 -- 172.21.15.42:0/3487943443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a40666f0 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.388+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db6aa5ec20 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff49e604640 1 -- 172.21.15.42:0/3487943443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff5a4066850 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff49e604640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff4980367e0 0x7ff498038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff49e604640 1 -- 172.21.15.42:0/3487943443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5a408e210 con 0x55db6aaeb020 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff5b1233640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff4980367e0 0x7ff498038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6aaec280 0x55db6abebc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6aa5f3a0 con 0x55db6aaec280 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff5b2235640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6aaec280 0x55db6abebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff5b1233640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff4980367e0 0x7ff498038ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8000f60 tx=0x7ff5a80012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.389+0000 7ff5b2235640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6aaec280 0x55db6abebc90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b2235640 1 -- 172.21.15.42:0/3487943443 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6abec210 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b2235640 1 -- 172.21.15.42:0/3487943443 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6abedfd0 0x55db6abf03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6abf0ac0 con 0x55db6abedfd0 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6abedfd0 0x55db6abf03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.390+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6abedfd0 0x55db6abf03c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.391+0000 7ff5b1a34640 1 -- 172.21.15.42:0/3487943443 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6abedfd0 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.391+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6abecf50 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.391+0000 7ff5b2235640 1 -- 172.21.15.42:0/3487943443 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.391+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6abed340 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.391+0000 7ff5b2235640 1 -- 172.21.15.42:0/3487943443 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6aaec280 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b5d31800 1 Processor -- start 2024-02-16T00:11:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b5d31800 1 -- start start 2024-02-16T00:11:22.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b5d31800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 0x55db6abffce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b5d31800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6a988e80 con 0x55db6abff8c0 2024-02-16T00:11:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b2235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 0x55db6abffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b2235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 0x55db6abffce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58346/0 (socket says 172.21.15.42:58346) 2024-02-16T00:11:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.392+0000 7ff5b2235640 1 -- 172.21.15.42:0/1577133398 learned_addr learned my addr 172.21.15.42:0/1577133398 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff5b2235640 1 -- 172.21.15.42:0/1577133398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6ac00220 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff5b2235640 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 0x55db6abffce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55db6aa5fd90 tx=0x7ff5ac00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff4977fe640 1 -- 172.21.15.42:0/1577133398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac00f040 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff4977fe640 1 -- 172.21.15.42:0/1577133398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac007d00 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff4977fe640 1 -- 172.21.15.42:0/1577133398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac019420 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55db6ac00c90 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.393+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db6ac01150 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff4977fe640 1 -- 172.21.15.42:0/1577133398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff5ac0195d0 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff4977fe640 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff48c036790 0x7ff48c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff4977fe640 1 -- 172.21.15.42:0/1577133398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5ac04e0b0 con 0x55db6abff8c0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff48c036790 0x7ff48c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff5b5d31800 1 Processor -- start 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff5b5d31800 1 -- start start 2024-02-16T00:11:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff5b5d31800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac0cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.394+0000 7ff5b5d31800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6a95e5d0 con 0x55db6ac0cb50 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff48c036790 0x7ff48c038c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55db6aa5ef30 tx=0x7ff5a40447b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff5b2235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac0cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff5b2235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac0cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58360/0 (socket says 172.21.15.42:58360) 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff5b2235640 1 -- 172.21.15.42:0/1780536534 learned_addr learned my addr 172.21.15.42:0/1780536534 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff5b2235640 1 -- 172.21.15.42:0/1780536534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6ac0d520 con 0x55db6ac0cb50 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff5b2235640 1 --2- 172.21.15.42:0/1780536534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac0cf50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac04c400 tx=0x7ff5ac015800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f06c02e0c6d213 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff4957fa640 1 -- 172.21.15.42:0/1780536534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac017e00 con 0x55db6ac0cb50 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff4957fa640 1 -- 172.21.15.42:0/1780536534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac04a070 con 0x55db6ac0cb50 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.395+0000 7ff4957fa640 1 -- 172.21.15.42:0/1780536534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac018500 con 0x55db6ac0cb50 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1780536534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 msgr2=0x55db6ac0cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1780536534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac0cf50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac04c400 tx=0x7ff5ac015800 comp rx=0 tx=0).stop 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1780536534 shutdown_connections 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1780536534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac0cf50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1780536534 >> 172.21.15.42:0/1780536534 conn(0x55db6ac08e20 msgr2=0x55db6ac06e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1780536534 shutdown_connections 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1780536534 wait complete. 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 Processor -- start 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- start start 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac13a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b5d31800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6ac13f40 con 0x55db6ac0cb50 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b2235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac13a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b2235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac13a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58362/0 (socket says 172.21.15.42:58362) 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.396+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 learned_addr learned my addr 172.21.15.42:0/2403072659 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6ac01150 con 0x55db6ac0cb50 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff5b2235640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac13a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac015840 tx=0x7ff5ac04c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff4837fe640 1 -- 172.21.15.42:0/2403072659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac047040 con 0x55db6ac0cb50 2024-02-16T00:11:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff4837fe640 1 -- 172.21.15.42:0/2403072659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0183b0 con 0x55db6ac0cb50 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55db6ac14140 con 0x55db6ac0cb50 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff4837fe640 1 -- 172.21.15.42:0/2403072659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac0173b0 con 0x55db6ac0cb50 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.397+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db6ac14600 con 0x55db6ac0cb50 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff4837fe640 1 -- 172.21.15.42:0/2403072659 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff5ac03b250 con 0x55db6ac0cb50 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff4837fe640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff47c036790 0x7ff47c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff4837fe640 1 -- 172.21.15.42:0/2403072659 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5ac036c90 con 0x55db6ac0cb50 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff47c036790 0x7ff47c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6ac1f7b0 0x55db6ac21c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.398+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac223c0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b1233640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6ac1f7b0 0x55db6ac21c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff47c036790 0x7ff47c038c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4067fd0 tx=0x7ff5a4083000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b1233640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6ac1f7b0 0x55db6ac21c70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 20 realm 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac1ec10 con 0x55db6ac1f7b0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.399+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac22e40 con 0x55db6ac1f7b0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac236c0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6ac240a0 0x55db6ac26490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac26b60 con 0x55db6ac240a0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b2235640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6ac240a0 0x55db6ac26490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b2235640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6ac240a0 0x55db6ac26490 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 20 searching for the correct realm 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.400+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55db6ac28e50 0x55db6ac2b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.401+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.401+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55db6ac28e50 0x55db6ac2b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.401+0000 7ff5b1a34640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55db6ac28e50 0x55db6ac2b310 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.401+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.401+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac240a0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.402+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.402+0000 7ff5b2235640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff5ac035070 0x7ff5ac042090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.402+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.402+0000 7ff5b1233640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff5ac035070 0x7ff5ac042090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.402+0000 7ff5b1233640 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff5ac035070 0x7ff5ac042090 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.403+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.403+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.403+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.403+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.403+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.403+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac240a0 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.404+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac240a0 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.405+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.406+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.407+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.408+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.408+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac240a0 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.408+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.408+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.408+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x55db6ac1f7b0 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.408+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8006070 con 0x7ff5ac035070 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac240a0 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.409+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac28e50 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.410+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.410+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x7ff5ac035070 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.410+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.410+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.410+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.410+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2b9e0 con 0x55db6ac240a0 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:22.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac283b0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac27370 con 0x55db6ac1f7b0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac27ca0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:22.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 zone default found 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 4 Realm: () 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 zonegroup default 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.411+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2c2c0 con 0x7ff5ac035070 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2dd90 con 0x55db6ac28e50 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2e220 con 0x55db6ac28e50 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 started sync module instance, tier type = 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.412+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2d9c0 con 0x55db6ac240a0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.413+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.413+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94400877349952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2e640 con 0x55db6ac240a0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.413+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2ee40 con 0x55db6ac1f7b0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.414+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94400877349952] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.415+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.415+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94400877356608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2ef00 con 0x55db6ac1f7b0 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.415+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2f870 con 0x55db6ac28e50 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.416+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.416+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94400877360080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac300f0 con 0x55db6ac28e50 2024-02-16T00:11:22.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.416+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac30b80 con 0x55db6ac240a0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.416+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94400877356608] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.417+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.417+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94400877360080] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.417+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94400877357664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac30f60 con 0x55db6ac240a0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.417+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2fc90 con 0x55db6ac1f7b0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.418+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94400877357664] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.418+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.418+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94400877364896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2fc90 con 0x55db6ac1f7b0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.418+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31f90 con 0x7ff5ac035070 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.419+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94400877364896] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.419+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.420+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94400877368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31f90 con 0x7ff5ac035070 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.420+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac32940 con 0x7ff5ac035070 2024-02-16T00:11:22.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.421+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.421+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94400877372512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac32d80 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.421+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac33850 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.421+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94400877368544] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94400877376304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac33810 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=0 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=1 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=2 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=3 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=4 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=5 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94400877372512] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.422+0000 7ff5b5d31800 20 add_watcher() i=6 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.423+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94400877376304] v27'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.423+0000 7ff5b5d31800 20 add_watcher() i=7 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.423+0000 7ff5b5d31800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.423+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac32990 con 0x55db6ac1f7b0 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.423+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.423+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94400877370096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac340d0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.424+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94400877370096] v27'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.424+0000 7ff4637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.424+0000 7ff5b5d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.424+0000 7ff5b5d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.424+0000 7ff5b5d31800 5 note: GC not initialized 2024-02-16T00:11:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff4627fc640 20 reqs_thread_entry: start 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 20 Filter name: none 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff3d3fff640 20 reqs_thread_entry: start 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac687d0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.425+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac6acf0 con 0x55db6ac240a0 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.426+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.426+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac6e660 con 0x55db6ac1f7b0 2024-02-16T00:11:22.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v27'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b5d31800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b5d31800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b5d31800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94400877617920 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac6b560 con 0x55db6ac1f7b0 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94400877364896 notify 115964116994 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55db6aa35bb0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff4957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94400877364896 notifier 4320 bl.length()=534 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff4957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff4957fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff4957fa640 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7ff474003e90 con 0x55db6ac1f7b0 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(65 notify.4 [notify cookie 94400877617920 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.427+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94400877617920 notify 115964116994 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff5a802f830 con 0x55db6ac1f7b0 2024-02-16T00:11:22.439 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.428+0000 7ff4637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.428+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94400877370096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac35f20 con 0x55db6ac1f7b0 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.429+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94400877370096] v27'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.429+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94400877349952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31af0 con 0x55db6ac240a0 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.430+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94400877349952] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.430+0000 7ff5b5d31800 20 remove_watcher() i=0 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.430+0000 7ff5b5d31800 2 removed watcher, disabling cache 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.430+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94400877356608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31af0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.432+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94400877356608] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.432+0000 7ff5b5d31800 20 remove_watcher() i=1 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.432+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94400877360080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac2e640 con 0x55db6ac28e50 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.433+0000 7ff5b1a34640 1 -- 172.21.15.42:0/2403072659 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94400877360080] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a4077070 con 0x55db6ac28e50 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.433+0000 7ff5b5d31800 20 remove_watcher() i=2 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.433+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94400877357664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31af0 con 0x55db6ac240a0 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.434+0000 7ff5b2235640 1 -- 172.21.15.42:0/2403072659 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94400877357664] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5ac0083e0 con 0x55db6ac240a0 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.434+0000 7ff5b5d31800 20 remove_watcher() i=3 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.434+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94400877364896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31af0 con 0x55db6ac1f7b0 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.435+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94400877364896] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x55db6ac1f7b0 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.435+0000 7ff5b5d31800 20 remove_watcher() i=4 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.435+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94400877368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac306a0 con 0x7ff5ac035070 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.436+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94400877368544] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.436+0000 7ff5b5d31800 20 remove_watcher() i=5 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.436+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94400877372512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac31af0 con 0x7ff5ac035070 2024-02-16T00:11:22.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.437+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94400877372512] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.437+0000 7ff5b5d31800 20 remove_watcher() i=6 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.437+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94400877376304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55db6ac314e0 con 0x7ff5ac035070 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94400877376304] v27'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5a8037040 con 0x7ff5ac035070 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 20 remove_watcher() i=7 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff5ac035070 msgr2=0x7ff5ac042090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff5ac035070 0x7ff5ac042090 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6ac1f7b0 msgr2=0x55db6ac21c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6ac1f7b0 0x55db6ac21c70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6ac240a0 msgr2=0x55db6ac26490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6ac240a0 0x55db6ac26490 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55db6ac28e50 msgr2=0x55db6ac2b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55db6ac28e50 0x55db6ac2b310 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff47c036790 msgr2=0x7ff47c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff47c036790 0x7ff47c038c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4067fd0 tx=0x7ff5a4083000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 msgr2=0x55db6ac13a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/2403072659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6ac0cb50 0x55db6ac13a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac015840 tx=0x7ff5ac04c390 comp rx=0 tx=0).stop 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 reap_dead start 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b1233640 1 -- 172.21.15.42:0/2403072659 reap_dead start 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 shutdown_connections 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 >> 172.21.15.42:0/2403072659 conn(0x55db6ac08e20 msgr2=0x55db6ac06480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 shutdown_connections 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/2403072659 wait complete. 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff48c036790 msgr2=0x7ff48c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff48c036790 0x7ff48c038c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55db6aa5ef30 tx=0x7ff5a40447b0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 msgr2=0x55db6abffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 0x55db6abffce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55db6aa5fd90 tx=0x7ff5ac00aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 shutdown_connections 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff48c036790 0x7ff48c038c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/1577133398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6abff8c0 0x55db6abffce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 >> 172.21.15.42:0/1577133398 conn(0x55db6abf3960 msgr2=0x55db6abf3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.438+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 shutdown_connections 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/1577133398 wait complete. 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6aaec280 msgr2=0x55db6abebc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6aaec280 0x55db6abebc90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6abedfd0 msgr2=0x55db6abf03c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6abedfd0 0x55db6abf03c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff4980367e0 msgr2=0x7ff498038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff4980367e0 0x7ff498038ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8000f60 tx=0x7ff5a80012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 msgr2=0x55db6aa60050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aa60050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff5a401d2c0 tx=0x7ff5a4003330 comp rx=0 tx=0).stop 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 shutdown_connections 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55db6abedfd0 0x55db6abf03c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55db6aaec280 0x55db6abebc90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff4980367e0 0x7ff498038ca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 --2- 172.21.15.42:0/3487943443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db6aaeb020 0x55db6aa60050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 >> 172.21.15.42:0/3487943443 conn(0x55db6aae65c0 msgr2=0x55db6abd9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 shutdown_connections 2024-02-16T00:11:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.439+0000 7ff5b5d31800 1 -- 172.21.15.42:0/3487943443 wait complete. 2024-02-16T00:11:22.450 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:22.450 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:22.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:22.450 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:22.531 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.532 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.529+0000 7f2ba6b39800 1 Processor -- start 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.529+0000 7f2ba6b39800 1 -- start start 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba6b39800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558ce6a6b300 0x558ce6a6d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba6b39800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558ce69b2bb0 con 0x558ce6a66e70 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba6b39800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x558ce696a450 con 0x558ce6a6b300 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba20cf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558ce6a6b300 0x558ce6a6d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba28d0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558ce6a66e70 0x558ce6a67290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60202/0 (socket says 172.21.15.42:60202) 2024-02-16T00:11:22.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba20cf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558ce6a6b300 0x558ce6a6d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58374/0 (socket says 172.21.15.42:58374) 2024-02-16T00:11:22.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba28d0640 1 -- 172.21.15.42:0/1458929571 learned_addr learned my addr 172.21.15.42:0/1458929571 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba20cf640 1 -- 172.21.15.42:0/1458929571 >> v1:172.21.15.2:6789/0 conn(0x558ce6a66e70 legacy=0x558ce6a67290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.530+0000 7f2ba20cf640 1 -- 172.21.15.42:0/1458929571 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ce6a6ed20 con 0x558ce6a6b300 2024-02-16T00:11:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.532+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/1458929571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a6b300 0x558ce6a6d6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800a470 tx=0x7f2b9801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc34f50220b2bde server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.532+0000 7f2ba18ce640 1 -- 172.21.15.42:0/1458929571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b98052570 con 0x558ce6a6b300 2024-02-16T00:11:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.532+0000 7f2ba18ce640 1 -- 172.21.15.42:0/1458929571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980526d0 con 0x558ce6a6b300 2024-02-16T00:11:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.532+0000 7f2ba18ce640 1 -- 172.21.15.42:0/1458929571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b98052990 con 0x558ce6a6b300 2024-02-16T00:11:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1458929571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a6b300 msgr2=0x558ce6a6d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/1458929571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a6b300 0x558ce6a6d6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800a470 tx=0x7f2b9801cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1458929571 shutdown_connections 2024-02-16T00:11:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/1458929571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a6b300 0x558ce6a6d6f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1458929571 >> 172.21.15.42:0/1458929571 conn(0x558ce6a624d0 msgr2=0x558ce6a648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1458929571 shutdown_connections 2024-02-16T00:11:22.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.533+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1458929571 wait complete. 2024-02-16T00:11:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.544+0000 7f2ba6b39800 1 Processor -- start 2024-02-16T00:11:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.544+0000 7f2ba6b39800 1 -- start start 2024-02-16T00:11:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.544+0000 7f2ba6b39800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce69daf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.544+0000 7f2ba6b39800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ce6967980 con 0x558ce6a66e70 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2ba28d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce69daf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2ba28d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce69daf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58390/0 (socket says 172.21.15.42:58390) 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2ba28d0640 1 -- 172.21.15.42:0/2622586003 learned_addr learned my addr 172.21.15.42:0/2622586003 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2ba28d0640 1 -- 172.21.15.42:0/2622586003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98005d20 con 0x558ce6a66e70 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/2622586003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce69daf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b940014d0 tx=0x7f2b94001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661f6e771a9e8465 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2a90e09640 1 -- 172.21.15.42:0/2622586003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b94004520 con 0x558ce6a66e70 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2a90e09640 1 -- 172.21.15.42:0/2622586003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94004680 con 0x558ce6a66e70 2024-02-16T00:11:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.545+0000 7f2a90e09640 1 -- 172.21.15.42:0/2622586003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b94004980 con 0x558ce6a66e70 2024-02-16T00:11:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2622586003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 msgr2=0x558ce69daf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2622586003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce69daf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b940014d0 tx=0x7f2b94001990 comp rx=0 tx=0).stop 2024-02-16T00:11:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2622586003 shutdown_connections 2024-02-16T00:11:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2622586003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce69daf30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2622586003 >> 172.21.15.42:0/2622586003 conn(0x558ce6a624d0 msgr2=0x558ce6b52810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2622586003 shutdown_connections 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.546+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2622586003 wait complete. 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba6b39800 1 Processor -- start 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba6b39800 1 -- start start 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba6b39800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce6b61880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba6b39800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ce6963160 con 0x558ce6a66e70 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba28d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce6b61880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba28d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce6b61880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58404/0 (socket says 172.21.15.42:58404) 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba28d0640 1 -- 172.21.15.42:0/2071811226 learned_addr learned my addr 172.21.15.42:0/2071811226 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.547+0000 7f2ba28d0640 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ce69b2bb0 con 0x558ce6a66e70 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.548+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce6b61880 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b940014d0 tx=0x7f2b94001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.548+0000 7f2a8f606640 1 -- 172.21.15.42:0/2071811226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b94013820 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.548+0000 7f2a8f606640 1 -- 172.21.15.42:0/2071811226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94013980 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.548+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ce6b61dc0 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.548+0000 7f2a8f606640 1 -- 172.21.15.42:0/2071811226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b94013c40 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.548+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ce6b622a0 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2a8f606640 1 -- 172.21.15.42:0/2071811226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2b94028460 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2a8f606640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a88036790 0x7f2a88038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2a8f606640 1 -- 172.21.15.42:0/2071811226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2b9404c290 con 0x558ce6a66e70 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a88036790 0x7f2a88038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6a6b300 0x558ce6b685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b68c00 con 0x558ce6a6b300 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6a6b300 0x558ce6b685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a88036790 0x7f2a88038c50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b98054000 tx=0x7f2b9804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.549+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6a6b300 0x558ce6b685c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba30d1640 1 -- 172.21.15.42:0/2071811226 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6a6b300 2024-02-16T00:11:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b65c50 con 0x558ce6a6b300 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba30d1640 1 -- 172.21.15.42:0/2071811226 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6a6b300 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6b6ae10 0x558ce6b6d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b6d8f0 con 0x558ce6b6ae10 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6b6ae10 0x558ce6b6d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.550+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6b6ae10 0x558ce6b6d200 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.551+0000 7f2ba28d0640 1 -- 172.21.15.42:0/2071811226 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2b94024020 con 0x558ce6b6ae10 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.551+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b69d90 con 0x558ce6a6b300 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.551+0000 7f2ba30d1640 1 -- 172.21.15.42:0/2071811226 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6a6b300 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.551+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b6a180 con 0x558ce6a6b300 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.551+0000 7f2ba30d1640 1 -- 172.21.15.42:0/2071811226 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6a6b300 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba6b39800 1 Processor -- start 2024-02-16T00:11:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba6b39800 1 -- start start 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba6b39800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 0x558ce6b7cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba6b39800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ce6905e80 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba30d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 0x558ce6b7cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba30d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 0x558ce6b7cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58408/0 (socket says 172.21.15.42:58408) 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba30d1640 1 -- 172.21.15.42:0/1368716445 learned_addr learned my addr 172.21.15.42:0/1368716445 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.552+0000 7f2ba30d1640 1 -- 172.21.15.42:0/1368716445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ce6b7d050 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.553+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 0x558ce6b7cb10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x558ce6b62450 tx=0x7f2b9c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.553+0000 7f2a8ce01640 1 -- 172.21.15.42:0/1368716445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c00f040 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.553+0000 7f2a8ce01640 1 -- 172.21.15.42:0/1368716445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c007d00 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.553+0000 7f2a8ce01640 1 -- 172.21.15.42:0/1368716445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c019420 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.553+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ce6b7dac0 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.553+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ce6b7df80 con 0x558ce6b7c6f0 2024-02-16T00:11:22.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2a8ce01640 1 -- 172.21.15.42:0/1368716445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2b9c0195d0 con 0x558ce6b7c6f0 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2a8ce01640 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a7c036790 0x7f2a7c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2a8ce01640 1 -- 172.21.15.42:0/1368716445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2b9c04dff0 con 0x558ce6b7c6f0 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a7c036790 0x7f2a7c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2ba6b39800 1 Processor -- start 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2ba6b39800 1 -- start start 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a7c036790 0x7f2a7c038c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x558ce6b68fd0 tx=0x7f2b9404a630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2ba6b39800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b89d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.554+0000 7f2ba6b39800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ce68db5d0 con 0x558ce6b89940 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2ba30d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b89d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2ba30d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b89d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58418/0 (socket says 172.21.15.42:58418) 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2ba30d1640 1 -- 172.21.15.42:0/4027783569 learned_addr learned my addr 172.21.15.42:0/4027783569 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2ba30d1640 1 -- 172.21.15.42:0/4027783569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ce6b8a330 con 0x558ce6b89940 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/4027783569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b89d60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c04c400 tx=0x7f2b9c015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5b79075f613b14 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2a867fc640 1 -- 172.21.15.42:0/4027783569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c017e00 con 0x558ce6b89940 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2a867fc640 1 -- 172.21.15.42:0/4027783569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c04a070 con 0x558ce6b89940 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.555+0000 7f2a867fc640 1 -- 172.21.15.42:0/4027783569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c018500 con 0x558ce6b89940 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- 172.21.15.42:0/4027783569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 msgr2=0x558ce6b89d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/4027783569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b89d60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c04c400 tx=0x7f2b9c015760 comp rx=0 tx=0).stop 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- 172.21.15.42:0/4027783569 shutdown_connections 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/4027783569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b89d60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- 172.21.15.42:0/4027783569 >> 172.21.15.42:0/4027783569 conn(0x558ce6b85c10 msgr2=0x558ce6b83c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- 172.21.15.42:0/4027783569 shutdown_connections 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- 172.21.15.42:0/4027783569 wait complete. 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 Processor -- start 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- start start 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b90890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.556+0000 7f2ba6b39800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ce6b90dd0 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba30d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b90890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba30d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b90890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58430/0 (socket says 172.21.15.42:58430) 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 learned_addr learned my addr 172.21.15.42:0/256173079 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ce6b7df80 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b90890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c04c400 tx=0x7f2b9c04c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2a84ff9640 1 -- 172.21.15.42:0/256173079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c040040 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2a84ff9640 1 -- 172.21.15.42:0/256173079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0183b0 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ce6b90fd0 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2a84ff9640 1 -- 172.21.15.42:0/256173079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c0173b0 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.557+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ce6b91430 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2a84ff9640 1 -- 172.21.15.42:0/256173079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2b9c03b250 con 0x558ce6b89940 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2a84ff9640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a6c0367e0 0x7f2a6c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2a84ff9640 1 -- 172.21.15.42:0/256173079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2b9c036c90 con 0x558ce6b89940 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a6c0367e0 0x7f2a6c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6b9c5b0 0x558ce6b9ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b9f1a0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.558+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6b9c5b0 0x558ce6b9ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a6c0367e0 0x7f2a6c038ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2b94013fd0 tx=0x7f2b94036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6b9c5b0 0x558ce6b9ea50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b98059040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 realm 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b9f590 con 0x558ce6b9c5b0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b98059040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6b9fde0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b98059040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.559+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba0140 con 0x558ce6b9c5b0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b98059040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba6b39800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6ba0e50 0x558ce6ba3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba37c0 con 0x558ce6ba0e50 2024-02-16T00:11:22.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6ba0e50 0x558ce6ba3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6ba0e50 0x558ce6ba3240 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.560+0000 7f2ba6b39800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba6b39800 20 searching for the correct realm 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558ce6ba5770 0x558ce6ba7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558ce6ba5770 0x558ce6ba7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba28d0640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558ce6ba5770 0x558ce6ba7c00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.561+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba0e50 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.562+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.562+0000 7f2ba30d1640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2b9c050070 0x7f2b9c03d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.562+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.562+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2b9c050070 0x7f2b9c03d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.562+0000 7f2ba20cf640 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2b9c050070 0x7f2b9c03d110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.563+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba0e50 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.564+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba0e50 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.565+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.566+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.567+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba0e50 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.568+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba0e50 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba5770 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.569+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x7f2b9c050070 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba82d0 con 0x558ce6ba0e50 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.570+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba41c0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba3de0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba4a50 con 0x558ce6b9c5b0 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 zone default found 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 4 Realm: () 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 zonegroup default 2024-02-16T00:11:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.571+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba8bb0 con 0x7f2b9c050070 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baa5c0 con 0x558ce6ba5770 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baaa10 con 0x558ce6ba5770 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 started sync module instance, tier type = 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.572+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6ba9b60 con 0x558ce6ba0e50 2024-02-16T00:11:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.574+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.574+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063654772800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baae30 con 0x558ce6ba0e50 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.574+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bab630 con 0x558ce6b9c5b0 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.575+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063654772800] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.575+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.575+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063654776368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baba10 con 0x558ce6b9c5b0 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.575+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bac210 con 0x558ce6ba5770 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.576+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063654776368] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.577+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.577+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063654779408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6babe30 con 0x558ce6ba5770 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.577+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bacef0 con 0x558ce6ba0e50 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.578+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.578+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063654783504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bad740 con 0x558ce6ba0e50 2024-02-16T00:11:22.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.578+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bae210 con 0x558ce6b9c5b0 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.578+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063654779408] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.579+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.579+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063654788336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bae1d0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.579+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baec70 con 0x7f2b9c050070 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.579+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063654783504] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.580+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.580+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063654791056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baec70 con 0x7f2b9c050070 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.580+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baf660 con 0x7f2b9c050070 2024-02-16T00:11:22.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.580+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063654788336] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.581+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.581+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063654782320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baf660 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.581+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bb0010 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.581+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063654791056] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063654782320] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063654793664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bafb30 con 0x7f2b9c050070 2024-02-16T00:11:22.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=0 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=1 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=2 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=3 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=4 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=5 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.582+0000 7f2ba6b39800 20 add_watcher() i=6 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.583+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063654793664] v27'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.583+0000 7f2ba6b39800 20 add_watcher() i=7 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.583+0000 7f2ba6b39800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.583+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bb2ff0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.583+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.583+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063654785696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bb0360 con 0x558ce6b9c5b0 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.584+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063654785696] v27'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.584+0000 7f2a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 5 note: GC not initialized 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f29d3fff640 20 reqs_thread_entry: start 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 20 Filter name: none 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f29d1ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6be4ad0 con 0x558ce6b9c5b0 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.585+0000 7f2ba6b39800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:22.598 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.586+0000 7f2a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.586+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063654785696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bb2440 con 0x558ce6b9c5b0 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.587+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94063654785696] v27'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.587+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063654772800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6bad2a0 con 0x558ce6ba0e50 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.588+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94063654772800] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.588+0000 7f2ba6b39800 20 remove_watcher() i=0 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.588+0000 7f2ba6b39800 2 removed watcher, disabling cache 2024-02-16T00:11:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.588+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063654776368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baa040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.590+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94063654776368] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.590+0000 7f2ba6b39800 20 remove_watcher() i=1 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.590+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063654779408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baa040 con 0x558ce6ba5770 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.591+0000 7f2ba28d0640 1 -- 172.21.15.42:0/256173079 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94063654779408] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b94054040 con 0x558ce6ba5770 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.591+0000 7f2ba6b39800 20 remove_watcher() i=2 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.591+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063654783504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baba10 con 0x558ce6ba0e50 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.592+0000 7f2ba30d1640 1 -- 172.21.15.42:0/256173079 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94063654783504] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x558ce6ba0e50 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.592+0000 7f2ba6b39800 20 remove_watcher() i=3 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.592+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063654788336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baba10 con 0x558ce6b9c5b0 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.593+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94063654788336] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x558ce6b9c5b0 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.593+0000 7f2ba6b39800 20 remove_watcher() i=4 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.593+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063654791056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6badcf0 con 0x7f2b9c050070 2024-02-16T00:11:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.594+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94063654791056] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.594+0000 7f2ba6b39800 20 remove_watcher() i=5 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.594+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063654782320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baba10 con 0x7f2b9c050070 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.595+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94063654782320] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.595+0000 7f2ba6b39800 20 remove_watcher() i=6 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.595+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063654793664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558ce6baba10 con 0x7f2b9c050070 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94063654793664] v27'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b98071040 con 0x7f2b9c050070 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 20 remove_watcher() i=7 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2b9c050070 msgr2=0x7f2b9c03d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2b9c050070 0x7f2b9c03d110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6b9c5b0 msgr2=0x558ce6b9ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6b9c5b0 0x558ce6b9ea50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6ba0e50 msgr2=0x558ce6ba3240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6ba0e50 0x558ce6ba3240 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558ce6ba5770 msgr2=0x558ce6ba7c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558ce6ba5770 0x558ce6ba7c00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a6c0367e0 msgr2=0x7f2a6c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a6c0367e0 0x7f2a6c038ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2b94013fd0 tx=0x7f2b94036000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 msgr2=0x558ce6b90890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b90890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c04c400 tx=0x7f2b9c04c390 comp rx=0 tx=0).stop 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba20cf640 1 -- 172.21.15.42:0/256173079 reap_dead start 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 shutdown_connections 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/256173079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b89940 0x558ce6b90890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 >> 172.21.15.42:0/256173079 conn(0x558ce6b85c10 msgr2=0x558ce6b83270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 shutdown_connections 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.596+0000 7f2ba6b39800 1 -- 172.21.15.42:0/256173079 wait complete. 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a7c036790 msgr2=0x7f2a7c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a7c036790 0x7f2a7c038c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x558ce6b68fd0 tx=0x7f2b9404a630 comp rx=0 tx=0).stop 2024-02-16T00:11:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 msgr2=0x558ce6b7cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 0x558ce6b7cb10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x558ce6b62450 tx=0x7f2b9c00aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 shutdown_connections 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a7c036790 0x7f2a7c038c50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/1368716445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6b7c6f0 0x558ce6b7cb10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 >> 172.21.15.42:0/1368716445 conn(0x558ce6b70790 msgr2=0x558ce6b70b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 shutdown_connections 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/1368716445 wait complete. 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6a6b300 msgr2=0x558ce6b685c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6a6b300 0x558ce6b685c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6b6ae10 msgr2=0x558ce6b6d200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6b6ae10 0x558ce6b6d200 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a88036790 msgr2=0x7f2a88038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a88036790 0x7f2a88038c50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b98054000 tx=0x7f2b9804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 msgr2=0x558ce6b61880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce6b61880 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b940014d0 tx=0x7f2b94001250 comp rx=0 tx=0).stop 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 shutdown_connections 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558ce6b6ae10 0x558ce6b6d200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558ce6a6b300 0x558ce6b685c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2a88036790 0x7f2a88038c50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 --2- 172.21.15.42:0/2071811226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ce6a66e70 0x558ce6b61880 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 >> 172.21.15.42:0/2071811226 conn(0x558ce6a624d0 msgr2=0x558ce6b51090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 shutdown_connections 2024-02-16T00:11:22.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.597+0000 7f2ba6b39800 1 -- 172.21.15.42:0/2071811226 wait complete. 2024-02-16T00:11:22.609 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:22.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-16T00:11:22.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-16T00:11:22.610 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-02-16T00:11:22.695 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.693+0000 7fbd5cc10800 1 Processor -- start 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd5cc10800 1 -- start start 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd5cc10800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f8c342daa0 0x55f8c342fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd5cc10800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f8c3377c50 con 0x55f8c34303d0 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd5cc10800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f8c332f450 con 0x55f8c342daa0 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd582c2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f8c342daa0 0x55f8c342fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd57ac1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55f8c34303d0 0x55f8c34327c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60206/0 (socket says 172.21.15.42:60206) 2024-02-16T00:11:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.694+0000 7fbd57ac1640 1 -- 172.21.15.42:0/2293924024 learned_addr learned my addr 172.21.15.42:0/2293924024 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.695+0000 7fbd582c2640 1 -- 172.21.15.42:0/2293924024 >> v1:172.21.15.2:6789/0 conn(0x55f8c34303d0 legacy=0x55f8c34327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.695+0000 7fbd572c0640 1 -- 172.21.15.42:0/2293924024 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079346856 0 0) 0x55f8c3377c50 con 0x55f8c34303d0 2024-02-16T00:11:22.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.695+0000 7fbd582c2640 1 -- 172.21.15.42:0/2293924024 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c3434ef0 con 0x55f8c342daa0 2024-02-16T00:11:22.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.696+0000 7fbd582c2640 1 --2- 172.21.15.42:0/2293924024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342fe90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800a470 tx=0x7fbd4801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509f1923b7dbc80e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd572c0640 1 -- 172.21.15.42:0/2293924024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd48052570 con 0x55f8c342daa0 2024-02-16T00:11:22.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd572c0640 1 -- 172.21.15.42:0/2293924024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd480526d0 con 0x55f8c342daa0 2024-02-16T00:11:22.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd572c0640 1 -- 172.21.15.42:0/2293924024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd48052990 con 0x55f8c342daa0 2024-02-16T00:11:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2293924024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 msgr2=0x55f8c342fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/2293924024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342fe90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800a470 tx=0x7fbd4801cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2293924024 shutdown_connections 2024-02-16T00:11:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/2293924024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342fe90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2293924024 >> 172.21.15.42:0/2293924024 conn(0x55f8c34274f0 msgr2=0x55f8c3429910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2293924024 shutdown_connections 2024-02-16T00:11:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.697+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2293924024 wait complete. 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd5cc10800 1 Processor -- start 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd5cc10800 1 -- start start 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd5cc10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd5cc10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c332c980 con 0x55f8c342daa0 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd582c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd582c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58450/0 (socket says 172.21.15.42:58450) 2024-02-16T00:11:22.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd582c2640 1 -- 172.21.15.42:0/3676095165 learned_addr learned my addr 172.21.15.42:0/3676095165 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.709+0000 7fbd582c2640 1 -- 172.21.15.42:0/3676095165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48005d20 con 0x55f8c342daa0 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.710+0000 7fbd582c2640 1 --2- 172.21.15.42:0/3676095165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342d3e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd48055040 tx=0x7fbd4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3db308e87627d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.710+0000 7fbc4660c640 1 -- 172.21.15.42:0/3676095165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4800a180 con 0x55f8c342daa0 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.710+0000 7fbc4660c640 1 -- 172.21.15.42:0/3676095165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800a2e0 con 0x55f8c342daa0 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.710+0000 7fbc4660c640 1 -- 172.21.15.42:0/3676095165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd480529b0 con 0x55f8c342daa0 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.710+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3676095165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 msgr2=0x55f8c342d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.710+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3676095165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342d3e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd48055040 tx=0x7fbd4804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3676095165 shutdown_connections 2024-02-16T00:11:22.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3676095165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c342d3e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3676095165 >> 172.21.15.42:0/3676095165 conn(0x55f8c34274f0 msgr2=0x55f8c3518870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3676095165 shutdown_connections 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3676095165 wait complete. 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 Processor -- start 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 -- start start 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c3526750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd5cc10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3328160 con 0x55f8c342daa0 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd582c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c3526750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd582c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c3526750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58452/0 (socket says 172.21.15.42:58452) 2024-02-16T00:11:22.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.711+0000 7fbd582c2640 1 -- 172.21.15.42:0/3177725353 learned_addr learned my addr 172.21.15.42:0/3177725353 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbd582c2640 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c3434ef0 con 0x55f8c342daa0 2024-02-16T00:11:22.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbd582c2640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c3526750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800a470 tx=0x7fbd48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbc44e09640 1 -- 172.21.15.42:0/3177725353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4806a070 con 0x55f8c342daa0 2024-02-16T00:11:22.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbc44e09640 1 -- 172.21.15.42:0/3177725353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4805d420 con 0x55f8c342daa0 2024-02-16T00:11:22.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbc44e09640 1 -- 172.21.15.42:0/3177725353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4805d5d0 con 0x55f8c342daa0 2024-02-16T00:11:22.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8c3526c90 con 0x55f8c342daa0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.712+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8c3527170 con 0x55f8c342daa0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbc44e09640 1 -- 172.21.15.42:0/3177725353 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd4805d730 con 0x55f8c342daa0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbc44e09640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc40036830 0x7fbc40038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbc44e09640 1 -- 172.21.15.42:0/3177725353 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbd4808db30 con 0x55f8c342daa0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbd57ac1640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc40036830 0x7fbc40038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c34303d0 0x55f8c352d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c352da00 con 0x55f8c34303d0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.713+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c34303d0 0x55f8c352d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd57ac1640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc40036830 0x7fbc40038cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c000c00 tx=0x7fbd4c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c34303d0 0x55f8c352d430 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd58ac3640 1 -- 172.21.15.42:0/3177725353 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c34303d0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c352ab40 con 0x55f8c34303d0 2024-02-16T00:11:22.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd58ac3640 1 -- 172.21.15.42:0/3177725353 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c34303d0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c352fc40 0x55f8c3532030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3532700 con 0x55f8c352fc40 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.714+0000 7fbd582c2640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c352fc40 0x55f8c3532030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.715+0000 7fbd582c2640 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c352fc40 0x55f8c3532030 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.715+0000 7fbd582c2640 1 -- 172.21.15.42:0/3177725353 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbd48059040 con 0x55f8c352fc40 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.715+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c352ebc0 con 0x55f8c34303d0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.715+0000 7fbd58ac3640 1 -- 172.21.15.42:0/3177725353 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c34303d0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.715+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c352efb0 con 0x55f8c34303d0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd58ac3640 1 -- 172.21.15.42:0/3177725353 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c34303d0 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd5cc10800 1 Processor -- start 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd5cc10800 1 -- start start 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd5cc10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 0x55f8c3541890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd5cc10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c32cae80 con 0x55f8c3541470 2024-02-16T00:11:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd58ac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 0x55f8c3541890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd58ac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 0x55f8c3541890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58464/0 (socket says 172.21.15.42:58464) 2024-02-16T00:11:22.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.716+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1481076635 learned_addr learned my addr 172.21.15.42:0/1481076635 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1481076635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c3541dd0 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 0x55f8c3541890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55f8c352dd60 tx=0x7fbd50018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbc3dffb640 1 -- 172.21.15.42:0/1481076635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd5001d070 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbc3dffb640 1 -- 172.21.15.42:0/1481076635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd500182e0 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbc3dffb640 1 -- 172.21.15.42:0/1481076635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd50014580 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8c3542840 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.717+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8c3542d00 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.718+0000 7fbc3dffb640 1 -- 172.21.15.42:0/1481076635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd50020020 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.718+0000 7fbc3dffb640 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc300367e0 0x7fbc30038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.718+0000 7fbc3dffb640 1 -- 172.21.15.42:0/1481076635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbd5004dc50 con 0x55f8c3541470 2024-02-16T00:11:22.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.718+0000 7fbd582c2640 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc300367e0 0x7fbc30038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.718+0000 7fbd5cc10800 1 Processor -- start 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.718+0000 7fbd5cc10800 1 -- start start 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd582c2640 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc300367e0 0x7fbc30038ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55f8c352de00 tx=0x7fbd4805df50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd5cc10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c354eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd5cc10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c32a05d0 con 0x55f8c354e690 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd58ac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c354eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd58ac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c354eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58478/0 (socket says 172.21.15.42:58478) 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd58ac3640 1 -- 172.21.15.42:0/2639483551 learned_addr learned my addr 172.21.15.42:0/2639483551 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd58ac3640 1 -- 172.21.15.42:0/2639483551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c354f080 con 0x55f8c354e690 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/2639483551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c354eab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd5004bfd0 tx=0x7fbd50011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688cd34bc8d669cf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/2639483551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd500403d0 con 0x55f8c354e690 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/2639483551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50040530 con 0x55f8c354e690 2024-02-16T00:11:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.719+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/2639483551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd50016440 con 0x55f8c354e690 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2639483551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 msgr2=0x55f8c354eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/2639483551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c354eab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd5004bfd0 tx=0x7fbd50011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2639483551 shutdown_connections 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/2639483551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c354eab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2639483551 >> 172.21.15.42:0/2639483551 conn(0x55f8c354a9b0 msgr2=0x55f8c3548a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2639483551 shutdown_connections 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- 172.21.15.42:0/2639483551 wait complete. 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 Processor -- start 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- start start 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c35555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.720+0000 7fbd5cc10800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3555b30 con 0x55f8c354e690 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd58ac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c35555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd58ac3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c35555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58486/0 (socket says 172.21.15.42:58486) 2024-02-16T00:11:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 learned_addr learned my addr 172.21.15.42:0/1439215361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c3542d00 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c35555f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd5004aec0 tx=0x7fbd5004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbc2dffb640 1 -- 172.21.15.42:0/1439215361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd50032070 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbc2dffb640 1 -- 172.21.15.42:0/1439215361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5002bda0 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8c3555d30 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbc2dffb640 1 -- 172.21.15.42:0/1439215361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd50013bc0 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.721+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8c3556190 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.722+0000 7fbc2dffb640 1 -- 172.21.15.42:0/1439215361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd50013d20 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.722+0000 7fbc2dffb640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc20036790 0x7fbc20038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.722+0000 7fbc2dffb640 1 -- 172.21.15.42:0/1439215361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fbd50017030 con 0x55f8c354e690 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.722+0000 7fbd582c2640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc20036790 0x7fbc20038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c35613f0 0x55f8c35638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3564000 con 0x55f8c35613f0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd582c2640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc20036790 0x7fbc20038c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd4805dd40 tx=0x7fbd48088000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd57ac1640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c35613f0 0x55f8c35638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd57ac1640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c35613f0 0x55f8c35638b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 20 realm 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3560850 con 0x55f8c35613f0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.723+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3564a80 con 0x55f8c35613f0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3565300 con 0x55f8c35613f0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c3565ce0 0x55f8c35680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c3565ce0 2024-02-16T00:11:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c3565ce0 0x55f8c35680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.724+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c3565ce0 0x55f8c35680d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd5cc10800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd5cc10800 20 searching for the correct realm 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f8c356ab50 0x55f8c356d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356d690 con 0x55f8c356ab50 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd582c2640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f8c356ab50 0x55f8c356d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.725+0000 7fbd582c2640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f8c356ab50 0x55f8c356d010 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.726+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.726+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356d690 con 0x55f8c3565ce0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.726+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.726+0000 7fbd58ac3640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbd5004d070 0x7fbd500406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.726+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.726+0000 7fbd57ac1640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbd5004d070 0x7fbd500406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbd5004d070 0x7fbd500406a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.727+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c3565ce0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.728+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c3565ce0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.729+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.730+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.731+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.732+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.732+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c3565ce0 2024-02-16T00:11:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.732+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.732+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.732+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.732+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c3565ce0 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c356ab50 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.733+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x7fbd5004d070 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c35613f0 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568840 con 0x55f8c3565ce0 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.734+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3568f50 con 0x55f8c35613f0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3569300 con 0x55f8c35613f0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35696e0 con 0x55f8c35613f0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 zone default found 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 4 Realm: () 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 zonegroup default 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3569ad0 con 0x7fbd5004d070 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.735+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356f4b0 con 0x55f8c356ab50 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356f810 con 0x55f8c356ab50 2024-02-16T00:11:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 20 started sync module instance, tier type = 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.736+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356a030 con 0x55f8c3565ce0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.737+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.737+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526917503520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356fb70 con 0x55f8c3565ce0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.737+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3570610 con 0x55f8c35613f0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.738+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526917503520] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.738+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.738+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526917509360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35705d0 con 0x55f8c35613f0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.738+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35710c0 con 0x55f8c356ab50 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.739+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526917509360] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.740+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.740+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526917504880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3571470 con 0x55f8c356ab50 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.740+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3571ed0 con 0x55f8c3565ce0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.741+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.741+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526917515760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3572790 con 0x55f8c3565ce0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.741+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3573250 con 0x55f8c35613f0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.741+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526917504880] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.742+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.742+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526917520656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3573210 con 0x55f8c35613f0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.742+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3573c60 con 0x7fbd5004d070 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.742+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526917515760] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.743+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.743+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526917523264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3573c20 con 0x7fbd5004d070 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.743+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3574680 con 0x7fbd5004d070 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.743+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526917520656] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.744+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.744+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526917525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3574640 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.744+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3575060 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.744+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526917523264] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526917525888] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526917528384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3570bb0 con 0x7fbd5004d070 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=0 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=1 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=2 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=3 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=4 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=5 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.745+0000 7fbd5cc10800 20 add_watcher() i=6 2024-02-16T00:11:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.746+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526917528384] v27'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.746+0000 7fbd5cc10800 20 add_watcher() i=7 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.746+0000 7fbd5cc10800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.746+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3578050 con 0x55f8c35613f0 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.746+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.746+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526917518000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3575560 con 0x55f8c35613f0 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.747+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526917518000] v27'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.747+0000 7fbc0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 5 note: GC not initialized 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbc0d7e2640 20 reqs_thread_entry: start 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 Filter name: none 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbb7effd640 20 reqs_thread_entry: start 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35aa0a0 con 0x55f8c35613f0 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.748+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35aa620 con 0x7fbd5004d070 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.749+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.749+0000 7fbd5cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.749+0000 7fbd5cc10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.749+0000 7fbd5cc10800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.749+0000 7fbd5cc10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.749+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~461 in=461b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35b01c0 con 0x55f8c35613f0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~461] v27'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd5cc10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd5cc10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd5cc10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94526917770848 in=649b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35acee0 con 0x55f8c35613f0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94526917520656 notify 115964116995 ret 0) v3 ==== 679+0+0 (crc 0 0 0) 0x7fbd4c03f9d0 con 0x55f8c35613f0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbc2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94526917520656 notifier 4334 bl.length()=637 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbc2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbc2f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(65 notify.4 [notify cookie 94526917770848 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.750+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fbc1c003e90 con 0x55f8c35613f0 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.751+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.751+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94526917770848 notify 115964116995 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbd4c03fb60 con 0x55f8c35613f0 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.751+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35afe60 con 0x7fbd5004d070 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd5cc10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd5cc10800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd5cc10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94526917770848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35aa8e0 con 0x55f8c356ab50 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== watch-notify(notify (1) cookie 94526917504880 notify 115964116992 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55f8c3527170 con 0x55f8c356ab50 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbc2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94526917504880 notifier 4334 bl.length()=177 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbc2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbc2f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbc2f7fe640 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fbc1c003e90 con 0x55f8c356ab50 2024-02-16T00:11:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.752+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(68 notify.2 [notify cookie 94526917770848 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.753+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.753+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== watch-notify(notify_complete (2) cookie 94526917770848 notify 115964116992 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f8c3526c90 con 0x55f8c356ab50 2024-02-16T00:11:22.768 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:22.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.754+0000 7fbc0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.754+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526917518000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3577bb0 con 0x55f8c35613f0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.755+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94526917518000] v27'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.755+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526917503520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c35722b0 con 0x55f8c3565ce0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.755+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94526917503520] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.755+0000 7fbd5cc10800 20 remove_watcher() i=0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.755+0000 7fbd5cc10800 2 removed watcher, disabling cache 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.755+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526917509360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356ea00 con 0x55f8c35613f0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.757+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94526917509360] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.757+0000 7fbd5cc10800 20 remove_watcher() i=1 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.757+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526917504880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356ea00 con 0x55f8c356ab50 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.758+0000 7fbd582c2640 1 -- 172.21.15.42:0/1439215361 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94526917504880] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4807e040 con 0x55f8c356ab50 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.758+0000 7fbd5cc10800 20 remove_watcher() i=2 2024-02-16T00:11:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.758+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526917515760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356ea00 con 0x55f8c3565ce0 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.759+0000 7fbd58ac3640 1 -- 172.21.15.42:0/1439215361 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94526917515760] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd5000a4a0 con 0x55f8c3565ce0 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.759+0000 7fbd5cc10800 20 remove_watcher() i=3 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.759+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526917520656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c356ea00 con 0x55f8c35613f0 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.760+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94526917520656] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x55f8c35613f0 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.760+0000 7fbd5cc10800 20 remove_watcher() i=4 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.760+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526917523264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3572d10 con 0x7fbd5004d070 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.761+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94526917523264] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c00f5f0 con 0x7fbd5004d070 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.761+0000 7fbd5cc10800 20 remove_watcher() i=5 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.761+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526917525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3572d10 con 0x7fbd5004d070 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.762+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94526917525888] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c049040 con 0x7fbd5004d070 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.762+0000 7fbd5cc10800 20 remove_watcher() i=6 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.762+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526917528384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f8c3572d10 con 0x7fbd5004d070 2024-02-16T00:11:22.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94526917528384] v27'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd4c049040 con 0x7fbd5004d070 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 20 remove_watcher() i=7 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbd5004d070 msgr2=0x7fbd500406a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbd5004d070 0x7fbd500406a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c35613f0 msgr2=0x55f8c35638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c35613f0 0x55f8c35638b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c3565ce0 msgr2=0x55f8c35680d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c3565ce0 0x55f8c35680d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f8c356ab50 msgr2=0x55f8c356d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f8c356ab50 0x55f8c356d010 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc20036790 msgr2=0x7fbc20038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc20036790 0x7fbc20038c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd4805dd40 tx=0x7fbd48088000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 msgr2=0x55f8c35555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd57ac1640 1 -- 172.21.15.42:0/1439215361 reap_dead start 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c35555f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd5004aec0 tx=0x7fbd5004bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 shutdown_connections 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.763+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1439215361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c354e690 0x55f8c35555f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 >> 172.21.15.42:0/1439215361 conn(0x55f8c354a9b0 msgr2=0x55f8c3548010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 shutdown_connections 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1439215361 wait complete. 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc300367e0 msgr2=0x7fbc30038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc300367e0 0x7fbc30038ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55f8c352de00 tx=0x7fbd4805df50 comp rx=0 tx=0).stop 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 msgr2=0x55f8c3541890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 0x55f8c3541890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55f8c352dd60 tx=0x7fbd50018830 comp rx=0 tx=0).stop 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 shutdown_connections 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc300367e0 0x7fbc30038ca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/1481076635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c3541470 0x55f8c3541890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 >> 172.21.15.42:0/1481076635 conn(0x55f8c3535510 msgr2=0x55f8c3535910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 shutdown_connections 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/1481076635 wait complete. 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c34303d0 msgr2=0x55f8c352d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c34303d0 0x55f8c352d430 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c352fc40 msgr2=0x55f8c3532030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c352fc40 0x55f8c3532030 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc40036830 msgr2=0x7fbc40038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc40036830 0x7fbc40038cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c000c00 tx=0x7fbd4c0013b0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 msgr2=0x55f8c3526750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c3526750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800a470 tx=0x7fbd48002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 shutdown_connections 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f8c352fc40 0x55f8c3532030 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f8c34303d0 0x55f8c352d430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc40036830 0x7fbc40038cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 --2- 172.21.15.42:0/3177725353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f8c342daa0 0x55f8c3526750 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.764+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 >> 172.21.15.42:0/3177725353 conn(0x55f8c34274f0 msgr2=0x55f8c342bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.765+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 shutdown_connections 2024-02-16T00:11:22.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.765+0000 7fbd5cc10800 1 -- 172.21.15.42:0/3177725353 wait complete. 2024-02-16T00:11:22.780 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:22.780 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:22.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:22.780 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:22.822 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.823 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb64d92b800 1 Processor -- start 2024-02-16T00:11:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb64d92b800 1 -- start start 2024-02-16T00:11:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb64d92b800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627a415d890 0x5627a415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb64d92b800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5627a40a9bb0 con 0x5627a415e1f0 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb64d92b800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5627a4061450 con 0x5627a415d890 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb649557640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627a415d890 0x5627a415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb648d56640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5627a415e1f0 0x5627a415e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60210/0 (socket says 172.21.15.42:60210) 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb649557640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627a415d890 0x5627a415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58494/0 (socket says 172.21.15.42:58494) 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb648d56640 1 -- 172.21.15.42:0/1960709931 learned_addr learned my addr 172.21.15.42:0/1960709931 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb649557640 1 -- 172.21.15.42:0/1960709931 >> v1:172.21.15.2:6789/0 conn(0x5627a415e1f0 legacy=0x5627a415e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.821+0000 7fb649557640 1 -- 172.21.15.42:0/1960709931 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a40d2310 con 0x5627a415d890 2024-02-16T00:11:22.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.823+0000 7fb649557640 1 --2- 172.21.15.42:0/1960709931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a415dcb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005fd0 tx=0x7fb63c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8230c7d1185c0680 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.823+0000 7fb63bfff640 1 -- 172.21.15.42:0/1960709931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63c052560 con 0x5627a415d890 2024-02-16T00:11:22.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.823+0000 7fb63bfff640 1 -- 172.21.15.42:0/1960709931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c0526c0 con 0x5627a415d890 2024-02-16T00:11:22.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.823+0000 7fb63bfff640 1 -- 172.21.15.42:0/1960709931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63c0529e0 con 0x5627a415d890 2024-02-16T00:11:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 -- 172.21.15.42:0/1960709931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 msgr2=0x5627a415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 --2- 172.21.15.42:0/1960709931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a415dcb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005fd0 tx=0x7fb63c01cb90 comp rx=0 tx=0).stop 2024-02-16T00:11:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 -- 172.21.15.42:0/1960709931 shutdown_connections 2024-02-16T00:11:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 --2- 172.21.15.42:0/1960709931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a415dcb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 -- 172.21.15.42:0/1960709931 >> 172.21.15.42:0/1960709931 conn(0x5627a41594d0 msgr2=0x5627a415b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 -- 172.21.15.42:0/1960709931 shutdown_connections 2024-02-16T00:11:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.824+0000 7fb64d92b800 1 -- 172.21.15.42:0/1960709931 wait complete. 2024-02-16T00:11:22.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.835+0000 7fb64d92b800 1 Processor -- start 2024-02-16T00:11:22.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.835+0000 7fb64d92b800 1 -- start start 2024-02-16T00:11:22.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.835+0000 7fb64d92b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4251160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.835+0000 7fb64d92b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a405e980 con 0x5627a415d890 2024-02-16T00:11:22.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb649557640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4251160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb649557640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4251160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58502/0 (socket says 172.21.15.42:58502) 2024-02-16T00:11:22.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb649557640 1 -- 172.21.15.42:0/1359455340 learned_addr learned my addr 172.21.15.42:0/1359455340 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb649557640 1 -- 172.21.15.42:0/1359455340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c00a100 con 0x5627a415d890 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb649557640 1 --2- 172.21.15.42:0/1359455340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4251160 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb63c054040 tx=0x7fb63c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c3b783f97ef79b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb537606640 1 -- 172.21.15.42:0/1359455340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63c052960 con 0x5627a415d890 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb537606640 1 -- 172.21.15.42:0/1359455340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c052ac0 con 0x5627a415d890 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.836+0000 7fb537606640 1 -- 172.21.15.42:0/1359455340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63c052d80 con 0x5627a415d890 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 -- 172.21.15.42:0/1359455340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 msgr2=0x5627a4251160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 --2- 172.21.15.42:0/1359455340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4251160 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb63c054040 tx=0x7fb63c04c000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 -- 172.21.15.42:0/1359455340 shutdown_connections 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 --2- 172.21.15.42:0/1359455340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4251160 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 -- 172.21.15.42:0/1359455340 >> 172.21.15.42:0/1359455340 conn(0x5627a41594d0 msgr2=0x5627a424ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 -- 172.21.15.42:0/1359455340 shutdown_connections 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 -- 172.21.15.42:0/1359455340 wait complete. 2024-02-16T00:11:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 Processor -- start 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.837+0000 7fb64d92b800 1 -- start start 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb64d92b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4258790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb64d92b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a405a160 con 0x5627a415d890 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb649557640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4258790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb649557640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4258790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58508/0 (socket says 172.21.15.42:58508) 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb649557640 1 -- 172.21.15.42:0/3606157193 learned_addr learned my addr 172.21.15.42:0/3606157193 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb649557640 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a40d2310 con 0x5627a415d890 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.838+0000 7fb649557640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4258790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb63c01d2c0 tx=0x7fb63c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.839+0000 7fb535e03640 1 -- 172.21.15.42:0/3606157193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63c066410 con 0x5627a415d890 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.839+0000 7fb535e03640 1 -- 172.21.15.42:0/3606157193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c066570 con 0x5627a415d890 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.839+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627a4258cd0 con 0x5627a415d890 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.839+0000 7fb535e03640 1 -- 172.21.15.42:0/3606157193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63c066850 con 0x5627a415d890 2024-02-16T00:11:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.839+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627a42591b0 con 0x5627a415d890 2024-02-16T00:11:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb535e03640 1 -- 172.21.15.42:0/3606157193 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb63c0669b0 con 0x5627a415d890 2024-02-16T00:11:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb535e03640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb5300367e0 0x7fb530038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb535e03640 1 -- 172.21.15.42:0/3606157193 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb63c08e5d0 con 0x5627a415d890 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb648d56640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb5300367e0 0x7fb530038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a415e1f0 0x5627a425f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a425fb50 con 0x5627a415e1f0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb649d58640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a415e1f0 0x5627a425f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb648d56640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb5300367e0 0x7fb530038ca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb640000f60 tx=0x7fb6400012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.840+0000 7fb649d58640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a415e1f0 0x5627a425f5c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb649d58640 1 -- 172.21.15.42:0/3606157193 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a415e1f0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a425cb80 con 0x5627a415e1f0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb649d58640 1 -- 172.21.15.42:0/3606157193 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a415e1f0 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4261d90 0x5627a4264180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a4264880 con 0x5627a4261d90 2024-02-16T00:11:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb649557640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4261d90 0x5627a4264180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.841+0000 7fb649557640 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4261d90 0x5627a4264180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.842+0000 7fb649557640 1 -- 172.21.15.42:0/3606157193 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb63c077070 con 0x5627a4261d90 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.842+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a4260d10 con 0x5627a415e1f0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.842+0000 7fb649d58640 1 -- 172.21.15.42:0/3606157193 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a415e1f0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.842+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a4261100 con 0x5627a415e1f0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.842+0000 7fb649d58640 1 -- 172.21.15.42:0/3606157193 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a415e1f0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.842+0000 7fb64d92b800 1 Processor -- start 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb64d92b800 1 -- start start 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb64d92b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 0x5627a4273a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb64d92b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a3ffce80 con 0x5627a4273610 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb649d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 0x5627a4273a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb649d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 0x5627a4273a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58520/0 (socket says 172.21.15.42:58520) 2024-02-16T00:11:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb649d58640 1 -- 172.21.15.42:0/2419129261 learned_addr learned my addr 172.21.15.42:0/2419129261 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.843+0000 7fb649d58640 1 -- 172.21.15.42:0/2419129261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a4273f70 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.844+0000 7fb649d58640 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 0x5627a4273a30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5627a4259b90 tx=0x7fb64400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.844+0000 7fb52effd640 1 -- 172.21.15.42:0/2419129261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb64400f040 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.844+0000 7fb52effd640 1 -- 172.21.15.42:0/2419129261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644007d00 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.844+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627a42749e0 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.844+0000 7fb52effd640 1 -- 172.21.15.42:0/2419129261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb644019420 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.844+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627a4274ea0 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb52effd640 1 -- 172.21.15.42:0/2419129261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb6440195d0 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb52effd640 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb520036790 0x7fb520038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb52effd640 1 -- 172.21.15.42:0/2419129261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb64404dff0 con 0x5627a4273610 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb649557640 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb520036790 0x7fb520038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb64d92b800 1 Processor -- start 2024-02-16T00:11:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb64d92b800 1 -- start start 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb649557640 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb520036790 0x7fb520038c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5627a425ff50 tx=0x7fb63c083040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb64d92b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a4280ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb64d92b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a3fd25d0 con 0x5627a4280880 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.845+0000 7fb649d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a4280ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb649d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a4280ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58522/0 (socket says 172.21.15.42:58522) 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb649d58640 1 -- 172.21.15.42:0/811059659 learned_addr learned my addr 172.21.15.42:0/811059659 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb649d58640 1 -- 172.21.15.42:0/811059659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a4281270 con 0x5627a4280880 2024-02-16T00:11:22.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb649d58640 1 --2- 172.21.15.42:0/811059659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a4280ca0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb64404c400 tx=0x7fb644015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f704add6cc6549c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb52cff9640 1 -- 172.21.15.42:0/811059659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb644017e00 con 0x5627a4280880 2024-02-16T00:11:22.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb52cff9640 1 -- 172.21.15.42:0/811059659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64404a070 con 0x5627a4280880 2024-02-16T00:11:22.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.846+0000 7fb52cff9640 1 -- 172.21.15.42:0/811059659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb644018500 con 0x5627a4280880 2024-02-16T00:11:22.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- 172.21.15.42:0/811059659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 msgr2=0x5627a4280ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 --2- 172.21.15.42:0/811059659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a4280ca0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb64404c400 tx=0x7fb644015760 comp rx=0 tx=0).stop 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- 172.21.15.42:0/811059659 shutdown_connections 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 --2- 172.21.15.42:0/811059659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a4280ca0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- 172.21.15.42:0/811059659 >> 172.21.15.42:0/811059659 conn(0x5627a427cb50 msgr2=0x5627a427abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- 172.21.15.42:0/811059659 shutdown_connections 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- 172.21.15.42:0/811059659 wait complete. 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 Processor -- start 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- start start 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a42877d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb64d92b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a4287d10 con 0x5627a4280880 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb649d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a42877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb649d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a42877d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58536/0 (socket says 172.21.15.42:58536) 2024-02-16T00:11:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.847+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 learned_addr learned my addr 172.21.15.42:0/434829926 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a4274ea0 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb649d58640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a42877d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb64404c400 tx=0x7fb64404c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb51effd640 1 -- 172.21.15.42:0/434829926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb644040040 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb51effd640 1 -- 172.21.15.42:0/434829926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6440183b0 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627a4287f10 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb51effd640 1 -- 172.21.15.42:0/434829926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6440173b0 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.848+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627a4288370 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb51effd640 1 -- 172.21.15.42:0/434829926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb64403b250 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb51effd640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb514036790 0x7fb514038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb51effd640 1 -- 172.21.15.42:0/434829926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb644036c90 con 0x5627a4280880 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb649557640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb514036790 0x7fb514038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a42934f0 0x5627a4295990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42960e0 con 0x5627a42934f0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.849+0000 7fb648d56640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a42934f0 0x5627a4295990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb649557640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb514036790 0x7fb514038c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb63c070e00 tx=0x7fb63c08b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb648d56640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a42934f0 0x5627a4295990 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 realm 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a4292a10 con 0x5627a42934f0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a4296b60 con 0x5627a42934f0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.850+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a4297070 con 0x5627a42934f0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4297e20 0x5627a429a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429a790 con 0x5627a4297e20 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb649d58640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4297e20 0x5627a429a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb649d58640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4297e20 0x5627a429a210 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 20 searching for the correct realm 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627a429c770 0x5627a429ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.851+0000 7fb649557640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627a429c770 0x5627a429ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.852+0000 7fb649557640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627a429c770 0x5627a429ec10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.852+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.852+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a4297e20 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.852+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.852+0000 7fb649d58640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb644050070 0x7fb64403d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.852+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.853+0000 7fb648d56640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb644050070 0x7fb64403d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.853+0000 7fb648d56640 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb644050070 0x7fb64403d110 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.853+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.853+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.854+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.854+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.854+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.854+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.854+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.854+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a4297e20 2024-02-16T00:11:22.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.855+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a4297e20 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.856+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.857+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.858+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.858+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.858+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.858+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.858+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.858+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a4297e20 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.859+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a4297e20 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a429c770 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x7fb644050070 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.860+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a42934f0 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f2e0 con 0x5627a4297e20 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429b1c0 con 0x5627a42934f0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.861+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429ade0 con 0x5627a42934f0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429ba50 con 0x5627a42934f0 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 zone default found 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 4 Realm: () 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 zonegroup default 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a429f720 con 0x7fb644050070 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a15a0 con 0x5627a429c770 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.862+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a1900 con 0x5627a429c770 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.863+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.863+0000 7fb64d92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.863+0000 7fb64d92b800 20 started sync module instance, tier type = 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.863+0000 7fb64d92b800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.863+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0a30 con 0x5627a4297e20 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.864+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.864+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728257933040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0a30 con 0x5627a4297e20 2024-02-16T00:11:22.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.864+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a2300 con 0x5627a42934f0 2024-02-16T00:11:22.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.865+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728257933040] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.865+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.865+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728257936896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0a30 con 0x5627a42934f0 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.865+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a2d20 con 0x5627a429c770 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.866+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.866+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728257936896] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.866+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728257930640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a09b0 con 0x5627a429c770 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.866+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a3bb0 con 0x5627a4297e20 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.867+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.867+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728257943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a43b0 con 0x5627a4297e20 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.867+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a4e80 con 0x5627a42934f0 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.867+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728257930640] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.868+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.868+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728257943792] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.868+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728257948000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a4e40 con 0x5627a42934f0 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.868+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a3e50 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.869+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728257948000] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.870+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.870+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728257941760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a3e10 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.870+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a5d80 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.871+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728257941760] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.871+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.871+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728257950720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a5cc0 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.871+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a6740 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728257950720] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728257954368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a5cc0 con 0x7fb644050070 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=0 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=1 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=2 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=3 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=4 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=5 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.872+0000 7fb64d92b800 20 add_watcher() i=6 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.873+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728257954368] v27'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.873+0000 7fb64d92b800 20 add_watcher() i=7 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.873+0000 7fb64d92b800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.873+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a5cb0 con 0x5627a42934f0 2024-02-16T00:11:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.873+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.873+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728257956640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a74f0 con 0x5627a42934f0 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.874+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728257956640] v27'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.874+0000 7fb4ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.874+0000 7fb64d92b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.874+0000 7fb64d92b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.874+0000 7fb64d92b800 5 note: GC not initialized 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.874+0000 7fb4fe7e4640 20 reqs_thread_entry: start 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb64d92b800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb64d92b800 20 Filter name: none 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb46ffff640 20 reqs_thread_entry: start 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb64d92b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42dbab0 con 0x5627a42934f0 2024-02-16T00:11:22.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.875+0000 7fb64d92b800 20 rados_obj.operate() r=0 bl.length=461 2024-02-16T00:11:22.890 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.876+0000 7fb4ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.876+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728257956640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a428d350 con 0x5627a42934f0 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.877+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94728257956640] v27'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.877+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728257933040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a428ceb0 con 0x5627a4297e20 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.878+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94728257933040] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.878+0000 7fb64d92b800 20 remove_watcher() i=0 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.878+0000 7fb64d92b800 2 removed watcher, disabling cache 2024-02-16T00:11:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.878+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728257936896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0ef0 con 0x5627a42934f0 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.879+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94728257936896] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.879+0000 7fb64d92b800 20 remove_watcher() i=1 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.879+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728257930640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0ef0 con 0x5627a429c770 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.880+0000 7fb649557640 1 -- 172.21.15.42:0/434829926 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94728257930640] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb63c077070 con 0x5627a429c770 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.880+0000 7fb64d92b800 20 remove_watcher() i=2 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.880+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728257943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0590 con 0x5627a4297e20 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.881+0000 7fb649d58640 1 -- 172.21.15.42:0/434829926 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94728257943792] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6440083e0 con 0x5627a4297e20 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.881+0000 7fb64d92b800 20 remove_watcher() i=3 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.881+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728257948000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0590 con 0x5627a42934f0 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.882+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94728257948000] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x5627a42934f0 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.882+0000 7fb64d92b800 20 remove_watcher() i=4 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.882+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728257941760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0590 con 0x7fb644050070 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.883+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94728257941760] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.883+0000 7fb64d92b800 20 remove_watcher() i=5 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.883+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728257950720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a3100 con 0x7fb644050070 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.884+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94728257950720] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.884+0000 7fb64d92b800 20 remove_watcher() i=6 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.884+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728257954368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5627a42a0590 con 0x7fb644050070 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.885+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94728257954368] v27'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb640006070 con 0x7fb644050070 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 20 remove_watcher() i=7 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb644050070 msgr2=0x7fb64403d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb644050070 0x7fb64403d110 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a42934f0 msgr2=0x5627a4295990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a42934f0 0x5627a4295990 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4297e20 msgr2=0x5627a429a210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4297e20 0x5627a429a210 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627a429c770 msgr2=0x5627a429ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627a429c770 0x5627a429ec10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb514036790 msgr2=0x7fb514038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb514036790 0x7fb514038c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb63c070e00 tx=0x7fb63c08b000 comp rx=0 tx=0).stop 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb648d56640 1 -- 172.21.15.42:0/434829926 reap_dead start 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 msgr2=0x5627a42877d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a42877d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb64404c400 tx=0x7fb64404c390 comp rx=0 tx=0).stop 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 shutdown_connections 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/434829926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4280880 0x5627a42877d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 >> 172.21.15.42:0/434829926 conn(0x5627a427cb50 msgr2=0x5627a427a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 shutdown_connections 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/434829926 wait complete. 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb520036790 msgr2=0x7fb520038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb520036790 0x7fb520038c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5627a425ff50 tx=0x7fb63c083040 comp rx=0 tx=0).stop 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 msgr2=0x5627a4273a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 0x5627a4273a30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5627a4259b90 tx=0x7fb64400aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 shutdown_connections 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb520036790 0x7fb520038c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 --2- 172.21.15.42:0/2419129261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a4273610 0x5627a4273a30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 >> 172.21.15.42:0/2419129261 conn(0x5627a42676b0 msgr2=0x5627a4267ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 shutdown_connections 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.886+0000 7fb64d92b800 1 -- 172.21.15.42:0/2419129261 wait complete. 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a415e1f0 msgr2=0x5627a425f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a415e1f0 0x5627a425f5c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4261d90 msgr2=0x5627a4264180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4261d90 0x5627a4264180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb5300367e0 msgr2=0x7fb530038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb5300367e0 0x7fb530038ca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb640000f60 tx=0x7fb6400012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 msgr2=0x5627a4258790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4258790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb63c01d2c0 tx=0x7fb63c003330 comp rx=0 tx=0).stop 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 shutdown_connections 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627a4261d90 0x5627a4264180 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627a415e1f0 0x5627a425f5c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb5300367e0 0x7fb530038ca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 --2- 172.21.15.42:0/3606157193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627a415d890 0x5627a4258790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 >> 172.21.15.42:0/3606157193 conn(0x5627a41594d0 msgr2=0x5627a424b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 shutdown_connections 2024-02-16T00:11:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.887+0000 7fb64d92b800 1 -- 172.21.15.42:0/3606157193 wait complete. 2024-02-16T00:11:22.902 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:22.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-16T00:11:22.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-16T00:11:22.903 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-02-16T00:11:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.984+0000 7f68a7c9d800 1 Processor -- start 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.984+0000 7f68a7c9d800 1 -- start start 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a7c9d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596364788d0 0x559636478cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a7c9d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5596363c4ba0 con 0x559636479230 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a7c9d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55963637c450 con 0x5596364788d0 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a57a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596364788d0 0x559636478cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a4fa2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x559636479230 0x5596364796e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60212/0 (socket says 172.21.15.42:60212) 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a57a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5596364788d0 0x559636478cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58538/0 (socket says 172.21.15.42:58538) 2024-02-16T00:11:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a4fa2640 1 -- 172.21.15.42:0/119101297 learned_addr learned my addr 172.21.15.42:0/119101297 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a57a3640 1 -- 172.21.15.42:0/119101297 >> v1:172.21.15.2:6789/0 conn(0x559636479230 legacy=0x5596364796e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.985+0000 7f68a57a3640 1 -- 172.21.15.42:0/119101297 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596363ed310 con 0x5596364788d0 2024-02-16T00:11:22.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.987+0000 7f68a57a3640 1 --2- 172.21.15.42:0/119101297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636478cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6898005fd0 tx=0x7f689801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5c57bebf992b70 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:22.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.987+0000 7f6897fff640 1 -- 172.21.15.42:0/119101297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898052560 con 0x5596364788d0 2024-02-16T00:11:22.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.987+0000 7f6897fff640 1 -- 172.21.15.42:0/119101297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980526c0 con 0x5596364788d0 2024-02-16T00:11:22.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.987+0000 7f6897fff640 1 -- 172.21.15.42:0/119101297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68980529e0 con 0x5596364788d0 2024-02-16T00:11:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 -- 172.21.15.42:0/119101297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 msgr2=0x559636478cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/119101297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636478cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6898005fd0 tx=0x7f689801cb90 comp rx=0 tx=0).stop 2024-02-16T00:11:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 -- 172.21.15.42:0/119101297 shutdown_connections 2024-02-16T00:11:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/119101297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636478cf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 -- 172.21.15.42:0/119101297 >> 172.21.15.42:0/119101297 conn(0x5596364744f0 msgr2=0x559636476910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 -- 172.21.15.42:0/119101297 shutdown_connections 2024-02-16T00:11:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.988+0000 7f68a7c9d800 1 -- 172.21.15.42:0/119101297 wait complete. 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a7c9d800 1 Processor -- start 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a7c9d800 1 -- start start 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a7c9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x55963656c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a7c9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559636379980 con 0x5596364788d0 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a57a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x55963656c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a57a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x55963656c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58540/0 (socket says 172.21.15.42:58540) 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:22.999+0000 7f68a57a3640 1 -- 172.21.15.42:0/2968511100 learned_addr learned my addr 172.21.15.42:0/2968511100 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.000+0000 7f68a57a3640 1 -- 172.21.15.42:0/2968511100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689800a100 con 0x5596364788d0 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.000+0000 7f68a57a3640 1 --2- 172.21.15.42:0/2968511100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x55963656c1d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6898054040 tx=0x7f689804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a9a9fec90b183c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.000+0000 7f6793606640 1 -- 172.21.15.42:0/2968511100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898052960 con 0x5596364788d0 2024-02-16T00:11:23.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.000+0000 7f6793606640 1 -- 172.21.15.42:0/2968511100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898052ac0 con 0x5596364788d0 2024-02-16T00:11:23.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.000+0000 7f6793606640 1 -- 172.21.15.42:0/2968511100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898052d80 con 0x5596364788d0 2024-02-16T00:11:23.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- 172.21.15.42:0/2968511100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 msgr2=0x55963656c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/2968511100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x55963656c1d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6898054040 tx=0x7f689804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- 172.21.15.42:0/2968511100 shutdown_connections 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/2968511100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x55963656c1d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- 172.21.15.42:0/2968511100 >> 172.21.15.42:0/2968511100 conn(0x5596364744f0 msgr2=0x559636567af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- 172.21.15.42:0/2968511100 shutdown_connections 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- 172.21.15.42:0/2968511100 wait complete. 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 Processor -- start 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- start start 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636573820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a7c9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559636375160 con 0x5596364788d0 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a57a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636573820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a57a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636573820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58554/0 (socket says 172.21.15.42:58554) 2024-02-16T00:11:23.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.001+0000 7f68a57a3640 1 -- 172.21.15.42:0/1382596919 learned_addr learned my addr 172.21.15.42:0/1382596919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f68a57a3640 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596363ed310 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f68a57a3640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636573820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f689801d2c0 tx=0x7f6898003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f6791e03640 1 -- 172.21.15.42:0/1382596919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898066410 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f6791e03640 1 -- 172.21.15.42:0/1382596919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898066570 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f6791e03640 1 -- 172.21.15.42:0/1382596919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898066850 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559636573d60 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.002+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559636574240 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f6791e03640 1 -- 172.21.15.42:0/1382596919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f68980669b0 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f6791e03640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f678c036790 0x7f678c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f6791e03640 1 -- 172.21.15.42:0/1382596919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f689808e5c0 con 0x5596364788d0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f68a4fa2640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f678c036790 0x7f678c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559636479230 0x55963657a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55963657ac20 con 0x559636479230 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.003+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559636479230 0x55963657a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a4fa2640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f678c036790 0x7f678c038c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f689c000f60 tx=0x7f689c0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559636479230 0x55963657a650 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a5fa4640 1 -- 172.21.15.42:0/1382596919 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f68a00083e0 con 0x559636479230 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559636577bf0 con 0x559636479230 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a5fa4640 1 -- 172.21.15.42:0/1382596919 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f68a00083e0 con 0x559636479230 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55963657ce60 0x55963657f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.004+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55963657f920 con 0x55963657ce60 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.005+0000 7f68a57a3640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55963657ce60 0x55963657f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.005+0000 7f68a57a3640 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55963657ce60 0x55963657f250 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.005+0000 7f68a57a3640 1 -- 172.21.15.42:0/1382596919 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6898077070 con 0x55963657ce60 2024-02-16T00:11:23.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.005+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55963657bde0 con 0x559636479230 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.005+0000 7f68a5fa4640 1 -- 172.21.15.42:0/1382596919 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f68a00083e0 con 0x559636479230 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.005+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55963657c190 con 0x559636479230 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a5fa4640 1 -- 172.21.15.42:0/1382596919 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f68a00083e0 con 0x559636479230 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a7c9d800 1 Processor -- start 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a7c9d800 1 -- start start 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a7c9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 0x55963658ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a7c9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559636317e80 con 0x55963658e610 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a5fa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 0x55963658ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a5fa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 0x55963658ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58558/0 (socket says 172.21.15.42:58558) 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.006+0000 7f68a5fa4640 1 -- 172.21.15.42:0/1339999889 learned_addr learned my addr 172.21.15.42:0/1339999889 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f68a5fa4640 1 -- 172.21.15.42:0/1339999889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55963658ef70 con 0x55963658e610 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 0x55963658ea30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x559636574c20 tx=0x7f68a000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f678affd640 1 -- 172.21.15.42:0/1339999889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a000f040 con 0x55963658e610 2024-02-16T00:11:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f678affd640 1 -- 172.21.15.42:0/1339999889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0007d00 con 0x55963658e610 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f678affd640 1 -- 172.21.15.42:0/1339999889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a001a430 con 0x55963658e610 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55963658f9e0 con 0x55963658e610 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.007+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55963658fea0 con 0x55963658e610 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.008+0000 7f678affd640 1 -- 172.21.15.42:0/1339999889 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f68a001a5e0 con 0x55963658e610 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.008+0000 7f678affd640 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f677c0367e0 0x7f677c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.008+0000 7f678affd640 1 -- 172.21.15.42:0/1339999889 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f68a004e360 con 0x55963658e610 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.008+0000 7f68a57a3640 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f677c0367e0 0x7f677c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.008+0000 7f68a7c9d800 1 Processor -- start 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a7c9d800 1 -- start start 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a7c9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x55963659bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a57a3640 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f677c0367e0 0x7f677c038ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55963657aff0 tx=0x7f6898065ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a7c9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596362ed5d0 con 0x55963659b960 2024-02-16T00:11:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a5fa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x55963659bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a5fa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x55963659bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58572/0 (socket says 172.21.15.42:58572) 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3344695520 learned_addr learned my addr 172.21.15.42:0/3344695520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3344695520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55963659c350 con 0x55963659b960 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.009+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/3344695520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x55963659bd80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68a001aa60 tx=0x7f68a001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a1a7c857967460 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f6788ff9640 1 -- 172.21.15.42:0/3344695520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a004a030 con 0x55963659b960 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f6788ff9640 1 -- 172.21.15.42:0/3344695520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a001ac60 con 0x55963659b960 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f6788ff9640 1 -- 172.21.15.42:0/3344695520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a004b360 con 0x55963659b960 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3344695520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 msgr2=0x55963659bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3344695520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x55963659bd80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68a001aa60 tx=0x7f68a001ab50 comp rx=0 tx=0).stop 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3344695520 shutdown_connections 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3344695520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x55963659bd80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3344695520 >> 172.21.15.42:0/3344695520 conn(0x559636597c30 msgr2=0x559636595c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3344695520 shutdown_connections 2024-02-16T00:11:23.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3344695520 wait complete. 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 Processor -- start 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.010+0000 7f68a7c9d800 1 -- start start 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a7c9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x5596365a2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a7c9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596365a2da0 con 0x55963659b960 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a5fa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x5596365a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a5fa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x5596365a2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58582/0 (socket says 172.21.15.42:58582) 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 learned_addr learned my addr 172.21.15.42:0/3826927404 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55963658fea0 con 0x55963659b960 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x5596365a2860 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68a001aa60 tx=0x7f68a0019f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f677affd640 1 -- 172.21.15.42:0/3826927404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a0047040 con 0x55963659b960 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f677affd640 1 -- 172.21.15.42:0/3826927404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a001add0 con 0x55963659b960 2024-02-16T00:11:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5596365a2fa0 con 0x55963659b960 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f677affd640 1 -- 172.21.15.42:0/3826927404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a00234f0 con 0x55963659b960 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.011+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596365a3400 con 0x55963659b960 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.012+0000 7f677affd640 1 -- 172.21.15.42:0/3826927404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f68a0023650 con 0x55963659b960 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f677affd640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67700367e0 0x7f6770038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f677affd640 1 -- 172.21.15.42:0/3826927404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f68a004b070 con 0x55963659b960 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a57a3640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67700367e0 0x7f6770038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5596365ae5b0 0x5596365b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b11c0 con 0x5596365ae5b0 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a57a3640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67700367e0 0x7f6770038ca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f689808ca90 tx=0x7f6898085000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a4fa2640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5596365ae5b0 0x5596365b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.013+0000 7f68a4fa2640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5596365ae5b0 0x5596365b0a70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 realm 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ada10 con 0x5596365ae5b0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b1c40 con 0x5596365ae5b0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b24c0 con 0x5596365ae5b0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5596365b2ea0 0x5596365b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b5960 con 0x5596365b2ea0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.014+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5596365b2ea0 0x5596365b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5596365b2ea0 0x5596365b5290 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a7c9d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a7c9d800 20 searching for the correct realm 2024-02-16T00:11:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5596365b7c50 0x5596365ba110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a57a3640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5596365b7c50 0x5596365ba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.015+0000 7f68a57a3640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5596365b7c50 0x5596365ba110 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.016+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.016+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b2ea0 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.016+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.016+0000 7f68a5fa4640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f68a0037060 0x7f68a001b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.016+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.016+0000 7f68a4fa2640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f68a0037060 0x7f68a001b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.017+0000 7f68a4fa2640 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f68a0037060 0x7f68a001b770 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.017+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.017+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.018+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b2ea0 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.019+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b2ea0 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.020+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.021+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b2ea0 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.022+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.023+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b2ea0 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b7c50 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x7f68a0037060 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.024+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365ae5b0 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365ba7e0 con 0x5596365b2ea0 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b71e0 con 0x5596365ae5b0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b69e0 con 0x5596365ae5b0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.025+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365b6170 con 0x5596365ae5b0 2024-02-16T00:11:23.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 zone default found 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 4 Realm: () 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 zonegroup default 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bb0c0 con 0x7f68a0037060 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bcbc0 con 0x5596365b7c50 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bd050 con 0x5596365b7c50 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.026+0000 7f68a7c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.027+0000 7f68a7c9d800 20 started sync module instance, tier type = 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.027+0000 7f68a7c9d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.027+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bc7f0 con 0x5596365b2ea0 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.028+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.028+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94103645437744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbb50 con 0x5596365b2ea0 2024-02-16T00:11:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.028+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bdf20 con 0x5596365ae5b0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.029+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94103645437744] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.029+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.029+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94103645443184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bdf20 con 0x5596365ae5b0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.029+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365be970 con 0x5596365b7c50 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.030+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94103645443184] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.030+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.031+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94103645444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bdea0 con 0x5596365b7c50 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.031+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bf800 con 0x5596365b2ea0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.032+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.032+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94103645444736] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.032+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94103645451584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bffe0 con 0x5596365b2ea0 2024-02-16T00:11:23.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.032+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bed90 con 0x5596365ae5b0 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.033+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94103645451584] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.033+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.033+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94103645452864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bffa0 con 0x5596365ae5b0 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.033+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c1010 con 0x7f68a0037060 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.034+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.034+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94103645457264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c1430 con 0x7f68a0037060 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.034+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c1ee0 con 0x7f68a0037060 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.034+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94103645452864] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.035+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94103645457264] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.035+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.035+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94103645460960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c0f90 con 0x7f68a0037060 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.035+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c2730 con 0x7f68a0037060 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94103645460960] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94103645455712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c0f90 con 0x7f68a0037060 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=0 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=1 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=2 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=3 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=4 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=5 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.036+0000 7f68a7c9d800 20 add_watcher() i=6 2024-02-16T00:11:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.037+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94103645455712] v27'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.037+0000 7f68a7c9d800 20 add_watcher() i=7 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.037+0000 7f68a7c9d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.037+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c58b0 con 0x5596365ae5b0 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.037+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.038+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94103645463040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c2c00 con 0x5596365ae5b0 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94103645463040] v27'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f675b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 5 note: GC not initialized 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f675a7e4640 20 reqs_thread_entry: start 2024-02-16T00:11:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 20 Filter name: none 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f66cbfff640 20 reqs_thread_entry: start 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.039+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365f78b0 con 0x5596365ae5b0 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.040+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.040+0000 7f68a7c9d800 20 rados_obj.operate() r=0 bl.length=461 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.040+0000 7f68a7c9d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.040+0000 7f68a7c9d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.040+0000 7f68a7c9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:23.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.040+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365fd800 con 0x5596365ae5b0 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v27'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a7c9d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a7c9d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a7c9d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94103645704832 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365f9260 con 0x5596365ae5b0 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94103645452864 notify 115964116996 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f689c035040 con 0x5596365ae5b0 2024-02-16T00:11:23.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f6788ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94103645452864 notifier 4348 bl.length()=534 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f6788ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f6788ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94103645704832 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f6788ff9640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6768003e90 con 0x5596365ae5b0 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94103645704832 notify 115964116996 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5596363c4ba0 con 0x5596365ae5b0 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a7c9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.041+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94103645704832 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365f9260 con 0x5596365b7c50 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== watch-notify(notify (1) cookie 94103645444736 notify 115964116993 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f689807f040 con 0x5596365b7c50 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f6788ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94103645444736 notifier 4348 bl.length()=170 2024-02-16T00:11:23.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(66 notify.2 [notify cookie 94103645704832 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f6788ff9640 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f6768003e90 con 0x5596365b7c50 2024-02-16T00:11:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== watch-notify(notify_complete (2) cookie 94103645704832 notify 115964116993 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559636574240 con 0x5596365b7c50 2024-02-16T00:11:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.042+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365fd280 con 0x7f68a0037060 2024-02-16T00:11:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.043+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v27'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.060 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.044+0000 7f675b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.044+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94103645463040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365abbb0 con 0x5596365ae5b0 2024-02-16T00:11:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.045+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94103645463040] v27'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.045+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94103645437744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c2200 con 0x5596365b2ea0 2024-02-16T00:11:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.046+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94103645437744] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.046+0000 7f68a7c9d800 20 remove_watcher() i=0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.046+0000 7f68a7c9d800 2 removed watcher, disabling cache 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.046+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94103645443184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbf30 con 0x5596365ae5b0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.048+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94103645443184] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.048+0000 7f68a7c9d800 20 remove_watcher() i=1 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.048+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94103645444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbf30 con 0x5596365b7c50 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.049+0000 7f68a57a3640 1 -- 172.21.15.42:0/3826927404 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94103645444736] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68980a1040 con 0x5596365b7c50 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.049+0000 7f68a7c9d800 20 remove_watcher() i=2 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.049+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94103645451584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbf30 con 0x5596365b2ea0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.050+0000 7f68a5fa4640 1 -- 172.21.15.42:0/3826927404 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94103645451584] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68a0012070 con 0x5596365b2ea0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.050+0000 7f68a7c9d800 20 remove_watcher() i=3 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.050+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94103645452864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbf30 con 0x5596365ae5b0 2024-02-16T00:11:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.051+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94103645452864] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x5596365ae5b0 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.051+0000 7f68a7c9d800 20 remove_watcher() i=4 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.051+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94103645457264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbf30 con 0x7f68a0037060 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.052+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94103645457264] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.052+0000 7f68a7c9d800 20 remove_watcher() i=5 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.052+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94103645460960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365c0b70 con 0x7f68a0037060 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.052+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94103645460960] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.052+0000 7f68a7c9d800 20 remove_watcher() i=6 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.052+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94103645455712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5596365bbf30 con 0x7f68a0037060 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.053+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94103645455712] v27'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689c006070 con 0x7f68a0037060 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.053+0000 7f68a7c9d800 20 remove_watcher() i=7 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f68a0037060 msgr2=0x7f68a001b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f68a0037060 0x7f68a001b770 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5596365ae5b0 msgr2=0x5596365b0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5596365ae5b0 0x5596365b0a70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5596365b2ea0 msgr2=0x5596365b5290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5596365b2ea0 0x5596365b5290 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5596365b7c50 msgr2=0x5596365ba110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5596365b7c50 0x5596365ba110 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67700367e0 msgr2=0x7f6770038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f67700367e0 0x7f6770038ca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f689808ca90 tx=0x7f6898085000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 msgr2=0x5596365a2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a4fa2640 1 -- 172.21.15.42:0/3826927404 reap_dead start 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x5596365a2860 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68a001aa60 tx=0x7f68a0019f70 comp rx=0 tx=0).stop 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 shutdown_connections 2024-02-16T00:11:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/3826927404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963659b960 0x5596365a2860 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 >> 172.21.15.42:0/3826927404 conn(0x559636597c30 msgr2=0x559636595290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 shutdown_connections 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/3826927404 wait complete. 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f677c0367e0 msgr2=0x7f677c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f677c0367e0 0x7f677c038ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55963657aff0 tx=0x7f6898065ee0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 msgr2=0x55963658ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 0x55963658ea30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x559636574c20 tx=0x7f68a000aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 shutdown_connections 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f677c0367e0 0x7f677c038ca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1339999889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55963658e610 0x55963658ea30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 >> 172.21.15.42:0/1339999889 conn(0x5596365826b0 msgr2=0x559636582ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 shutdown_connections 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.054+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1339999889 wait complete. 2024-02-16T00:11:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559636479230 msgr2=0x55963657a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559636479230 0x55963657a650 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55963657ce60 msgr2=0x55963657f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55963657ce60 0x55963657f250 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f678c036790 msgr2=0x7f678c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f678c036790 0x7f678c038c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f689c000f60 tx=0x7f689c0012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 msgr2=0x559636573820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636573820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f689801d2c0 tx=0x7f6898003330 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 shutdown_connections 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55963657ce60 0x55963657f250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559636479230 0x55963657a650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f678c036790 0x7f678c038c50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 --2- 172.21.15.42:0/1382596919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5596364788d0 0x559636573820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 >> 172.21.15.42:0/1382596919 conn(0x5596364744f0 msgr2=0x559636566350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 shutdown_connections 2024-02-16T00:11:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.055+0000 7f68a7c9d800 1 -- 172.21.15.42:0/1382596919 wait complete. 2024-02-16T00:11:23.072 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-16T00:11:23.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-16T00:11:23.073 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-02-16T00:11:23.116 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:23.116 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.114+0000 7fdfe9f3e800 1 Processor -- start 2024-02-16T00:11:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.114+0000 7fdfe9f3e800 1 -- start start 2024-02-16T00:11:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.114+0000 7fdfe9f3e800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f2c1144040 0x55f2c1144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.114+0000 7fdfe9f3e800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f2c108eba0 con 0x55f2c11452a0 2024-02-16T00:11:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.114+0000 7fdfe9f3e800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f2c1046450 con 0x55f2c1144040 2024-02-16T00:11:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe5c44640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f2c1144040 0x55f2c1144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe5443640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55f2c11452a0 0x55f2c1145720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60216/0 (socket says 172.21.15.42:60216) 2024-02-16T00:11:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe5443640 1 -- 172.21.15.42:0/1390303556 learned_addr learned my addr 172.21.15.42:0/1390303556 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe4c42640 1 -- 172.21.15.42:0/1390303556 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638767987 0 0) 0x55f2c108eba0 con 0x55f2c11452a0 2024-02-16T00:11:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe4c42640 1 -- 172.21.15.42:0/1390303556 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd4001e10 con 0x55f2c11452a0 2024-02-16T00:11:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1390303556 >> v1:172.21.15.2:6789/0 conn(0x55f2c11452a0 legacy=0x55f2c1145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.115+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1390303556 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c1144b30 con 0x55f2c1144040 2024-02-16T00:11:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/1390303556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c1144460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800a470 tx=0x7fdfd801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf687a07cad23e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe4c42640 1 -- 172.21.15.42:0/1390303556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfd804ad60 con 0x55f2c1144040 2024-02-16T00:11:23.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe4c42640 1 -- 172.21.15.42:0/1390303556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd8052440 con 0x55f2c1144040 2024-02-16T00:11:23.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe4c42640 1 -- 172.21.15.42:0/1390303556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8052700 con 0x55f2c1144040 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1390303556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 msgr2=0x55f2c1144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1390303556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c1144460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800a470 tx=0x7fdfd801cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1390303556 shutdown_connections 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1390303556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c1144460 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1390303556 >> 172.21.15.42:0/1390303556 conn(0x55f2c113f5e0 msgr2=0x55f2c1141a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1390303556 shutdown_connections 2024-02-16T00:11:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.117+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1390303556 wait complete. 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe9f3e800 1 Processor -- start 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe9f3e800 1 -- start start 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe9f3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c12341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe9f3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c1043980 con 0x55f2c1144040 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe5c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c12341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe5c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c12341c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58604/0 (socket says 172.21.15.42:58604) 2024-02-16T00:11:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.129+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1509523263 learned_addr learned my addr 172.21.15.42:0/1509523263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.130+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1509523263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8005d20 con 0x55f2c1144040 2024-02-16T00:11:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.130+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/1509523263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c12341c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdfd801ccc0 tx=0x7fdfd804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821fd691680289ee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.130+0000 7fded3e07640 1 -- 172.21.15.42:0/1509523263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfd800a040 con 0x55f2c1144040 2024-02-16T00:11:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.130+0000 7fded3e07640 1 -- 172.21.15.42:0/1509523263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd800a1a0 con 0x55f2c1144040 2024-02-16T00:11:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.130+0000 7fded3e07640 1 -- 172.21.15.42:0/1509523263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfd80525b0 con 0x55f2c1144040 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1509523263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 msgr2=0x55f2c12341c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1509523263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c12341c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdfd801ccc0 tx=0x7fdfd804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1509523263 shutdown_connections 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1509523263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c12341c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1509523263 >> 172.21.15.42:0/1509523263 conn(0x55f2c113f5e0 msgr2=0x55f2c122fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1509523263 shutdown_connections 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1509523263 wait complete. 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 Processor -- start 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- start start 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c10b9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.131+0000 7fdfe9f3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c103f160 con 0x55f2c1144040 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fdfe5c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c10b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fdfe5c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c10b9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58614/0 (socket says 172.21.15.42:58614) 2024-02-16T00:11:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fdfe5c44640 1 -- 172.21.15.42:0/2091814801 learned_addr learned my addr 172.21.15.42:0/2091814801 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fdfe5c44640 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd804e070 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c10b9070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdfd801d3b0 tx=0x7fdfd8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fded2604640 1 -- 172.21.15.42:0/2091814801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfd806b070 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.132+0000 7fded2604640 1 -- 172.21.15.42:0/2091814801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd8052990 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.133+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2c10b7760 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.133+0000 7fded2604640 1 -- 172.21.15.42:0/2091814801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfd8052c70 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.133+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2c10b7ca0 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.133+0000 7fded2604640 1 -- 172.21.15.42:0/2091814801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdfd8059050 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fded2604640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdecc036830 0x7fdecc038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fded2604640 1 -- 172.21.15.42:0/2091814801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdfd808cdd0 con 0x55f2c1144040 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe5443640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdecc036830 0x7fdecc038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c11452a0 0x55f2c1244ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c10b8380 con 0x55f2c11452a0 2024-02-16T00:11:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe6445640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c11452a0 0x55f2c1244ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe5443640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdecc036830 0x7fdecc038cf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0000f60 tx=0x7fdfd00010a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe6445640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c11452a0 0x55f2c1244ab0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe6445640 1 -- 172.21.15.42:0/2091814801 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdfe000a4a0 con 0x55f2c11452a0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.134+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1244ff0 con 0x55f2c11452a0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe6445640 1 -- 172.21.15.42:0/2091814801 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdfe000a4a0 con 0x55f2c11452a0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c1246d90 0x55f2c1249180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1249870 con 0x55f2c1246d90 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c1246d90 0x55f2c1249180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c1246d90 0x55f2c1249180 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe5c44640 1 -- 172.21.15.42:0/2091814801 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1246d90 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.135+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1245d10 con 0x55f2c11452a0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.136+0000 7fdfe6445640 1 -- 172.21.15.42:0/2091814801 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdfe000a4a0 con 0x55f2c11452a0 2024-02-16T00:11:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.136+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1246100 con 0x55f2c11452a0 2024-02-16T00:11:23.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.136+0000 7fdfe6445640 1 -- 172.21.15.42:0/2091814801 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdfe000a4a0 con 0x55f2c11452a0 2024-02-16T00:11:23.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.136+0000 7fdfe9f3e800 1 Processor -- start 2024-02-16T00:11:23.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.136+0000 7fdfe9f3e800 1 -- start start 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe9f3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 0x55f2c1258a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe9f3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c0fe1e80 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe6445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 0x55f2c1258a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe6445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 0x55f2c1258a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58620/0 (socket says 172.21.15.42:58620) 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe6445640 1 -- 172.21.15.42:0/3242814330 learned_addr learned my addr 172.21.15.42:0/3242814330 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe6445640 1 -- 172.21.15.42:0/3242814330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c1258fa0 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe6445640 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 0x55f2c1258a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55f2c10b86e0 tx=0x7fdfe0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdecb7fe640 1 -- 172.21.15.42:0/3242814330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe001d070 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdecb7fe640 1 -- 172.21.15.42:0/3242814330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0014450 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdecb7fe640 1 -- 172.21.15.42:0/3242814330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0014730 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.137+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2c1259a10 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.138+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2c1259ed0 con 0x55f2c1258640 2024-02-16T00:11:23.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.138+0000 7fdecb7fe640 1 -- 172.21.15.42:0/3242814330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdfe0020020 con 0x55f2c1258640 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.138+0000 7fdecb7fe640 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdec0036790 0x7fdec0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.138+0000 7fdecb7fe640 1 -- 172.21.15.42:0/3242814330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdfe004dd60 con 0x55f2c1258640 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdec0036790 0x7fdec0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe9f3e800 1 Processor -- start 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe9f3e800 1 -- start start 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdec0036790 0x7fdec0038c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55f2c10b7f10 tx=0x7fdfd808b0b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe9f3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c1265d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe9f3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c0fb75d0 con 0x55f2c1265910 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe6445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c1265d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe6445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c1265d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58624/0 (socket says 172.21.15.42:58624) 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe6445640 1 -- 172.21.15.42:0/1178186093 learned_addr learned my addr 172.21.15.42:0/1178186093 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.139+0000 7fdfe6445640 1 -- 172.21.15.42:0/1178186093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c1266300 con 0x55f2c1265910 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe6445640 1 --2- 172.21.15.42:0/1178186093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c1265d30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0011470 tx=0x7fdfe0016880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd19a024c65e08db server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdec97fa640 1 -- 172.21.15.42:0/1178186093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0013dc0 con 0x55f2c1265910 2024-02-16T00:11:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdec97fa640 1 -- 172.21.15.42:0/1178186093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0022a50 con 0x55f2c1265910 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdec97fa640 1 -- 172.21.15.42:0/1178186093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0022cf0 con 0x55f2c1265910 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1178186093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 msgr2=0x55f2c1265d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1178186093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c1265d30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0011470 tx=0x7fdfe0016880 comp rx=0 tx=0).stop 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1178186093 shutdown_connections 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1178186093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c1265d30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1178186093 >> 172.21.15.42:0/1178186093 conn(0x55f2c1261be0 msgr2=0x55f2c125fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1178186093 shutdown_connections 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1178186093 wait complete. 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.140+0000 7fdfe9f3e800 1 Processor -- start 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe9f3e800 1 -- start start 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe9f3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c126c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe9f3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c126cdc0 con 0x55f2c1265910 2024-02-16T00:11:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe6445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c126c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe6445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c126c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58640/0 (socket says 172.21.15.42:58640) 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 learned_addr learned my addr 172.21.15.42:0/1302501410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c1259ed0 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdfe6445640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c126c880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00168c0 tx=0x7fdfe004c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.141+0000 7fdeb77fe640 1 -- 172.21.15.42:0/1302501410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0032070 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.142+0000 7fdeb77fe640 1 -- 172.21.15.42:0/1302501410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0014e70 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.142+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2c126cfc0 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.142+0000 7fdeb77fe640 1 -- 172.21.15.42:0/1302501410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe002b8f0 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.142+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2c126d420 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdeb77fe640 1 -- 172.21.15.42:0/1302501410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdfe0049070 con 0x55f2c1265910 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdeb77fe640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdeb0036790 0x7fdeb0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdeb77fe640 1 -- 172.21.15.42:0/1302501410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdfe0037cb0 con 0x55f2c1265910 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdeb0036790 0x7fdeb0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c1278610 0x55f2c127aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127b220 con 0x55f2c1278610 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdeb0036790 0x7fdeb0038c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfd804aa40 tx=0x7fdfd8089000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.143+0000 7fdfe5443640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c1278610 0x55f2c127aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe5443640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c1278610 0x55f2c127aad0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 realm 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1277a70 con 0x55f2c1278610 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127bca0 con 0x55f2c1278610 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.144+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127c520 con 0x55f2c1278610 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c127cf00 0x55f2c127f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c127cf00 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe6445640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c127cf00 0x55f2c127f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe6445640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c127cf00 0x55f2c127f2f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 20 searching for the correct realm 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f2c1281d00 0x55f2c12841c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1284890 con 0x55f2c1281d00 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.145+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f2c1281d00 0x55f2c12841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.146+0000 7fdfe5c44640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f2c1281d00 0x55f2c12841c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.146+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.146+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1284890 con 0x55f2c127cf00 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.147+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.147+0000 7fdfe6445640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fdfe002bc20 0x7fdfe002d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.147+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.147+0000 7fdfe5443640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fdfe002bc20 0x7fdfe002d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.147+0000 7fdfe5443640 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fdfe002bc20 0x7fdfe002d8e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.148+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c127cf00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.149+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c127cf00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.150+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.151+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.152+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c127cf00 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x55f2c1278610 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.153+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0006070 con 0x7fdfe002bc20 2024-02-16T00:11:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c127cf00 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1281d00 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.154+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x7fdfe002bc20 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c1278610 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c127f9f0 con 0x55f2c127cf00 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.155+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1280100 con 0x55f2c1278610 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12804b0 con 0x55f2c1278610 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1280890 con 0x55f2c1278610 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 zone default found 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 4 Realm: () 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 zonegroup default 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.156+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1284cd0 con 0x7fdfe002bc20 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1280dd0 con 0x55f2c1281d00 2024-02-16T00:11:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1286c70 con 0x55f2c1281d00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 started sync module instance, tier type = 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.157+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1286120 con 0x55f2c127cf00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.158+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.158+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501111096848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1287090 con 0x55f2c127cf00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.158+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1287890 con 0x55f2c1278610 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.159+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501111096848] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.159+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.159+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501111099536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1287950 con 0x55f2c1278610 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.159+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12882c0 con 0x55f2c1281d00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.161+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.161+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501111103008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1288ac0 con 0x55f2c1281d00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.161+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1289530 con 0x55f2c127cf00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.161+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501111099536] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.162+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.162+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501111103008] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.162+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501111107696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1289910 con 0x55f2c127cf00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.162+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1288640 con 0x55f2c1278610 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.163+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501111107696] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.163+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.163+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501111100592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1288640 con 0x55f2c1278610 2024-02-16T00:11:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.163+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128a8c0 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.164+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.164+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501111112736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128ace0 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.164+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128b770 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.164+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501111100592] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.165+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501111112736] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.165+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.165+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501111111184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128b290 con 0x7fdfe002bc20 2024-02-16T00:11:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.165+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128bc40 con 0x7fdfe002bc20 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501111111184] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501111113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128bc00 con 0x7fdfe002bc20 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=0 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=1 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=2 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=3 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=4 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=5 2024-02-16T00:11:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.166+0000 7fdfe9f3e800 20 add_watcher() i=6 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.167+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501111113792] v27'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.167+0000 7fdfe9f3e800 20 add_watcher() i=7 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.167+0000 7fdfe9f3e800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.167+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128bbd0 con 0x55f2c1278610 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.167+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.167+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501111119952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128c910 con 0x55f2c1278610 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.168+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501111119952] v27'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.168+0000 7fde977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.168+0000 7fdfe9f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.168+0000 7fdfe9f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.168+0000 7fdfe9f3e800 5 note: GC not initialized 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fde967fc640 20 reqs_thread_entry: start 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 20 Filter name: none 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fde07fff640 20 reqs_thread_entry: start 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12c1100 con 0x55f2c1278610 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.169+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12c1640 con 0x55f2c1278610 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.170+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.170+0000 7fdfe9f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.170+0000 7fdfe9f3e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.170+0000 7fdfe9f3e800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.170+0000 7fdfe9f3e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.170+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12c7190 con 0x55f2c1278610 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~515] v27'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe9f3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe9f3e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe9f3e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94501111361120 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12c3eb0 con 0x55f2c1278610 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== watch-notify(notify (1) cookie 94501111100592 notify 115964116997 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7fdfd4001e10 con 0x55f2c1278610 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdec97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94501111100592 notifier 4355 bl.length()=691 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdec97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdec97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdec97fa640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fdea8003e90 con 0x55f2c1278610 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify cookie 94501111361120 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== watch-notify(notify_complete (2) cookie 94501111361120 notify 115964116997 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fdfd003dce0 con 0x55f2c1278610 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.171+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12c6e30 con 0x55f2c1278610 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.172+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.172+0000 7fdfe9f3e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.172+0000 7fdfe9f3e800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.172+0000 7fdfe9f3e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.172+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94501111361072 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c12c19a0 con 0x55f2c127cf00 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== watch-notify(notify (1) cookie 94501111096848 notify 115964116994 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55f2c126d420 con 0x55f2c127cf00 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdec8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94501111096848 notifier 4355 bl.length()=166 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdec8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdec8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T00:11:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdec8ff9640 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fde100033f0 con 0x55f2c127cf00 2024-02-16T00:11:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(68 notify.0 [notify cookie 94501111361072 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== watch-notify(notify_complete (2) cookie 94501111361072 notify 115964116994 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f2c126cfc0 con 0x55f2c127cf00 2024-02-16T00:11:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.173+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.187 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"C1l9Dvc6auH8LtEBhHZB7CTOGx1hajrNl6NhPkim","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.174+0000 7fde977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.174+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501111119952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128ec90 con 0x55f2c1278610 2024-02-16T00:11:23.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.175+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94501111119952] v27'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.175+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501111096848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128c050 con 0x55f2c127cf00 2024-02-16T00:11:23.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.176+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94501111096848] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.176+0000 7fdfe9f3e800 20 remove_watcher() i=0 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.176+0000 7fdfe9f3e800 2 removed watcher, disabling cache 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.176+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501111099536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128c050 con 0x55f2c1278610 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.177+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94501111099536] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.177+0000 7fdfe9f3e800 20 remove_watcher() i=1 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.177+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501111103008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1287090 con 0x55f2c1281d00 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.178+0000 7fdfe5c44640 1 -- 172.21.15.42:0/1302501410 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94501111103008] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd805c5a0 con 0x55f2c1281d00 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.178+0000 7fdfe9f3e800 20 remove_watcher() i=2 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.178+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501111107696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128c050 con 0x55f2c127cf00 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.179+0000 7fdfe6445640 1 -- 172.21.15.42:0/1302501410 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94501111107696] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfe005d380 con 0x55f2c127cf00 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.179+0000 7fdfe9f3e800 20 remove_watcher() i=3 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.179+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501111100592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1287e20 con 0x55f2c1278610 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.180+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94501111100592] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x55f2c1278610 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.180+0000 7fdfe9f3e800 20 remove_watcher() i=4 2024-02-16T00:11:23.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.180+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501111112736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1289070 con 0x7fdfe002bc20 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.181+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94501111112736] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.181+0000 7fdfe9f3e800 20 remove_watcher() i=5 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.181+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501111111184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c128c050 con 0x7fdfe002bc20 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.182+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94501111111184] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.182+0000 7fdfe9f3e800 20 remove_watcher() i=6 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.182+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501111113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55f2c1287e20 con 0x7fdfe002bc20 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.183+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94501111113792] v27'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdfd0037040 con 0x7fdfe002bc20 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.183+0000 7fdfe9f3e800 20 remove_watcher() i=7 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fdfe002bc20 msgr2=0x7fdfe002d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fdfe002bc20 0x7fdfe002d8e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c1278610 msgr2=0x55f2c127aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c1278610 0x55f2c127aad0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c127cf00 msgr2=0x55f2c127f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c127cf00 0x55f2c127f2f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f2c1281d00 msgr2=0x55f2c12841c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f2c1281d00 0x55f2c12841c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdeb0036790 msgr2=0x7fdeb0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdeb0036790 0x7fdeb0038c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfd804aa40 tx=0x7fdfd8089000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 msgr2=0x55f2c126c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe5443640 1 -- 172.21.15.42:0/1302501410 reap_dead start 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c126c880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00168c0 tx=0x7fdfe004c100 comp rx=0 tx=0).stop 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 shutdown_connections 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/1302501410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1265910 0x55f2c126c880 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 >> 172.21.15.42:0/1302501410 conn(0x55f2c1261be0 msgr2=0x55f2c125f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 shutdown_connections 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/1302501410 wait complete. 2024-02-16T00:11:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdec0036790 msgr2=0x7fdec0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdec0036790 0x7fdec0038c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55f2c10b7f10 tx=0x7fdfd808b0b0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 msgr2=0x55f2c1258a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 0x55f2c1258a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55f2c10b86e0 tx=0x7fdfe0018830 comp rx=0 tx=0).stop 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 shutdown_connections 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdec0036790 0x7fdec0038c50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/3242814330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1258640 0x55f2c1258a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 >> 172.21.15.42:0/3242814330 conn(0x55f2c124c6e0 msgr2=0x55f2c124cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 shutdown_connections 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.184+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/3242814330 wait complete. 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c11452a0 msgr2=0x55f2c1244ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c11452a0 0x55f2c1244ab0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c1246d90 msgr2=0x55f2c1249180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c1246d90 0x55f2c1249180 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdecc036830 msgr2=0x7fdecc038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdecc036830 0x7fdecc038cf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0000f60 tx=0x7fdfd00010a0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 msgr2=0x55f2c10b9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c10b9070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdfd801d3b0 tx=0x7fdfd8002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 shutdown_connections 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f2c1246d90 0x55f2c1249180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f2c11452a0 0x55f2c1244ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fdecc036830 0x7fdecc038cf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 --2- 172.21.15.42:0/2091814801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f2c1144040 0x55f2c10b9070 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 >> 172.21.15.42:0/2091814801 conn(0x55f2c113f5e0 msgr2=0x55f2c1232bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 shutdown_connections 2024-02-16T00:11:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.185+0000 7fdfe9f3e800 1 -- 172.21.15.42:0/2091814801 wait complete. 2024-02-16T00:11:23.198 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'C1l9Dvc6auH8LtEBhHZB7CTOGx1hajrNl6NhPkim', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.198 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-16T00:11:23.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-16T00:11:23.199 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-02-16T00:11:23.285 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:23.285 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:23.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01e1d29800 1 Processor -- start 2024-02-16T00:11:23.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01e1d29800 1 -- start start 2024-02-16T00:11:23.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01e1d29800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e3ae29ac0 0x561e3ae2beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01e1d29800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561e3ad73c50 con 0x561e3ae2c3f0 2024-02-16T00:11:23.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01e1d29800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x561e3ad2b450 con 0x561e3ae29ac0 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01dd953640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e3ae29ac0 0x561e3ae2beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01dd152640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561e3ae2c3f0 0x561e3ae2e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60228/0 (socket says 172.21.15.42:60228) 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.283+0000 7f01dd152640 1 -- 172.21.15.42:0/3339110784 learned_addr learned my addr 172.21.15.42:0/3339110784 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.284+0000 7f01dc951640 1 -- 172.21.15.42:0/3339110784 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981278359 0 0) 0x561e3ad73c50 con 0x561e3ae2c3f0 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.284+0000 7f01dc951640 1 -- 172.21.15.42:0/3339110784 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c8001e10 con 0x561e3ae2c3f0 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.284+0000 7f01dd953640 1 -- 172.21.15.42:0/3339110784 >> v1:172.21.15.2:6789/0 conn(0x561e3ae2c3f0 legacy=0x561e3ae2e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.284+0000 7f01dd953640 1 -- 172.21.15.42:0/3339110784 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3ae30f10 con 0x561e3ae29ac0 2024-02-16T00:11:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.285+0000 7f01dd953640 1 --2- 172.21.15.42:0/3339110784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae2beb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01d000a470 tx=0x7f01d001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb180dbde402558 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01dc951640 1 -- 172.21.15.42:0/3339110784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d004ad60 con 0x561e3ae29ac0 2024-02-16T00:11:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01dc951640 1 -- 172.21.15.42:0/3339110784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0052440 con 0x561e3ae29ac0 2024-02-16T00:11:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01dc951640 1 -- 172.21.15.42:0/3339110784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d0052700 con 0x561e3ae29ac0 2024-02-16T00:11:23.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 -- 172.21.15.42:0/3339110784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 msgr2=0x561e3ae2beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3339110784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae2beb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01d000a470 tx=0x7f01d001cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 -- 172.21.15.42:0/3339110784 shutdown_connections 2024-02-16T00:11:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3339110784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae2beb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 -- 172.21.15.42:0/3339110784 >> 172.21.15.42:0/3339110784 conn(0x561e3ae234f0 msgr2=0x561e3ae25910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 -- 172.21.15.42:0/3339110784 shutdown_connections 2024-02-16T00:11:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.286+0000 7f01e1d29800 1 -- 172.21.15.42:0/3339110784 wait complete. 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01e1d29800 1 Processor -- start 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01e1d29800 1 -- start start 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01e1d29800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae29400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01e1d29800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3ad28980 con 0x561e3ae29ac0 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01dd953640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae29400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01dd953640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae29400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58664/0 (socket says 172.21.15.42:58664) 2024-02-16T00:11:23.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01dd953640 1 -- 172.21.15.42:0/2600077621 learned_addr learned my addr 172.21.15.42:0/2600077621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.298+0000 7f01dd953640 1 -- 172.21.15.42:0/2600077621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0005d20 con 0x561e3ae29ac0 2024-02-16T00:11:23.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.299+0000 7f01dd953640 1 --2- 172.21.15.42:0/2600077621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae29400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f01d0055040 tx=0x7f01d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d4560e9f6cf6ac server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.299+0000 7f00cbe07640 1 -- 172.21.15.42:0/2600077621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d000a040 con 0x561e3ae29ac0 2024-02-16T00:11:23.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.299+0000 7f00cbe07640 1 -- 172.21.15.42:0/2600077621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d000a1a0 con 0x561e3ae29ac0 2024-02-16T00:11:23.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.299+0000 7f00cbe07640 1 -- 172.21.15.42:0/2600077621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d00525b0 con 0x561e3ae29ac0 2024-02-16T00:11:23.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- 172.21.15.42:0/2600077621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 msgr2=0x561e3ae29400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 --2- 172.21.15.42:0/2600077621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae29400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f01d0055040 tx=0x7f01d004c000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- 172.21.15.42:0/2600077621 shutdown_connections 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 --2- 172.21.15.42:0/2600077621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3ae29400 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- 172.21.15.42:0/2600077621 >> 172.21.15.42:0/2600077621 conn(0x561e3ae234f0 msgr2=0x561e3af147d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- 172.21.15.42:0/2600077621 shutdown_connections 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- 172.21.15.42:0/2600077621 wait complete. 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 Processor -- start 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- start start 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3af22670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01e1d29800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3ad24160 con 0x561e3ae29ac0 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01dd953640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3af22670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.300+0000 7f01dd953640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3af22670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58680/0 (socket says 172.21.15.42:58680) 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f01dd953640 1 -- 172.21.15.42:0/3152515625 learned_addr learned my addr 172.21.15.42:0/3152515625 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f01dd953640 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3ae30f10 con 0x561e3ae29ac0 2024-02-16T00:11:23.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f01dd953640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3af22670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f01d0005870 tx=0x7f01d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f00ca604640 1 -- 172.21.15.42:0/3152515625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d006b070 con 0x561e3ae29ac0 2024-02-16T00:11:23.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f00ca604640 1 -- 172.21.15.42:0/3152515625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0052d90 con 0x561e3ae29ac0 2024-02-16T00:11:23.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3af22bb0 con 0x561e3ae29ac0 2024-02-16T00:11:23.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f00ca604640 1 -- 172.21.15.42:0/3152515625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d006f560 con 0x561e3ae29ac0 2024-02-16T00:11:23.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.301+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3af230f0 con 0x561e3ae29ac0 2024-02-16T00:11:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.302+0000 7f00ca604640 1 -- 172.21.15.42:0/3152515625 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f01d0059050 con 0x561e3ae29ac0 2024-02-16T00:11:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.302+0000 7f00ca604640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00c40367e0 0x7f00c4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.302+0000 7f00ca604640 1 -- 172.21.15.42:0/3152515625 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f01d008d3b0 con 0x561e3ae29ac0 2024-02-16T00:11:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.302+0000 7f01dd152640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00c40367e0 0x7f00c4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.302+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3ae2c3f0 0x561e3af294a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.303+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af299e0 con 0x561e3ae2c3f0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.303+0000 7f01de154640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3ae2c3f0 0x561e3af294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.303+0000 7f01dd152640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00c40367e0 0x7f00c4038ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000f60 tx=0x7f01d40010a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.303+0000 7f01de154640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3ae2c3f0 0x561e3af294a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.303+0000 7f01de154640 1 -- 172.21.15.42:0/3152515625 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3ae2c3f0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.303+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af26a20 con 0x561e3ae2c3f0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01de154640 1 -- 172.21.15.42:0/3152515625 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3ae2c3f0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af2bc20 0x561e3af2e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af2e6b0 con 0x561e3af2bc20 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01dd953640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af2bc20 0x561e3af2e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01dd953640 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af2bc20 0x561e3af2e010 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01dd953640 1 -- 172.21.15.42:0/3152515625 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f01d0078bb0 con 0x561e3af2bc20 2024-02-16T00:11:23.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af2ab70 con 0x561e3ae2c3f0 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01de154640 1 -- 172.21.15.42:0/3152515625 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3ae2c3f0 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.304+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af2af80 con 0x561e3ae2c3f0 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.305+0000 7f01de154640 1 -- 172.21.15.42:0/3152515625 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3ae2c3f0 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.305+0000 7f01e1d29800 1 Processor -- start 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.305+0000 7f01e1d29800 1 -- start start 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.305+0000 7f01e1d29800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 0x561e3af3d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.305+0000 7f01e1d29800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3acc6e80 con 0x561e3af3d420 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01de154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 0x561e3af3d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01de154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 0x561e3af3d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58692/0 (socket says 172.21.15.42:58692) 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01de154640 1 -- 172.21.15.42:0/566429508 learned_addr learned my addr 172.21.15.42:0/566429508 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01de154640 1 -- 172.21.15.42:0/566429508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3af3dd80 con 0x561e3af3d420 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01de154640 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 0x561e3af3d840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x561e3af29d40 tx=0x7f01d8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f00c37fe640 1 -- 172.21.15.42:0/566429508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d801d070 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f00c37fe640 1 -- 172.21.15.42:0/566429508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80182e0 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f00c37fe640 1 -- 172.21.15.42:0/566429508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d80145e0 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3af3e7f0 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.306+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3af3ecb0 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.307+0000 7f00c37fe640 1 -- 172.21.15.42:0/566429508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f01d8020020 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.307+0000 7f00c37fe640 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00b8036790 0x7f00b8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.307+0000 7f00c37fe640 1 -- 172.21.15.42:0/566429508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f01d804dca0 con 0x561e3af3d420 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.307+0000 7f01dd953640 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00b8036790 0x7f00b8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01e1d29800 1 Processor -- start 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01e1d29800 1 -- start start 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01dd953640 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00b8036790 0x7f00b8038c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x561e3af29d70 tx=0x7f01d0005350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01e1d29800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af4aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01e1d29800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3ac9c5d0 con 0x561e3af4a6f0 2024-02-16T00:11:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01de154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af4aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01de154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af4aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58698/0 (socket says 172.21.15.42:58698) 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01de154640 1 -- 172.21.15.42:0/3444299412 learned_addr learned my addr 172.21.15.42:0/3444299412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01de154640 1 -- 172.21.15.42:0/3444299412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3af4b0c0 con 0x561e3af4a6f0 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.308+0000 7f01de154640 1 --2- 172.21.15.42:0/3444299412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af4aaf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01d804c020 tx=0x7f01d8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd65441a31290b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f00c17fa640 1 -- 172.21.15.42:0/3444299412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d8016440 con 0x561e3af4a6f0 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f00c17fa640 1 -- 172.21.15.42:0/3444299412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80165a0 con 0x561e3af4a6f0 2024-02-16T00:11:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f00c17fa640 1 -- 172.21.15.42:0/3444299412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d8014b10 con 0x561e3af4a6f0 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 -- 172.21.15.42:0/3444299412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 msgr2=0x561e3af4aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3444299412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af4aaf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01d804c020 tx=0x7f01d8011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 -- 172.21.15.42:0/3444299412 shutdown_connections 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3444299412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af4aaf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 -- 172.21.15.42:0/3444299412 >> 172.21.15.42:0/3444299412 conn(0x561e3af469c0 msgr2=0x561e3af44a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 -- 172.21.15.42:0/3444299412 shutdown_connections 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 -- 172.21.15.42:0/3444299412 wait complete. 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 Processor -- start 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.309+0000 7f01e1d29800 1 -- start start 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01e1d29800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af51610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01e1d29800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3af51b50 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01de154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af51610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01de154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af51610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58700/0 (socket says 172.21.15.42:58700) 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 learned_addr learned my addr 172.21.15.42:0/1765721586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3af3ecb0 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01de154640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af51610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f01d8042040 tx=0x7f01d804bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f00af7fe640 1 -- 172.21.15.42:0/1765721586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d8032070 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f00af7fe640 1 -- 172.21.15.42:0/1765721586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80116f0 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3af51d50 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f00af7fe640 1 -- 172.21.15.42:0/1765721586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d8013730 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.310+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3af521b0 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.311+0000 7f00af7fe640 1 -- 172.21.15.42:0/1765721586 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f01d8022740 con 0x561e3af4a6f0 2024-02-16T00:11:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.311+0000 7f00af7fe640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00a8036830 0x7f00a8038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.311+0000 7f00af7fe640 1 -- 172.21.15.42:0/1765721586 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f01d8037c50 con 0x561e3af4a6f0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.311+0000 7f01dd953640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00a8036830 0x7f00a8038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3af5d360 0x561e3af5f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af5ff70 con 0x561e3af5d360 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01dd953640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00a8036830 0x7f00a8038cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x561e3af2ea50 tx=0x7f01d0084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01dd152640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3af5d360 0x561e3af5f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01dd152640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3af5d360 0x561e3af5f820 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 20 realm 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.312+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af5c7c0 con 0x561e3af5d360 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af609f0 con 0x561e3af5d360 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af61270 con 0x561e3af5d360 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af61c50 0x561e3af64040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af61c50 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01de154640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af61c50 0x561e3af64040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.313+0000 7f01de154640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af61c50 0x561e3af64040 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01e1d29800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01e1d29800 20 searching for the correct realm 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3af66a50 0x561e3af68f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af695e0 con 0x561e3af66a50 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01dd953640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3af66a50 0x561e3af68f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.314+0000 7f01dd953640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3af66a50 0x561e3af68f10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.315+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.315+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af695e0 con 0x561e3af61c50 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.315+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.315+0000 7f01de154640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f01d8058040 0x7f01d8023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.315+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.315+0000 7f01dd152640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f01d8058040 0x7f01d8023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f01d8058040 0x7f01d8023420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.316+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af61c50 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.317+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af61c50 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.318+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.319+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.320+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.321+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.321+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af61c50 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.321+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.321+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.321+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x561e3af5d360 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.321+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.322+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.322+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.322+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.322+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.322+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4006070 con 0x7f01d8058040 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.322+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af61c50 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af66a50 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x7f01d8058040 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af5d360 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.323+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64740 con 0x561e3af61c50 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af64e50 con 0x561e3af5d360 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af65200 con 0x561e3af5d360 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af655e0 con 0x561e3af5d360 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 zone default found 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 4 Realm: () 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 zonegroup default 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.324+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af69a20 con 0x7f01d8058040 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6b8a0 con 0x561e3af66a50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6bc00 con 0x561e3af66a50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 started sync module instance, tier type = 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.325+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6ae70 con 0x561e3af61c50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.326+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.326+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687838253648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6ae70 con 0x561e3af61c50 2024-02-16T00:11:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.326+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6c570 con 0x561e3af5d360 2024-02-16T00:11:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.327+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687838253648] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.327+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.328+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687838257840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6ae70 con 0x561e3af5d360 2024-02-16T00:11:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.328+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6cfe0 con 0x561e3af66a50 2024-02-16T00:11:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.329+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687838257840] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.329+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.329+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687838251472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6adf0 con 0x561e3af66a50 2024-02-16T00:11:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.329+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6de40 con 0x561e3af61c50 2024-02-16T00:11:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.330+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.330+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687838251472] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.330+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687838263712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6e260 con 0x561e3af61c50 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.330+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6ebd0 con 0x561e3af5d360 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.331+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687838263712] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.331+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.331+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687838267664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6e260 con 0x561e3af5d360 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.331+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6f590 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.332+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.332+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687838269680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6f550 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.332+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af704d0 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.332+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687838267664] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.333+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687838269680] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.333+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.333+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687838264768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af70000 con 0x7f01d8058040 2024-02-16T00:11:23.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.333+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af709b0 con 0x7f01d8058040 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687838264768] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687838274768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af70dd0 con 0x7f01d8058040 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=0 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=1 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=2 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=3 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=4 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=5 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.334+0000 7f01e1d29800 20 add_watcher() i=6 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.335+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687838274768] v27'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.335+0000 7f01e1d29800 20 add_watcher() i=7 2024-02-16T00:11:23.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.335+0000 7f01e1d29800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.335+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af74210 con 0x561e3af5d360 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.336+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.336+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687838275824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af716b0 con 0x561e3af5d360 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687838275824] v27'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f008f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 5 note: GC not initialized 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f008e7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 20 Filter name: none 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7efffffff640 20 reqs_thread_entry: start 2024-02-16T00:11:23.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.337+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3afa5e80 con 0x561e3af5d360 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.338+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.338+0000 7f01e1d29800 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.338+0000 7f01e1d29800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.338+0000 7f01e1d29800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.338+0000 7f01e1d29800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.338+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3afac140 con 0x561e3af5d360 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v27'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01e1d29800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01e1d29800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01e1d29800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:23.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94687838518208 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3afa7860 con 0x561e3af5d360 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94687838267664 notify 115964116998 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7f01c8001e10 con 0x561e3af5d360 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f00c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94687838267664 notifier 4362 bl.length()=691 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94687838518208 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f00c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f00c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f00c17fa640 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f00a0003e90 con 0x561e3af5d360 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.339+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.340+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94687838518208 notify 115964116998 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f01d403dce0 con 0x561e3af5d360 2024-02-16T00:11:23.354 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.340+0000 7f008f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.340+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687838275824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3afa73c0 con 0x561e3af5d360 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.341+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94687838275824] v27'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.341+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687838253648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af708f0 con 0x561e3af61c50 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.342+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94687838253648] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.342+0000 7f01e1d29800 20 remove_watcher() i=0 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.342+0000 7f01e1d29800 2 removed watcher, disabling cache 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.342+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687838257840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af708f0 con 0x561e3af5d360 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.343+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94687838257840] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.343+0000 7f01e1d29800 20 remove_watcher() i=1 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.343+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687838251472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af708f0 con 0x561e3af66a50 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.345+0000 7f01dd953640 1 -- 172.21.15.42:0/1765721586 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94687838251472] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d00a0040 con 0x561e3af66a50 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.345+0000 7f01e1d29800 20 remove_watcher() i=2 2024-02-16T00:11:23.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.345+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687838263712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6a9d0 con 0x561e3af61c50 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.345+0000 7f01de154640 1 -- 172.21.15.42:0/1765721586 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94687838263712] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d800a4a0 con 0x561e3af61c50 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.345+0000 7f01e1d29800 20 remove_watcher() i=3 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.345+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687838267664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6a9d0 con 0x561e3af5d360 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.347+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94687838267664] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x561e3af5d360 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.347+0000 7f01e1d29800 20 remove_watcher() i=4 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.347+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687838269680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6e910 con 0x7f01d8058040 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.347+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94687838269680] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.348+0000 7f01e1d29800 20 remove_watcher() i=5 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.348+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687838264768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6a9d0 con 0x7f01d8058040 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.348+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94687838264768] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.348+0000 7f01e1d29800 20 remove_watcher() i=6 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.348+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687838274768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3af6f0f0 con 0x7f01d8058040 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94687838274768] v27'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01d4037040 con 0x7f01d8058040 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 20 remove_watcher() i=7 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f01d8058040 msgr2=0x7f01d8023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f01d8058040 0x7f01d8023420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3af5d360 msgr2=0x561e3af5f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3af5d360 0x561e3af5f820 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af61c50 msgr2=0x561e3af64040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af61c50 0x561e3af64040 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3af66a50 msgr2=0x561e3af68f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.349+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3af66a50 0x561e3af68f10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00a8036830 msgr2=0x7f00a8038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00a8036830 0x7f00a8038cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x561e3af2ea50 tx=0x7f01d0084000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 msgr2=0x561e3af51610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/1765721586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af4a6f0 0x561e3af51610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f01d8042040 tx=0x7f01d804bf80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 reap_dead start 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01dd152640 1 -- 172.21.15.42:0/1765721586 reap_dead start 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 shutdown_connections 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 >> 172.21.15.42:0/1765721586 conn(0x561e3af469c0 msgr2=0x561e3af44020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 shutdown_connections 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/1765721586 wait complete. 2024-02-16T00:11:23.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00b8036790 msgr2=0x7f00b8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00b8036790 0x7f00b8038c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x561e3af29d70 tx=0x7f01d0005350 comp rx=0 tx=0).stop 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 msgr2=0x561e3af3d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 0x561e3af3d840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x561e3af29d40 tx=0x7f01d8018830 comp rx=0 tx=0).stop 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 shutdown_connections 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00b8036790 0x7f00b8038c50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/566429508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3af3d420 0x561e3af3d840 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 >> 172.21.15.42:0/566429508 conn(0x561e3af314c0 msgr2=0x561e3af318c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 shutdown_connections 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/566429508 wait complete. 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3ae2c3f0 msgr2=0x561e3af294a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3ae2c3f0 0x561e3af294a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af2bc20 msgr2=0x561e3af2e010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af2bc20 0x561e3af2e010 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.350+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00c40367e0 msgr2=0x7f00c4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00c40367e0 0x7f00c4038ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000f60 tx=0x7f01d40010a0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 msgr2=0x561e3af22670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3af22670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f01d0005870 tx=0x7f01d0002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 shutdown_connections 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3af2bc20 0x561e3af2e010 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3ae2c3f0 0x561e3af294a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f00c40367e0 0x7f00c4038ca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 --2- 172.21.15.42:0/3152515625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3ae29ac0 0x561e3af22670 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 >> 172.21.15.42:0/3152515625 conn(0x561e3ae234f0 msgr2=0x561e3ae27da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 shutdown_connections 2024-02-16T00:11:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.351+0000 7f01e1d29800 1 -- 172.21.15.42:0/3152515625 wait complete. 2024-02-16T00:11:23.369 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:23.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:23.369 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:23.411 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:23.411 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.409+0000 7fa696b33800 1 Processor -- start 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.409+0000 7fa696b33800 1 -- start start 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.409+0000 7fa696b33800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562e967d3300 0x562e967d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.409+0000 7fa696b33800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562e9671abb0 con 0x562e967cee70 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.409+0000 7fa696b33800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x562e966d2450 con 0x562e967d3300 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa692066640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562e967d3300 0x562e967d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa692867640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x562e967cee70 0x562e967cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60236/0 (socket says 172.21.15.42:60236) 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa692867640 1 -- 172.21.15.42:0/646659356 learned_addr learned my addr 172.21.15.42:0/646659356 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa691865640 1 -- 172.21.15.42:0/646659356 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503853136 0 0) 0x562e9671abb0 con 0x562e967cee70 2024-02-16T00:11:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa691865640 1 -- 172.21.15.42:0/646659356 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa67c001e10 con 0x562e967cee70 2024-02-16T00:11:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa692066640 1 -- 172.21.15.42:0/646659356 >> v1:172.21.15.2:6789/0 conn(0x562e967cee70 legacy=0x562e967cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.410+0000 7fa692066640 1 -- 172.21.15.42:0/646659356 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e967d6d20 con 0x562e967d3300 2024-02-16T00:11:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa692066640 1 --2- 172.21.15.42:0/646659356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967d3300 0x562e967d56f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa68800a470 tx=0x7fa68801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a36311c4f069d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa691865640 1 -- 172.21.15.42:0/646659356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68804ad60 con 0x562e967d3300 2024-02-16T00:11:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa691865640 1 -- 172.21.15.42:0/646659356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688052440 con 0x562e967d3300 2024-02-16T00:11:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa691865640 1 -- 172.21.15.42:0/646659356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa688052700 con 0x562e967d3300 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 -- 172.21.15.42:0/646659356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967d3300 msgr2=0x562e967d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 --2- 172.21.15.42:0/646659356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967d3300 0x562e967d56f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa68800a470 tx=0x7fa68801cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 -- 172.21.15.42:0/646659356 shutdown_connections 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 --2- 172.21.15.42:0/646659356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967d3300 0x562e967d56f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 -- 172.21.15.42:0/646659356 >> 172.21.15.42:0/646659356 conn(0x562e967ca4d0 msgr2=0x562e967cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 -- 172.21.15.42:0/646659356 shutdown_connections 2024-02-16T00:11:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.412+0000 7fa696b33800 1 -- 172.21.15.42:0/646659356 wait complete. 2024-02-16T00:11:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa696b33800 1 Processor -- start 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa696b33800 1 -- start start 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa696b33800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e968beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa696b33800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e966cf980 con 0x562e967cee70 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa692867640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e968beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa692867640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e968beeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58722/0 (socket says 172.21.15.42:58722) 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa692867640 1 -- 172.21.15.42:0/2824327727 learned_addr learned my addr 172.21.15.42:0/2824327727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.424+0000 7fa692867640 1 -- 172.21.15.42:0/2824327727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688005d20 con 0x562e967cee70 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.425+0000 7fa692867640 1 --2- 172.21.15.42:0/2824327727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e968beeb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa684001ca0 tx=0x7fa68400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d00d554cf9b911 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.425+0000 7fa580e09640 1 -- 172.21.15.42:0/2824327727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68400e470 con 0x562e967cee70 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.425+0000 7fa580e09640 1 -- 172.21.15.42:0/2824327727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400e5d0 con 0x562e967cee70 2024-02-16T00:11:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.425+0000 7fa580e09640 1 -- 172.21.15.42:0/2824327727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68400e8f0 con 0x562e967cee70 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.425+0000 7fa696b33800 1 -- 172.21.15.42:0/2824327727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 msgr2=0x562e968beeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.425+0000 7fa696b33800 1 --2- 172.21.15.42:0/2824327727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e968beeb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa684001ca0 tx=0x7fa68400b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 -- 172.21.15.42:0/2824327727 shutdown_connections 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 --2- 172.21.15.42:0/2824327727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e968beeb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 -- 172.21.15.42:0/2824327727 >> 172.21.15.42:0/2824327727 conn(0x562e967ca4d0 msgr2=0x562e968ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 -- 172.21.15.42:0/2824327727 shutdown_connections 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 -- 172.21.15.42:0/2824327727 wait complete. 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 Processor -- start 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 -- start start 2024-02-16T00:11:23.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e96742f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa696b33800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e966cb160 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa692867640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e96742f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa692867640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e96742f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58738/0 (socket says 172.21.15.42:58738) 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.426+0000 7fa692867640 1 -- 172.21.15.42:0/1717861605 learned_addr learned my addr 172.21.15.42:0/1717861605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa692867640 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c001e10 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa692867640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e96742f70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa684001ed0 tx=0x7fa684000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa57f606640 1 -- 172.21.15.42:0/1717861605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68401f070 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa57f606640 1 -- 172.21.15.42:0/1717861605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684018770 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562e968ca0f0 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa57f606640 1 -- 172.21.15.42:0/1717861605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa684018a30 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.427+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e968ca5d0 con 0x562e967cee70 2024-02-16T00:11:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa57f606640 1 -- 172.21.15.42:0/1717861605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa684018b90 con 0x562e967cee70 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa57f606640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa5780367e0 0x7fa578038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa57f606640 1 -- 172.21.15.42:0/1717861605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa68404c2b0 con 0x562e967cee70 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa692066640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa5780367e0 0x7fa578038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e967d3300 0x562e968ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e968ce770 con 0x562e967d3300 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa693068640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e967d3300 0x562e968ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.428+0000 7fa692066640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa5780367e0 0x7fa578038ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa688054000 tx=0x7fa68804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa693068640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e967d3300 0x562e968ce170 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa693068640 1 -- 172.21.15.42:0/1717861605 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e967d3300 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e968cb730 con 0x562e967d3300 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa693068640 1 -- 172.21.15.42:0/1717861605 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e967d3300 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e968d09b0 0x562e968d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e968d3470 con 0x562e968d09b0 2024-02-16T00:11:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.429+0000 7fa692867640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e968d09b0 0x562e968d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.430+0000 7fa692867640 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e968d09b0 0x562e968d2da0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.430+0000 7fa692867640 1 -- 172.21.15.42:0/1717861605 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa684014070 con 0x562e968d09b0 2024-02-16T00:11:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.430+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e968cf930 con 0x562e967d3300 2024-02-16T00:11:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.430+0000 7fa693068640 1 -- 172.21.15.42:0/1717861605 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e967d3300 2024-02-16T00:11:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.430+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e968cfd40 con 0x562e967d3300 2024-02-16T00:11:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa693068640 1 -- 172.21.15.42:0/1717861605 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e967d3300 2024-02-16T00:11:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa696b33800 1 Processor -- start 2024-02-16T00:11:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa696b33800 1 -- start start 2024-02-16T00:11:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa696b33800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 0x562e968c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa696b33800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9666de80 con 0x562e968c7c80 2024-02-16T00:11:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa693068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 0x562e968c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa693068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 0x562e968c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58746/0 (socket says 172.21.15.42:58746) 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.431+0000 7fa693068640 1 -- 172.21.15.42:0/2048663662 learned_addr learned my addr 172.21.15.42:0/2048663662 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa693068640 1 -- 172.21.15.42:0/2048663662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e968c6630 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa693068640 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 0x562e968c60f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x562e968cead0 tx=0x7fa68c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa57ce01640 1 -- 172.21.15.42:0/2048663662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68c01d070 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa57ce01640 1 -- 172.21.15.42:0/2048663662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0182e0 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa57ce01640 1 -- 172.21.15.42:0/2048663662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68c0145e0 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562e968c6880 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.432+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e968c6d40 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa57ce01640 1 -- 172.21.15.42:0/2048663662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa68c020020 con 0x562e968c7c80 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa57ce01640 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa56c036790 0x7fa56c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa57ce01640 1 -- 172.21.15.42:0/2048663662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa68c04dca0 con 0x562e968c7c80 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa692867640 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa56c036790 0x7fa56c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa696b33800 1 Processor -- start 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa696b33800 1 -- start start 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa692867640 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa56c036790 0x7fa56c038c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x562e968ceb40 tx=0x7fa68402dee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa696b33800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.433+0000 7fa696b33800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e966435d0 con 0x562e968f16e0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa693068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa693068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58750/0 (socket says 172.21.15.42:58750) 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa693068640 1 -- 172.21.15.42:0/2277807596 learned_addr learned my addr 172.21.15.42:0/2277807596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa693068640 1 -- 172.21.15.42:0/2277807596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e968f20d0 con 0x562e968f16e0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa693068640 1 --2- 172.21.15.42:0/2277807596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f1b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa68c04c020 tx=0x7fa68c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5bc553d483d2a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa5767fc640 1 -- 172.21.15.42:0/2277807596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68c016440 con 0x562e968f16e0 2024-02-16T00:11:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa5767fc640 1 -- 172.21.15.42:0/2277807596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0165a0 con 0x562e968f16e0 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.434+0000 7fa5767fc640 1 -- 172.21.15.42:0/2277807596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68c014b10 con 0x562e968f16e0 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- 172.21.15.42:0/2277807596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 msgr2=0x562e968f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 --2- 172.21.15.42:0/2277807596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f1b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa68c04c020 tx=0x7fa68c011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- 172.21.15.42:0/2277807596 shutdown_connections 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 --2- 172.21.15.42:0/2277807596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f1b00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- 172.21.15.42:0/2277807596 >> 172.21.15.42:0/2277807596 conn(0x562e968eda00 msgr2=0x562e968eba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- 172.21.15.42:0/2277807596 shutdown_connections 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- 172.21.15.42:0/2277807596 wait complete. 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 Processor -- start 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- start start 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa696b33800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e968f8c20 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa693068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa693068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58762/0 (socket says 172.21.15.42:58762) 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.435+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 learned_addr learned my addr 172.21.15.42:0/444653923 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e968c6d40 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa693068640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f86e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa68c042040 tx=0x7fa68c04bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa574ff9640 1 -- 172.21.15.42:0/444653923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68c032070 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa574ff9640 1 -- 172.21.15.42:0/444653923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0116f0 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562e968f8e20 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa574ff9640 1 -- 172.21.15.42:0/444653923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68c013730 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.436+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e968f9280 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa574ff9640 1 -- 172.21.15.42:0/444653923 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa68c022740 con 0x562e968f16e0 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa574ff9640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa55c036790 0x7fa55c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa574ff9640 1 -- 172.21.15.42:0/444653923 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa68c037c50 con 0x562e968f16e0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa692867640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa55c036790 0x7fa55c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e969043c0 0x562e96906880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96906fd0 con 0x562e969043c0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa692066640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e969043c0 0x562e96906880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.437+0000 7fa692867640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa55c036790 0x7fa55c038c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa68404c220 tx=0x7fa684034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa692066640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e969043c0 0x562e96906880 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 realm 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969073c0 con 0x562e969043c0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96907c10 con 0x562e969043c0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.438+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96907f70 con 0x562e969043c0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e96908c80 0x562e9690b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e96908c80 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa693068640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e96908c80 0x562e9690b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa693068640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e96908c80 0x562e9690b070 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 20 searching for the correct realm 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562e9690d550 0x562e9690fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969100e0 con 0x562e9690d550 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.439+0000 7fa692867640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562e9690d550 0x562e9690fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.440+0000 7fa692867640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562e9690d550 0x562e9690fa10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.440+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.440+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969100e0 con 0x562e96908c80 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.440+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.440+0000 7fa693068640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa68c058040 0x7fa68c04a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.440+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.441+0000 7fa692066640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa68c058040 0x7fa68c04a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.441+0000 7fa692066640 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa68c058040 0x7fa68c04a580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.441+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.441+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.441+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.441+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e96908c80 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.442+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.443+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e96908c80 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.444+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.445+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e96908c80 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.446+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e96908c80 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.447+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e9690d550 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x7fa68c058040 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e969043c0 2024-02-16T00:11:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690b5f0 con 0x562e96908c80 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.448+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690bec0 con 0x562e969043c0 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690c270 con 0x562e969043c0 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9690c650 con 0x562e969043c0 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 zone default found 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 4 Realm: () 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 zonegroup default 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96910570 con 0x7fa68c058040 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.449+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969123f0 con 0x562e9690d550 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96912750 con 0x562e9690d550 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 20 started sync module instance, tier type = 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.450+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96911830 con 0x562e96908c80 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.451+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.451+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94758094574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96912080 con 0x562e96908c80 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.451+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969130c0 con 0x562e969043c0 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.452+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94758094574784] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.452+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.452+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94758094580768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96913040 con 0x562e969043c0 2024-02-16T00:11:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.452+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96913f20 con 0x562e9690d550 2024-02-16T00:11:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.453+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.453+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94758094584448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969147b0 con 0x562e9690d550 2024-02-16T00:11:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.453+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96915250 con 0x562e96908c80 2024-02-16T00:11:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.454+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94758094580768] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.454+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.454+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94758094589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96915600 con 0x562e96908c80 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.454+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96916020 con 0x562e969043c0 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.454+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94758094584448] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.456+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.456+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94758094592768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96915fe0 con 0x562e969043c0 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.456+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94758094589232] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.456+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96916a30 con 0x7fa68c058040 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.457+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.457+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94758094582976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96916a30 con 0x7fa68c058040 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.457+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96917430 con 0x7fa68c058040 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.457+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94758094592768] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.457+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94758094582976] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.458+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.458+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94758094597936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969173f0 con 0x7fa68c058040 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.458+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969166b0 con 0x7fa68c058040 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94758094597936] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94758094586576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96917a70 con 0x7fa68c058040 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=0 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=1 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=2 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=3 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=4 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=5 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.459+0000 7fa696b33800 20 add_watcher() i=6 2024-02-16T00:11:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.460+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94758094586576] v27'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.460+0000 7fa696b33800 20 add_watcher() i=7 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.460+0000 7fa696b33800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.460+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9691ae00 con 0x562e969043c0 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.460+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.460+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94758094612416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9691ae00 con 0x562e969043c0 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94758094612416] v27'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa5497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa696b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa696b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa696b33800 5 note: GC not initialized 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa4c3fff640 20 reqs_thread_entry: start 2024-02-16T00:11:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.461+0000 7fa696b33800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.462+0000 7fa696b33800 20 Filter name: none 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.462+0000 7fa4c1ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.462+0000 7fa696b33800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.462+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9694c800 con 0x562e969043c0 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.462+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.462+0000 7fa696b33800 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T00:11:23.480 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.463+0000 7fa5497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.463+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94758094612416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96919b40 con 0x562e969043c0 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.464+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94758094612416] v27'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.464+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94758094574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9691a7c0 con 0x562e96908c80 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.465+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94758094574784] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.465+0000 7fa696b33800 20 remove_watcher() i=0 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.465+0000 7fa696b33800 2 removed watcher, disabling cache 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.465+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94758094580768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9691a7c0 con 0x562e969043c0 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.466+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94758094580768] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.466+0000 7fa696b33800 20 remove_watcher() i=1 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.466+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94758094584448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e9691a7c0 con 0x562e9690d550 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.467+0000 7fa692867640 1 -- 172.21.15.42:0/444653923 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94758094584448] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa684033070 con 0x562e9690d550 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.467+0000 7fa696b33800 20 remove_watcher() i=2 2024-02-16T00:11:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.467+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94758094589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96913a80 con 0x562e96908c80 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.468+0000 7fa693068640 1 -- 172.21.15.42:0/444653923 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94758094589232] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa68c00a4a0 con 0x562e96908c80 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.468+0000 7fa696b33800 20 remove_watcher() i=3 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.468+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94758094592768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96913a80 con 0x562e969043c0 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.469+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94758094592768] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x562e969043c0 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.470+0000 7fa696b33800 20 remove_watcher() i=4 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.470+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94758094582976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96915b00 con 0x7fa68c058040 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.470+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94758094582976] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.471+0000 7fa696b33800 20 remove_watcher() i=5 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.471+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94758094597936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e96913a80 con 0x7fa68c058040 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.471+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94758094597936] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.472+0000 7fa696b33800 20 remove_watcher() i=6 2024-02-16T00:11:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.472+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94758094586576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562e969134c0 con 0x7fa68c058040 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.472+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94758094586576] v27'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa688065040 con 0x7fa68c058040 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.472+0000 7fa696b33800 20 remove_watcher() i=7 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa68c058040 msgr2=0x7fa68c04a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa68c058040 0x7fa68c04a580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e969043c0 msgr2=0x562e96906880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e969043c0 0x562e96906880 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e96908c80 msgr2=0x562e9690b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e96908c80 0x562e9690b070 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562e9690d550 msgr2=0x562e9690fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562e9690d550 0x562e9690fa10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa55c036790 msgr2=0x7fa55c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa55c036790 0x7fa55c038c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa68404c220 tx=0x7fa684034000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 msgr2=0x562e968f86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa692066640 1 -- 172.21.15.42:0/444653923 reap_dead start 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f86e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa68c042040 tx=0x7fa68c04bf80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 shutdown_connections 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/444653923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968f16e0 0x562e968f86e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 >> 172.21.15.42:0/444653923 conn(0x562e968eda00 msgr2=0x562e968eb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 shutdown_connections 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/444653923 wait complete. 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa56c036790 msgr2=0x7fa56c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa56c036790 0x7fa56c038c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x562e968ceb40 tx=0x7fa68402dee0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 msgr2=0x562e968c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 0x562e968c60f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x562e968cead0 tx=0x7fa68c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 shutdown_connections 2024-02-16T00:11:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa56c036790 0x7fa56c038c50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 --2- 172.21.15.42:0/2048663662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e968c7c80 0x562e968c60f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 >> 172.21.15.42:0/2048663662 conn(0x562e968d6300 msgr2=0x562e968d6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 shutdown_connections 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.473+0000 7fa696b33800 1 -- 172.21.15.42:0/2048663662 wait complete. 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e967d3300 msgr2=0x562e968ce170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e967d3300 0x562e968ce170 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e968d09b0 msgr2=0x562e968d2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e968d09b0 0x562e968d2da0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa5780367e0 msgr2=0x7fa578038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa5780367e0 0x7fa578038ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa688054000 tx=0x7fa68804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 msgr2=0x562e96742f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e96742f70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa684001ed0 tx=0x7fa684000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 shutdown_connections 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562e968d09b0 0x562e968d2da0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562e967d3300 0x562e968ce170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa5780367e0 0x7fa578038ca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 --2- 172.21.15.42:0/1717861605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562e967cee70 0x562e96742f70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 >> 172.21.15.42:0/1717861605 conn(0x562e967ca4d0 msgr2=0x562e968b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 shutdown_connections 2024-02-16T00:11:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.474+0000 7fa696b33800 1 -- 172.21.15.42:0/1717861605 wait complete. 2024-02-16T00:11:23.492 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:23.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:23.493 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:23.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.566+0000 7feb97d3e800 1 Processor -- start 2024-02-16T00:11:23.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.566+0000 7feb97d3e800 1 -- start start 2024-02-16T00:11:23.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb97d3e800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55989a1f3aa0 0x55989a1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb97d3e800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55989a13dbb0 con 0x55989a1f63d0 2024-02-16T00:11:23.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb97d3e800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55989a0f5450 con 0x55989a1f3aa0 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb93a44640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55989a1f3aa0 0x55989a1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb93243640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55989a1f63d0 0x55989a1f87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60238/0 (socket says 172.21.15.42:60238) 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb93243640 1 -- 172.21.15.42:0/563557371 learned_addr learned my addr 172.21.15.42:0/563557371 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb92a42640 1 -- 172.21.15.42:0/563557371 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694594222 0 0) 0x55989a13dbb0 con 0x55989a1f63d0 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb92a42640 1 -- 172.21.15.42:0/563557371 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb80001e10 con 0x55989a1f63d0 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb93a44640 1 -- 172.21.15.42:0/563557371 >> v1:172.21.15.2:6789/0 conn(0x55989a1f63d0 legacy=0x55989a1f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.567+0000 7feb93a44640 1 -- 172.21.15.42:0/563557371 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55989a1faef0 con 0x55989a1f3aa0 2024-02-16T00:11:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.569+0000 7feb93a44640 1 --2- 172.21.15.42:0/563557371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f5e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a470 tx=0x7feb8c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e2673b5a480f68 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.569+0000 7feb92a42640 1 -- 172.21.15.42:0/563557371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c04ad60 con 0x55989a1f3aa0 2024-02-16T00:11:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.569+0000 7feb92a42640 1 -- 172.21.15.42:0/563557371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c052440 con 0x55989a1f3aa0 2024-02-16T00:11:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.569+0000 7feb92a42640 1 -- 172.21.15.42:0/563557371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c052700 con 0x55989a1f3aa0 2024-02-16T00:11:23.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 -- 172.21.15.42:0/563557371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 msgr2=0x55989a1f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 --2- 172.21.15.42:0/563557371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f5e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a470 tx=0x7feb8c01cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 -- 172.21.15.42:0/563557371 shutdown_connections 2024-02-16T00:11:23.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 --2- 172.21.15.42:0/563557371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f5e90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 -- 172.21.15.42:0/563557371 >> 172.21.15.42:0/563557371 conn(0x55989a1ed4d0 msgr2=0x55989a1ef8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 -- 172.21.15.42:0/563557371 shutdown_connections 2024-02-16T00:11:23.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.570+0000 7feb97d3e800 1 -- 172.21.15.42:0/563557371 wait complete. 2024-02-16T00:11:23.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.581+0000 7feb97d3e800 1 Processor -- start 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.581+0000 7feb97d3e800 1 -- start start 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.581+0000 7feb97d3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a2e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.581+0000 7feb97d3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55989a0f2980 con 0x55989a1f3aa0 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.582+0000 7feb93a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a2e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.582+0000 7feb93a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a2e2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58784/0 (socket says 172.21.15.42:58784) 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.582+0000 7feb93a44640 1 -- 172.21.15.42:0/2816137829 learned_addr learned my addr 172.21.15.42:0/2816137829 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.582+0000 7feb93a44640 1 -- 172.21.15.42:0/2816137829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c005d20 con 0x55989a1f3aa0 2024-02-16T00:11:23.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.582+0000 7feb93a44640 1 --2- 172.21.15.42:0/2816137829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a2e2f90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feb8c055040 tx=0x7feb8c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ace53ee54cf0fb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7fea81e0b640 1 -- 172.21.15.42:0/2816137829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c00a040 con 0x55989a1f3aa0 2024-02-16T00:11:23.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7fea81e0b640 1 -- 172.21.15.42:0/2816137829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00a1a0 con 0x55989a1f3aa0 2024-02-16T00:11:23.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7fea81e0b640 1 -- 172.21.15.42:0/2816137829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c0525b0 con 0x55989a1f3aa0 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 -- 172.21.15.42:0/2816137829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 msgr2=0x55989a2e2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 --2- 172.21.15.42:0/2816137829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a2e2f90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feb8c055040 tx=0x7feb8c04c000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 -- 172.21.15.42:0/2816137829 shutdown_connections 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 --2- 172.21.15.42:0/2816137829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a2e2f90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 -- 172.21.15.42:0/2816137829 >> 172.21.15.42:0/2816137829 conn(0x55989a1ed4d0 msgr2=0x55989a2de730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 -- 172.21.15.42:0/2816137829 shutdown_connections 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.583+0000 7feb97d3e800 1 -- 172.21.15.42:0/2816137829 wait complete. 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb97d3e800 1 Processor -- start 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb97d3e800 1 -- start start 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb97d3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb97d3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55989a0ee160 con 0x55989a1f3aa0 2024-02-16T00:11:23.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb93a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb93a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58786/0 (socket says 172.21.15.42:58786) 2024-02-16T00:11:23.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb93a44640 1 -- 172.21.15.42:0/725697286 learned_addr learned my addr 172.21.15.42:0/725697286 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.584+0000 7feb93a44640 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55989a1faef0 con 0x55989a1f3aa0 2024-02-16T00:11:23.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.585+0000 7feb93a44640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f3370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feb8c055040 tx=0x7feb8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.585+0000 7fea7bfff640 1 -- 172.21.15.42:0/725697286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c06b070 con 0x55989a1f3aa0 2024-02-16T00:11:23.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.585+0000 7fea7bfff640 1 -- 172.21.15.42:0/725697286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c052c60 con 0x55989a1f3aa0 2024-02-16T00:11:23.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.585+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55989a1f38b0 con 0x55989a1f3aa0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.585+0000 7fea7bfff640 1 -- 172.21.15.42:0/725697286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c06f410 con 0x55989a1f3aa0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.585+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55989a1f1e00 con 0x55989a1f3aa0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7fea7bfff640 1 -- 172.21.15.42:0/725697286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feb8c059050 con 0x55989a1f3aa0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7fea7bfff640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea7c036790 0x7fea7c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7fea7bfff640 1 -- 172.21.15.42:0/725697286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7feb8c08d010 con 0x55989a1f3aa0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7feb93243640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea7c036790 0x7fea7c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a1f63d0 0x55989a2f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a1f27b0 con 0x55989a1f63d0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7feb94245640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a1f63d0 0x55989a2f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.586+0000 7feb93243640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea7c036790 0x7fea7c038c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb7c000f60 tx=0x7feb7c0010a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb94245640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a1f63d0 0x55989a2f3780 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb94245640 1 -- 172.21.15.42:0/725697286 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a1f63d0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a1f2130 con 0x55989a1f63d0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb94245640 1 -- 172.21.15.42:0/725697286 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a1f63d0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a2f5ba0 0x55989a2f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a2f8660 con 0x55989a2f5ba0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb93a44640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a2f5ba0 0x55989a2f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.587+0000 7feb93a44640 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a2f5ba0 0x55989a2f7f90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.588+0000 7feb93a44640 1 -- 172.21.15.42:0/725697286 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a2f5ba0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.588+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a2f4b20 con 0x55989a1f63d0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.588+0000 7feb94245640 1 -- 172.21.15.42:0/725697286 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a1f63d0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.588+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a2f4f30 con 0x55989a1f63d0 2024-02-16T00:11:23.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.588+0000 7feb94245640 1 -- 172.21.15.42:0/725697286 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a1f63d0 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb97d3e800 1 Processor -- start 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb97d3e800 1 -- start start 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb97d3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 0x55989a307870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb97d3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55989a090e80 con 0x55989a307450 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb94245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 0x55989a307870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb94245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 0x55989a307870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58796/0 (socket says 172.21.15.42:58796) 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb94245640 1 -- 172.21.15.42:0/2346943085 learned_addr learned my addr 172.21.15.42:0/2346943085 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.589+0000 7feb94245640 1 -- 172.21.15.42:0/2346943085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55989a307db0 con 0x55989a307450 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.590+0000 7feb94245640 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 0x55989a307870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55989a2f3cc0 tx=0x7feb84018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.590+0000 7fea797fa640 1 -- 172.21.15.42:0/2346943085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8401d070 con 0x55989a307450 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.590+0000 7fea797fa640 1 -- 172.21.15.42:0/2346943085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb840182e0 con 0x55989a307450 2024-02-16T00:11:23.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.590+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55989a308820 con 0x55989a307450 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.590+0000 7fea797fa640 1 -- 172.21.15.42:0/2346943085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb840145e0 con 0x55989a307450 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.590+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55989a308ce0 con 0x55989a307450 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7fea797fa640 1 -- 172.21.15.42:0/2346943085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feb84020020 con 0x55989a307450 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7fea797fa640 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea6c0367e0 0x7fea6c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7fea797fa640 1 -- 172.21.15.42:0/2346943085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7feb8404db90 con 0x55989a307450 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb93a44640 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea6c0367e0 0x7fea6c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb97d3e800 1 Processor -- start 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb97d3e800 1 -- start start 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb93a44640 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea6c0367e0 0x7fea6c038ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55989a2f3d30 tx=0x7feb8c08b4d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb97d3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a314ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb97d3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55989a0665d0 con 0x55989a3146e0 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb94245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a314ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb94245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a314ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58800/0 (socket says 172.21.15.42:58800) 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.591+0000 7feb94245640 1 -- 172.21.15.42:0/3919469256 learned_addr learned my addr 172.21.15.42:0/3919469256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb94245640 1 -- 172.21.15.42:0/3919469256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55989a3150b0 con 0x55989a3146e0 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb94245640 1 --2- 172.21.15.42:0/3919469256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a314ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feb84013010 tx=0x7feb84011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb74a6ad8110582 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7fea72ffd640 1 -- 172.21.15.42:0/3919469256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb84040500 con 0x55989a3146e0 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7fea72ffd640 1 -- 172.21.15.42:0/3919469256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84014ac0 con 0x55989a3146e0 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7fea72ffd640 1 -- 172.21.15.42:0/3919469256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8402b350 con 0x55989a3146e0 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb97d3e800 1 -- 172.21.15.42:0/3919469256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 msgr2=0x55989a314ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb97d3e800 1 --2- 172.21.15.42:0/3919469256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a314ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feb84013010 tx=0x7feb84011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb97d3e800 1 -- 172.21.15.42:0/3919469256 shutdown_connections 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb97d3e800 1 --2- 172.21.15.42:0/3919469256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a314ae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb97d3e800 1 -- 172.21.15.42:0/3919469256 >> 172.21.15.42:0/3919469256 conn(0x55989a3109b0 msgr2=0x55989a30ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.592+0000 7feb97d3e800 1 -- 172.21.15.42:0/3919469256 shutdown_connections 2024-02-16T00:11:23.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb97d3e800 1 -- 172.21.15.42:0/3919469256 wait complete. 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb97d3e800 1 Processor -- start 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb97d3e800 1 -- start start 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb97d3e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a31b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb97d3e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55989a31bb70 con 0x55989a3146e0 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb94245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a31b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb94245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a31b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58806/0 (socket says 172.21.15.42:58806) 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 learned_addr learned my addr 172.21.15.42:0/1603292407 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.593+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55989a308ce0 con 0x55989a3146e0 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7feb94245640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a31b630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feb8404aec0 tx=0x7feb8404bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7fea717fa640 1 -- 172.21.15.42:0/1603292407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb84032070 con 0x55989a3146e0 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7fea717fa640 1 -- 172.21.15.42:0/1603292407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84013c60 con 0x55989a3146e0 2024-02-16T00:11:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55989a31bd70 con 0x55989a3146e0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7fea717fa640 1 -- 172.21.15.42:0/1603292407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb840133b0 con 0x55989a3146e0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55989a31c1d0 con 0x55989a3146e0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.594+0000 7fea717fa640 1 -- 172.21.15.42:0/1603292407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feb84013510 con 0x55989a3146e0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7fea717fa640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea5c0367e0 0x7fea5c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7fea717fa640 1 -- 172.21.15.42:0/1603292407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7feb84038c60 con 0x55989a3146e0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb93a44640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea5c0367e0 0x7fea5c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a3271c0 0x55989a329680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a329dd0 con 0x55989a3271c0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb93243640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a3271c0 0x55989a329680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb93a44640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea5c0367e0 0x7fea5c038ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0774d0 tx=0x7feb8c089000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.595+0000 7feb93243640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a3271c0 0x55989a329680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 realm 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3266a0 con 0x55989a3271c0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32a850 con 0x55989a3271c0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32ad60 con 0x55989a3271c0 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a32bb10 0x55989a32df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.596+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a32bb10 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb94245640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a32bb10 0x55989a32df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb94245640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a32bb10 0x55989a32df00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb97d3e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb97d3e800 20 searching for the correct realm 2024-02-16T00:11:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55989a330460 0x55989a332920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a332ff0 con 0x55989a330460 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb93a44640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55989a330460 0x55989a332920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.597+0000 7feb93a44640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55989a330460 0x55989a332920 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.598+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.598+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a332ff0 con 0x55989a32bb10 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.598+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.598+0000 7feb94245640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7feb84057040 0x7feb84022740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.598+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.598+0000 7feb93243640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7feb84057040 0x7feb84022740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.599+0000 7feb93243640 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7feb84057040 0x7feb84022740 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.599+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.599+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.599+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.599+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a32bb10 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.600+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.601+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a32bb10 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.602+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.603+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a32bb10 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x55989a3271c0 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.604+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.605+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.605+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.605+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c006070 con 0x7feb84057040 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.605+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a32bb10 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.605+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.605+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a330460 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.606+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.606+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x7feb84057040 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.606+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.606+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a3271c0 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.606+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.606+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32e480 con 0x55989a32bb10 2024-02-16T00:11:23.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32ed80 con 0x55989a3271c0 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32f130 con 0x55989a3271c0 2024-02-16T00:11:23.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.607+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a32f510 con 0x55989a3271c0 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 zone default found 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 4 Realm: () 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 zonegroup default 2024-02-16T00:11:23.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a333430 con 0x7feb84057040 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3352b0 con 0x55989a330460 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a335610 con 0x55989a330460 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 started sync module instance, tier type = 2024-02-16T00:11:23.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.608+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3346f0 con 0x55989a32bb10 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.609+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.609+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113910440832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a334f40 con 0x55989a32bb10 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.609+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a336000 con 0x55989a3271c0 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.611+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94113910440832] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.611+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.611+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94113910446816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3363b0 con 0x55989a3271c0 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.611+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a336d20 con 0x55989a330460 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.612+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.612+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94113910450304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a337570 con 0x55989a330460 2024-02-16T00:11:23.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.612+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a338040 con 0x55989a32bb10 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.612+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94113910446816] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.613+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94113910450304] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.613+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.613+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94113910452432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a334aa0 con 0x55989a32bb10 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.613+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a338a00 con 0x55989a3271c0 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.614+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.614+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94113910457696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a338e20 con 0x55989a3271c0 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.614+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94113910452432] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.614+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a339320 con 0x7feb84057040 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.615+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94113910457696] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.615+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.615+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94113910455072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a338e20 con 0x7feb84057040 2024-02-16T00:11:23.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.615+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a339ce0 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.616+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94113910455072] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.616+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.616+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94113910459232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a339ce0 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.616+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a33a690 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94113910459232] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94113910464944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a339ce0 con 0x7feb84057040 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=0 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=1 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=2 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=3 2024-02-16T00:11:23.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=4 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=5 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.617+0000 7feb97d3e800 20 add_watcher() i=6 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.618+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94113910464944] v27'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.618+0000 7feb97d3e800 20 add_watcher() i=7 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.618+0000 7feb97d3e800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.618+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a339ce0 con 0x55989a3271c0 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.619+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.619+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94113910467232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a33b360 con 0x55989a3271c0 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.619+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94113910467232] v27'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7fea49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 5 note: GC not initialized 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7fea48fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 20 Filter name: none 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7fe9c27fc640 20 reqs_thread_entry: start 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.620+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a36f820 con 0x55989a3271c0 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.621+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.621+0000 7feb97d3e800 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T00:11:23.638 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.621+0000 7fea49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.621+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94113910467232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a33d6c0 con 0x55989a3271c0 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.622+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94113910467232] v27'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.622+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94113910440832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a33aaa0 con 0x55989a32bb10 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.623+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94113910440832] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.623+0000 7feb97d3e800 20 remove_watcher() i=0 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.623+0000 7feb97d3e800 2 removed watcher, disabling cache 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.623+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94113910446816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a33aaa0 con 0x55989a3271c0 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.625+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94113910446816] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.625+0000 7feb97d3e800 20 remove_watcher() i=1 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.625+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94113910450304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a33aaa0 con 0x55989a330460 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.626+0000 7feb93a44640 1 -- 172.21.15.42:0/1603292407 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94113910450304] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8c05c930 con 0x55989a330460 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.626+0000 7feb97d3e800 20 remove_watcher() i=2 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.626+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94113910452432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a335ae0 con 0x55989a32bb10 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.627+0000 7feb94245640 1 -- 172.21.15.42:0/1603292407 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94113910452432] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb8400a4a0 con 0x55989a32bb10 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.627+0000 7feb97d3e800 20 remove_watcher() i=3 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.627+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94113910457696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3370d0 con 0x55989a3271c0 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.628+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94113910457696] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x55989a3271c0 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.628+0000 7feb97d3e800 20 remove_watcher() i=4 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.628+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94113910455072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3370d0 con 0x7feb84057040 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.629+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94113910455072] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.629+0000 7feb97d3e800 20 remove_watcher() i=5 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.629+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94113910459232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a337b20 con 0x7feb84057040 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.630+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94113910459232] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.630+0000 7feb97d3e800 20 remove_watcher() i=6 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.630+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94113910464944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55989a3370d0 con 0x7feb84057040 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.630+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94113910464944] v27'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb7c037040 con 0x7feb84057040 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.630+0000 7feb97d3e800 20 remove_watcher() i=7 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7feb84057040 msgr2=0x7feb84022740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7feb84057040 0x7feb84022740 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a3271c0 msgr2=0x55989a329680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a3271c0 0x55989a329680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a32bb10 msgr2=0x55989a32df00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a32bb10 0x55989a32df00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55989a330460 msgr2=0x55989a332920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55989a330460 0x55989a332920 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea5c0367e0 msgr2=0x7fea5c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea5c0367e0 0x7fea5c038ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0774d0 tx=0x7feb8c089000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb93243640 1 -- 172.21.15.42:0/1603292407 reap_dead start 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 msgr2=0x55989a31b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a31b630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feb8404aec0 tx=0x7feb8404bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 shutdown_connections 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/1603292407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a3146e0 0x55989a31b630 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 >> 172.21.15.42:0/1603292407 conn(0x55989a3109b0 msgr2=0x55989a30e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 shutdown_connections 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/1603292407 wait complete. 2024-02-16T00:11:23.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea6c0367e0 msgr2=0x7fea6c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea6c0367e0 0x7fea6c038ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55989a2f3d30 tx=0x7feb8c08b4d0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 msgr2=0x55989a307870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 0x55989a307870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55989a2f3cc0 tx=0x7feb84018830 comp rx=0 tx=0).stop 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 shutdown_connections 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea6c0367e0 0x7fea6c038ca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 --2- 172.21.15.42:0/2346943085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a307450 0x55989a307870 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 >> 172.21.15.42:0/2346943085 conn(0x55989a2fb4f0 msgr2=0x55989a2fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 shutdown_connections 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.631+0000 7feb97d3e800 1 -- 172.21.15.42:0/2346943085 wait complete. 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a1f63d0 msgr2=0x55989a2f3780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a1f63d0 0x55989a2f3780 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a2f5ba0 msgr2=0x55989a2f7f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a2f5ba0 0x55989a2f7f90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea7c036790 msgr2=0x7fea7c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea7c036790 0x7fea7c038c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb7c000f60 tx=0x7feb7c0010a0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 msgr2=0x55989a1f3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f3370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feb8c055040 tx=0x7feb8c002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 shutdown_connections 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55989a2f5ba0 0x55989a2f7f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55989a1f63d0 0x55989a2f3780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fea7c036790 0x7fea7c038c50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 --2- 172.21.15.42:0/725697286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55989a1f3aa0 0x55989a1f3370 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 >> 172.21.15.42:0/725697286 conn(0x55989a1ed4d0 msgr2=0x55989a2dcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 shutdown_connections 2024-02-16T00:11:23.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.632+0000 7feb97d3e800 1 -- 172.21.15.42:0/725697286 wait complete. 2024-02-16T00:11:23.651 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.651 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-16T00:11:23.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-16T00:11:23.651 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-02-16T00:11:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.730+0000 7f8e47524800 1 Processor -- start 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.730+0000 7f8e47524800 1 -- start start 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.730+0000 7f8e47524800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5600e2ab7e90 0x5600e2ab82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.730+0000 7f8e47524800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5600e2a03c50 con 0x5600e2ab90f0 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.730+0000 7f8e47524800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5600e29bb450 con 0x5600e2ab7e90 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e431c8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5600e2ab7e90 0x5600e2ab82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e429c7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5600e2ab90f0 0x5600e2ab9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60252/0 (socket says 172.21.15.42:60252) 2024-02-16T00:11:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e429c7640 1 -- 172.21.15.42:0/3102883509 learned_addr learned my addr 172.21.15.42:0/3102883509 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e421c6640 1 -- 172.21.15.42:0/3102883509 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571017055 0 0) 0x5600e2a03c50 con 0x5600e2ab90f0 2024-02-16T00:11:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e421c6640 1 -- 172.21.15.42:0/3102883509 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e2c001e10 con 0x5600e2ab90f0 2024-02-16T00:11:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e431c8640 1 -- 172.21.15.42:0/3102883509 >> v1:172.21.15.2:6789/0 conn(0x5600e2ab90f0 legacy=0x5600e2ab9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.731+0000 7f8e431c8640 1 -- 172.21.15.42:0/3102883509 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e2ab8980 con 0x5600e2ab7e90 2024-02-16T00:11:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.733+0000 7f8e431c8640 1 --2- 172.21.15.42:0/3102883509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ab82b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400a470 tx=0x7f8e3401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0b2bfddebe5fd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.733+0000 7f8e421c6640 1 -- 172.21.15.42:0/3102883509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3404ad60 con 0x5600e2ab7e90 2024-02-16T00:11:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.733+0000 7f8e421c6640 1 -- 172.21.15.42:0/3102883509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34052440 con 0x5600e2ab7e90 2024-02-16T00:11:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.733+0000 7f8e421c6640 1 -- 172.21.15.42:0/3102883509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e34052700 con 0x5600e2ab7e90 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.733+0000 7f8e47524800 1 -- 172.21.15.42:0/3102883509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 msgr2=0x5600e2ab82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.733+0000 7f8e47524800 1 --2- 172.21.15.42:0/3102883509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ab82b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400a470 tx=0x7f8e3401cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.734+0000 7f8e47524800 1 -- 172.21.15.42:0/3102883509 shutdown_connections 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.734+0000 7f8e47524800 1 --2- 172.21.15.42:0/3102883509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ab82b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.734+0000 7f8e47524800 1 -- 172.21.15.42:0/3102883509 >> 172.21.15.42:0/3102883509 conn(0x5600e2ab34f0 msgr2=0x5600e2ab5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.734+0000 7f8e47524800 1 -- 172.21.15.42:0/3102883509 shutdown_connections 2024-02-16T00:11:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.734+0000 7f8e47524800 1 -- 172.21.15.42:0/3102883509 wait complete. 2024-02-16T00:11:23.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e47524800 1 Processor -- start 2024-02-16T00:11:23.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e47524800 1 -- start start 2024-02-16T00:11:23.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e47524800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ba8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e47524800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e29b8980 con 0x5600e2ab7e90 2024-02-16T00:11:23.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e431c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ba8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e431c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ba8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58826/0 (socket says 172.21.15.42:58826) 2024-02-16T00:11:23.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.745+0000 7f8e431c8640 1 -- 172.21.15.42:0/3283886894 learned_addr learned my addr 172.21.15.42:0/3283886894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.746+0000 7f8e431c8640 1 -- 172.21.15.42:0/3283886894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e34005d20 con 0x5600e2ab7e90 2024-02-16T00:11:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.746+0000 7f8e431c8640 1 --2- 172.21.15.42:0/3283886894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ba8180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e34055040 tx=0x7f8e3404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51603737c212f842 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.746+0000 7f8d3160a640 1 -- 172.21.15.42:0/3283886894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3400a040 con 0x5600e2ab7e90 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.746+0000 7f8d3160a640 1 -- 172.21.15.42:0/3283886894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400a1a0 con 0x5600e2ab7e90 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.746+0000 7f8d3160a640 1 -- 172.21.15.42:0/3283886894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e340525b0 con 0x5600e2ab7e90 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- 172.21.15.42:0/3283886894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 msgr2=0x5600e2ba8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 --2- 172.21.15.42:0/3283886894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ba8180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e34055040 tx=0x7f8e3404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- 172.21.15.42:0/3283886894 shutdown_connections 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 --2- 172.21.15.42:0/3283886894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2ba8180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- 172.21.15.42:0/3283886894 >> 172.21.15.42:0/3283886894 conn(0x5600e2ab34f0 msgr2=0x5600e2ba3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- 172.21.15.42:0/3283886894 shutdown_connections 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- 172.21.15.42:0/3283886894 wait complete. 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 Processor -- start 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- start start 2024-02-16T00:11:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2a2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.747+0000 7f8e47524800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e29b4160 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e431c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2a2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e431c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2a2bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58840/0 (socket says 172.21.15.42:58840) 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e431c8640 1 -- 172.21.15.42:0/119132716 learned_addr learned my addr 172.21.15.42:0/119132716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e431c8640 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3404e070 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e431c8640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2a2bf90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e34055040 tx=0x7f8e34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8d2fe07640 1 -- 172.21.15.42:0/119132716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3406b070 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8d2fe07640 1 -- 172.21.15.42:0/119132716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34052990 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600e2bb3520 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8d2fe07640 1 -- 172.21.15.42:0/119132716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e34052c70 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.748+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600e2bb3a60 con 0x5600e2ab7e90 2024-02-16T00:11:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.749+0000 7f8d2fe07640 1 -- 172.21.15.42:0/119132716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8e34059050 con 0x5600e2ab7e90 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.749+0000 7f8d2fe07640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d28036830 0x7f8d28038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.749+0000 7f8d2fe07640 1 -- 172.21.15.42:0/119132716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8e3408cc70 con 0x5600e2ab7e90 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.749+0000 7f8e429c7640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d28036830 0x7f8d28038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.749+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2ab90f0 0x5600e2bb7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.750+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bb7a60 con 0x5600e2ab90f0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.750+0000 7f8e439c9640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2ab90f0 0x5600e2bb7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.750+0000 7f8e429c7640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d28036830 0x7f8d28038cf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e38000f60 tx=0x7f8e380010a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.750+0000 7f8e439c9640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2ab90f0 0x5600e2bb7490 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.750+0000 7f8e439c9640 1 -- 172.21.15.42:0/119132716 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2ab90f0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.750+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bb4bc0 con 0x5600e2ab90f0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e439c9640 1 -- 172.21.15.42:0/119132716 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2ab90f0 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bb9c70 0x5600e2bbc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bbc730 con 0x5600e2bb9c70 2024-02-16T00:11:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e431c8640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bb9c70 0x5600e2bbc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e431c8640 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bb9c70 0x5600e2bbc060 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e431c8640 1 -- 172.21.15.42:0/119132716 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bb9c70 2024-02-16T00:11:23.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bb8bf0 con 0x5600e2ab90f0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.751+0000 7f8e439c9640 1 -- 172.21.15.42:0/119132716 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2ab90f0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bb9000 con 0x5600e2ab90f0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e439c9640 1 -- 172.21.15.42:0/119132716 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2ab90f0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e47524800 1 Processor -- start 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e47524800 1 -- start start 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e47524800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 0x5600e2bcb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e47524800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e2956e80 con 0x5600e2bcb4b0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.752+0000 7f8e439c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 0x5600e2bcb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8e439c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 0x5600e2bcb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58850/0 (socket says 172.21.15.42:58850) 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8e439c9640 1 -- 172.21.15.42:0/1457443207 learned_addr learned my addr 172.21.15.42:0/1457443207 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8e439c9640 1 -- 172.21.15.42:0/1457443207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e2bcbe10 con 0x5600e2bcb4b0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8e439c9640 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 0x5600e2bcb8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5600e2a2b7f0 tx=0x7f8e3c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8d2d602640 1 -- 172.21.15.42:0/1457443207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3c01d070 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8d2d602640 1 -- 172.21.15.42:0/1457443207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0182e0 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600e2bcc880 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8d2d602640 1 -- 172.21.15.42:0/1457443207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3c0145e0 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.753+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600e2bccd40 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.754+0000 7f8d2d602640 1 -- 172.21.15.42:0/1457443207 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8e3c020020 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.754+0000 7f8d2d602640 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d1c036830 0x7f8d1c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.754+0000 7f8d2d602640 1 -- 172.21.15.42:0/1457443207 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8e3c04dc50 con 0x5600e2bcb4b0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.754+0000 7f8e431c8640 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d1c036830 0x7f8d1c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.754+0000 7f8e47524800 1 Processor -- start 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.754+0000 7f8e47524800 1 -- start start 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e431c8640 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d1c036830 0x7f8d1c038cf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5600e2bb7e00 tx=0x7f8e3405bf40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e47524800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2bb0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e47524800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e292c5d0 con 0x5600e2bb0b00 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e439c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2bb0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e439c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2bb0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58864/0 (socket says 172.21.15.42:58864) 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e439c9640 1 -- 172.21.15.42:0/1062976193 learned_addr learned my addr 172.21.15.42:0/1062976193 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e439c9640 1 -- 172.21.15.42:0/1062976193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e2baf300 con 0x5600e2bb0b00 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.755+0000 7f8e439c9640 1 --2- 172.21.15.42:0/1062976193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2bb0f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c013010 tx=0x7f8e3c011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce2dc51b086348 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8d26ffd640 1 -- 172.21.15.42:0/1062976193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3c016570 con 0x5600e2bb0b00 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8d26ffd640 1 -- 172.21.15.42:0/1062976193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c014ac0 con 0x5600e2bb0b00 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8d26ffd640 1 -- 172.21.15.42:0/1062976193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3c02b350 con 0x5600e2bb0b00 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 -- 172.21.15.42:0/1062976193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 msgr2=0x5600e2bb0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 --2- 172.21.15.42:0/1062976193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2bb0f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c013010 tx=0x7f8e3c011460 comp rx=0 tx=0).stop 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 -- 172.21.15.42:0/1062976193 shutdown_connections 2024-02-16T00:11:23.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 --2- 172.21.15.42:0/1062976193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2bb0f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 -- 172.21.15.42:0/1062976193 >> 172.21.15.42:0/1062976193 conn(0x5600e2bd4a10 msgr2=0x5600e2bd2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 -- 172.21.15.42:0/1062976193 shutdown_connections 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 -- 172.21.15.42:0/1062976193 wait complete. 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 Processor -- start 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.756+0000 7f8e47524800 1 -- start start 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e47524800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2be1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e47524800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600e2be1d90 con 0x5600e2bb0b00 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e439c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2be1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e439c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2be1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58866/0 (socket says 172.21.15.42:58866) 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 learned_addr learned my addr 172.21.15.42:0/614618800 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600e2bccd40 con 0x5600e2bb0b00 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e439c9640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2be1850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c03e040 tx=0x7f8e3c04bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8d257fa640 1 -- 172.21.15.42:0/614618800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3c014c30 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8d257fa640 1 -- 172.21.15.42:0/614618800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0133b0 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600e2be1f90 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8d257fa640 1 -- 172.21.15.42:0/614618800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e3c013690 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.757+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600e2be2450 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.758+0000 7f8d257fa640 1 -- 172.21.15.42:0/614618800 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8e3c022740 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.758+0000 7f8d257fa640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d0c036790 0x7f8d0c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.758+0000 7f8d257fa640 1 -- 172.21.15.42:0/614618800 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8e3c038ca0 con 0x5600e2bb0b00 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.758+0000 7f8e431c8640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d0c036790 0x7f8d0c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2bed3e0 0x5600e2bef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2befff0 con 0x5600e2bed3e0 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e431c8640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d0c036790 0x7f8d0c038c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e340053a0 tx=0x7f8e34085000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e429c7640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2bed3e0 0x5600e2bef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e429c7640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2bed3e0 0x5600e2bef8a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 20 realm 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.759+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bec840 con 0x5600e2bed3e0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf0a70 con 0x5600e2bed3e0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf12f0 con 0x5600e2bed3e0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bf1cd0 0x5600e2bf40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e439c9640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bf1cd0 0x5600e2bf40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.760+0000 7f8e439c9640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bf1cd0 0x5600e2bf40c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e47524800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e47524800 20 searching for the correct realm 2024-02-16T00:11:23.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5600e2bf6ad0 0x5600e2bf8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf9660 con 0x5600e2bf6ad0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e431c8640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5600e2bf6ad0 0x5600e2bf8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.761+0000 7f8e431c8640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5600e2bf6ad0 0x5600e2bf8f90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf9660 con 0x5600e2bf1cd0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e439c9640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8e3c014070 0x7f8e3c02c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e429c7640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8e3c014070 0x7f8e3c02c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.762+0000 7f8e429c7640 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8e3c014070 0x7f8e3c02c7d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.763+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.763+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.763+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.763+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.763+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.763+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.764+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.765+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.766+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.766+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.766+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.766+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.766+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.766+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.767+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x5600e2bed3e0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.768+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38006070 con 0x7f8e3c014070 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.769+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x7f8e3c014070 2024-02-16T00:11:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf47c0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf4ed0 con 0x5600e2bed3e0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.770+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf5280 con 0x5600e2bed3e0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf5660 con 0x5600e2bed3e0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 zone default found 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 4 Realm: () 2024-02-16T00:11:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 zonegroup default 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bf9aa0 con 0x7f8e3c014070 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.771+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfb920 con 0x5600e2bf6ad0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfbc80 con 0x5600e2bf6ad0 2024-02-16T00:11:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 20 started sync module instance, tier type = 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.772+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfaef0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.773+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.773+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94561804202976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfaef0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.773+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfc660 con 0x5600e2bed3e0 2024-02-16T00:11:23.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.774+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94561804202976] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.774+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.774+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94561804206464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfaef0 con 0x5600e2bed3e0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.774+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfd0b0 con 0x5600e2bf6ad0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.775+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94561804206464] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.775+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.775+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94561804200528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfae70 con 0x5600e2bf6ad0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.775+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfdf40 con 0x5600e2bf1cd0 2024-02-16T00:11:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.776+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.776+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94561804213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfe720 con 0x5600e2bf1cd0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.776+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94561804200528] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.776+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfd4d0 con 0x5600e2bed3e0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.777+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.777+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94561804217504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfd4d0 con 0x5600e2bed3e0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.777+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94561804213376] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.777+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bffc20 con 0x7f8e3c014070 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.778+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.778+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94561804220160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bffbe0 con 0x7f8e3c014070 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.779+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00620 con 0x7f8e3c014070 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.779+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94561804217504] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.779+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94561804220160] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.780+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.780+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94561804214656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00140 con 0x7f8e3c014070 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.780+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00ab0 con 0x7f8e3c014070 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94561804214656] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94561804218560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00ab0 con 0x7f8e3c014070 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=0 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=1 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=2 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=3 2024-02-16T00:11:23.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=4 2024-02-16T00:11:23.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=5 2024-02-16T00:11:23.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e47524800 20 add_watcher() i=6 2024-02-16T00:11:23.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.781+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94561804218560] v27'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.782+0000 7f8e47524800 20 add_watcher() i=7 2024-02-16T00:11:23.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.782+0000 7f8e47524800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.782+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c04340 con 0x5600e2bed3e0 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.782+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.782+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94561804226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c01730 con 0x5600e2bed3e0 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94561804226160] v27'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8cf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8e47524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8e47524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8e47524800 5 note: GC not initialized 2024-02-16T00:11:23.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8cf8fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:23.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8e47524800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8e47524800 20 Filter name: none 2024-02-16T00:11:23.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.783+0000 7f8c727fc640 20 reqs_thread_entry: start 2024-02-16T00:11:23.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:23.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c36030 con 0x5600e2bed3e0 2024-02-16T00:11:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T00:11:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:23.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-02-16T00:11:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c369d0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-02-16T00:11:23.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.784+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~624 in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c3c610 con 0x5600e2bed3e0 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.785+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~624] v27'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.785+0000 7f8e47524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.785+0000 7f8e47524800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.785+0000 7f8e47524800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.785+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94561804468432 in=812b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c37cd0 con 0x5600e2bed3e0 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.785+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94561804217504 notify 115964116999 ret 0) v3 ==== 842+0+0 (crc 0 0 0) 0x7f8e2c001e10 con 0x5600e2bed3e0 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8d26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94561804217504 notifier 4383 bl.length()=800 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8d26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8d26ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8d26ffd640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8d08003e90 con 0x5600e2bed3e0 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(65 notify.4 [notify cookie 94561804468432 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94561804468432 notify 115964116999 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8e3803dd50 con 0x5600e2bed3e0 2024-02-16T00:11:23.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.786+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c3c0d0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.787+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.787+0000 7f8e47524800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-16T00:11:23.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.787+0000 7f8e47524800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T00:11:23.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.787+0000 7f8e47524800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-16T00:11:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.787+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94561804468432 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c37830 con 0x5600e2bf1cd0 2024-02-16T00:11:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== watch-notify(notify (1) cookie 94561804202976 notify 115964116995 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x5600e2be1f90 con 0x5600e2bf1cd0 2024-02-16T00:11:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8d267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94561804202976 notifier 4383 bl.length()=166 2024-02-16T00:11:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8d267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-16T00:11:23.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8d267fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T00:11:23.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8d267fc640 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8c780033f0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.0 [notify cookie 94561804468432 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.788+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== watch-notify(notify_complete (2) cookie 94561804468432 notify 115964116995 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8e3c03b020 con 0x5600e2bf1cd0 2024-02-16T00:11:23.813 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.789+0000 7f8cf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.789+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94561804226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c380c0 con 0x5600e2bed3e0 2024-02-16T00:11:23.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.790+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94561804226160] v27'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.790+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94561804202976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00e70 con 0x5600e2bf1cd0 2024-02-16T00:11:23.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.791+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94561804202976] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.791+0000 7f8e47524800 20 remove_watcher() i=0 2024-02-16T00:11:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.791+0000 7f8e47524800 2 removed watcher, disabling cache 2024-02-16T00:11:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.791+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94561804206464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00e70 con 0x5600e2bed3e0 2024-02-16T00:11:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.792+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94561804206464] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.792+0000 7f8e47524800 20 remove_watcher() i=1 2024-02-16T00:11:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.792+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94561804200528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfc180 con 0x5600e2bf6ad0 2024-02-16T00:11:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.793+0000 7f8e431c8640 1 -- 172.21.15.42:0/614618800 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94561804200528] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e34078c90 con 0x5600e2bf6ad0 2024-02-16T00:11:23.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.793+0000 7f8e47524800 20 remove_watcher() i=2 2024-02-16T00:11:23.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.793+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94561804213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00e70 con 0x5600e2bf1cd0 2024-02-16T00:11:23.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.794+0000 7f8e439c9640 1 -- 172.21.15.42:0/614618800 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94561804213376] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e3c00a4a0 con 0x5600e2bf1cd0 2024-02-16T00:11:23.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.794+0000 7f8e47524800 20 remove_watcher() i=3 2024-02-16T00:11:23.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.794+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94561804217504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2bfaa50 con 0x5600e2bed3e0 2024-02-16T00:11:23.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.796+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94561804217504] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x5600e2bed3e0 2024-02-16T00:11:23.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.796+0000 7f8e47524800 20 remove_watcher() i=4 2024-02-16T00:11:23.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.796+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94561804220160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00e70 con 0x7f8e3c014070 2024-02-16T00:11:23.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.797+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94561804220160] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.797+0000 7f8e47524800 20 remove_watcher() i=5 2024-02-16T00:11:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.797+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94561804214656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00e70 con 0x7f8e3c014070 2024-02-16T00:11:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.798+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94561804214656] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.798+0000 7f8e47524800 20 remove_watcher() i=6 2024-02-16T00:11:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.798+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94561804218560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5600e2c00e70 con 0x7f8e3c014070 2024-02-16T00:11:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94561804218560] v27'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e38037040 con 0x7f8e3c014070 2024-02-16T00:11:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 20 remove_watcher() i=7 2024-02-16T00:11:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8e3c014070 msgr2=0x7f8e3c02c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8e3c014070 0x7f8e3c02c7d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2bed3e0 msgr2=0x5600e2bef8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2bed3e0 0x5600e2bef8a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bf1cd0 msgr2=0x5600e2bf40c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bf1cd0 0x5600e2bf40c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5600e2bf6ad0 msgr2=0x5600e2bf8f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5600e2bf6ad0 0x5600e2bf8f90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d0c036790 msgr2=0x7f8d0c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d0c036790 0x7f8d0c038c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e340053a0 tx=0x7f8e34085000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 msgr2=0x5600e2be1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/614618800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bb0b00 0x5600e2be1850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c03e040 tx=0x7f8e3c04bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:23.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 reap_dead start 2024-02-16T00:11:23.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e429c7640 1 -- 172.21.15.42:0/614618800 reap_dead start 2024-02-16T00:11:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 shutdown_connections 2024-02-16T00:11:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 >> 172.21.15.42:0/614618800 conn(0x5600e2bd4a10 msgr2=0x5600e2bd2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 shutdown_connections 2024-02-16T00:11:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/614618800 wait complete. 2024-02-16T00:11:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d1c036830 msgr2=0x7f8d1c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d1c036830 0x7f8d1c038cf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5600e2bb7e00 tx=0x7f8e3405bf40 comp rx=0 tx=0).stop 2024-02-16T00:11:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 msgr2=0x5600e2bcb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 0x5600e2bcb8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5600e2a2b7f0 tx=0x7f8e3c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 shutdown_connections 2024-02-16T00:11:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d1c036830 0x7f8d1c038cf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 --2- 172.21.15.42:0/1457443207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2bcb4b0 0x5600e2bcb8d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 >> 172.21.15.42:0/1457443207 conn(0x5600e2bbf550 msgr2=0x5600e2bbf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 shutdown_connections 2024-02-16T00:11:23.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.799+0000 7f8e47524800 1 -- 172.21.15.42:0/1457443207 wait complete. 2024-02-16T00:11:23.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2ab90f0 msgr2=0x5600e2bb7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2ab90f0 0x5600e2bb7490 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bb9c70 msgr2=0x5600e2bbc060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bb9c70 0x5600e2bbc060 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d28036830 msgr2=0x7f8d28038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d28036830 0x7f8d28038cf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e38000f60 tx=0x7f8e380010a0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 msgr2=0x5600e2a2bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2a2bf90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e34055040 tx=0x7f8e34002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 shutdown_connections 2024-02-16T00:11:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5600e2bb9c70 0x5600e2bbc060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5600e2ab90f0 0x5600e2bb7490 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8d28036830 0x7f8d28038cf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 --2- 172.21.15.42:0/119132716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5600e2ab7e90 0x5600e2a2bf90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 >> 172.21.15.42:0/119132716 conn(0x5600e2ab34f0 msgr2=0x5600e2ba2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 shutdown_connections 2024-02-16T00:11:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.800+0000 7f8e47524800 1 -- 172.21.15.42:0/119132716 wait complete. 2024-02-16T00:11:23.841 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.841 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:11:23.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:11:23.842 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:11:23.884 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:23.884 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:23.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa059933800 1 Processor -- start 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa059933800 1 -- start start 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa059933800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a0c087ba80 0x55a0c087de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa059933800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a0c07c5bb0 con 0x55a0c087e3b0 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa059933800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a0c077d450 con 0x55a0c087ba80 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa0556f9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a0c087ba80 0x55a0c087de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa054ef8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55a0c087e3b0 0x55a0c08807a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60266/0 (socket says 172.21.15.42:60266) 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.882+0000 7fa054ef8640 1 -- 172.21.15.42:0/1945874759 learned_addr learned my addr 172.21.15.42:0/1945874759 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.883+0000 7fa04ffff640 1 -- 172.21.15.42:0/1945874759 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592859307 0 0) 0x55a0c07c5bb0 con 0x55a0c087e3b0 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.883+0000 7fa04ffff640 1 -- 172.21.15.42:0/1945874759 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa044001e10 con 0x55a0c087e3b0 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.883+0000 7fa0556f9640 1 -- 172.21.15.42:0/1945874759 >> v1:172.21.15.2:6789/0 conn(0x55a0c087e3b0 legacy=0x55a0c08807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.883+0000 7fa0556f9640 1 -- 172.21.15.42:0/1945874759 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c0882ed0 con 0x55a0c087ba80 2024-02-16T00:11:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa0556f9640 1 --2- 172.21.15.42:0/1945874759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c087de70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa050005fd0 tx=0x7fa05001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94b6bd0e7fc8ccb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa04ffff640 1 -- 172.21.15.42:0/1945874759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050052560 con 0x55a0c087ba80 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa04ffff640 1 -- 172.21.15.42:0/1945874759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500526c0 con 0x55a0c087ba80 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa04ffff640 1 -- 172.21.15.42:0/1945874759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0500529e0 con 0x55a0c087ba80 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 -- 172.21.15.42:0/1945874759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 msgr2=0x55a0c087de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 --2- 172.21.15.42:0/1945874759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c087de70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa050005fd0 tx=0x7fa05001cab0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 -- 172.21.15.42:0/1945874759 shutdown_connections 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 --2- 172.21.15.42:0/1945874759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c087de70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 -- 172.21.15.42:0/1945874759 >> 172.21.15.42:0/1945874759 conn(0x55a0c08754d0 msgr2=0x55a0c08778f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 -- 172.21.15.42:0/1945874759 shutdown_connections 2024-02-16T00:11:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.885+0000 7fa059933800 1 -- 172.21.15.42:0/1945874759 wait complete. 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa059933800 1 Processor -- start 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa059933800 1 -- start start 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa059933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c096aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa059933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c077a980 con 0x55a0c087ba80 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa0556f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c096aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa0556f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c096aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58892/0 (socket says 172.21.15.42:58892) 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa0556f9640 1 -- 172.21.15.42:0/1437363235 learned_addr learned my addr 172.21.15.42:0/1437363235 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.897+0000 7fa0556f9640 1 -- 172.21.15.42:0/1437363235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05000a100 con 0x55a0c087ba80 2024-02-16T00:11:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.898+0000 7fa0556f9640 1 --2- 172.21.15.42:0/1437363235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c096aed0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa050007000 tx=0x7fa05004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db589db14052db4b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.898+0000 7f9f43606640 1 -- 172.21.15.42:0/1437363235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050052960 con 0x55a0c087ba80 2024-02-16T00:11:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.898+0000 7f9f43606640 1 -- 172.21.15.42:0/1437363235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050052ac0 con 0x55a0c087ba80 2024-02-16T00:11:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.898+0000 7f9f43606640 1 -- 172.21.15.42:0/1437363235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa050052d60 con 0x55a0c087ba80 2024-02-16T00:11:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- 172.21.15.42:0/1437363235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 msgr2=0x55a0c096aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 --2- 172.21.15.42:0/1437363235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c096aed0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa050007000 tx=0x7fa05004c000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- 172.21.15.42:0/1437363235 shutdown_connections 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 --2- 172.21.15.42:0/1437363235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c096aed0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- 172.21.15.42:0/1437363235 >> 172.21.15.42:0/1437363235 conn(0x55a0c08754d0 msgr2=0x55a0c09666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- 172.21.15.42:0/1437363235 shutdown_connections 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- 172.21.15.42:0/1437363235 wait complete. 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 Processor -- start 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- start start 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c0972370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa059933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c0776160 con 0x55a0c087ba80 2024-02-16T00:11:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa0556f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c0972370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa0556f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c0972370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58894/0 (socket says 172.21.15.42:58894) 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.899+0000 7fa0556f9640 1 -- 172.21.15.42:0/3731074689 learned_addr learned my addr 172.21.15.42:0/3731074689 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7fa0556f9640 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c0882ed0 con 0x55a0c087ba80 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7fa0556f9640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c0972370 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f80 tx=0x7fa050003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7f9f41e03640 1 -- 172.21.15.42:0/3731074689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa05005c560 con 0x55a0c087ba80 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7f9f41e03640 1 -- 172.21.15.42:0/3731074689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05005c6c0 con 0x55a0c087ba80 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0c09728b0 con 0x55a0c087ba80 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7f9f41e03640 1 -- 172.21.15.42:0/3731074689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa05005c9a0 con 0x55a0c087ba80 2024-02-16T00:11:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.900+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0c0972df0 con 0x55a0c087ba80 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7f9f41e03640 1 -- 172.21.15.42:0/3731074689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa05005cb00 con 0x55a0c087ba80 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7f9f41e03640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f3c0367e0 0x7f9f3c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7f9f41e03640 1 -- 172.21.15.42:0/3731074689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa05008e210 con 0x55a0c087ba80 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7fa054ef8640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f3c0367e0 0x7f9f3c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c087e3b0 0x55a0c0979150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c0979690 con 0x55a0c087e3b0 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.901+0000 7fa055efa640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c087e3b0 0x55a0c0979150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa054ef8640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f3c0367e0 0x7f9f3c038ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa040000f60 tx=0x7fa0400010a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa055efa640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c087e3b0 0x55a0c0979150 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa055efa640 1 -- 172.21.15.42:0/3731074689 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c087e3b0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09766f0 con 0x55a0c087e3b0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa055efa640 1 -- 172.21.15.42:0/3731074689 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c087e3b0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c097b920 0x55a0c097dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.902+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c097e400 con 0x55a0c097b920 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.903+0000 7fa0556f9640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c097b920 0x55a0c097dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.903+0000 7fa0556f9640 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c097b920 0x55a0c097dd10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.903+0000 7fa0556f9640 1 -- 172.21.15.42:0/3731074689 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c097b920 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.903+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c097a8a0 con 0x55a0c087e3b0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.903+0000 7fa055efa640 1 -- 172.21.15.42:0/3731074689 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c087e3b0 2024-02-16T00:11:23.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.903+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c097ac90 con 0x55a0c087e3b0 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.904+0000 7fa055efa640 1 -- 172.21.15.42:0/3731074689 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c087e3b0 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.904+0000 7fa059933800 1 Processor -- start 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.904+0000 7fa059933800 1 -- start start 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.904+0000 7fa059933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 0x55a0c0879a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.904+0000 7fa059933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c0718e80 con 0x55a0c087b620 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.904+0000 7fa055efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 0x55a0c0879a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7fa055efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 0x55a0c0879a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58900/0 (socket says 172.21.15.42:58900) 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7fa055efa640 1 -- 172.21.15.42:0/437914548 learned_addr learned my addr 172.21.15.42:0/437914548 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7fa055efa640 1 -- 172.21.15.42:0/437914548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c0879fd0 con 0x55a0c087b620 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7fa055efa640 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 0x55a0c0879a90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55a0c0972fa0 tx=0x7fa04800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7f9f3affd640 1 -- 172.21.15.42:0/437914548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa04800f040 con 0x55a0c087b620 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7f9f3affd640 1 -- 172.21.15.42:0/437914548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048007ca0 con 0x55a0c087b620 2024-02-16T00:11:23.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0c087a220 con 0x55a0c087b620 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7f9f3affd640 1 -- 172.21.15.42:0/437914548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa048019420 con 0x55a0c087b620 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.905+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0c087a6e0 con 0x55a0c087b620 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.906+0000 7f9f3affd640 1 -- 172.21.15.42:0/437914548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa048019580 con 0x55a0c087b620 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.906+0000 7f9f3affd640 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f2c036830 0x7f9f2c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.906+0000 7f9f3affd640 1 -- 172.21.15.42:0/437914548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa04804e2d0 con 0x55a0c087b620 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.906+0000 7fa0556f9640 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f2c036830 0x7f9f2c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa059933800 1 Processor -- start 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa059933800 1 -- start start 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa0556f9640 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f2c036830 0x7f9f2c038cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55a0c0979ae0 tx=0x7fa05005bf70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa059933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c099c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa059933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c06ee5d0 con 0x55a0c099c5a0 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa055efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c099c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa055efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c099c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58904/0 (socket says 172.21.15.42:58904) 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa055efa640 1 -- 172.21.15.42:0/1340505892 learned_addr learned my addr 172.21.15.42:0/1340505892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.907+0000 7fa055efa640 1 -- 172.21.15.42:0/1340505892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c099cf90 con 0x55a0c099c5a0 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa055efa640 1 --2- 172.21.15.42:0/1340505892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c099c9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa04804c620 tx=0x7fa048017980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a34c44e13b50514 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7f9f38ff9640 1 -- 172.21.15.42:0/1340505892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0480229f0 con 0x55a0c099c5a0 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7f9f38ff9640 1 -- 172.21.15.42:0/1340505892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048023790 con 0x55a0c099c5a0 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7f9f38ff9640 1 -- 172.21.15.42:0/1340505892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa048022cb0 con 0x55a0c099c5a0 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 -- 172.21.15.42:0/1340505892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 msgr2=0x55a0c099c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 --2- 172.21.15.42:0/1340505892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c099c9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa04804c620 tx=0x7fa048017980 comp rx=0 tx=0).stop 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 -- 172.21.15.42:0/1340505892 shutdown_connections 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 --2- 172.21.15.42:0/1340505892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c099c9c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 -- 172.21.15.42:0/1340505892 >> 172.21.15.42:0/1340505892 conn(0x55a0c0998900 msgr2=0x55a0c0996960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 -- 172.21.15.42:0/1340505892 shutdown_connections 2024-02-16T00:11:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 -- 172.21.15.42:0/1340505892 wait complete. 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.908+0000 7fa059933800 1 Processor -- start 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa059933800 1 -- start start 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa059933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c09a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa059933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c09a3a70 con 0x55a0c099c5a0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa055efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c09a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa055efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c09a3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58918/0 (socket says 172.21.15.42:58918) 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 learned_addr learned my addr 172.21.15.42:0/1446104962 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c087a6e0 con 0x55a0c099c5a0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7fa055efa640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c09a3530 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa048008fd0 tx=0x7fa04804c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7f9f2affd640 1 -- 172.21.15.42:0/1446104962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa048032070 con 0x55a0c099c5a0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.909+0000 7f9f2affd640 1 -- 172.21.15.42:0/1446104962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04804e070 con 0x55a0c099c5a0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0c09a3c70 con 0x55a0c099c5a0 2024-02-16T00:11:23.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7f9f2affd640 1 -- 172.21.15.42:0/1446104962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa048015e50 con 0x55a0c099c5a0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0c09a4130 con 0x55a0c099c5a0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7f9f2affd640 1 -- 172.21.15.42:0/1446104962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa048018a30 con 0x55a0c099c5a0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7f9f2affd640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f200366f0 0x7f9f20038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7f9f2affd640 1 -- 172.21.15.42:0/1446104962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa048038c50 con 0x55a0c099c5a0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.910+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa0556f9640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f200366f0 0x7f9f20038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c09af250 0x55a0c09b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b1e30 con 0x55a0c09af250 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa054ef8640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c09af250 0x55a0c09b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa0556f9640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f200366f0 0x7f9f20038bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa050077df0 tx=0x7fa050084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa054ef8640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c09af250 0x55a0c09b16e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa059933800 20 realm 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.911+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09ae770 con 0x55a0c09af250 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b28b0 con 0x55a0c09af250 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b2550 con 0x55a0c09af250 2024-02-16T00:11:23.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c09b3b80 0x55a0c09b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa055efa640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c09b3b80 0x55a0c09b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.912+0000 7fa055efa640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c09b3b80 0x55a0c09b5f70 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa059933800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa059933800 20 searching for the correct realm 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a0c09b84d0 0x55a0c09ba970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bb040 con 0x55a0c09b84d0 2024-02-16T00:11:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa0556f9640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a0c09b84d0 0x55a0c09ba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.913+0000 7fa0556f9640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a0c09b84d0 0x55a0c09ba970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.914+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.914+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bb040 con 0x55a0c09b3b80 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.914+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.914+0000 7fa055efa640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa048019040 0x7fa04804c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.914+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.914+0000 7fa054ef8640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa048019040 0x7fa04804c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.915+0000 7fa054ef8640 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa048019040 0x7fa04804c980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.915+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.915+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.915+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.915+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.915+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.916+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.917+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.918+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.919+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x55a0c09af250 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.920+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040006070 con 0x7fa048019040 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b84d0 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.921+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x7fa048019040 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09af250 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b64f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b6df0 con 0x55a0c09af250 2024-02-16T00:11:23.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.922+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b71a0 con 0x55a0c09af250 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09b7580 con 0x55a0c09af250 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 zone default found 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 4 Realm: () 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 zonegroup default 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bb480 con 0x7fa048019040 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.923+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bd300 con 0x55a0c09b84d0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bd660 con 0x55a0c09b84d0 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 20 started sync module instance, tier type = 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.924+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bc790 con 0x55a0c09b3b80 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.925+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.925+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94148914564176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bc790 con 0x55a0c09b3b80 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.925+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09be0d0 con 0x55a0c09af250 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.926+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94148914564176] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.926+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.926+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94148914568112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bc790 con 0x55a0c09af250 2024-02-16T00:11:23.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.926+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09beb20 con 0x55a0c09b84d0 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.927+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.927+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94148914570784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bf3a0 con 0x55a0c09b84d0 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.927+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bfe10 con 0x55a0c09b3b80 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.928+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94148914568112] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.928+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.928+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94148914575696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c01f0 con 0x55a0c09b3b80 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.928+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c0c10 con 0x55a0c09af250 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.928+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94148914570784] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.929+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.929+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94148914575696] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.929+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94148914579184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c0bd0 con 0x55a0c09af250 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.929+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c1460 con 0x7fa048019040 2024-02-16T00:11:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.930+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.930+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94148914580432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c1570 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.930+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c2020 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.931+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94148914579184] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.931+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94148914580432] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.931+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.931+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94148914584352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c0ff0 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.931+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c25f0 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.932+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94148914584352] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94148914561776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c25f0 con 0x7fa048019040 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=0 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=1 2024-02-16T00:11:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=2 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=3 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=4 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=5 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=6 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94148914561776] v27'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 20 add_watcher() i=7 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.933+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c59f0 con 0x55a0c09af250 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.934+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.934+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94148914598992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c2760 con 0x55a0c09af250 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94148914598992] v27'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7f9f0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 5 note: GC not initialized 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7f9f0a7e4640 20 reqs_thread_entry: start 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 20 Filter name: none 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7f9e7bfff640 20 reqs_thread_entry: start 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.935+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09f7480 con 0x55a0c09af250 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.936+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.936+0000 7fa059933800 20 rados_obj.operate() r=0 bl.length=624 2024-02-16T00:11:23.953 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:23.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.936+0000 7f9f0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.937+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94148914598992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09f6440 con 0x55a0c09af250 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.937+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94148914598992] v27'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.937+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94148914564176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c5450 con 0x55a0c09b3b80 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.938+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94148914564176] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.938+0000 7fa059933800 20 remove_watcher() i=0 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.938+0000 7fa059933800 2 removed watcher, disabling cache 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.938+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94148914568112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bcc50 con 0x55a0c09af250 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.939+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94148914568112] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.939+0000 7fa059933800 20 remove_watcher() i=1 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.939+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94148914570784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09bcc50 con 0x55a0c09b84d0 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.941+0000 7fa0556f9640 1 -- 172.21.15.42:0/1446104962 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94148914570784] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0500667c0 con 0x55a0c09b84d0 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.941+0000 7fa059933800 20 remove_watcher() i=2 2024-02-16T00:11:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.941+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94148914575696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09be620 con 0x55a0c09b3b80 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.941+0000 7fa055efa640 1 -- 172.21.15.42:0/1446104962 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94148914575696] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0480083e0 con 0x55a0c09b3b80 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.941+0000 7fa059933800 20 remove_watcher() i=3 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.941+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94148914579184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09be620 con 0x55a0c09af250 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.942+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94148914579184] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x55a0c09af250 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.943+0000 7fa059933800 20 remove_watcher() i=4 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.943+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94148914580432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c06f0 con 0x7fa048019040 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.943+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94148914580432] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.943+0000 7fa059933800 20 remove_watcher() i=5 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.943+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94148914584352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09be620 con 0x7fa048019040 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.944+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94148914584352] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.944+0000 7fa059933800 20 remove_watcher() i=6 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.944+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94148914561776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55a0c09c06f0 con 0x7fa048019040 2024-02-16T00:11:23.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.945+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94148914561776] v27'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa040037040 con 0x7fa048019040 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.945+0000 7fa059933800 20 remove_watcher() i=7 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.945+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa048019040 msgr2=0x7fa04804c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.945+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa048019040 0x7fa04804c980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.945+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c09af250 msgr2=0x55a0c09b16e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c09af250 0x55a0c09b16e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c09b3b80 msgr2=0x55a0c09b5f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c09b3b80 0x55a0c09b5f70 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a0c09b84d0 msgr2=0x55a0c09ba970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a0c09b84d0 0x55a0c09ba970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f200366f0 msgr2=0x7f9f20038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f200366f0 0x7f9f20038bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa050077df0 tx=0x7fa050084000 comp rx=0 tx=0).stop 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 msgr2=0x55a0c09a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa054ef8640 1 -- 172.21.15.42:0/1446104962 reap_dead start 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c09a3530 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa048008fd0 tx=0x7fa04804c5b0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 shutdown_connections 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/1446104962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c099c5a0 0x55a0c09a3530 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 >> 172.21.15.42:0/1446104962 conn(0x55a0c0998900 msgr2=0x55a0c0995f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 shutdown_connections 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/1446104962 wait complete. 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f2c036830 msgr2=0x7f9f2c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f2c036830 0x7f9f2c038cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55a0c0979ae0 tx=0x7fa05005bf70 comp rx=0 tx=0).stop 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 msgr2=0x55a0c0879a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 0x55a0c0879a90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55a0c0972fa0 tx=0x7fa04800aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 shutdown_connections 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f2c036830 0x7f9f2c038cf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/437914548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087b620 0x55a0c0879a90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 >> 172.21.15.42:0/437914548 conn(0x55a0c0981270 msgr2=0x55a0c0981670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 shutdown_connections 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/437914548 wait complete. 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c087e3b0 msgr2=0x55a0c0979150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c087e3b0 0x55a0c0979150 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.946+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c097b920 msgr2=0x55a0c097dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c097b920 0x55a0c097dd10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f3c0367e0 msgr2=0x7f9f3c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f3c0367e0 0x7f9f3c038ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa040000f60 tx=0x7fa0400010a0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 msgr2=0x55a0c0972370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c0972370 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f80 tx=0x7fa050003330 comp rx=0 tx=0).stop 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 shutdown_connections 2024-02-16T00:11:23.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a0c097b920 0x55a0c097dd10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a0c087e3b0 0x55a0c0979150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9f3c0367e0 0x7f9f3c038ca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 --2- 172.21.15.42:0/3731074689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0c087ba80 0x55a0c0972370 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 >> 172.21.15.42:0/3731074689 conn(0x55a0c08754d0 msgr2=0x55a0c0964f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 shutdown_connections 2024-02-16T00:11:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:23.947+0000 7fa059933800 1 -- 172.21.15.42:0/3731074689 wait complete. 2024-02-16T00:11:23.964 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:23.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-16T00:11:23.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-16T00:11:23.965 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-02-16T00:11:24.043 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.043 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5b4733800 1 Processor -- start 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5b4733800 1 -- start start 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5b4733800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c247f03ac0 0x55c247f05eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5b4733800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c247e4dba0 con 0x55c247f063f0 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5b4733800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c247e05450 con 0x55c247f03ac0 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5b04f9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c247f03ac0 0x55c247f05eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5afcf8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c247f063f0 0x55c247f087e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60276/0 (socket says 172.21.15.42:60276) 2024-02-16T00:11:24.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.041+0000 7fe5afcf8640 1 -- 172.21.15.42:0/2394432563 learned_addr learned my addr 172.21.15.42:0/2394432563 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.042+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2394432563 >> v1:172.21.15.2:6789/0 conn(0x55c247f063f0 legacy=0x55c247f087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.042+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2394432563 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c247f0af10 con 0x55c247f03ac0 2024-02-16T00:11:24.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.042+0000 7fe5af4f7640 1 -- 172.21.15.42:0/2394432563 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295870818 0 0) 0x55c247e4dba0 con 0x55c247f063f0 2024-02-16T00:11:24.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/2394432563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f05eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000a470 tx=0x7fe5a001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfa990e5cc578ba server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5af4f7640 1 -- 172.21.15.42:0/2394432563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a0052570 con 0x55c247f03ac0 2024-02-16T00:11:24.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5af4f7640 1 -- 172.21.15.42:0/2394432563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a00526d0 con 0x55c247f03ac0 2024-02-16T00:11:24.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5af4f7640 1 -- 172.21.15.42:0/2394432563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a0052990 con 0x55c247f03ac0 2024-02-16T00:11:24.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 -- 172.21.15.42:0/2394432563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 msgr2=0x55c247f05eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2394432563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f05eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000a470 tx=0x7fe5a001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:24.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 -- 172.21.15.42:0/2394432563 shutdown_connections 2024-02-16T00:11:24.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2394432563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f05eb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 -- 172.21.15.42:0/2394432563 >> 172.21.15.42:0/2394432563 conn(0x55c247efd4f0 msgr2=0x55c247eff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 -- 172.21.15.42:0/2394432563 shutdown_connections 2024-02-16T00:11:24.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.044+0000 7fe5b4733800 1 -- 172.21.15.42:0/2394432563 wait complete. 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b4733800 1 Processor -- start 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b4733800 1 -- start start 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b4733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247ff2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b4733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c247e02980 con 0x55c247f03ac0 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b04f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247ff2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b04f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247ff2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58940/0 (socket says 172.21.15.42:58940) 2024-02-16T00:11:24.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.056+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2211648683 learned_addr learned my addr 172.21.15.42:0/2211648683 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.057+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2211648683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0005d20 con 0x55c247f03ac0 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.057+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/2211648683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247ff2f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0055040 tx=0x7fe5a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dc8cc3a3cc8850 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.057+0000 7fe49e60c640 1 -- 172.21.15.42:0/2211648683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a000a180 con 0x55c247f03ac0 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.057+0000 7fe49e60c640 1 -- 172.21.15.42:0/2211648683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000a2e0 con 0x55c247f03ac0 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.057+0000 7fe49e60c640 1 -- 172.21.15.42:0/2211648683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a00529b0 con 0x55c247f03ac0 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- 172.21.15.42:0/2211648683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 msgr2=0x55c247ff2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2211648683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247ff2f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0055040 tx=0x7fe5a004c000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- 172.21.15.42:0/2211648683 shutdown_connections 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2211648683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247ff2f90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- 172.21.15.42:0/2211648683 >> 172.21.15.42:0/2211648683 conn(0x55c247efd4f0 msgr2=0x55c247fee730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- 172.21.15.42:0/2211648683 shutdown_connections 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- 172.21.15.42:0/2211648683 wait complete. 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 Processor -- start 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- start start 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b4733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c247dfe160 con 0x55c247f03ac0 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b04f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b04f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f033b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58944/0 (socket says 172.21.15.42:58944) 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.058+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2553841813 learned_addr learned my addr 172.21.15.42:0/2553841813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c247f0af10 con 0x55c247f03ac0 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f033b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000a470 tx=0x7fe5a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe49ce09640 1 -- 172.21.15.42:0/2553841813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a006a070 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe49ce09640 1 -- 172.21.15.42:0/2553841813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a005d420 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe49ce09640 1 -- 172.21.15.42:0/2553841813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a005d5d0 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c247f038f0 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.059+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c247f01e40 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.060+0000 7fe49ce09640 1 -- 172.21.15.42:0/2553841813 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe5a005d730 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.060+0000 7fe49ce09640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4980367e0 0x7fe498038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.060+0000 7fe49ce09640 1 -- 172.21.15.42:0/2553841813 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe5a008db30 con 0x55c247f03ac0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.060+0000 7fe5afcf8640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4980367e0 0x7fe498038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.060+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c247f063f0 0x55c248003760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.060+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c247f02770 con 0x55c247f063f0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c247f063f0 0x55c248003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5afcf8640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4980367e0 0x7fe498038ca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4000c00 tx=0x7fe5a40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c247f063f0 0x55c248003760 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/2553841813 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5a800a4a0 con 0x55c247f063f0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248003d00 con 0x55c247f063f0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/2553841813 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe5a800a4a0 con 0x55c247f063f0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c248005ac0 0x55c248007eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.061+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248008580 con 0x55c248005ac0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.062+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c248005ac0 0x55c248007eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.062+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c248005ac0 0x55c248007eb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.062+0000 7fe5b04f9640 1 -- 172.21.15.42:0/2553841813 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe5a007e040 con 0x55c248005ac0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.062+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248004a10 con 0x55c247f063f0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.062+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/2553841813 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe5a800a4a0 con 0x55c247f063f0 2024-02-16T00:11:24.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.062+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248004e00 con 0x55c247f063f0 2024-02-16T00:11:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.063+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/2553841813 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe5a800a4a0 con 0x55c247f063f0 2024-02-16T00:11:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.063+0000 7fe5b4733800 1 Processor -- start 2024-02-16T00:11:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.063+0000 7fe5b4733800 1 -- start start 2024-02-16T00:11:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.063+0000 7fe5b4733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 0x55c248017750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.063+0000 7fe5b4733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c247da0e80 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.063+0000 7fe5b0cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 0x55c248017750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe5b0cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 0x55c248017750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58948/0 (socket says 172.21.15.42:58948) 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1372791943 learned_addr learned my addr 172.21.15.42:0/1372791943 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1372791943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c248017c90 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 0x55c248017750 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55c247f02da0 tx=0x7fe5a8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe495ffb640 1 -- 172.21.15.42:0/1372791943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a801d070 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe495ffb640 1 -- 172.21.15.42:0/1372791943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a80182e0 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe495ffb640 1 -- 172.21.15.42:0/1372791943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a80145c0 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c248018700 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.064+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c248018bc0 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe495ffb640 1 -- 172.21.15.42:0/1372791943 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe5a8020020 con 0x55c248017330 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe495ffb640 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4880367e0 0x7fe488038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe495ffb640 1 -- 172.21.15.42:0/1372791943 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe5a804dc60 con 0x55c248017330 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4880367e0 0x7fe488038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe5b4733800 1 Processor -- start 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe5b4733800 1 -- start start 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.065+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4880367e0 0x7fe488038ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5a006d000 tx=0x7fe5a0066eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b4733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c2480249c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b4733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c247d765d0 con 0x55c2480245a0 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b0cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c2480249c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b0cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c2480249c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58958/0 (socket says 172.21.15.42:58958) 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1806479285 learned_addr learned my addr 172.21.15.42:0/1806479285 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1806479285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c248024f90 con 0x55c2480245a0 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/1806479285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c2480249c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe5a804bfe0 tx=0x7fe5a8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba7202c23c99493 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe4877fe640 1 -- 172.21.15.42:0/1806479285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a8040430 con 0x55c2480245a0 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe4877fe640 1 -- 172.21.15.42:0/1806479285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a802bc70 con 0x55c2480245a0 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.066+0000 7fe4877fe640 1 -- 172.21.15.42:0/1806479285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a8016440 con 0x55c2480245a0 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- 172.21.15.42:0/1806479285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 msgr2=0x55c2480249c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1806479285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c2480249c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe5a804bfe0 tx=0x7fe5a8011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- 172.21.15.42:0/1806479285 shutdown_connections 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1806479285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c2480249c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- 172.21.15.42:0/1806479285 >> 172.21.15.42:0/1806479285 conn(0x55c248020870 msgr2=0x55c24801e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- 172.21.15.42:0/1806479285 shutdown_connections 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- 172.21.15.42:0/1806479285 wait complete. 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 Processor -- start 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- start start 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c24802b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.067+0000 7fe5b4733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24802ba40 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b0cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c24802b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b0cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c24802b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58970/0 (socket says 172.21.15.42:58970) 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 learned_addr learned my addr 172.21.15.42:0/1390380394 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c248018bc0 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c24802b500 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800aa00 tx=0x7fe5a804bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe485ffb640 1 -- 172.21.15.42:0/1390380394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a8032070 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe485ffb640 1 -- 172.21.15.42:0/1390380394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a80116f0 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c24802bc40 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe485ffb640 1 -- 172.21.15.42:0/1390380394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5a8013a90 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.068+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c24802c0a0 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.069+0000 7fe485ffb640 1 -- 172.21.15.42:0/1390380394 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe5a803d030 con 0x55c2480245a0 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.069+0000 7fe485ffb640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe478036790 0x7fe478038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.069+0000 7fe485ffb640 1 -- 172.21.15.42:0/1390380394 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe5a80420c0 con 0x55c2480245a0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.069+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe478036790 0x7fe478038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe478036790 0x7fe478038c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0044790 tx=0x7fe5a008e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c248037230 0x55c2480396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248039e40 con 0x55c248037230 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5afcf8640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c248037230 0x55c2480396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5afcf8640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c248037230 0x55c2480396f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 20 realm 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.070+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248036690 con 0x55c248037230 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803a8c0 con 0x55c248037230 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803b140 con 0x55c248037230 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c24803bb20 0x55c24803df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803e680 con 0x55c24803bb20 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.071+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c24803bb20 0x55c24803df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c24803bb20 0x55c24803df10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe5a800a4a0 con 0x55c24803bb20 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b4733800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b4733800 20 searching for the correct realm 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c248040600 0x55c248042ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248043140 con 0x55c248040600 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c248040600 0x55c248042ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.072+0000 7fe5b04f9640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c248040600 0x55c248042ac0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.073+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.073+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248043140 con 0x55c24803bb20 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.073+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a800a4a0 con 0x55c24803bb20 2024-02-16T00:11:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.073+0000 7fe5b0cfa640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe5a8014070 0x7fe5a8040860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.073+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.073+0000 7fe5afcf8640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe5a8014070 0x7fe5a8040860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.074+0000 7fe5afcf8640 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe5a8014070 0x7fe5a8040860 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.074+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.074+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.074+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.074+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.074+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c24803bb20 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.075+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.076+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c24803bb20 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.077+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.078+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c24803bb20 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.079+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c24803bb20 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.080+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248040600 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.081+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.081+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x7fe5a8014070 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.081+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.081+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c248037230 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.081+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.081+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe5a8037030 con 0x55c24803bb20 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803eef0 con 0x55c248037230 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803f2a0 con 0x55c248037230 2024-02-16T00:11:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803f680 con 0x55c248037230 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 20 zone default found 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 4 Realm: () 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.082+0000 7fe5b4733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 zonegroup default 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803fa90 con 0x7fe5a8014070 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248044f60 con 0x55c248040600 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c2480452c0 con 0x55c248040600 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 started sync module instance, tier type = 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.083+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248044840 con 0x55c24803bb20 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.084+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.084+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94292920255392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248044bf0 con 0x55c24803bb20 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.084+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248045fd0 con 0x55c248037230 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.085+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94292920255392] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.086+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.086+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94292920260512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248046160 con 0x55c248037230 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.086+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248046c30 con 0x55c248040600 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.087+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.087+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94292920264464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c2480474c0 con 0x55c248040600 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.087+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248047f40 con 0x55c24803bb20 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.087+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94292920260512] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.088+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.088+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94292920269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248048320 con 0x55c24803bb20 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.088+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248048d10 con 0x55c248037230 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.088+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94292920264464] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.089+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94292920269376] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.089+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.089+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94292920261568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248048cd0 con 0x55c248037230 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.089+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248049560 con 0x7fe5a8014070 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.090+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.090+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94292920275056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248049930 con 0x7fe5a8014070 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.090+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24804a130 con 0x7fe5a8014070 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.090+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94292920261568] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.091+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94292920275056] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.091+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.091+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94292920276112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248049d50 con 0x7fe5a8014070 2024-02-16T00:11:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.091+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24804a5b0 con 0x7fe5a8014070 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94292920276112] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94292920277168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24804a790 con 0x7fe5a8014070 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=0 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=1 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=2 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=3 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=4 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=5 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.092+0000 7fe5b4733800 20 add_watcher() i=6 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.093+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94292920277168] v27'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.093+0000 7fe5b4733800 20 add_watcher() i=7 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.093+0000 7fe5b4733800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.093+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24804db50 con 0x55c248037230 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.093+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.093+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94292920280704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24804b050 con 0x55c248037230 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.094+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94292920280704] v27'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.094+0000 7fe4667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 5 note: GC not initialized 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe4657e2640 20 reqs_thread_entry: start 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 20 Filter name: none 2024-02-16T00:11:24.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe3d6ffd640 20 reqs_thread_entry: start 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24807fa50 con 0x55c248037230 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 20 rados_obj.operate() r=0 bl.length=624 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.095+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~541 in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248086130 con 0x55c248037230 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~541] v27'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5b4733800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5b4733800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5b4733800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:24.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94292920523760 in=729b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c2480818c0 con 0x55c248037230 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94292920261568 notify 115964117000 ret 0) v3 ==== 759+0+0 (crc 0 0 0) 0x7fe5a403f6c0 con 0x55c248037230 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe4877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94292920261568 notifier 4397 bl.length()=717 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe4877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe4877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94292920523760 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe4877fe640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe474003e90 con 0x55c248037230 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94292920523760 notify 115964117000 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe5a403f850 con 0x55c248037230 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5b4733800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.097+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94292920523760 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248081420 con 0x55c24803bb20 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== watch-notify(notify (1) cookie 94292920255392 notify 115964116996 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55c24802c0a0 con 0x55c24803bb20 2024-02-16T00:11:24.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94292920255392 notifier 4397 bl.length()=159 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe486ffd640 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e40032b0 con 0x55c24803bb20 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(66 notify.0 [notify cookie 94292920523760 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== watch-notify(notify_complete (2) cookie 94292920523760 notify 115964116996 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c24802bc40 con 0x55c24803bb20 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.098+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248085bf0 con 0x55c248037230 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.099+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(68 foo:foo1 [delete] v27'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.121 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:24.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.100+0000 7fe4667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.100+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94292920280704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248081890 con 0x55c248037230 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.101+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94292920280704] v27'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.101+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94292920255392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248081840 con 0x55c24803bb20 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.102+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94292920255392] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.102+0000 7fe5b4733800 20 remove_watcher() i=0 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.102+0000 7fe5b4733800 2 removed watcher, disabling cache 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.102+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94292920260512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803f2a0 con 0x55c248037230 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.103+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94292920260512] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.103+0000 7fe5b4733800 20 remove_watcher() i=1 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.103+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94292920264464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c24803f2a0 con 0x55c248040600 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.104+0000 7fe5b04f9640 1 -- 172.21.15.42:0/1390380394 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94292920264464] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a0095040 con 0x55c248040600 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.104+0000 7fe5b4733800 20 remove_watcher() i=2 2024-02-16T00:11:24.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.104+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94292920269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c2480443a0 con 0x55c24803bb20 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.105+0000 7fe5b0cfa640 1 -- 172.21.15.42:0/1390380394 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94292920269376] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a8062040 con 0x55c24803bb20 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.105+0000 7fe5b4733800 20 remove_watcher() i=3 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.105+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94292920261568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c2480457a0 con 0x55c248037230 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.106+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94292920261568] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x55c248037230 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.106+0000 7fe5b4733800 20 remove_watcher() i=4 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.106+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94292920275056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248045c40 con 0x7fe5a8014070 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.107+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94292920275056] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a400f5f0 con 0x7fe5a8014070 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.107+0000 7fe5b4733800 20 remove_watcher() i=5 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.107+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94292920276112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248045c40 con 0x7fe5a8014070 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.108+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94292920276112] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a4049040 con 0x7fe5a8014070 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.108+0000 7fe5b4733800 20 remove_watcher() i=6 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.108+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94292920277168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c248049510 con 0x7fe5a8014070 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94292920277168] v27'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5a4049040 con 0x7fe5a8014070 2024-02-16T00:11:24.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 20 remove_watcher() i=7 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe5a8014070 msgr2=0x7fe5a8040860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe5a8014070 0x7fe5a8040860 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c248037230 msgr2=0x55c2480396f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c248037230 0x55c2480396f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c24803bb20 msgr2=0x55c24803df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c24803bb20 0x55c24803df10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c248040600 msgr2=0x55c248042ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c248040600 0x55c248042ac0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe478036790 msgr2=0x7fe478038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe478036790 0x7fe478038c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0044790 tx=0x7fe5a008e000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 msgr2=0x55c24802b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5afcf8640 1 -- 172.21.15.42:0/1390380394 reap_dead start 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c24802b500 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800aa00 tx=0x7fe5a804bf40 comp rx=0 tx=0).stop 2024-02-16T00:11:24.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 shutdown_connections 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1390380394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2480245a0 0x55c24802b500 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 >> 172.21.15.42:0/1390380394 conn(0x55c248020870 msgr2=0x55c24801ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 shutdown_connections 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.109+0000 7fe5b4733800 1 -- 172.21.15.42:0/1390380394 wait complete. 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4880367e0 msgr2=0x7fe488038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4880367e0 0x7fe488038ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5a006d000 tx=0x7fe5a0066eb0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 msgr2=0x55c248017750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 0x55c248017750 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55c247f02da0 tx=0x7fe5a8018830 comp rx=0 tx=0).stop 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 shutdown_connections 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4880367e0 0x7fe488038ca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/1372791943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c248017330 0x55c248017750 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 >> 172.21.15.42:0/1372791943 conn(0x55c24800b3d0 msgr2=0x55c24800b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 shutdown_connections 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/1372791943 wait complete. 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c247f063f0 msgr2=0x55c248003760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c247f063f0 0x55c248003760 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c248005ac0 msgr2=0x55c248007eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c248005ac0 0x55c248007eb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4980367e0 msgr2=0x7fe498038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4980367e0 0x7fe498038ca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4000c00 tx=0x7fe5a40013b0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 msgr2=0x55c247f033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f033b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000a470 tx=0x7fe5a0002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 shutdown_connections 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c248005ac0 0x55c248007eb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c247f063f0 0x55c248003760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe4980367e0 0x7fe498038ca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 --2- 172.21.15.42:0/2553841813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c247f03ac0 0x55c247f033b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 >> 172.21.15.42:0/2553841813 conn(0x55c247efd4f0 msgr2=0x55c247fecfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 shutdown_connections 2024-02-16T00:11:24.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.110+0000 7fe5b4733800 1 -- 172.21.15.42:0/2553841813 wait complete. 2024-02-16T00:11:24.133 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:24.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-16T00:11:24.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-16T00:11:24.133 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-02-16T00:11:24.175 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.176 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff350a9d800 1 Processor -- start 2024-02-16T00:11:24.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff350a9d800 1 -- start start 2024-02-16T00:11:24.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff350a9d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5625f9ee4300 0x5625f9ee66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff350a9d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5625f9e2bbb0 con 0x5625f9edfe70 2024-02-16T00:11:24.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff350a9d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5625f9de3450 con 0x5625f9ee4300 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff34dda2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5625f9ee4300 0x5625f9ee66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff34e5a3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5625f9edfe70 0x5625f9ee0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60286/0 (socket says 172.21.15.42:60286) 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff34e5a3640 1 -- 172.21.15.42:0/3360123094 learned_addr learned my addr 172.21.15.42:0/3360123094 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.174+0000 7ff34d5a1640 1 -- 172.21.15.42:0/3360123094 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205904671 0 0) 0x5625f9e2bbb0 con 0x5625f9edfe70 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.175+0000 7ff34d5a1640 1 -- 172.21.15.42:0/3360123094 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff338001e10 con 0x5625f9edfe70 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.175+0000 7ff34dda2640 1 -- 172.21.15.42:0/3360123094 >> v1:172.21.15.2:6789/0 conn(0x5625f9edfe70 legacy=0x5625f9ee0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.175+0000 7ff34dda2640 1 -- 172.21.15.42:0/3360123094 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f9ee7d20 con 0x5625f9ee4300 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.176+0000 7ff34dda2640 1 --2- 172.21.15.42:0/3360123094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ee4300 0x5625f9ee66f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff34400a470 tx=0x7ff34401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2c4fc705a39dc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff34d5a1640 1 -- 172.21.15.42:0/3360123094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34404ad60 con 0x5625f9ee4300 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff34d5a1640 1 -- 172.21.15.42:0/3360123094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344052440 con 0x5625f9ee4300 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff34d5a1640 1 -- 172.21.15.42:0/3360123094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff344052700 con 0x5625f9ee4300 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 -- 172.21.15.42:0/3360123094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ee4300 msgr2=0x5625f9ee66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 --2- 172.21.15.42:0/3360123094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ee4300 0x5625f9ee66f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff34400a470 tx=0x7ff34401cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 -- 172.21.15.42:0/3360123094 shutdown_connections 2024-02-16T00:11:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 --2- 172.21.15.42:0/3360123094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ee4300 0x5625f9ee66f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 -- 172.21.15.42:0/3360123094 >> 172.21.15.42:0/3360123094 conn(0x5625f9edb4d0 msgr2=0x5625f9edd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 -- 172.21.15.42:0/3360123094 shutdown_connections 2024-02-16T00:11:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.177+0000 7ff350a9d800 1 -- 172.21.15.42:0/3360123094 wait complete. 2024-02-16T00:11:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.188+0000 7ff350a9d800 1 Processor -- start 2024-02-16T00:11:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.188+0000 7ff350a9d800 1 -- start start 2024-02-16T00:11:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff350a9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9e53f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff350a9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f9de0980 con 0x5625f9edfe70 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff34e5a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9e53f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff34e5a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9e53f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:58988/0 (socket says 172.21.15.42:58988) 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff34e5a3640 1 -- 172.21.15.42:0/3844051464 learned_addr learned my addr 172.21.15.42:0/3844051464 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff34e5a3640 1 -- 172.21.15.42:0/3844051464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344005d20 con 0x5625f9edfe70 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.189+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/3844051464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9e53f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff340001ca0 tx=0x7ff34000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4281e3e4b12b185e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff23c608640 1 -- 172.21.15.42:0/3844051464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34000e470 con 0x5625f9edfe70 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff23c608640 1 -- 172.21.15.42:0/3844051464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34000e5d0 con 0x5625f9edfe70 2024-02-16T00:11:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff23c608640 1 -- 172.21.15.42:0/3844051464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34000e8f0 con 0x5625f9edfe70 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 -- 172.21.15.42:0/3844051464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 msgr2=0x5625f9e53f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 --2- 172.21.15.42:0/3844051464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9e53f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff340001ca0 tx=0x7ff34000b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 -- 172.21.15.42:0/3844051464 shutdown_connections 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 --2- 172.21.15.42:0/3844051464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9e53f30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 -- 172.21.15.42:0/3844051464 >> 172.21.15.42:0/3844051464 conn(0x5625f9edb4d0 msgr2=0x5625f9fcb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 -- 172.21.15.42:0/3844051464 shutdown_connections 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.190+0000 7ff350a9d800 1 -- 172.21.15.42:0/3844051464 wait complete. 2024-02-16T00:11:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff350a9d800 1 Processor -- start 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff350a9d800 1 -- start start 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff350a9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9fda6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff350a9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f9ddc160 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff34e5a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9fda6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff34e5a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9fda6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59004/0 (socket says 172.21.15.42:59004) 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff34e5a3640 1 -- 172.21.15.42:0/4225362804 learned_addr learned my addr 172.21.15.42:0/4225362804 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.191+0000 7ff34e5a3640 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338001e10 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9fda6a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff340001ed0 tx=0x7ff340000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff23ae05640 1 -- 172.21.15.42:0/4225362804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34001f070 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff23ae05640 1 -- 172.21.15.42:0/4225362804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff340018770 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625f9fdabe0 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff23ae05640 1 -- 172.21.15.42:0/4225362804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff340018a30 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625f9fdb0c0 con 0x5625f9edfe70 2024-02-16T00:11:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.192+0000 7ff23ae05640 1 -- 172.21.15.42:0/4225362804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff340018b90 con 0x5625f9edfe70 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff23ae05640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff234036830 0x7ff234038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff23ae05640 1 -- 172.21.15.42:0/4225362804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff34004c2f0 con 0x5625f9edfe70 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff34dda2640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff234036830 0x7ff234038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625f9ee4300 0x5625f9fe1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625f9fe1950 con 0x5625f9ee4300 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff34eda4640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625f9ee4300 0x5625f9fe1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff34dda2640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff234036830 0x7ff234038cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff344054000 tx=0x7ff34404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.193+0000 7ff34eda4640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625f9ee4300 0x5625f9fe1380 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff34eda4640 1 -- 172.21.15.42:0/4225362804 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff34800a4a0 con 0x5625f9ee4300 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625f9fdeab0 con 0x5625f9ee4300 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff34eda4640 1 -- 172.21.15.42:0/4225362804 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff34800a4a0 con 0x5625f9ee4300 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625f9fe3bc0 0x5625f9fe5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625f9fe66a0 con 0x5625f9fe3bc0 2024-02-16T00:11:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625f9fe3bc0 0x5625f9fe5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.194+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625f9fe3bc0 0x5625f9fe5fb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.195+0000 7ff34e5a3640 1 -- 172.21.15.42:0/4225362804 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff340014070 con 0x5625f9fe3bc0 2024-02-16T00:11:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.195+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625f9fe2b40 con 0x5625f9ee4300 2024-02-16T00:11:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.195+0000 7ff34eda4640 1 -- 172.21.15.42:0/4225362804 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff34800a4a0 con 0x5625f9ee4300 2024-02-16T00:11:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.195+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625f9fe2f30 con 0x5625f9ee4300 2024-02-16T00:11:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.195+0000 7ff34eda4640 1 -- 172.21.15.42:0/4225362804 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff34800a4a0 con 0x5625f9ee4300 2024-02-16T00:11:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff350a9d800 1 Processor -- start 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff350a9d800 1 -- start start 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff350a9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 0x5625f9ff5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff350a9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f9d7ee80 con 0x5625f9ff5470 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff34eda4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 0x5625f9ff5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff34eda4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 0x5625f9ff5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59008/0 (socket says 172.21.15.42:59008) 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff34eda4640 1 -- 172.21.15.42:0/4047808558 learned_addr learned my addr 172.21.15.42:0/4047808558 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.196+0000 7ff34eda4640 1 -- 172.21.15.42:0/4047808558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f9ff5dd0 con 0x5625f9ff5470 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.197+0000 7ff34eda4640 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 0x5625f9ff5890 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5625f9fdbaa0 tx=0x7ff348018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.197+0000 7ff233fff640 1 -- 172.21.15.42:0/4047808558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34801d070 con 0x5625f9ff5470 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.197+0000 7ff233fff640 1 -- 172.21.15.42:0/4047808558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3480182e0 con 0x5625f9ff5470 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.197+0000 7ff233fff640 1 -- 172.21.15.42:0/4047808558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3480145a0 con 0x5625f9ff5470 2024-02-16T00:11:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.197+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625f9ff6840 con 0x5625f9ff5470 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.197+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625f9ff6d00 con 0x5625f9ff5470 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff233fff640 1 -- 172.21.15.42:0/4047808558 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff348020020 con 0x5625f9ff5470 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff233fff640 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff228036790 0x7ff228038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff233fff640 1 -- 172.21.15.42:0/4047808558 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff34804dca0 con 0x5625f9ff5470 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff228036790 0x7ff228038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff350a9d800 1 Processor -- start 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff350a9d800 1 -- start start 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff228036790 0x7ff228038c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x5625f9fe1d20 tx=0x7ff3400163d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff350a9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa002b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff350a9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f9d545d0 con 0x5625fa002720 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff34eda4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa002b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff34eda4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa002b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59022/0 (socket says 172.21.15.42:59022) 2024-02-16T00:11:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.198+0000 7ff34eda4640 1 -- 172.21.15.42:0/1906809567 learned_addr learned my addr 172.21.15.42:0/1906809567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff34eda4640 1 -- 172.21.15.42:0/1906809567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625fa003110 con 0x5625fa002720 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff34eda4640 1 --2- 172.21.15.42:0/1906809567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa002b40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff34804c020 tx=0x7ff34804c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1ad390d8071bb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff231ffb640 1 -- 172.21.15.42:0/1906809567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34802bc70 con 0x5625fa002720 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff231ffb640 1 -- 172.21.15.42:0/1906809567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34802bdd0 con 0x5625fa002720 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff231ffb640 1 -- 172.21.15.42:0/1906809567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3480148a0 con 0x5625fa002720 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff350a9d800 1 -- 172.21.15.42:0/1906809567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 msgr2=0x5625fa002b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff350a9d800 1 --2- 172.21.15.42:0/1906809567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa002b40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff34804c020 tx=0x7ff34804c2b0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff350a9d800 1 -- 172.21.15.42:0/1906809567 shutdown_connections 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff350a9d800 1 --2- 172.21.15.42:0/1906809567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa002b40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.199+0000 7ff350a9d800 1 -- 172.21.15.42:0/1906809567 >> 172.21.15.42:0/1906809567 conn(0x5625f9ffea30 msgr2=0x5625f9ffca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff350a9d800 1 -- 172.21.15.42:0/1906809567 shutdown_connections 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff350a9d800 1 -- 172.21.15.42:0/1906809567 wait complete. 2024-02-16T00:11:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff350a9d800 1 Processor -- start 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff350a9d800 1 -- start start 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff350a9d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa009640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff350a9d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625fa009b80 con 0x5625fa002720 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff34eda4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff34eda4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa009640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59034/0 (socket says 172.21.15.42:59034) 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 learned_addr learned my addr 172.21.15.42:0/2036608085 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.200+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f9ff6d00 con 0x5625fa002720 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff34eda4640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa009640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff348011ae0 tx=0x7ff34804bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff21ffff640 1 -- 172.21.15.42:0/2036608085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff348033070 con 0x5625fa002720 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff21ffff640 1 -- 172.21.15.42:0/2036608085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3480116f0 con 0x5625fa002720 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625fa009d80 con 0x5625fa002720 2024-02-16T00:11:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff21ffff640 1 -- 172.21.15.42:0/2036608085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff34802b560 con 0x5625fa002720 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625fa00a240 con 0x5625fa002720 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.201+0000 7ff21ffff640 1 -- 172.21.15.42:0/2036608085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff348022740 con 0x5625fa002720 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff21ffff640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff218036760 0x7ff218038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff21ffff640 1 -- 172.21.15.42:0/2036608085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff348039c60 con 0x5625fa002720 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff218036760 0x7ff218038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff218036760 0x7ff218038c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff34000dfd0 tx=0x7ff340035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625fa0153c0 0x5625fa017880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa017fd0 con 0x5625fa0153c0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.202+0000 7ff34dda2640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625fa0153c0 0x5625fa017880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff34dda2640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625fa0153c0 0x5625fa017880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 realm 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0183c0 con 0x5625fa0153c0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa018c40 con 0x5625fa0153c0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.203+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa018fa0 con 0x5625fa0153c0 2024-02-16T00:11:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625fa019cb0 0x5625fa01c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa019cb0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff34eda4640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625fa019cb0 0x5625fa01c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff34eda4640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625fa019cb0 0x5625fa01c0a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff34800a4a0 con 0x5625fa019cb0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 20 searching for the correct realm 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5625fa01e980 0x5625fa020e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa021510 con 0x5625fa01e980 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.204+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5625fa01e980 0x5625fa020e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.205+0000 7ff34e5a3640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5625fa01e980 0x5625fa020e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.205+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.205+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa021510 con 0x5625fa019cb0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.205+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff34800a4a0 con 0x5625fa019cb0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.205+0000 7ff34eda4640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3480133b0 0x7ff34802f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.205+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.206+0000 7ff34dda2640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3480133b0 0x7ff34802f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.206+0000 7ff34dda2640 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3480133b0 0x7ff34802f040 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.206+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.206+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.207+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.207+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.207+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.207+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.207+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.207+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa019cb0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.208+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa019cb0 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.209+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.210+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.211+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa019cb0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.212+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa019cb0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa01e980 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.213+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x7ff3480133b0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa0153c0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01c6b0 con 0x5625fa019cb0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01cd80 con 0x5625fa0153c0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.214+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01d130 con 0x5625fa0153c0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa01d510 con 0x5625fa0153c0 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 zone default found 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 4 Realm: () 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 zonegroup default 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa021950 con 0x7ff3480133b0 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.215+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0237d0 con 0x5625fa01e980 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa023b30 con 0x5625fa01e980 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 20 started sync module instance, tier type = 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.216+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa022c60 con 0x5625fa019cb0 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.217+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.217+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94721108226416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa022c60 con 0x5625fa019cb0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.217+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0244e0 con 0x5625fa0153c0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.218+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94721108226416] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.218+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.218+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94721108230144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa022c60 con 0x5625fa0153c0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.218+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa024f50 con 0x5625fa01e980 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.219+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94721108230144] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.219+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.220+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94721108223936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa022be0 con 0x5625fa01e980 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.220+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa025db0 con 0x5625fa019cb0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.221+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94721108223936] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.221+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.221+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94721108236560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0261d0 con 0x5625fa019cb0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.221+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa026b40 con 0x5625fa0153c0 2024-02-16T00:11:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.222+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94721108236560] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.222+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.222+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94721108240512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0261d0 con 0x5625fa0153c0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.222+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa027560 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.223+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.223+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94721108242528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa027520 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.223+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0284c0 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.223+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94721108240512] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.224+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94721108242528] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.224+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.224+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94721108237616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa027780 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.224+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa028960 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94721108247744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa028d80 con 0x7ff3480133b0 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=0 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=1 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=2 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=3 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=4 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=5 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94721108237616] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.225+0000 7ff350a9d800 20 add_watcher() i=6 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.226+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94721108247744] v27'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.226+0000 7ff350a9d800 20 add_watcher() i=7 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.226+0000 7ff350a9d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.226+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa028d80 con 0x5625fa0153c0 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.226+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.226+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94721108248800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0296f0 con 0x5625fa0153c0 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94721108248800] v27'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff204fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff350a9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff350a9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff350a9d800 5 note: GC not initialized 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff17f7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.227+0000 7ff350a9d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 20 Filter name: none 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff17d7fa640 20 reqs_thread_entry: start 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa05de60 con 0x5625fa0153c0 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~541 out=541b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+664 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 20 rados_obj.operate() r=0 bl.length=541 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.228+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa064280 con 0x5625fa0153c0 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.229+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v27'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.229+0000 7ff350a9d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.229+0000 7ff350a9d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.229+0000 7ff350a9d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.229+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94721108491520 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa05f950 con 0x5625fa0153c0 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94721108240512 notify 115964117001 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7ff344084040 con 0x5625fa0153c0 2024-02-16T00:11:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff231ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94721108240512 notifier 4404 bl.length()=691 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff231ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff231ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff231ffb640 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7ff214003e90 con 0x5625fa0153c0 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94721108491520 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== watch-notify(notify_complete (2) cookie 94721108491520 notify 115964117001 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff344079040 con 0x5625fa0153c0 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.230+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.246 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.231+0000 7ff204fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.231+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94721108248800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa05f4b0 con 0x5625fa0153c0 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.232+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94721108248800] v27'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.232+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94721108226416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0288e0 con 0x5625fa019cb0 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.232+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94721108226416] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.233+0000 7ff350a9d800 20 remove_watcher() i=0 2024-02-16T00:11:24.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.233+0000 7ff350a9d800 2 removed watcher, disabling cache 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.233+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94721108230144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0288e0 con 0x5625fa0153c0 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.234+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94721108230144] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.234+0000 7ff350a9d800 20 remove_watcher() i=1 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.234+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94721108223936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0288e0 con 0x5625fa01e980 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.235+0000 7ff34e5a3640 1 -- 172.21.15.42:0/2036608085 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94721108223936] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff340033070 con 0x5625fa01e980 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.235+0000 7ff350a9d800 20 remove_watcher() i=2 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.235+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94721108236560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0227c0 con 0x5625fa019cb0 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.236+0000 7ff34eda4640 1 -- 172.21.15.42:0/2036608085 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94721108236560] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff348062040 con 0x5625fa019cb0 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.236+0000 7ff350a9d800 20 remove_watcher() i=3 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.236+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94721108240512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa025910 con 0x5625fa0153c0 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.237+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94721108240512] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x5625fa0153c0 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.237+0000 7ff350a9d800 20 remove_watcher() i=4 2024-02-16T00:11:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.237+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94721108242528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0227c0 con 0x7ff3480133b0 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.238+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94721108242528] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.238+0000 7ff350a9d800 20 remove_watcher() i=5 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.238+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94721108237616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa025910 con 0x7ff3480133b0 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.239+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94721108237616] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.239+0000 7ff350a9d800 20 remove_watcher() i=6 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.239+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94721108247744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5625fa0227c0 con 0x7ff3480133b0 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94721108247744] v27'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff344065040 con 0x7ff3480133b0 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 20 remove_watcher() i=7 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3480133b0 msgr2=0x7ff34802f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3480133b0 0x7ff34802f040 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625fa0153c0 msgr2=0x5625fa017880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625fa0153c0 0x5625fa017880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625fa019cb0 msgr2=0x5625fa01c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625fa019cb0 0x5625fa01c0a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5625fa01e980 msgr2=0x5625fa020e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5625fa01e980 0x5625fa020e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff218036760 msgr2=0x7ff218038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff218036760 0x7ff218038c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff34000dfd0 tx=0x7ff340035000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 msgr2=0x5625fa009640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 --2- 172.21.15.42:0/2036608085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625fa002720 0x5625fa009640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff348011ae0 tx=0x7ff34804bf80 comp rx=0 tx=0).stop 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 reap_dead start 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff34dda2640 1 -- 172.21.15.42:0/2036608085 reap_dead start 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 shutdown_connections 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 >> 172.21.15.42:0/2036608085 conn(0x5625f9ffea30 msgr2=0x5625f9ffca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 shutdown_connections 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.240+0000 7ff350a9d800 1 -- 172.21.15.42:0/2036608085 wait complete. 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff228036790 msgr2=0x7ff228038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff228036790 0x7ff228038c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x5625f9fe1d20 tx=0x7ff3400163d0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 msgr2=0x5625f9ff5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 0x5625f9ff5890 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5625f9fdbaa0 tx=0x7ff348018830 comp rx=0 tx=0).stop 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 shutdown_connections 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff228036790 0x7ff228038c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4047808558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9ff5470 0x5625f9ff5890 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 >> 172.21.15.42:0/4047808558 conn(0x5625f9fe9510 msgr2=0x5625f9fe9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 shutdown_connections 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4047808558 wait complete. 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625f9ee4300 msgr2=0x5625f9fe1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625f9ee4300 0x5625f9fe1380 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625f9fe3bc0 msgr2=0x5625f9fe5fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625f9fe3bc0 0x5625f9fe5fb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff234036830 msgr2=0x7ff234038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff234036830 0x7ff234038cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff344054000 tx=0x7ff34404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 msgr2=0x5625f9fda6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9fda6a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff340001ed0 tx=0x7ff340000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 shutdown_connections 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5625f9fe3bc0 0x5625f9fe5fb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5625f9ee4300 0x5625f9fe1380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff234036830 0x7ff234038cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 --2- 172.21.15.42:0/4225362804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625f9edfe70 0x5625f9fda6a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 >> 172.21.15.42:0/4225362804 conn(0x5625f9edb4d0 msgr2=0x5625f9fc9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 shutdown_connections 2024-02-16T00:11:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.241+0000 7ff350a9d800 1 -- 172.21.15.42:0/4225362804 wait complete. 2024-02-16T00:11:24.258 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:24.258 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-16T00:11:24.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-16T00:11:24.258 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-02-16T00:11:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.335+0000 7fe69812b800 1 Processor -- start 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.335+0000 7fe69812b800 1 -- start start 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe69812b800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558673e60e90 0x558673e612b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe69812b800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558673dacc50 con 0x558673e620f0 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe69812b800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x558673d64450 con 0x558673e60e90 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe693d57640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558673e60e90 0x558673e612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe693556640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558673e620f0 0x558673e62570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60298/0 (socket says 172.21.15.42:60298) 2024-02-16T00:11:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe693556640 1 -- 172.21.15.42:0/628744298 learned_addr learned my addr 172.21.15.42:0/628744298 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe693d57640 1 -- 172.21.15.42:0/628744298 >> v1:172.21.15.2:6789/0 conn(0x558673e620f0 legacy=0x558673e62570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe692d55640 1 -- 172.21.15.42:0/628744298 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349998775 0 0) 0x558673dacc50 con 0x558673e620f0 2024-02-16T00:11:24.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.336+0000 7fe693d57640 1 -- 172.21.15.42:0/628744298 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558673e61980 con 0x558673e60e90 2024-02-16T00:11:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.338+0000 7fe693d57640 1 --2- 172.21.15.42:0/628744298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673e612b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe68400a470 tx=0x7fe68401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140f7a52b8122b39 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.338+0000 7fe692d55640 1 -- 172.21.15.42:0/628744298 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684052570 con 0x558673e60e90 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.338+0000 7fe692d55640 1 -- 172.21.15.42:0/628744298 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840526d0 con 0x558673e60e90 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.338+0000 7fe692d55640 1 -- 172.21.15.42:0/628744298 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684052990 con 0x558673e60e90 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 -- 172.21.15.42:0/628744298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 msgr2=0x558673e612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 --2- 172.21.15.42:0/628744298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673e612b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe68400a470 tx=0x7fe68401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 -- 172.21.15.42:0/628744298 shutdown_connections 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 --2- 172.21.15.42:0/628744298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673e612b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 -- 172.21.15.42:0/628744298 >> 172.21.15.42:0/628744298 conn(0x558673e5c4f0 msgr2=0x558673e5e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 -- 172.21.15.42:0/628744298 shutdown_connections 2024-02-16T00:11:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.339+0000 7fe69812b800 1 -- 172.21.15.42:0/628744298 wait complete. 2024-02-16T00:11:24.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.350+0000 7fe69812b800 1 Processor -- start 2024-02-16T00:11:24.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.350+0000 7fe69812b800 1 -- start start 2024-02-16T00:11:24.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.350+0000 7fe69812b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673dd4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.350+0000 7fe69812b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558673d61980 con 0x558673e60e90 2024-02-16T00:11:24.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.350+0000 7fe693d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673dd4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe693d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673dd4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59054/0 (socket says 172.21.15.42:59054) 2024-02-16T00:11:24.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe693d57640 1 -- 172.21.15.42:0/3439762040 learned_addr learned my addr 172.21.15.42:0/3439762040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe693d57640 1 -- 172.21.15.42:0/3439762040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684005d20 con 0x558673e60e90 2024-02-16T00:11:24.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe693d57640 1 --2- 172.21.15.42:0/3439762040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673dd4f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe684055040 tx=0x7fe68404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9c21fcbe88b85f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe581e0b640 1 -- 172.21.15.42:0/3439762040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68400a180 con 0x558673e60e90 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe581e0b640 1 -- 172.21.15.42:0/3439762040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68400a2e0 con 0x558673e60e90 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.351+0000 7fe581e0b640 1 -- 172.21.15.42:0/3439762040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6840529b0 con 0x558673e60e90 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 -- 172.21.15.42:0/3439762040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 msgr2=0x558673dd4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 --2- 172.21.15.42:0/3439762040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673dd4f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe684055040 tx=0x7fe68404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 -- 172.21.15.42:0/3439762040 shutdown_connections 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 --2- 172.21.15.42:0/3439762040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673dd4f50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 -- 172.21.15.42:0/3439762040 >> 172.21.15.42:0/3439762040 conn(0x558673e5c4f0 msgr2=0x558673f4ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 -- 172.21.15.42:0/3439762040 shutdown_connections 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 -- 172.21.15.42:0/3439762040 wait complete. 2024-02-16T00:11:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 Processor -- start 2024-02-16T00:11:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.352+0000 7fe69812b800 1 -- start start 2024-02-16T00:11:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe69812b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673f5ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe69812b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558673d5d160 con 0x558673e60e90 2024-02-16T00:11:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe693d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673f5ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe693d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673f5ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59058/0 (socket says 172.21.15.42:59058) 2024-02-16T00:11:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe693d57640 1 -- 172.21.15.42:0/3882104566 learned_addr learned my addr 172.21.15.42:0/3882104566 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe693d57640 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68404e070 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.353+0000 7fe693d57640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673f5ba30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe68400a470 tx=0x7fe684002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.354+0000 7fe57bfff640 1 -- 172.21.15.42:0/3882104566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68406a070 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.354+0000 7fe57bfff640 1 -- 172.21.15.42:0/3882104566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684052cc0 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.354+0000 7fe57bfff640 1 -- 172.21.15.42:0/3882104566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68405d420 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.354+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558673f5bf70 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.354+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558673f5c450 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.354+0000 7fe57bfff640 1 -- 172.21.15.42:0/3882104566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe68405d580 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe57bfff640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe57c0367e0 0x7fe57c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe57bfff640 1 -- 172.21.15.42:0/3882104566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe68408d770 con 0x558673e60e90 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe693556640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe57c0367e0 0x7fe57c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673e620f0 0x558673f626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f62c30 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe694558640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673e620f0 0x558673f626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe693556640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe57c0367e0 0x7fe57c038ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe6880013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe694558640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673e620f0 0x558673f626f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe694558640 1 -- 172.21.15.42:0/3882104566 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe68c00a4a0 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.355+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f62fd0 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.356+0000 7fe694558640 1 -- 172.21.15.42:0/3882104566 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe68c00a4a0 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.356+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f64d60 0x558673f67150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.356+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f67840 con 0x558673f64d60 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.356+0000 7fe693d57640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f64d60 0x558673f67150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.356+0000 7fe693d57640 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f64d60 0x558673f67150 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.357+0000 7fe693d57640 1 -- 172.21.15.42:0/3882104566 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe68407e040 con 0x558673f64d60 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.357+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f63ce0 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.357+0000 7fe694558640 1 -- 172.21.15.42:0/3882104566 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe68c00a4a0 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.357+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f640d0 con 0x558673e620f0 2024-02-16T00:11:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.357+0000 7fe694558640 1 -- 172.21.15.42:0/3882104566 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe68c00a4a0 con 0x558673e620f0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.357+0000 7fe69812b800 1 Processor -- start 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe69812b800 1 -- start start 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe69812b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 0x558673f769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe69812b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558673cffe80 con 0x558673f765b0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe694558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 0x558673f769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe694558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 0x558673f769d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59068/0 (socket says 172.21.15.42:59068) 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe694558640 1 -- 172.21.15.42:0/2882775730 learned_addr learned my addr 172.21.15.42:0/2882775730 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe694558640 1 -- 172.21.15.42:0/2882775730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558673f76f10 con 0x558673f765b0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.358+0000 7fe694558640 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 0x558673f769d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x558673f5c760 tx=0x7fe68c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.359+0000 7fe5797fa640 1 -- 172.21.15.42:0/2882775730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68c01d070 con 0x558673f765b0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.359+0000 7fe5797fa640 1 -- 172.21.15.42:0/2882775730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0182e0 con 0x558673f765b0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.359+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558673f77980 con 0x558673f765b0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.359+0000 7fe5797fa640 1 -- 172.21.15.42:0/2882775730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68c014580 con 0x558673f765b0 2024-02-16T00:11:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.359+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558673f77e40 con 0x558673f765b0 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.359+0000 7fe5797fa640 1 -- 172.21.15.42:0/2882775730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe68c020020 con 0x558673f765b0 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe5797fa640 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe56c0367e0 0x7fe56c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe5797fa640 1 -- 172.21.15.42:0/2882775730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe68c04dc60 con 0x558673f765b0 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe693d57640 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe56c0367e0 0x7fe56c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe69812b800 1 Processor -- start 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe69812b800 1 -- start start 2024-02-16T00:11:24.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe693d57640 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe56c0367e0 0x7fe56c038ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x558673f5fda0 tx=0x7fe68408ba70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe69812b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f83bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe69812b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558673cd55d0 con 0x558673f83790 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe694558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f83bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe694558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f83bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59070/0 (socket says 172.21.15.42:59070) 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe694558640 1 -- 172.21.15.42:0/558884393 learned_addr learned my addr 172.21.15.42:0/558884393 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.360+0000 7fe694558640 1 -- 172.21.15.42:0/558884393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558673f84180 con 0x558673f83790 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe694558640 1 --2- 172.21.15.42:0/558884393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f83bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe68c04bfb0 tx=0x7fe68c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509fc95a123a9b50 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe572ffd640 1 -- 172.21.15.42:0/558884393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68c040430 con 0x558673f83790 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe572ffd640 1 -- 172.21.15.42:0/558884393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c02bc70 con 0x558673f83790 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe572ffd640 1 -- 172.21.15.42:0/558884393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68c016440 con 0x558673f83790 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 -- 172.21.15.42:0/558884393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 msgr2=0x558673f83bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 --2- 172.21.15.42:0/558884393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f83bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe68c04bfb0 tx=0x7fe68c011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:24.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 -- 172.21.15.42:0/558884393 shutdown_connections 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 --2- 172.21.15.42:0/558884393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f83bb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 -- 172.21.15.42:0/558884393 >> 172.21.15.42:0/558884393 conn(0x558673f7faf0 msgr2=0x558673f7db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 -- 172.21.15.42:0/558884393 shutdown_connections 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.361+0000 7fe69812b800 1 -- 172.21.15.42:0/558884393 wait complete. 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe69812b800 1 Processor -- start 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe69812b800 1 -- start start 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe69812b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f8a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe69812b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558673f8ac90 con 0x558673f83790 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe694558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f8a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe694558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f8a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59084/0 (socket says 172.21.15.42:59084) 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 learned_addr learned my addr 172.21.15.42:0/2203001712 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558673f77e40 con 0x558673f83790 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe694558640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f8a750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe68c04c070 tx=0x7fe68c04bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe5717fa640 1 -- 172.21.15.42:0/2203001712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68c032070 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe5717fa640 1 -- 172.21.15.42:0/2203001712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c013630 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.362+0000 7fe5717fa640 1 -- 172.21.15.42:0/2203001712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68c013a90 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.363+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558673f8ae90 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.363+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558673f8b2f0 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.363+0000 7fe5717fa640 1 -- 172.21.15.42:0/2203001712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe68c03d030 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.363+0000 7fe5717fa640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe55c0367e0 0x7fe55c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.363+0000 7fe5717fa640 1 -- 172.21.15.42:0/2203001712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe68c02e040 con 0x558673f83790 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe693d57640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe55c0367e0 0x7fe55c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe693d57640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe55c0367e0 0x7fe55c038ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe68405dfd0 tx=0x7fe684086000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673f96490 0x558673f98950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f990a0 con 0x558673f96490 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe693556640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673f96490 0x558673f98950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.364+0000 7fe693556640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673f96490 0x558673f98950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 realm 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f958f0 con 0x558673f96490 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f99b20 con 0x558673f96490 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f9a3a0 con 0x558673f96490 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f9ad80 0x558673f9d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.365+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f9d8e0 con 0x558673f9ad80 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe694558640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f9ad80 0x558673f9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe694558640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f9ad80 0x558673f9d170 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe68c00a4a0 con 0x558673f9ad80 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe69812b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe69812b800 20 searching for the correct realm 2024-02-16T00:11:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558673f9f860 0x558673fa1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa23a0 con 0x558673f9f860 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe693d57640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558673f9f860 0x558673fa1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.366+0000 7fe693d57640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558673f9f860 0x558673fa1d20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.367+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68407e040 con 0x558673f9f860 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.367+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa23a0 con 0x558673f9ad80 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.367+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68c00a4a0 con 0x558673f9ad80 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.367+0000 7fe694558640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe68c014070 0x7fe68c047810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.367+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.368+0000 7fe693556640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe68c014070 0x7fe68c047810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.368+0000 7fe693556640 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe68c014070 0x7fe68c047810 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.368+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.368+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.368+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.368+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9ad80 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.369+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.370+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.370+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.370+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.370+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.370+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.370+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9ad80 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.371+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.372+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.372+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.372+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.372+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.372+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.372+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.373+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9ad80 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.374+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9ad80 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9f860 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.375+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x7fe68c014070 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f96490 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe68c037030 con 0x558673f9ad80 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:24.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f9e150 con 0x558673f96490 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.376+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f9e500 con 0x558673f96490 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f9e8e0 con 0x558673f96490 2024-02-16T00:11:24.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 20 zone default found 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 4 Realm: () 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 20 zonegroup default 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.377+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673f9ecd0 con 0x7fe68c014070 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa41c0 con 0x558673f9f860 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa4520 con 0x558673f9f860 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 started sync module instance, tier type = 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.378+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa3aa0 con 0x558673f9ad80 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.379+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.379+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94035959756288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa3e50 con 0x558673f9ad80 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.379+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa5210 con 0x558673f96490 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.380+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94035959756288] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.381+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.381+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94035959761104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa52b0 con 0x558673f96490 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.381+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa5d80 con 0x558673f9f860 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.382+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.382+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94035959765088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa65d0 con 0x558673f9f860 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.382+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa70a0 con 0x558673f9ad80 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.382+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94035959761104] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.383+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94035959765088] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.383+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.383+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94035959767344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa4d30 con 0x558673f9ad80 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.383+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa7a60 con 0x558673f96490 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.384+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94035959767344] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.384+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.384+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94035959769984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa7a60 con 0x558673f96490 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.384+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa83d0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.385+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.385+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94035959775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa8350 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.385+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa92f0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.385+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94035959769984] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.386+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94035959775024] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.386+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.386+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94035959778800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa8780 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.386+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa98c0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94035959778800] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94035959772608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa98c0 con 0x7fe68c014070 2024-02-16T00:11:24.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=0 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=1 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=2 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=3 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=4 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=5 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.387+0000 7fe69812b800 20 add_watcher() i=6 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.388+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94035959772608] v27'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.388+0000 7fe69812b800 20 add_watcher() i=7 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.388+0000 7fe69812b800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.388+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673facd00 con 0x558673f96490 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.388+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.388+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94035959793440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa9a30 con 0x558673f96490 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.389+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94035959793440] v27'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe549fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 5 note: GC not initialized 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe548fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 20 Filter name: none 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe4c27fc640 20 reqs_thread_entry: start 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.390+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fdec80 con 0x558673f96490 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.391+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.391+0000 7fe69812b800 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.391+0000 7fe69812b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.391+0000 7fe69812b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.391+0000 7fe69812b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:24.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.391+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fe4f40 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v27'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe69812b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe69812b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe69812b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94035960023552 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fe0660 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94035959769984 notify 115964117002 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7fe68803f960 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe572ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94035959769984 notifier 4411 bl.length()=534 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe572ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe572ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe572ffd640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe558003e90 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94035960023552 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.392+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94035960023552 notify 115964117002 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe68803faf0 con 0x558673f96490 2024-02-16T00:11:24.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe69812b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94035960023552 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fe3b10 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== watch-notify(notify (1) cookie 94035959756288 notify 115964116997 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x558673f8b2f0 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe5727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94035959756288 notifier 4411 bl.length()=159 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(66 notify.0 [notify cookie 94035960023552 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe5727fc640 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe4c80032b0 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== watch-notify(notify_complete (2) cookie 94035960023552 notify 115964116997 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558673f8ae90 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.393+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fdf180 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.394+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(68 foo:foo2 [delete] v27'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.408 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:24.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.395+0000 7fe549fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.395+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94035959793440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fabd60 con 0x558673f96490 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.396+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94035959793440] v27'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.396+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94035959756288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fac720 con 0x558673f9ad80 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.397+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94035959756288] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.397+0000 7fe69812b800 20 remove_watcher() i=0 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.397+0000 7fe69812b800 2 removed watcher, disabling cache 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.397+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94035959761104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa3600 con 0x558673f96490 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.398+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94035959761104] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.398+0000 7fe69812b800 20 remove_watcher() i=1 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.398+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94035959765088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa3600 con 0x558673f9f860 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.399+0000 7fe693d57640 1 -- 172.21.15.42:0/2203001712 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94035959765088] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6840a3040 con 0x558673f9f860 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.399+0000 7fe69812b800 20 remove_watcher() i=2 2024-02-16T00:11:24.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.399+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94035959767344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa5860 con 0x558673f9ad80 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.400+0000 7fe694558640 1 -- 172.21.15.42:0/2203001712 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94035959767344] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68c062040 con 0x558673f9ad80 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.400+0000 7fe69812b800 20 remove_watcher() i=3 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.400+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94035959769984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa5860 con 0x558673f96490 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.401+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94035959769984] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x558673f96490 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.401+0000 7fe69812b800 20 remove_watcher() i=4 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.401+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94035959775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa5860 con 0x7fe68c014070 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.402+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94035959775024] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe68800f5f0 con 0x7fe68c014070 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.403+0000 7fe69812b800 20 remove_watcher() i=5 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.403+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94035959778800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa7f30 con 0x7fe68c014070 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.404+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94035959778800] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe688049040 con 0x7fe68c014070 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.404+0000 7fe69812b800 20 remove_watcher() i=6 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.404+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94035959772608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558673fa5860 con 0x7fe68c014070 2024-02-16T00:11:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.404+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94035959772608] v27'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe688049040 con 0x7fe68c014070 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 20 remove_watcher() i=7 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe68c014070 msgr2=0x7fe68c047810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe68c014070 0x7fe68c047810 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673f96490 msgr2=0x558673f98950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673f96490 0x558673f98950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f9ad80 msgr2=0x558673f9d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f9ad80 0x558673f9d170 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558673f9f860 msgr2=0x558673fa1d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558673f9f860 0x558673fa1d20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe55c0367e0 msgr2=0x7fe55c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe55c0367e0 0x7fe55c038ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe68405dfd0 tx=0x7fe684086000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 msgr2=0x558673f8a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe693556640 1 -- 172.21.15.42:0/2203001712 reap_dead start 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f8a750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe68c04c070 tx=0x7fe68c04bf40 comp rx=0 tx=0).stop 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 shutdown_connections 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2203001712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f83790 0x558673f8a750 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 >> 172.21.15.42:0/2203001712 conn(0x558673f7faf0 msgr2=0x558673f7d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 shutdown_connections 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2203001712 wait complete. 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe56c0367e0 msgr2=0x7fe56c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe56c0367e0 0x7fe56c038ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x558673f5fda0 tx=0x7fe68408ba70 comp rx=0 tx=0).stop 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 msgr2=0x558673f769d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 0x558673f769d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x558673f5c760 tx=0x7fe68c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 shutdown_connections 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe56c0367e0 0x7fe56c038ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 --2- 172.21.15.42:0/2882775730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673f765b0 0x558673f769d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 >> 172.21.15.42:0/2882775730 conn(0x558673f6a650 msgr2=0x558673f6aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 shutdown_connections 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.405+0000 7fe69812b800 1 -- 172.21.15.42:0/2882775730 wait complete. 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673e620f0 msgr2=0x558673f626f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673e620f0 0x558673f626f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f64d60 msgr2=0x558673f67150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f64d60 0x558673f67150 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe57c0367e0 msgr2=0x7fe57c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe57c0367e0 0x7fe57c038ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe6880013b0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 msgr2=0x558673f5ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673f5ba30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe68400a470 tx=0x7fe684002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 shutdown_connections 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558673f64d60 0x558673f67150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558673e620f0 0x558673f626f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe57c0367e0 0x7fe57c038ca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 --2- 172.21.15.42:0/3882104566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558673e60e90 0x558673f5ba30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 >> 172.21.15.42:0/3882104566 conn(0x558673e5c4f0 msgr2=0x558673f4b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 shutdown_connections 2024-02-16T00:11:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.406+0000 7fe69812b800 1 -- 172.21.15.42:0/3882104566 wait complete. 2024-02-16T00:11:24.420 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:24.421 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-16T00:11:24.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-16T00:11:24.421 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-16T00:11:24.464 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.464 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.461+0000 7f2c03412800 1 Processor -- start 2024-02-16T00:11:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.461+0000 7f2c03412800 1 -- start start 2024-02-16T00:11:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2c03412800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5572afd4a300 0x5572afd4c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2c03412800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5572afc91bb0 con 0x5572afd45e70 2024-02-16T00:11:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2c03412800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5572afc49450 con 0x5572afd4a300 2024-02-16T00:11:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfe36e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5572afd4a300 0x5572afd4c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfeb6f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5572afd45e70 0x5572afd46290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60314/0 (socket says 172.21.15.42:60314) 2024-02-16T00:11:24.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/1170051325 learned_addr learned my addr 172.21.15.42:0/1170051325 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfdb6d640 1 -- 172.21.15.42:0/1170051325 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273934812 0 0) 0x5572afc91bb0 con 0x5572afd45e70 2024-02-16T00:11:24.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfdb6d640 1 -- 172.21.15.42:0/1170051325 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be8001e10 con 0x5572afd45e70 2024-02-16T00:11:24.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfe36e640 1 -- 172.21.15.42:0/1170051325 >> v1:172.21.15.2:6789/0 conn(0x5572afd45e70 legacy=0x5572afd46290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.462+0000 7f2bfe36e640 1 -- 172.21.15.42:0/1170051325 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572afd4dd20 con 0x5572afd4a300 2024-02-16T00:11:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.464+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/1170051325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd4a300 0x5572afd4c6f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400a470 tx=0x7f2bf401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afa789e782263d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.464+0000 7f2bfdb6d640 1 -- 172.21.15.42:0/1170051325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf404ad60 con 0x5572afd4a300 2024-02-16T00:11:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.464+0000 7f2bfdb6d640 1 -- 172.21.15.42:0/1170051325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf4052440 con 0x5572afd4a300 2024-02-16T00:11:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.464+0000 7f2bfdb6d640 1 -- 172.21.15.42:0/1170051325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf4052700 con 0x5572afd4a300 2024-02-16T00:11:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 -- 172.21.15.42:0/1170051325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd4a300 msgr2=0x5572afd4c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 --2- 172.21.15.42:0/1170051325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd4a300 0x5572afd4c6f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400a470 tx=0x7f2bf401cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 -- 172.21.15.42:0/1170051325 shutdown_connections 2024-02-16T00:11:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 --2- 172.21.15.42:0/1170051325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd4a300 0x5572afd4c6f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 -- 172.21.15.42:0/1170051325 >> 172.21.15.42:0/1170051325 conn(0x5572afd414d0 msgr2=0x5572afd438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 -- 172.21.15.42:0/1170051325 shutdown_connections 2024-02-16T00:11:24.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.465+0000 7f2c03412800 1 -- 172.21.15.42:0/1170051325 wait complete. 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.476+0000 7f2c03412800 1 Processor -- start 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.476+0000 7f2c03412800 1 -- start start 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.476+0000 7f2c03412800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe35eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.476+0000 7f2c03412800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572afc46980 con 0x5572afd45e70 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2bfeb6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe35eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2bfeb6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe35eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59098/0 (socket says 172.21.15.42:59098) 2024-02-16T00:11:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/1311903430 learned_addr learned my addr 172.21.15.42:0/1311903430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/1311903430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4005d20 con 0x5572afd45e70 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/1311903430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe35eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006ea0 tx=0x7f2bf0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663be34eb2a2914d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2aece09640 1 -- 172.21.15.42:0/1311903430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0004520 con 0x5572afd45e70 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2aece09640 1 -- 172.21.15.42:0/1311903430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf00046a0 con 0x5572afd45e70 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.477+0000 7f2aece09640 1 -- 172.21.15.42:0/1311903430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0004890 con 0x5572afd45e70 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 -- 172.21.15.42:0/1311903430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 msgr2=0x5572afe35eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 --2- 172.21.15.42:0/1311903430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe35eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006ea0 tx=0x7f2bf0006f90 comp rx=0 tx=0).stop 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 -- 172.21.15.42:0/1311903430 shutdown_connections 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 --2- 172.21.15.42:0/1311903430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe35eb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 -- 172.21.15.42:0/1311903430 >> 172.21.15.42:0/1311903430 conn(0x5572afd414d0 msgr2=0x5572afe31650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 -- 172.21.15.42:0/1311903430 shutdown_connections 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 -- 172.21.15.42:0/1311903430 wait complete. 2024-02-16T00:11:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 Processor -- start 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.478+0000 7f2c03412800 1 -- start start 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2c03412800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe3d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2c03412800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572afc42160 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2bfeb6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe3d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2bfeb6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe3d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59100/0 (socket says 172.21.15.42:59100) 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/243677805 learned_addr learned my addr 172.21.15.42:0/243677805 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8001e10 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.479+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe3d3a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0001560 tx=0x7f2bf0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2aeb606640 1 -- 172.21.15.42:0/243677805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf00148b0 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2aeb606640 1 -- 172.21.15.42:0/243677805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0014a10 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572afe3d8e0 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2aeb606640 1 -- 172.21.15.42:0/243677805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0014d30 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572afe3ddc0 con 0x5572afd45e70 2024-02-16T00:11:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2aeb606640 1 -- 172.21.15.42:0/243677805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2bf001e420 con 0x5572afd45e70 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.480+0000 7f2aeb606640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ae40367e0 0x7f2ae4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2aeb606640 1 -- 172.21.15.42:0/243677805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2bf004c530 con 0x5572afd45e70 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ae40367e0 0x7f2ae4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afd4a300 0x5572afe440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe44670 con 0x5572afd4a300 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2bff370640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afd4a300 0x5572afe440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ae40367e0 0x7f2ae4038ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4054000 tx=0x7f2bf404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2bff370640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afd4a300 0x5572afe440a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2bff370640 1 -- 172.21.15.42:0/243677805 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf80083e0 con 0x5572afd4a300 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.481+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe41790 con 0x5572afd4a300 2024-02-16T00:11:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2bff370640 1 -- 172.21.15.42:0/243677805 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2bf80083e0 con 0x5572afd4a300 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe468b0 0x5572afe48ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe493a0 con 0x5572afe468b0 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe468b0 0x5572afe48ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe468b0 0x5572afe48ca0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/243677805 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2bf001e900 con 0x5572afe468b0 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.482+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe45800 con 0x5572afd4a300 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2bff370640 1 -- 172.21.15.42:0/243677805 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bf80083e0 con 0x5572afd4a300 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe45bf0 con 0x5572afd4a300 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2bff370640 1 -- 172.21.15.42:0/243677805 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2bf80083e0 con 0x5572afd4a300 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2c03412800 1 Processor -- start 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2c03412800 1 -- start start 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2c03412800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 0x5572afe5c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.483+0000 7f2c03412800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572afbe4e80 con 0x5572afe59e50 2024-02-16T00:11:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2bff370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 0x5572afe5c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2bff370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 0x5572afe5c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59104/0 (socket says 172.21.15.42:59104) 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2bff370640 1 -- 172.21.15.42:0/3442841840 learned_addr learned my addr 172.21.15.42:0/3442841840 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2bff370640 1 -- 172.21.15.42:0/3442841840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572afcba1b0 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2bff370640 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 0x5572afe5c240 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5572afe3e7a0 tx=0x7f2bf800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2ae8e01640 1 -- 172.21.15.42:0/3442841840 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf800f040 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2ae8e01640 1 -- 172.21.15.42:0/3442841840 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8007d20 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.484+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572afe5c780 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.485+0000 7f2ae8e01640 1 -- 172.21.15.42:0/3442841840 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8019420 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.485+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572afe5cbe0 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.485+0000 7f2ae8e01640 1 -- 172.21.15.42:0/3442841840 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2bf8019580 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.485+0000 7f2ae8e01640 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ad80367e0 0x7f2ad8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.485+0000 7f2ae8e01640 1 -- 172.21.15.42:0/3442841840 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2bf804e0b0 con 0x5572afe59e50 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.485+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ad80367e0 0x7f2ad8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2c03412800 1 Processor -- start 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2c03412800 1 -- start start 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ad80367e0 0x7f2ad8038ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0000f80 tx=0x7f2bf0026960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2c03412800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe57c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2c03412800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572afbba5d0 con 0x5572afe59510 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2bff370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe57c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2bff370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe57c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59106/0 (socket says 172.21.15.42:59106) 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2bff370640 1 -- 172.21.15.42:0/1481883732 learned_addr learned my addr 172.21.15.42:0/1481883732 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2bff370640 1 -- 172.21.15.42:0/1481883732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572afe599c0 con 0x5572afe59510 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.486+0000 7f2bff370640 1 --2- 172.21.15.42:0/1481883732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe57c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2bf804c400 tx=0x7f2bf80183b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a504890b06c4f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2ae27fc640 1 -- 172.21.15.42:0/1481883732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf80174e0 con 0x5572afe59510 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2ae27fc640 1 -- 172.21.15.42:0/1481883732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf804a070 con 0x5572afe59510 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2ae27fc640 1 -- 172.21.15.42:0/1481883732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8017df0 con 0x5572afe59510 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 -- 172.21.15.42:0/1481883732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 msgr2=0x5572afe57c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 --2- 172.21.15.42:0/1481883732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe57c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2bf804c400 tx=0x7f2bf80183b0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 -- 172.21.15.42:0/1481883732 shutdown_connections 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 --2- 172.21.15.42:0/1481883732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe57c40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 -- 172.21.15.42:0/1481883732 >> 172.21.15.42:0/1481883732 conn(0x5572afe627b0 msgr2=0x5572afe60810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 -- 172.21.15.42:0/1481883732 shutdown_connections 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 -- 172.21.15.42:0/1481883732 wait complete. 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 Processor -- start 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 -- start start 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.487+0000 7f2c03412800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe6f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2c03412800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572afe6fbb0 con 0x5572afe59510 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2bff370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe6f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2bff370640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe6f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59112/0 (socket says 172.21.15.42:59112) 2024-02-16T00:11:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 learned_addr learned my addr 172.21.15.42:0/3090998723 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572afe5cbe0 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2bff370640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe6f670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80183f0 tx=0x7f2bf804c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2ae0ff9640 1 -- 172.21.15.42:0/3090998723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8015c90 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2ae0ff9640 1 -- 172.21.15.42:0/3090998723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8015df0 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572afe6fdb0 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2ae0ff9640 1 -- 172.21.15.42:0/3090998723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8015550 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.488+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572afe70210 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2ae0ff9640 1 -- 172.21.15.42:0/3090998723 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2bf803b2b0 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2ae0ff9640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ac80367e0 0x7f2ac8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2ae0ff9640 1 -- 172.21.15.42:0/3090998723 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2bf8036c40 con 0x5572afe59510 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ac80367e0 0x7f2ac8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afe7b3a0 0x5572afe7d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe7dfb0 con 0x5572afe7b3a0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.489+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afe7b3a0 0x5572afe7d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ac80367e0 0x7f2ac8038ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5572afe49760 tx=0x7f2bf0034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afe7b3a0 0x5572afe7d860 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 20 realm 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe7e3a0 con 0x5572afe7b3a0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe7ebf0 con 0x5572afe7b3a0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.490+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe7ef50 con 0x5572afe7b3a0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe7fc60 0x5572afe82050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe825d0 con 0x5572afe7fc60 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2bff370640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe7fc60 0x5572afe82050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2bff370640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe7fc60 0x5572afe82050 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2bf8032070 con 0x5572afe7fc60 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 20 searching for the correct realm 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5572afe84530 0x5572afe869f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.491+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.492+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5572afe84530 0x5572afe869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.492+0000 7f2bfeb6f640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5572afe84530 0x5572afe869f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.492+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.492+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7fc60 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf8032070 con 0x5572afe7fc60 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bff370640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2bf8035020 0x7f2bf803e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2bf8035020 0x7f2bf803e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bfe36e640 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2bf8035020 0x7f2bf803e120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.493+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.494+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7fc60 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.495+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7fc60 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.496+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.497+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.498+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.498+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.498+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.498+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7fc60 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.498+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.498+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.499+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7fc60 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe84530 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x7f2bf8035020 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7b3a0 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.500+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe870c0 con 0x5572afe7fc60 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe83000 con 0x5572afe7b3a0 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe83410 con 0x5572afe7b3a0 2024-02-16T00:11:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe83830 con 0x5572afe7b3a0 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.501+0000 7f2c03412800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 zone default found 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 4 Realm: () 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 zonegroup default 2024-02-16T00:11:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe82ca0 con 0x7f2bf8035020 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe89470 con 0x5572afe84530 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe89840 con 0x5572afe84530 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 started sync module instance, tier type = 2024-02-16T00:11:24.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.502+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe88d50 con 0x5572afe7fc60 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.503+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.503+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93951065884848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe88cd0 con 0x5572afe7fc60 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.504+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8a5a0 con 0x5572afe7b3a0 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.504+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93951065884848] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.505+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.505+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93951065889888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8a520 con 0x5572afe7b3a0 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.505+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8af10 con 0x5572afe84530 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.506+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93951065889888] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.506+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.506+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93951065890944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8a4a0 con 0x5572afe84530 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.506+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8bd70 con 0x5572afe7fc60 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.507+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93951065890944] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.507+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.507+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93951065897168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8bcf0 con 0x5572afe7fc60 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.507+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8cbd0 con 0x5572afe7b3a0 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.508+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.508+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93951065897168] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.508+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93951065900848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8d030 con 0x5572afe7b3a0 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.508+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8c160 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.509+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.509+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93951065904560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8c160 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.509+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8e500 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.509+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93951065900848] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.510+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93951065904560] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.510+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.510+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93951065905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8e4c0 con 0x7f2bf8035020 2024-02-16T00:11:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.510+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8ccc0 con 0x7f2bf8035020 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93951065905616] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93951065907168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8ed50 con 0x7f2bf8035020 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=0 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=1 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=2 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=3 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=4 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=5 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.511+0000 7f2c03412800 20 add_watcher() i=6 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.512+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93951065907168] v27'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.512+0000 7f2c03412800 20 add_watcher() i=7 2024-02-16T00:11:24.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.512+0000 7f2c03412800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.512+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8ed20 con 0x5572afe7b3a0 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.512+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.512+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93951065911520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8f9a0 con 0x5572afe7b3a0 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.513+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93951065911520] v27'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.513+0000 7f2ab57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.513+0000 7f2c03412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.513+0000 7f2c03412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.513+0000 7f2c03412800 5 note: GC not initialized 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2a2ffff640 20 reqs_thread_entry: start 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2c03412800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2c03412800 20 Filter name: none 2024-02-16T00:11:24.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2a2dffb640 20 reqs_thread_entry: start 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2c03412800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afec3c00 con 0x5572afe7b3a0 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2c03412800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.514+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afec3c00 con 0x5572afe7fc60 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.515+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.515+0000 7f2ab57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.515+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93951065911520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afec3bc0 con 0x5572afe7b3a0 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.516+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93951065911520] v27'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.516+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93951065884848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afec3bc0 con 0x5572afe7fc60 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.517+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93951065884848] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.517+0000 7f2c03412800 20 remove_watcher() i=0 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.517+0000 7f2c03412800 2 removed watcher, disabling cache 2024-02-16T00:11:24.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.517+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93951065889888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afec3bc0 con 0x5572afe7b3a0 2024-02-16T00:11:24.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.519+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93951065889888] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.519+0000 7f2c03412800 20 remove_watcher() i=1 2024-02-16T00:11:24.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.519+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93951065890944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afec3bc0 con 0x5572afe84530 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.520+0000 7f2bfeb6f640 1 -- 172.21.15.42:0/3090998723 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93951065890944] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf0051040 con 0x5572afe84530 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.520+0000 7f2c03412800 20 remove_watcher() i=2 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.520+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93951065897168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe888b0 con 0x5572afe7fc60 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.521+0000 7f2bff370640 1 -- 172.21.15.42:0/3090998723 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93951065897168] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf805a040 con 0x5572afe7fc60 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.521+0000 7f2c03412800 20 remove_watcher() i=3 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.521+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93951065900848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8b8d0 con 0x5572afe7b3a0 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.522+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93951065900848] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x5572afe7b3a0 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.522+0000 7f2c03412800 20 remove_watcher() i=4 2024-02-16T00:11:24.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.522+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93951065904560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe888b0 con 0x7f2bf8035020 2024-02-16T00:11:24.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.523+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93951065904560] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.523+0000 7f2c03412800 20 remove_watcher() i=5 2024-02-16T00:11:24.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.523+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93951065905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8c730 con 0x7f2bf8035020 2024-02-16T00:11:24.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.524+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93951065905616] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.524+0000 7f2c03412800 20 remove_watcher() i=6 2024-02-16T00:11:24.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.524+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93951065907168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5572afe8b8d0 con 0x7f2bf8035020 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93951065907168] v27'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf4065040 con 0x7f2bf8035020 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 20 remove_watcher() i=7 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2bf8035020 msgr2=0x7f2bf803e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2bf8035020 0x7f2bf803e120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afe7b3a0 msgr2=0x5572afe7d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afe7b3a0 0x5572afe7d860 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe7fc60 msgr2=0x5572afe82050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe7fc60 0x5572afe82050 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5572afe84530 msgr2=0x5572afe869f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5572afe84530 0x5572afe869f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ac80367e0 msgr2=0x7f2ac8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ac80367e0 0x7f2ac8038ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5572afe49760 tx=0x7f2bf0034000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 msgr2=0x5572afe6f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2bfe36e640 1 -- 172.21.15.42:0/3090998723 reap_dead start 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe6f670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80183f0 tx=0x7f2bf804c390 comp rx=0 tx=0).stop 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 shutdown_connections 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3090998723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59510 0x5572afe6f670 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 >> 172.21.15.42:0/3090998723 conn(0x5572afe627b0 msgr2=0x5572afe607e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 shutdown_connections 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3090998723 wait complete. 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ad80367e0 msgr2=0x7f2ad8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ad80367e0 0x7f2ad8038ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0000f80 tx=0x7f2bf0026960 comp rx=0 tx=0).stop 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 msgr2=0x5572afe5c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 0x5572afe5c240 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5572afe3e7a0 tx=0x7f2bf800aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 shutdown_connections 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ad80367e0 0x7f2ad8038ca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 --2- 172.21.15.42:0/3442841840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afe59e50 0x5572afe5c240 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 >> 172.21.15.42:0/3442841840 conn(0x5572afe4c210 msgr2=0x5572afe4c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 shutdown_connections 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.525+0000 7f2c03412800 1 -- 172.21.15.42:0/3442841840 wait complete. 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afd4a300 msgr2=0x5572afe440a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afd4a300 0x5572afe440a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe468b0 msgr2=0x5572afe48ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe468b0 0x5572afe48ca0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ae40367e0 msgr2=0x7f2ae4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ae40367e0 0x7f2ae4038ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4054000 tx=0x7f2bf404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 msgr2=0x5572afe3d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe3d3a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0001560 tx=0x7f2bf0001250 comp rx=0 tx=0).stop 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 shutdown_connections 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5572afe468b0 0x5572afe48ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5572afd4a300 0x5572afe440a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2ae40367e0 0x7f2ae4038ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 --2- 172.21.15.42:0/243677805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5572afd45e70 0x5572afe3d3a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 >> 172.21.15.42:0/243677805 conn(0x5572afd414d0 msgr2=0x5572afe2fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 shutdown_connections 2024-02-16T00:11:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.526+0000 7f2c03412800 1 -- 172.21.15.42:0/243677805 wait complete. 2024-02-16T00:11:24.557 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-02-16T00:11:24.557 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T00:11:24.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-16T00:11:24.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-16T00:11:24.558 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-16T00:11:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.640 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.637+0000 7f4cdd810800 1 Processor -- start 2024-02-16T00:11:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.637+0000 7f4cdd810800 1 -- start start 2024-02-16T00:11:24.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cdd810800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5633dd73a3b0 0x5633dd742eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cdd810800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5633dd684bb0 con 0x5633dd738870 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cdd810800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5633dd63c450 con 0x5633dd73a3b0 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd86c1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5633dd73a3b0 0x5633dd742eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd8ec2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5633dd738870 0x5633dd738c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60322/0 (socket says 172.21.15.42:60322) 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3058882454 learned_addr learned my addr 172.21.15.42:0/3058882454 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd86c1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5633dd73a3b0 0x5633dd742eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59122/0 (socket says 172.21.15.42:59122) 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3058882454 >> v1:172.21.15.2:6789/0 conn(0x5633dd738870 legacy=0x5633dd738c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd7ec0640 1 -- 172.21.15.42:0/3058882454 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550276248 0 0) 0x5633dd684bb0 con 0x5633dd738870 2024-02-16T00:11:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.638+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3058882454 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633dd6ad1a0 con 0x5633dd73a3b0 2024-02-16T00:11:24.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.640+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3058882454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd73a3b0 0x5633dd742eb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc9283601bd170a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.640+0000 7f4cd7ec0640 1 -- 172.21.15.42:0/3058882454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc04ad40 con 0x5633dd73a3b0 2024-02-16T00:11:24.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.640+0000 7f4cd7ec0640 1 -- 172.21.15.42:0/3058882454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc052440 con 0x5633dd73a3b0 2024-02-16T00:11:24.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.640+0000 7f4cd7ec0640 1 -- 172.21.15.42:0/3058882454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc04aea0 con 0x5633dd73a3b0 2024-02-16T00:11:24.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 -- 172.21.15.42:0/3058882454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd73a3b0 msgr2=0x5633dd742eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3058882454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd73a3b0 0x5633dd742eb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:24.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 -- 172.21.15.42:0/3058882454 shutdown_connections 2024-02-16T00:11:24.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3058882454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd73a3b0 0x5633dd742eb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 -- 172.21.15.42:0/3058882454 >> 172.21.15.42:0/3058882454 conn(0x5633dd7344d0 msgr2=0x5633dd7368f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 -- 172.21.15.42:0/3058882454 shutdown_connections 2024-02-16T00:11:24.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.641+0000 7f4cdd810800 1 -- 172.21.15.42:0/3058882454 wait complete. 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.652+0000 7f4cdd810800 1 Processor -- start 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.652+0000 7f4cdd810800 1 -- start start 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.652+0000 7f4cdd810800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd82c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.652+0000 7f4cdd810800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633dd639980 con 0x5633dd738870 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4cd8ec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd82c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4cd8ec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd82c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59138/0 (socket says 172.21.15.42:59138) 2024-02-16T00:11:24.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/2843265983 learned_addr learned my addr 172.21.15.42:0/2843265983 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/2843265983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc005d20 con 0x5633dd738870 2024-02-16T00:11:24.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/2843265983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd82c150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8001630 tx=0x7f4cc8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d543e757e50652af server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4bc6e0d640 1 -- 172.21.15.42:0/2843265983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8003450 con 0x5633dd738870 2024-02-16T00:11:24.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4bc6e0d640 1 -- 172.21.15.42:0/2843265983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc80035b0 con 0x5633dd738870 2024-02-16T00:11:24.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.653+0000 7f4bc6e0d640 1 -- 172.21.15.42:0/2843265983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8003910 con 0x5633dd738870 2024-02-16T00:11:24.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 -- 172.21.15.42:0/2843265983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 msgr2=0x5633dd82c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 --2- 172.21.15.42:0/2843265983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd82c150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8001630 tx=0x7f4cc8001af0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 -- 172.21.15.42:0/2843265983 shutdown_connections 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 --2- 172.21.15.42:0/2843265983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd82c150 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 -- 172.21.15.42:0/2843265983 >> 172.21.15.42:0/2843265983 conn(0x5633dd7344d0 msgr2=0x5633dd827a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 -- 172.21.15.42:0/2843265983 shutdown_connections 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 -- 172.21.15.42:0/2843265983 wait complete. 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.654+0000 7f4cdd810800 1 Processor -- start 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cdd810800 1 -- start start 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cdd810800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd833810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cdd810800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633dd635160 con 0x5633dd738870 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cd8ec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd833810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cd8ec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd833810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59144/0 (socket says 172.21.15.42:59144) 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3515991094 learned_addr learned my addr 172.21.15.42:0/3515991094 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc8006cb0 con 0x5633dd738870 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd833810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8006fa0 tx=0x7f4cc8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4bc560a640 1 -- 172.21.15.42:0/3515991094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8013820 con 0x5633dd738870 2024-02-16T00:11:24.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4bc560a640 1 -- 172.21.15.42:0/3515991094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8013980 con 0x5633dd738870 2024-02-16T00:11:24.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.655+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633dd833d50 con 0x5633dd738870 2024-02-16T00:11:24.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.656+0000 7f4bc560a640 1 -- 172.21.15.42:0/3515991094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8013c20 con 0x5633dd738870 2024-02-16T00:11:24.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.656+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633dd834230 con 0x5633dd738870 2024-02-16T00:11:24.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.656+0000 7f4bc560a640 1 -- 172.21.15.42:0/3515991094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cc8028460 con 0x5633dd738870 2024-02-16T00:11:24.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.656+0000 7f4bc560a640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bc0036830 0x7f4bc0038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4bc560a640 1 -- 172.21.15.42:0/3515991094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4cc804c440 con 0x5633dd738870 2024-02-16T00:11:24.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bc0036830 0x7f4bc0038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd73a3b0 0x5633dd83a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd83ab40 con 0x5633dd73a3b0 2024-02-16T00:11:24.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd73a3b0 0x5633dd83a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bc0036830 0x7f4bc0038cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc054000 tx=0x7f4ccc04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd73a3b0 0x5633dd83a570 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3515991094 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd73a3b0 2024-02-16T00:11:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.657+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd837c00 con 0x5633dd73a3b0 2024-02-16T00:11:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3515991094 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd73a3b0 2024-02-16T00:11:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd83cd80 0x5633dd83f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd83f870 con 0x5633dd83cd80 2024-02-16T00:11:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd83cd80 0x5633dd83f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd83cd80 0x5633dd83f170 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3515991094 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd83cd80 2024-02-16T00:11:24.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.658+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd83bd00 con 0x5633dd73a3b0 2024-02-16T00:11:24.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3515991094 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd73a3b0 2024-02-16T00:11:24.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd83c0f0 con 0x5633dd73a3b0 2024-02-16T00:11:24.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3515991094 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd73a3b0 2024-02-16T00:11:24.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cdd810800 1 Processor -- start 2024-02-16T00:11:24.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cdd810800 1 -- start start 2024-02-16T00:11:24.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cdd810800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 0x5633dd84ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.659+0000 7f4cdd810800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633dd5d7e80 con 0x5633dd84e670 2024-02-16T00:11:24.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cd96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 0x5633dd84ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cd96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 0x5633dd84ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59150/0 (socket says 172.21.15.42:59150) 2024-02-16T00:11:24.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3947639418 learned_addr learned my addr 172.21.15.42:0/3947639418 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3947639418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633dd84efd0 con 0x5633dd84e670 2024-02-16T00:11:24.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 0x5633dd84ea90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5633dd834c10 tx=0x7f4cd000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4bbe7fc640 1 -- 172.21.15.42:0/3947639418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd000f040 con 0x5633dd84e670 2024-02-16T00:11:24.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4bbe7fc640 1 -- 172.21.15.42:0/3947639418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd0007d00 con 0x5633dd84e670 2024-02-16T00:11:24.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4bbe7fc640 1 -- 172.21.15.42:0/3947639418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd0019420 con 0x5633dd84e670 2024-02-16T00:11:24.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633dd84fa40 con 0x5633dd84e670 2024-02-16T00:11:24.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.660+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633dd84ff00 con 0x5633dd84e670 2024-02-16T00:11:24.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.661+0000 7f4bbe7fc640 1 -- 172.21.15.42:0/3947639418 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd00195d0 con 0x5633dd84e670 2024-02-16T00:11:24.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.661+0000 7f4bbe7fc640 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bb00367e0 0x7f4bb0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.661+0000 7f4bbe7fc640 1 -- 172.21.15.42:0/3947639418 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4cd004e0b0 con 0x5633dd84e670 2024-02-16T00:11:24.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.661+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bb00367e0 0x7f4bb0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cdd810800 1 Processor -- start 2024-02-16T00:11:24.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cdd810800 1 -- start start 2024-02-16T00:11:24.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bb00367e0 0x7f4bb0038ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5633dd83af40 tx=0x7f4cc8040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cdd810800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd85bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cdd810800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633dd5ad5d0 con 0x5633dd85b870 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cd96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd85bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cd96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd85bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59158/0 (socket says 172.21.15.42:59158) 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cd96c3640 1 -- 172.21.15.42:0/76740262 learned_addr learned my addr 172.21.15.42:0/76740262 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cd96c3640 1 -- 172.21.15.42:0/76740262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633dd85c260 con 0x5633dd85b870 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.662+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/76740262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd85bc90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4cd004c400 tx=0x7f4cd0015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4918ea40e2f8f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4baffff640 1 -- 172.21.15.42:0/76740262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd0017e00 con 0x5633dd85b870 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4baffff640 1 -- 172.21.15.42:0/76740262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd004a070 con 0x5633dd85b870 2024-02-16T00:11:24.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4baffff640 1 -- 172.21.15.42:0/76740262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd0018500 con 0x5633dd85b870 2024-02-16T00:11:24.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 -- 172.21.15.42:0/76740262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 msgr2=0x5633dd85bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 --2- 172.21.15.42:0/76740262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd85bc90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4cd004c400 tx=0x7f4cd0015760 comp rx=0 tx=0).stop 2024-02-16T00:11:24.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 -- 172.21.15.42:0/76740262 shutdown_connections 2024-02-16T00:11:24.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 --2- 172.21.15.42:0/76740262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd85bc90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 -- 172.21.15.42:0/76740262 >> 172.21.15.42:0/76740262 conn(0x5633dd857b90 msgr2=0x5633dd855bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 -- 172.21.15.42:0/76740262 shutdown_connections 2024-02-16T00:11:24.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 -- 172.21.15.42:0/76740262 wait complete. 2024-02-16T00:11:24.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 Processor -- start 2024-02-16T00:11:24.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.663+0000 7f4cdd810800 1 -- start start 2024-02-16T00:11:24.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cdd810800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd8628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cdd810800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633dd862de0 con 0x5633dd85b870 2024-02-16T00:11:24.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cd96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd8628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cd96c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd8628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59170/0 (socket says 172.21.15.42:59170) 2024-02-16T00:11:24.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 learned_addr learned my addr 172.21.15.42:0/3469935557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633dd84ff00 con 0x5633dd85b870 2024-02-16T00:11:24.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd8628a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0014ab0 tx=0x7f4cd004c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4bae7fc640 1 -- 172.21.15.42:0/3469935557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd0047040 con 0x5633dd85b870 2024-02-16T00:11:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4bae7fc640 1 -- 172.21.15.42:0/3469935557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00173b0 con 0x5633dd85b870 2024-02-16T00:11:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633dd862fe0 con 0x5633dd85b870 2024-02-16T00:11:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4bae7fc640 1 -- 172.21.15.42:0/3469935557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd0022700 con 0x5633dd85b870 2024-02-16T00:11:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.664+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633dd863440 con 0x5633dd85b870 2024-02-16T00:11:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4bae7fc640 1 -- 172.21.15.42:0/3469935557 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd003b250 con 0x5633dd85b870 2024-02-16T00:11:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4bae7fc640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba4036830 0x7f4ba4038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4bae7fc640 1 -- 172.21.15.42:0/3469935557 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4cd0036c90 con 0x5633dd85b870 2024-02-16T00:11:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba4036830 0x7f4ba4038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd86e560 0x5633dd870a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.665+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd871150 con 0x5633dd86e560 2024-02-16T00:11:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd86e560 0x5633dd870a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba4036830 0x7f4ba4038cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8001b30 tx=0x7f4cc801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd86e560 0x5633dd870a00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 realm 2024-02-16T00:11:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8714e0 con 0x5633dd86e560 2024-02-16T00:11:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd871d30 con 0x5633dd86e560 2024-02-16T00:11:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.666+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd872090 con 0x5633dd86e560 2024-02-16T00:11:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd872da0 0x5633dd875190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd875710 con 0x5633dd872da0 2024-02-16T00:11:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd872da0 0x5633dd875190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd872da0 0x5633dd875190 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 20 searching for the correct realm 2024-02-16T00:11:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.667+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5633dd8776c0 0x5633dd879b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.668+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.668+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5633dd8776c0 0x5633dd879b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.668+0000 7f4cd8ec2640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5633dd8776c0 0x5633dd879b60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.668+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.668+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd872da0 2024-02-16T00:11:24.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.669+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.669+0000 7f4cd96c3640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4cd0035070 0x7f4cd00250d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.669+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.669+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4cd0035070 0x7f4cd00250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.669+0000 7f4cd86c1640 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4cd0035070 0x7f4cd00250d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.670+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd872da0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.671+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd872da0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.672+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.673+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.673+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.673+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.673+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.673+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.673+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.674+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.674+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.674+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.674+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.674+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.674+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd872da0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.675+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd872da0 2024-02-16T00:11:24.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.676+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd8776c0 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x7f4cd0035070 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x7f4cd0035070 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd86e560 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a230 con 0x5633dd872da0 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.677+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8760e0 con 0x5633dd86e560 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd876520 con 0x5633dd86e560 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ccc0525b0 con 0x5633dd86e560 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd876900 con 0x5633dd86e560 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 zone default found 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 4 Realm: () 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 zonegroup default 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.678+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87a670 con 0x7f4cd0035070 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87c4f0 con 0x5633dd8776c0 2024-02-16T00:11:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87c850 con 0x5633dd8776c0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 started sync module instance, tier type = 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.679+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87b930 con 0x5633dd872da0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.680+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.680+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94780759979488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87c180 con 0x5633dd872da0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.680+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87d230 con 0x5633dd86e560 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.681+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94780759979488] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.681+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.681+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94780759981280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87d610 con 0x5633dd86e560 2024-02-16T00:11:24.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.681+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87e030 con 0x5633dd8776c0 2024-02-16T00:11:24.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.683+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.683+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94780759981280] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.683+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94780759985488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87e3e0 con 0x5633dd8776c0 2024-02-16T00:11:24.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.683+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87ee30 con 0x5633dd872da0 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.684+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94780759985488] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.684+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.684+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94780759992592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87f1e0 con 0x5633dd872da0 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.684+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87fc10 con 0x5633dd86e560 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.685+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.685+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94780759992592] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.685+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94780759996176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87fc10 con 0x5633dd86e560 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.685+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87db50 con 0x7f4cd0035070 2024-02-16T00:11:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.686+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.686+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94780760000128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87fc10 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.686+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd881590 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.686+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94780759996176] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.687+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94780760000128] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.687+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.687+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94780760001184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8810b0 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.687+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd881a20 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94780760001184] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94780759998272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd881a20 con 0x7f4cd0035070 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=0 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=1 2024-02-16T00:11:24.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=2 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=3 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=4 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=5 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=6 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94780759998272] v27'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 20 add_watcher() i=7 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.688+0000 7f4cdd810800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.689+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd881a20 con 0x5633dd86e560 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.689+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.689+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94780760006112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8826a0 con 0x5633dd86e560 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94780760006112] v27'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4b8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cdd810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:24.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cdd810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cdd810800 5 note: GC not initialized 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4b8dfe3640 20 reqs_thread_entry: start 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cdd810800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cdd810800 20 Filter name: none 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4aff7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.690+0000 7f4cdd810800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.691+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8b6ad0 con 0x5633dd86e560 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.691+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.691+0000 7f4cdd810800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.691+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8b6ad0 con 0x5633dd872da0 2024-02-16T00:11:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.691+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.692+0000 7f4b8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.692+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94780760006112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8b6a90 con 0x5633dd86e560 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.693+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94780760006112] v27'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.693+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94780759979488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8b6a90 con 0x5633dd872da0 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.694+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94780759979488] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.694+0000 7f4cdd810800 20 remove_watcher() i=0 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.694+0000 7f4cdd810800 2 removed watcher, disabling cache 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.694+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94780759981280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8b6a90 con 0x5633dd86e560 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.695+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94780759981280] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.695+0000 7f4cdd810800 20 remove_watcher() i=1 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.695+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94780759985488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd8b6a90 con 0x5633dd8776c0 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.696+0000 7f4cd8ec2640 1 -- 172.21.15.42:0/3469935557 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94780759985488] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc8024020 con 0x5633dd8776c0 2024-02-16T00:11:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.696+0000 7f4cdd810800 20 remove_watcher() i=2 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.696+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94780759992592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87b5e0 con 0x5633dd872da0 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.697+0000 7f4cd96c3640 1 -- 172.21.15.42:0/3469935557 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94780759992592] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd00083e0 con 0x5633dd872da0 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.697+0000 7f4cdd810800 20 remove_watcher() i=3 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.697+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94780759996176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87bce0 con 0x5633dd86e560 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.698+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94780759996176] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x5633dd86e560 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.698+0000 7f4cdd810800 20 remove_watcher() i=4 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.698+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94780760000128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87cd50 con 0x7f4cd0035070 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.699+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94780760000128] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.699+0000 7f4cdd810800 20 remove_watcher() i=5 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.699+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94780760001184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87b5e0 con 0x7f4cd0035070 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.700+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94780760001184] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.700+0000 7f4cdd810800 20 remove_watcher() i=6 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.700+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94780759998272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5633dd87f710 con 0x7f4cd0035070 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94780759998272] v27'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08d040 con 0x7f4cd0035070 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 20 remove_watcher() i=7 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4cd0035070 msgr2=0x7f4cd00250d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4cd0035070 0x7f4cd00250d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd86e560 msgr2=0x5633dd870a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd86e560 0x5633dd870a00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd872da0 msgr2=0x5633dd875190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd872da0 0x5633dd875190 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5633dd8776c0 msgr2=0x5633dd879b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5633dd8776c0 0x5633dd879b60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba4036830 msgr2=0x7f4ba4038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba4036830 0x7f4ba4038cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8001b30 tx=0x7f4cc801f000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 msgr2=0x5633dd8628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cd86c1640 1 -- 172.21.15.42:0/3469935557 reap_dead start 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd8628a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0014ab0 tx=0x7f4cd004c390 comp rx=0 tx=0).stop 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 shutdown_connections 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3469935557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd85b870 0x5633dd8628a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.701+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 >> 172.21.15.42:0/3469935557 conn(0x5633dd857b90 msgr2=0x5633dd8551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 shutdown_connections 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3469935557 wait complete. 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bb00367e0 msgr2=0x7f4bb0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bb00367e0 0x7f4bb0038ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5633dd83af40 tx=0x7f4cc8040040 comp rx=0 tx=0).stop 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 msgr2=0x5633dd84ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 0x5633dd84ea90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5633dd834c10 tx=0x7f4cd000aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 shutdown_connections 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bb00367e0 0x7f4bb0038ca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3947639418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd84e670 0x5633dd84ea90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 >> 172.21.15.42:0/3947639418 conn(0x5633dd842710 msgr2=0x5633dd842b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 shutdown_connections 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3947639418 wait complete. 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd73a3b0 msgr2=0x5633dd83a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd73a3b0 0x5633dd83a570 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd83cd80 msgr2=0x5633dd83f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd83cd80 0x5633dd83f170 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bc0036830 msgr2=0x7f4bc0038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bc0036830 0x7f4bc0038cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc054000 tx=0x7f4ccc04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 msgr2=0x5633dd833810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd833810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8006fa0 tx=0x7f4cc8001250 comp rx=0 tx=0).stop 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 shutdown_connections 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633dd83cd80 0x5633dd83f170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633dd73a3b0 0x5633dd83a570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bc0036830 0x7f4bc0038cf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 --2- 172.21.15.42:0/3515991094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633dd738870 0x5633dd833810 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 >> 172.21.15.42:0/3515991094 conn(0x5633dd7344d0 msgr2=0x5633dd826350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.702+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 shutdown_connections 2024-02-16T00:11:24.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.703+0000 7f4cdd810800 1 -- 172.21.15.42:0/3515991094 wait complete. 2024-02-16T00:11:24.739 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-02-16T00:11:24.739 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T00:11:24.754 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:24.754 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-16T00:11:24.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-16T00:11:24.754 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-16T00:11:24.822 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.822 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.820+0000 7ff3f7811800 1 Processor -- start 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.820+0000 7ff3f7811800 1 -- start start 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3f7811800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555d23a43280 0x555d23a45740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3f7811800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555d23989bb0 con 0x555d239b2100 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3f7811800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x555d23941450 con 0x555d23a43280 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3ea701640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555d23a43280 0x555d23a45740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3f2f02640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x555d239b2100 0x555d23a41b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60334/0 (socket says 172.21.15.42:60334) 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3ea701640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555d23a43280 0x555d23a45740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59186/0 (socket says 172.21.15.42:59186) 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3f2f02640 1 -- 172.21.15.42:0/1766560517 learned_addr learned my addr 172.21.15.42:0/1766560517 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3ea701640 1 -- 172.21.15.42:0/1766560517 >> v1:172.21.15.2:6789/0 conn(0x555d239b2100 legacy=0x555d23a41b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.821+0000 7ff3ea701640 1 -- 172.21.15.42:0/1766560517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d23a46e50 con 0x555d23a43280 2024-02-16T00:11:24.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.823+0000 7ff3ea701640 1 --2- 172.21.15.42:0/1766560517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23a43280 0x555d23a45740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00a470 tx=0x7ff3dc01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7de4985c5ed092 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.823+0000 7ff3f2701640 1 -- 172.21.15.42:0/1766560517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc052570 con 0x555d23a43280 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.823+0000 7ff3f2701640 1 -- 172.21.15.42:0/1766560517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0526d0 con 0x555d23a43280 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.823+0000 7ff3f2701640 1 -- 172.21.15.42:0/1766560517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc052990 con 0x555d23a43280 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 -- 172.21.15.42:0/1766560517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23a43280 msgr2=0x555d23a45740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 --2- 172.21.15.42:0/1766560517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23a43280 0x555d23a45740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00a470 tx=0x7ff3dc01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 -- 172.21.15.42:0/1766560517 shutdown_connections 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 --2- 172.21.15.42:0/1766560517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23a43280 0x555d23a45740 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 -- 172.21.15.42:0/1766560517 >> 172.21.15.42:0/1766560517 conn(0x555d23a394d0 msgr2=0x555d23a3b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 -- 172.21.15.42:0/1766560517 shutdown_connections 2024-02-16T00:11:24.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.824+0000 7ff3f7811800 1 -- 172.21.15.42:0/1766560517 wait complete. 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.835+0000 7ff3f7811800 1 Processor -- start 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.835+0000 7ff3f7811800 1 -- start start 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.835+0000 7ff3f7811800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b2ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.835+0000 7ff3f7811800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2393e980 con 0x555d239b2100 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.835+0000 7ff3f2f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b2ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff3f2f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b2ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59194/0 (socket says 172.21.15.42:59194) 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2224430200 learned_addr learned my addr 172.21.15.42:0/2224430200 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2224430200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc005d20 con 0x555d239b2100 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/2224430200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b2ef80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4001bc0 tx=0x7ff3e400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d0b045ba8a2ef8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff2e0e09640 1 -- 172.21.15.42:0/2224430200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e400e470 con 0x555d239b2100 2024-02-16T00:11:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff2e0e09640 1 -- 172.21.15.42:0/2224430200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400e5f0 con 0x555d239b2100 2024-02-16T00:11:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.836+0000 7ff2e0e09640 1 -- 172.21.15.42:0/2224430200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e400e950 con 0x555d239b2100 2024-02-16T00:11:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- 172.21.15.42:0/2224430200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 msgr2=0x555d23b2ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2224430200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b2ef80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4001bc0 tx=0x7ff3e400b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- 172.21.15.42:0/2224430200 shutdown_connections 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2224430200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b2ef80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- 172.21.15.42:0/2224430200 >> 172.21.15.42:0/2224430200 conn(0x555d23a394d0 msgr2=0x555d23b2a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- 172.21.15.42:0/2224430200 shutdown_connections 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- 172.21.15.42:0/2224430200 wait complete. 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 Processor -- start 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- start start 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b34490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.837+0000 7ff3f7811800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2393a160 con 0x555d239b2100 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f2f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f2f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b34490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59206/0 (socket says 172.21.15.42:59206) 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f2f02640 1 -- 172.21.15.42:0/891869241 learned_addr learned my addr 172.21.15.42:0/891869241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f2f02640 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d23989bb0 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b34490 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c010 tx=0x7ff3e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff2df606640 1 -- 172.21.15.42:0/891869241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e401f070 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff2df606640 1 -- 172.21.15.42:0/891869241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e40197c0 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d23b349d0 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff2df606640 1 -- 172.21.15.42:0/891869241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e4019a60 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.838+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d23b34e50 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.839+0000 7ff2df606640 1 -- 172.21.15.42:0/891869241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3e4019bc0 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.839+0000 7ff2df606640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2d803aba0 0x7ff2d803d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.839+0000 7ff2df606640 1 -- 172.21.15.42:0/891869241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff3e404c6d0 con 0x555d239b2100 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.839+0000 7ff3ea701640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2d803aba0 0x7ff2d803d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.839+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23a43280 0x555d23b3b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.839+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b3b770 con 0x555d23a43280 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.840+0000 7ff3f3703640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23a43280 0x555d23b3b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.840+0000 7ff3ea701640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2d803aba0 0x7ff2d803d060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc054000 tx=0x7ff3dc04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.840+0000 7ff3f3703640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23a43280 0x555d23b3b150 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.840+0000 7ff3f3703640 1 -- 172.21.15.42:0/891869241 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23a43280 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.840+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b388a0 con 0x555d23a43280 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.840+0000 7ff3f3703640 1 -- 172.21.15.42:0/891869241 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23a43280 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b3d9e0 0x555d23b3fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b404c0 con 0x555d23b3d9e0 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b3d9e0 0x555d23b3fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b3d9e0 0x555d23b3fdd0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f2f02640 1 -- 172.21.15.42:0/891869241 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff3e400d590 con 0x555d23b3d9e0 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b3c960 con 0x555d23a43280 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.841+0000 7ff3f3703640 1 -- 172.21.15.42:0/891869241 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23a43280 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.842+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b3cd50 con 0x555d23a43280 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.842+0000 7ff3f3703640 1 -- 172.21.15.42:0/891869241 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23a43280 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.842+0000 7ff3f7811800 1 Processor -- start 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.842+0000 7ff3f7811800 1 -- start start 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.842+0000 7ff3f7811800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 0x555d23b4f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.842+0000 7ff3f7811800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d238dce80 con 0x555d23b4f250 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f3703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 0x555d23b4f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f3703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 0x555d23b4f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59222/0 (socket says 172.21.15.42:59222) 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f3703640 1 -- 172.21.15.42:0/3105346002 learned_addr learned my addr 172.21.15.42:0/3105346002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f3703640 1 -- 172.21.15.42:0/3105346002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d23b4fbb0 con 0x555d23b4f250 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f3703640 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 0x555d23b4f670 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x555d23b35890 tx=0x7ff3ec018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff2dce01640 1 -- 172.21.15.42:0/3105346002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec01d070 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff2dce01640 1 -- 172.21.15.42:0/3105346002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec0182e0 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d23b50620 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff2dce01640 1 -- 172.21.15.42:0/3105346002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec0145a0 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.843+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d23b50ae0 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.844+0000 7ff2dce01640 1 -- 172.21.15.42:0/3105346002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3ec020020 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.844+0000 7ff2dce01640 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2cc0367e0 0x7ff2cc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.844+0000 7ff2dce01640 1 -- 172.21.15.42:0/3105346002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff3ec04dbe0 con 0x555d23b4f250 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.844+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2cc0367e0 0x7ff2cc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f7811800 1 Processor -- start 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f7811800 1 -- start start 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2cc0367e0 0x7ff2cc038ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x555d23b3bb40 tx=0x7ff3e404a9b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f7811800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b5c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f7811800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d238b25d0 con 0x555d23b5c490 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f3703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b5c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f3703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b5c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59236/0 (socket says 172.21.15.42:59236) 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f3703640 1 -- 172.21.15.42:0/2365350880 learned_addr learned my addr 172.21.15.42:0/2365350880 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f3703640 1 -- 172.21.15.42:0/2365350880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d23b5ce80 con 0x555d23b5c490 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff3f3703640 1 --2- 172.21.15.42:0/2365350880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b5c8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec04bf70 tx=0x7ff3ec04c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43439073049c6a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.845+0000 7ff2d67fc640 1 -- 172.21.15.42:0/2365350880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec016440 con 0x555d23b5c490 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff2d67fc640 1 -- 172.21.15.42:0/2365350880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec0165a0 con 0x555d23b5c490 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff2d67fc640 1 -- 172.21.15.42:0/2365350880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec004750 con 0x555d23b5c490 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 -- 172.21.15.42:0/2365350880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 msgr2=0x555d23b5c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2365350880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b5c8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec04bf70 tx=0x7ff3ec04c0b0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 -- 172.21.15.42:0/2365350880 shutdown_connections 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2365350880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b5c8b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 -- 172.21.15.42:0/2365350880 >> 172.21.15.42:0/2365350880 conn(0x555d23b587b0 msgr2=0x555d23b56810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 -- 172.21.15.42:0/2365350880 shutdown_connections 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 -- 172.21.15.42:0/2365350880 wait complete. 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 Processor -- start 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.846+0000 7ff3f7811800 1 -- start start 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f7811800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f7811800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d23b639f0 con 0x555d23b5c490 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f3703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f3703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59250/0 (socket says 172.21.15.42:59250) 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 learned_addr learned my addr 172.21.15.42:0/2983503479 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d23b50ae0 con 0x555d23b5c490 2024-02-16T00:11:24.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f3703640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b634b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec048010 tx=0x7ff3ec04bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff2d4ff9640 1 -- 172.21.15.42:0/2983503479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec034070 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff2d4ff9640 1 -- 172.21.15.42:0/2983503479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec013630 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d23b63bf0 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff2d4ff9640 1 -- 172.21.15.42:0/2983503479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec0116f0 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.847+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d23b64050 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff2d4ff9640 1 -- 172.21.15.42:0/2983503479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff3ec014910 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff2d4ff9640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2bc036790 0x7ff2bc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff2d4ff9640 1 -- 172.21.15.42:0/2983503479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff3ec02ecc0 con 0x555d23b5c490 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2bc036790 0x7ff2bc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23b6f130 0x555d23b715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.848+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b71d40 con 0x555d23b6f130 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3ea701640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23b6f130 0x555d23b715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2bc036790 0x7ff2bc038c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40238c0 tx=0x7ff3e4039000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3ea701640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23b6f130 0x555d23b715f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 20 realm 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b720d0 con 0x555d23b6f130 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.849+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b72950 con 0x555d23b6f130 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b72cb0 con 0x555d23b6f130 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b739c0 0x555d23b75db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b739c0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f3703640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b739c0 0x555d23b75db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.850+0000 7ff3f3703640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b739c0 0x555d23b75db0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f7811800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f7811800 20 searching for the correct realm 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555d23b78280 0x555d23b7a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7adf0 con 0x555d23b78280 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555d23b78280 0x555d23b7a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.851+0000 7ff3f2f02640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555d23b78280 0x555d23b7a720 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.852+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.852+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7adf0 con 0x555d23b739c0 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.852+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.852+0000 7ff3f3703640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3ec02bc20 0x7ff3ec023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.852+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.852+0000 7ff3ea701640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3ec02bc20 0x7ff3ec023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3ec02bc20 0x7ff3ec023420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.853+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b739c0 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.854+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b739c0 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.855+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.856+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.856+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.856+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.856+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.856+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.856+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.857+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b739c0 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.858+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b739c0 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.859+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b78280 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b6f130 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b762f0 con 0x555d23b739c0 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:24.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.860+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b76bf0 con 0x555d23b6f130 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b76fa0 con 0x555d23b6f130 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:24.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b77380 con 0x555d23b6f130 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 zone default found 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 4 Realm: () 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 zonegroup default 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7b230 con 0x7ff3ec02bc20 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.861+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7d0b0 con 0x555d23b78280 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7d410 con 0x555d23b78280 2024-02-16T00:11:24.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 20 started sync module instance, tier type = 2024-02-16T00:11:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.862+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c680 con 0x555d23b739c0 2024-02-16T00:11:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.863+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.863+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93858519567200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c680 con 0x555d23b739c0 2024-02-16T00:11:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.863+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7de30 con 0x555d23b6f130 2024-02-16T00:11:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.864+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93858519567200] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.864+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.864+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93858519570704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c680 con 0x555d23b6f130 2024-02-16T00:11:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.864+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7e8b0 con 0x555d23b78280 2024-02-16T00:11:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.866+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.866+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93858519570704] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.866+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93858519564768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c600 con 0x555d23b78280 2024-02-16T00:11:24.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.866+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7f710 con 0x555d23b739c0 2024-02-16T00:11:24.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.867+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.867+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93858519564768] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.867+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93858519577680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7ff30 con 0x555d23b739c0 2024-02-16T00:11:24.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.867+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7ec80 con 0x555d23b6f130 2024-02-16T00:11:24.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.868+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93858519577680] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.868+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.868+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93858519581920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7ec80 con 0x555d23b6f130 2024-02-16T00:11:24.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.868+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b80ec0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.869+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93858519581920] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.869+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.869+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93858519583136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b80e80 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.869+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b81920 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.870+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93858519583136] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.870+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.870+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93858519585792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b818e0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.870+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b82310 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93858519585792] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93858519588368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b822d0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=0 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=1 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=2 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=3 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=4 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=5 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.871+0000 7ff3f7811800 20 add_watcher() i=6 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.872+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93858519588368] v27'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.872+0000 7ff3f7811800 20 add_watcher() i=7 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.872+0000 7ff3f7811800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.872+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b85860 con 0x555d23b6f130 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.872+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.872+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93858519579024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b82b90 con 0x555d23b6f130 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.873+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93858519579024] v27'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.873+0000 7ff2a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.873+0000 7ff3f7811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.873+0000 7ff3f7811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.873+0000 7ff3f7811800 5 note: GC not initialized 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff223fff640 20 reqs_thread_entry: start 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3f7811800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3f7811800 20 Filter name: none 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff221ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3f7811800 20 rados->read ofs=0 len=0 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23bb72e0 con 0x555d23b6f130 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3f7811800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.874+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23bb87f0 con 0x555d23b739c0 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.875+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.875+0000 7ff2a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.875+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93858519579024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b847a0 con 0x555d23b6f130 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.876+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93858519579024] v27'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.876+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93858519567200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7f990 con 0x555d23b739c0 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.877+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93858519567200] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.877+0000 7ff3f7811800 20 remove_watcher() i=0 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.877+0000 7ff3f7811800 2 removed watcher, disabling cache 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.877+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93858519570704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7f990 con 0x555d23b6f130 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.879+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93858519570704] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.879+0000 7ff3f7811800 20 remove_watcher() i=1 2024-02-16T00:11:24.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.879+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93858519564768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7f990 con 0x555d23b78280 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.880+0000 7ff3f2f02640 1 -- 172.21.15.42:0/2983503479 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93858519564768] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e4036070 con 0x555d23b78280 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.880+0000 7ff3f7811800 20 remove_watcher() i=2 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.880+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93858519577680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c1e0 con 0x555d23b739c0 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.881+0000 7ff3f3703640 1 -- 172.21.15.42:0/2983503479 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93858519577680] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec00a4a0 con 0x555d23b739c0 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.881+0000 7ff3f7811800 20 remove_watcher() i=3 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.881+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93858519581920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7f450 con 0x555d23b6f130 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.882+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93858519581920] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x555d23b6f130 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.882+0000 7ff3f7811800 20 remove_watcher() i=4 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.882+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93858519583136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c1e0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.883+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93858519583136] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.883+0000 7ff3f7811800 20 remove_watcher() i=5 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.883+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93858519585792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7f450 con 0x7ff3ec02bc20 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.884+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93858519585792] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.884+0000 7ff3f7811800 20 remove_watcher() i=6 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.884+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93858519588368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555d23b7c1e0 con 0x7ff3ec02bc20 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93858519588368] v27'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3dc059040 con 0x7ff3ec02bc20 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 20 remove_watcher() i=7 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3ec02bc20 msgr2=0x7ff3ec023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff3ec02bc20 0x7ff3ec023420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23b6f130 msgr2=0x555d23b715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23b6f130 0x555d23b715f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b739c0 msgr2=0x555d23b75db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b739c0 0x555d23b75db0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555d23b78280 msgr2=0x555d23b7a720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555d23b78280 0x555d23b7a720 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2bc036790 msgr2=0x7ff2bc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2bc036790 0x7ff2bc038c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40238c0 tx=0x7ff3e4039000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3ea701640 1 -- 172.21.15.42:0/2983503479 reap_dead start 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 msgr2=0x555d23b634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b634b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec048010 tx=0x7ff3ec04bf00 comp rx=0 tx=0).stop 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 shutdown_connections 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 --2- 172.21.15.42:0/2983503479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b5c490 0x555d23b634b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 >> 172.21.15.42:0/2983503479 conn(0x555d23b587b0 msgr2=0x555d23b55e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 shutdown_connections 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.885+0000 7ff3f7811800 1 -- 172.21.15.42:0/2983503479 wait complete. 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2cc0367e0 msgr2=0x7ff2cc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2cc0367e0 0x7ff2cc038ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x555d23b3bb40 tx=0x7ff3e404a9b0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 msgr2=0x555d23b4f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 0x555d23b4f670 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x555d23b35890 tx=0x7ff3ec018830 comp rx=0 tx=0).stop 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 shutdown_connections 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2cc0367e0 0x7ff2cc038ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/3105346002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d23b4f250 0x555d23b4f670 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 >> 172.21.15.42:0/3105346002 conn(0x555d23b432f0 msgr2=0x555d23b436f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 shutdown_connections 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/3105346002 wait complete. 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23a43280 msgr2=0x555d23b3b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23a43280 0x555d23b3b150 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b3d9e0 msgr2=0x555d23b3fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b3d9e0 0x555d23b3fdd0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2d803aba0 msgr2=0x7ff2d803d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2d803aba0 0x7ff2d803d060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc054000 tx=0x7ff3dc04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 msgr2=0x555d23b34490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b34490 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c010 tx=0x7ff3e4000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 shutdown_connections 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555d23b3d9e0 0x555d23b3fdd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555d23a43280 0x555d23b3b150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff2d803aba0 0x7ff2d803d060 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 --2- 172.21.15.42:0/891869241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555d239b2100 0x555d23b34490 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 >> 172.21.15.42:0/891869241 conn(0x555d23a394d0 msgr2=0x555d23b29140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 shutdown_connections 2024-02-16T00:11:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.886+0000 7ff3f7811800 1 -- 172.21.15.42:0/891869241 wait complete. 2024-02-16T00:11:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:["myfoo"] 2024-02-16T00:11:24.913 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-16T00:11:24.919 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:24.919 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-16T00:11:24.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-16T00:11:24.919 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-16T00:11:24.993 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:24.993 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:24.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa864933800 1 Processor -- start 2024-02-16T00:11:24.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa864933800 1 -- start start 2024-02-16T00:11:24.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa864933800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55774bae0500 0x55774bae28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:24.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa864933800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55774ba26ba0 con 0x55774badc9f0 2024-02-16T00:11:24.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa864933800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55774b9de450 con 0x55774bae0500 2024-02-16T00:11:24.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa85fef8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55774bae0500 0x55774bae28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:24.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa8606f9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55774badc9f0 0x55774badede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60338/0 (socket says 172.21.15.42:60338) 2024-02-16T00:11:24.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa8606f9640 1 -- 172.21.15.42:0/3781103692 learned_addr learned my addr 172.21.15.42:0/3781103692 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:24.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa85fef8640 1 -- 172.21.15.42:0/3781103692 >> v1:172.21.15.2:6789/0 conn(0x55774badc9f0 legacy=0x55774badede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.991+0000 7fa85fef8640 1 -- 172.21.15.42:0/3781103692 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774bae3e40 con 0x55774bae0500 2024-02-16T00:11:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.993+0000 7fa85fef8640 1 --2- 172.21.15.42:0/3781103692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bae0500 0x55774bae28f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa85400a470 tx=0x7fa85401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e68fb50e3287e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.993+0000 7fa85f6f7640 1 -- 172.21.15.42:0/3781103692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa854052570 con 0x55774bae0500 2024-02-16T00:11:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.993+0000 7fa85f6f7640 1 -- 172.21.15.42:0/3781103692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540526d0 con 0x55774bae0500 2024-02-16T00:11:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.993+0000 7fa85f6f7640 1 -- 172.21.15.42:0/3781103692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa854052990 con 0x55774bae0500 2024-02-16T00:11:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 -- 172.21.15.42:0/3781103692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bae0500 msgr2=0x55774bae28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:24.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 --2- 172.21.15.42:0/3781103692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bae0500 0x55774bae28f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa85400a470 tx=0x7fa85401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:24.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 -- 172.21.15.42:0/3781103692 shutdown_connections 2024-02-16T00:11:24.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 --2- 172.21.15.42:0/3781103692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bae0500 0x55774bae28f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:24.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 -- 172.21.15.42:0/3781103692 >> 172.21.15.42:0/3781103692 conn(0x55774bad64c0 msgr2=0x55774bad88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:24.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 -- 172.21.15.42:0/3781103692 shutdown_connections 2024-02-16T00:11:24.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:24.994+0000 7fa864933800 1 -- 172.21.15.42:0/3781103692 wait complete. 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa864933800 1 Processor -- start 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa864933800 1 -- start start 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa864933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774badc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa864933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b9db980 con 0x55774badc9f0 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa8606f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774badc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa8606f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774badc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59270/0 (socket says 172.21.15.42:59270) 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.005+0000 7fa8606f9640 1 -- 172.21.15.42:0/3058163596 learned_addr learned my addr 172.21.15.42:0/3058163596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.006+0000 7fa8606f9640 1 -- 172.21.15.42:0/3058163596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854005d20 con 0x55774badc9f0 2024-02-16T00:11:25.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.006+0000 7fa8606f9640 1 --2- 172.21.15.42:0/3058163596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774badc330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa850001bc0 tx=0x7fa85000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536037dc5667575c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.006+0000 7fa74e60c640 1 -- 172.21.15.42:0/3058163596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa85000e470 con 0x55774badc9f0 2024-02-16T00:11:25.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.006+0000 7fa74e60c640 1 -- 172.21.15.42:0/3058163596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85000e5f0 con 0x55774badc9f0 2024-02-16T00:11:25.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.006+0000 7fa74e60c640 1 -- 172.21.15.42:0/3058163596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa85000e950 con 0x55774badc9f0 2024-02-16T00:11:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- 172.21.15.42:0/3058163596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 msgr2=0x55774badc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 --2- 172.21.15.42:0/3058163596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774badc330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa850001bc0 tx=0x7fa85000b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- 172.21.15.42:0/3058163596 shutdown_connections 2024-02-16T00:11:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 --2- 172.21.15.42:0/3058163596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774badc330 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- 172.21.15.42:0/3058163596 >> 172.21.15.42:0/3058163596 conn(0x55774bad64c0 msgr2=0x55774bbc7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- 172.21.15.42:0/3058163596 shutdown_connections 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- 172.21.15.42:0/3058163596 wait complete. 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 Processor -- start 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- start start 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774bbd5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa864933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b9d7160 con 0x55774badc9f0 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.007+0000 7fa8606f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774bbd5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa8606f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774bbd5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59272/0 (socket says 172.21.15.42:59272) 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa8606f9640 1 -- 172.21.15.42:0/1296815129 learned_addr learned my addr 172.21.15.42:0/1296815129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa8606f9640 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774ba26ba0 con 0x55774badc9f0 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa8606f9640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774bbd5820 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa85000b700 tx=0x7fa850000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa74ce09640 1 -- 172.21.15.42:0/1296815129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa85001f070 con 0x55774badc9f0 2024-02-16T00:11:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa74ce09640 1 -- 172.21.15.42:0/1296815129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8500197c0 con 0x55774badc9f0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa74ce09640 1 -- 172.21.15.42:0/1296815129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa850019a60 con 0x55774badc9f0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55774bbd5d60 con 0x55774badc9f0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.008+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55774bbd6240 con 0x55774badc9f0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa74ce09640 1 -- 172.21.15.42:0/1296815129 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa850019bc0 con 0x55774badc9f0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa74ce09640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa748036790 0x7fa748038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa74ce09640 1 -- 172.21.15.42:0/1296815129 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa85004c800 con 0x55774badc9f0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa85fef8640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa748036790 0x7fa748038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bae0500 0x55774bbdc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bbdcb50 con 0x55774bae0500 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.009+0000 7fa860efa640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bae0500 0x55774bbdc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa85fef8640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa748036790 0x7fa748038c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa854054000 tx=0x7fa85404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa860efa640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bae0500 0x55774bbdc580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa860efa640 1 -- 172.21.15.42:0/1296815129 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa85800a4a0 con 0x55774bae0500 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bbd9c30 con 0x55774bae0500 2024-02-16T00:11:25.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa860efa640 1 -- 172.21.15.42:0/1296815129 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa85800a4a0 con 0x55774bae0500 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bbdedc0 0x55774bbe11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bbe18a0 con 0x55774bbdedc0 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.010+0000 7fa8606f9640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bbdedc0 0x55774bbe11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.011+0000 7fa8606f9640 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bbdedc0 0x55774bbe11b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.011+0000 7fa8606f9640 1 -- 172.21.15.42:0/1296815129 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bbdedc0 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.011+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bbddd40 con 0x55774bae0500 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.011+0000 7fa860efa640 1 -- 172.21.15.42:0/1296815129 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa85800a4a0 con 0x55774bae0500 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.011+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bbde130 con 0x55774bae0500 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa860efa640 1 -- 172.21.15.42:0/1296815129 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa85800a4a0 con 0x55774bae0500 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa864933800 1 Processor -- start 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa864933800 1 -- start start 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa864933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 0x55774bbf0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa864933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b979e80 con 0x55774bbf0670 2024-02-16T00:11:25.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa860efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 0x55774bbf0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa860efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 0x55774bbf0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59280/0 (socket says 172.21.15.42:59280) 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.012+0000 7fa860efa640 1 -- 172.21.15.42:0/1186633733 learned_addr learned my addr 172.21.15.42:0/1186633733 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa860efa640 1 -- 172.21.15.42:0/1186633733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774bbf0fd0 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa860efa640 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 0x55774bbf0a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55774bbd6c20 tx=0x7fa858018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa745ffb640 1 -- 172.21.15.42:0/1186633733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa85801d070 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa745ffb640 1 -- 172.21.15.42:0/1186633733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8580182e0 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55774bbf1a40 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa745ffb640 1 -- 172.21.15.42:0/1186633733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8580145a0 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.013+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55774bbf1f00 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa745ffb640 1 -- 172.21.15.42:0/1186633733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa858020020 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa745ffb640 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7380367e0 0x7fa738038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa745ffb640 1 -- 172.21.15.42:0/1186633733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa85804db60 con 0x55774bbf0670 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa8606f9640 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7380367e0 0x7fa738038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa864933800 1 Processor -- start 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa864933800 1 -- start start 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.014+0000 7fa8606f9640 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7380367e0 0x7fa738038ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55774bbdcf20 tx=0x7fa85004aae0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa864933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bbfdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa864933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b94f5d0 con 0x55774bbfd920 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa860efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bbfdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa860efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bbfdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59292/0 (socket says 172.21.15.42:59292) 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa860efa640 1 -- 172.21.15.42:0/3473185659 learned_addr learned my addr 172.21.15.42:0/3473185659 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa860efa640 1 -- 172.21.15.42:0/3473185659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774bbfe310 con 0x55774bbfd920 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa860efa640 1 --2- 172.21.15.42:0/3473185659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bbfdd40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa85804bf70 tx=0x7fa858011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732d37c96ea2086 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa73f7fe640 1 -- 172.21.15.42:0/3473185659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa858004730 con 0x55774bbfd920 2024-02-16T00:11:25.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa73f7fe640 1 -- 172.21.15.42:0/3473185659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85802b350 con 0x55774bbfd920 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.015+0000 7fa73f7fe640 1 -- 172.21.15.42:0/3473185659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8580400d0 con 0x55774bbfd920 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- 172.21.15.42:0/3473185659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 msgr2=0x55774bbfdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 --2- 172.21.15.42:0/3473185659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bbfdd40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa85804bf70 tx=0x7fa858011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- 172.21.15.42:0/3473185659 shutdown_connections 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 --2- 172.21.15.42:0/3473185659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bbfdd40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- 172.21.15.42:0/3473185659 >> 172.21.15.42:0/3473185659 conn(0x55774bbf9c30 msgr2=0x55774bbf7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- 172.21.15.42:0/3473185659 shutdown_connections 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- 172.21.15.42:0/3473185659 wait complete. 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 Processor -- start 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- start start 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bc04880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa864933800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774bc04dc0 con 0x55774bbfd920 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa860efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bc04880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa860efa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bc04880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59308/0 (socket says 172.21.15.42:59308) 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.016+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 learned_addr learned my addr 172.21.15.42:0/2863431720 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774bbf1f00 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa860efa640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bc04880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa85804bed0 tx=0x7fa85804bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa73dffb640 1 -- 172.21.15.42:0/2863431720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa85802b4c0 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa73dffb640 1 -- 172.21.15.42:0/2863431720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858022740 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55774bc04fc0 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa73dffb640 1 -- 172.21.15.42:0/2863431720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8580229e0 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.017+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55774bc05480 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa73dffb640 1 -- 172.21.15.42:0/2863431720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa858022b40 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa73dffb640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7300367e0 0x7fa730038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa73dffb640 1 -- 172.21.15.42:0/2863431720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa85802f040 con 0x55774bbfd920 2024-02-16T00:11:25.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa8606f9640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7300367e0 0x7fa730038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bc10540 0x55774bc129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc13130 con 0x55774bc10540 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.018+0000 7fa85fef8640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bc10540 0x55774bc129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa8606f9640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7300367e0 0x7fa730038ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa85004ae70 tx=0x7fa850033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa85fef8640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bc10540 0x55774bc129e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 realm 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc13510 con 0x55774bc10540 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc13d60 con 0x55774bc10540 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.019+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc140c0 con 0x55774bc10540 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bc14dd0 0x55774bc171c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa860efa640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bc14dd0 0x55774bc171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa860efa640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bc14dd0 0x55774bc171c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa85804ddb0 con 0x55774bc14dd0 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 20 searching for the correct realm 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55774bc19720 0x55774bc1bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1c2b0 con 0x55774bc19720 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.020+0000 7fa8606f9640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55774bc19720 0x55774bc1bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.021+0000 7fa8606f9640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55774bc19720 0x55774bc1bbe0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.021+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.021+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1c2b0 con 0x55774bc14dd0 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.022+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa85804ddb0 con 0x55774bc14dd0 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.022+0000 7fa860efa640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa858014070 0x7fa858050a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.022+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.022+0000 7fa85fef8640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa858014070 0x7fa858050a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.022+0000 7fa85fef8640 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa858014070 0x7fa858050a50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.023+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa85804ddb0 con 0x55774bc14dd0 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.024+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.025+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.026+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.027+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.028+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.029+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc18040 con 0x55774bc10540 2024-02-16T00:11:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc183f0 con 0x55774bc10540 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc187d0 con 0x55774bc10540 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 zone default found 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 4 Realm: () 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 zonegroup default 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.030+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1c6f0 con 0x7fa858014070 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1e570 con 0x55774bc19720 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1e8d0 con 0x55774bc19720 2024-02-16T00:11:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 started sync module instance, tier type = 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.031+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1da00 con 0x55774bc14dd0 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.032+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.032+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93970860465888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1da00 con 0x55774bc14dd0 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.032+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1f2a0 con 0x55774bc10540 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.033+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93970860465888] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.034+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.034+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93970860469664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1da00 con 0x55774bc10540 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.034+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1fc90 con 0x55774bc19720 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.035+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.035+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93970860472304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc20490 con 0x55774bc19720 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.035+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc20f60 con 0x55774bc14dd0 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.035+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93970860469664] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.036+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93970860472304] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.036+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.036+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93970860474352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1d560 con 0x55774bc14dd0 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.036+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc21920 con 0x55774bc10540 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.037+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93970860474352] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.037+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.037+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93970860476992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc21920 con 0x55774bc10540 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.037+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc22290 con 0x7fa858014070 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.038+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93970860476992] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.038+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.038+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93970860480096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc22290 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.038+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc22c40 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.039+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93970860480096] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.039+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.039+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93970860484448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc22e20 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.039+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc23620 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93970860486656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc23a60 con 0x7fa858014070 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=0 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=1 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=2 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=3 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=4 2024-02-16T00:11:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93970860484448] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=5 2024-02-16T00:11:25.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.040+0000 7fa864933800 20 add_watcher() i=6 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.041+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93970860486656] v27'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.041+0000 7fa864933800 20 add_watcher() i=7 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.041+0000 7fa864933800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.041+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc21f30 con 0x55774bc10540 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.041+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.041+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93970860487936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc243d0 con 0x55774bc10540 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.042+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93970860487936] v27'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa7167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa864933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa864933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa864933800 5 note: GC not initialized 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa7157e2640 20 reqs_thread_entry: start 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa864933800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa864933800 20 Filter name: none 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa686ffd640 20 reqs_thread_entry: start 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.043+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc582b0 con 0x55774bc19720 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc582b0 con 0x55774bc19720 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc582b0 con 0x55774bc10540 2024-02-16T00:11:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc187d0 con 0x55774bc10540 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v27'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.044+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc187d0 con 0x55774bc14dd0 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=127b] v27'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.045+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.046+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.046+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.046+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.046+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.046+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.046+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.047+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x7fa858014070 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc19720 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(80 [pgnls start_epoch 27 out=70b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.048+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc10540 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc19720 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc14dd0 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.049+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x7fa858014070 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc10540 2024-02-16T00:11:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x7fa858014070 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc19720 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.050+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc14dd0 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x7fa858014070 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc10540 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc19720 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.051+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fa85408e040 con 0x55774bc14dd0 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.052+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.052+0000 7fa864933800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.052+0000 7fa864933800 20 RGWRados::pool_iterate: got myfoo 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.052+0000 7fa7167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.052+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93970860487936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc187d0 con 0x55774bc10540 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.053+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93970860487936] v27'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.053+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93970860465888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc14dd0 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.054+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93970860465888] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.054+0000 7fa864933800 20 remove_watcher() i=0 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.054+0000 7fa864933800 2 removed watcher, disabling cache 2024-02-16T00:11:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.054+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93970860469664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17740 con 0x55774bc10540 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.055+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93970860469664] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.055+0000 7fa864933800 20 remove_watcher() i=1 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.055+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93970860472304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc17720 con 0x55774bc19720 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.056+0000 7fa8606f9640 1 -- 172.21.15.42:0/2863431720 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93970860472304] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa850025cd0 con 0x55774bc19720 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.056+0000 7fa864933800 20 remove_watcher() i=2 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.056+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93970860474352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1dee0 con 0x55774bc14dd0 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.057+0000 7fa860efa640 1 -- 172.21.15.42:0/2863431720 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93970860474352] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa858061060 con 0x55774bc14dd0 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.057+0000 7fa864933800 20 remove_watcher() i=3 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.057+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93970860476992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1dee0 con 0x55774bc10540 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.058+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93970860476992] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x55774bc10540 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.059+0000 7fa864933800 20 remove_watcher() i=4 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.059+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93970860480096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1dee0 con 0x7fa858014070 2024-02-16T00:11:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.059+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93970860480096] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.060+0000 7fa864933800 20 remove_watcher() i=5 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.060+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93970860484448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc21660 con 0x7fa858014070 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.060+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93970860484448] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.060+0000 7fa864933800 20 remove_watcher() i=6 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.060+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93970860486656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55774bc1dee0 con 0x7fa858014070 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.061+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93970860486656] v27'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa854059040 con 0x7fa858014070 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.061+0000 7fa864933800 20 remove_watcher() i=7 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa858014070 msgr2=0x7fa858050a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa858014070 0x7fa858050a50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bc10540 msgr2=0x55774bc129e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bc10540 0x55774bc129e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bc14dd0 msgr2=0x55774bc171c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bc14dd0 0x55774bc171c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55774bc19720 msgr2=0x55774bc1bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55774bc19720 0x55774bc1bbe0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7300367e0 msgr2=0x7fa730038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7300367e0 0x7fa730038ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa85004ae70 tx=0x7fa850033000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 msgr2=0x55774bc04880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/2863431720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbfd920 0x55774bc04880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa85804bed0 tx=0x7fa85804bf00 comp rx=0 tx=0).stop 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 reap_dead start 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa85fef8640 1 -- 172.21.15.42:0/2863431720 reap_dead start 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 shutdown_connections 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 >> 172.21.15.42:0/2863431720 conn(0x55774bbf9c30 msgr2=0x55774bbf7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 shutdown_connections 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/2863431720 wait complete. 2024-02-16T00:11:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7380367e0 msgr2=0x7fa738038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7380367e0 0x7fa738038ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55774bbdcf20 tx=0x7fa85004aae0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 msgr2=0x55774bbf0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 0x55774bbf0a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55774bbd6c20 tx=0x7fa858018830 comp rx=0 tx=0).stop 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 shutdown_connections 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7380367e0 0x7fa738038ca0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 --2- 172.21.15.42:0/1186633733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774bbf0670 0x55774bbf0a90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 >> 172.21.15.42:0/1186633733 conn(0x55774bbe4710 msgr2=0x55774bbe4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 shutdown_connections 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.062+0000 7fa864933800 1 -- 172.21.15.42:0/1186633733 wait complete. 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bae0500 msgr2=0x55774bbdc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bae0500 0x55774bbdc580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bbdedc0 msgr2=0x55774bbe11b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bbdedc0 0x55774bbe11b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa748036790 msgr2=0x7fa748038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa748036790 0x7fa748038c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa854054000 tx=0x7fa85404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 msgr2=0x55774bbd5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774bbd5820 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa85000b700 tx=0x7fa850000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 shutdown_connections 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55774bbdedc0 0x55774bbe11b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55774bae0500 0x55774bbdc580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa748036790 0x7fa748038c50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 --2- 172.21.15.42:0/1296815129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55774badc9f0 0x55774bbd5820 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 >> 172.21.15.42:0/1296815129 conn(0x55774bad64c0 msgr2=0x55774badad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 shutdown_connections 2024-02-16T00:11:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.063+0000 7fa864933800 1 -- 172.21.15.42:0/1296815129 wait complete. 2024-02-16T00:11:25.091 INFO:teuthology.orchestra.run.smithi042.stdout:["myfoo"] 2024-02-16T00:11:25.091 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-16T00:11:25.101 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.110 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.119 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.164 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-02-16T00:11:25.192 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.219 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.246 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.246 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T00:11:25.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T00:11:25.247 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T00:11:25.289 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:25.289 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.286+0000 7f45a5e44800 1 Processor -- start 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.286+0000 7f45a5e44800 1 -- start start 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a5e44800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557e4b9d7510 0x557e4b9d9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a5e44800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557e4b91dbb0 con 0x557e4b9d3a00 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a5e44800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x557e4b8d5450 con 0x557e4b9d7510 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a3142640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x557e4b9d7510 0x557e4b9d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a3943640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x557e4b9d3a00 0x557e4b9d5df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60346/0 (socket says 172.21.15.42:60346) 2024-02-16T00:11:25.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a3943640 1 -- 172.21.15.42:0/1341295215 learned_addr learned my addr 172.21.15.42:0/1341295215 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:25.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a2941640 1 -- 172.21.15.42:0/1341295215 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6275640 0 0) 0x557e4b91dbb0 con 0x557e4b9d3a00 2024-02-16T00:11:25.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a2941640 1 -- 172.21.15.42:0/1341295215 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458c001e10 con 0x557e4b9d3a00 2024-02-16T00:11:25.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a3142640 1 -- 172.21.15.42:0/1341295215 >> v1:172.21.15.2:6789/0 conn(0x557e4b9d3a00 legacy=0x557e4b9d5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.287+0000 7f45a3142640 1 -- 172.21.15.42:0/1341295215 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e4b9dae50 con 0x557e4b9d7510 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.289+0000 7f45a3142640 1 --2- 172.21.15.42:0/1341295215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d7510 0x557e4b9d9900 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f459800a470 tx=0x7f459801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b3cee612dced34 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.289+0000 7f45a2941640 1 -- 172.21.15.42:0/1341295215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459804ad60 con 0x557e4b9d7510 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.289+0000 7f45a2941640 1 -- 172.21.15.42:0/1341295215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598052440 con 0x557e4b9d7510 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.289+0000 7f45a2941640 1 -- 172.21.15.42:0/1341295215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45980526e0 con 0x557e4b9d7510 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 -- 172.21.15.42:0/1341295215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d7510 msgr2=0x557e4b9d9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 --2- 172.21.15.42:0/1341295215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d7510 0x557e4b9d9900 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f459800a470 tx=0x7f459801cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 -- 172.21.15.42:0/1341295215 shutdown_connections 2024-02-16T00:11:25.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 --2- 172.21.15.42:0/1341295215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d7510 0x557e4b9d9900 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 -- 172.21.15.42:0/1341295215 >> 172.21.15.42:0/1341295215 conn(0x557e4b9cd4d0 msgr2=0x557e4b9cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 -- 172.21.15.42:0/1341295215 shutdown_connections 2024-02-16T00:11:25.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.290+0000 7f45a5e44800 1 -- 172.21.15.42:0/1341295215 wait complete. 2024-02-16T00:11:25.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.301+0000 7f45a5e44800 1 Processor -- start 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.301+0000 7f45a5e44800 1 -- start start 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.301+0000 7f45a5e44800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4bac2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.301+0000 7f45a5e44800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4b8d2980 con 0x557e4b9d3a00 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f45a3943640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4bac2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f45a3943640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4bac2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59314/0 (socket says 172.21.15.42:59314) 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f45a3943640 1 -- 172.21.15.42:0/3387699963 learned_addr learned my addr 172.21.15.42:0/3387699963 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f45a3943640 1 -- 172.21.15.42:0/3387699963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598005d20 con 0x557e4b9d3a00 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f45a3943640 1 --2- 172.21.15.42:0/3387699963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4bac2ef0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4594006dd0 tx=0x7f4594001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab99acbd3dd9072 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f4491e0b640 1 -- 172.21.15.42:0/3387699963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4594004520 con 0x557e4b9d3a00 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f4491e0b640 1 -- 172.21.15.42:0/3387699963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45940046a0 con 0x557e4b9d3a00 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.302+0000 7f4491e0b640 1 -- 172.21.15.42:0/3387699963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4594004a00 con 0x557e4b9d3a00 2024-02-16T00:11:25.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 -- 172.21.15.42:0/3387699963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 msgr2=0x557e4bac2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3387699963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4bac2ef0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4594006dd0 tx=0x7f4594001a20 comp rx=0 tx=0).stop 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 -- 172.21.15.42:0/3387699963 shutdown_connections 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3387699963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4bac2ef0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 -- 172.21.15.42:0/3387699963 >> 172.21.15.42:0/3387699963 conn(0x557e4b9cd4d0 msgr2=0x557e4babe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 -- 172.21.15.42:0/3387699963 shutdown_connections 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 -- 172.21.15.42:0/3387699963 wait complete. 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.303+0000 7f45a5e44800 1 Processor -- start 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a5e44800 1 -- start start 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a5e44800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4baca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a5e44800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4b8ce160 con 0x557e4b9d3a00 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a3943640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4baca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a3943640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4baca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59318/0 (socket says 172.21.15.42:59318) 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a3943640 1 -- 172.21.15.42:0/3144437110 learned_addr learned my addr 172.21.15.42:0/3144437110 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a3943640 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c001e10 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a3943640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4baca500 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4594006dd0 tx=0x7f4594000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f448bfff640 1 -- 172.21.15.42:0/3144437110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45940148b0 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f448bfff640 1 -- 172.21.15.42:0/3144437110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594014a10 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f448bfff640 1 -- 172.21.15.42:0/3144437110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4594014cf0 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.304+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e4bacaa40 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.305+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e4bacaf20 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.305+0000 7f448bfff640 1 -- 172.21.15.42:0/3144437110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f459401e420 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.305+0000 7f448bfff640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f448c036790 0x7f448c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.305+0000 7f448bfff640 1 -- 172.21.15.42:0/3144437110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f459404c230 con 0x557e4b9d3a00 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a3142640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f448c036790 0x7f448c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4b9d7510 0x557e4bad1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bad1810 con 0x557e4b9d7510 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a4144640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4b9d7510 0x557e4bad1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a3142640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f448c036790 0x7f448c038c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4598054000 tx=0x7f459804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a4144640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4b9d7510 0x557e4bad1240 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a4144640 1 -- 172.21.15.42:0/3144437110 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4b9d7510 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.306+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bace880 con 0x557e4b9d7510 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a4144640 1 -- 172.21.15.42:0/3144437110 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4b9d7510 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bad3a50 0x557e4bad5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bad6530 con 0x557e4bad3a50 2024-02-16T00:11:25.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a3943640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bad3a50 0x557e4bad5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a3943640 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bad3a50 0x557e4bad5e40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a3943640 1 -- 172.21.15.42:0/3144437110 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4594024070 con 0x557e4bad3a50 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.307+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bad29d0 con 0x557e4b9d7510 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.308+0000 7f45a4144640 1 -- 172.21.15.42:0/3144437110 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4b9d7510 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.308+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bad2dc0 con 0x557e4b9d7510 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.308+0000 7f45a4144640 1 -- 172.21.15.42:0/3144437110 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4b9d7510 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.308+0000 7f45a5e44800 1 Processor -- start 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.308+0000 7f45a5e44800 1 -- start start 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.308+0000 7f45a5e44800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 0x557e4b9d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a5e44800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4b870e80 con 0x557e4b9d3580 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a4144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 0x557e4b9d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a4144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 0x557e4b9d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59324/0 (socket says 172.21.15.42:59324) 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a4144640 1 -- 172.21.15.42:0/2913605261 learned_addr learned my addr 172.21.15.42:0/2913605261 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a4144640 1 -- 172.21.15.42:0/2913605261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e4b9d1f30 con 0x557e4b9d3580 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a4144640 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 0x557e4b9d19f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x557e4bacb8b0 tx=0x7f459c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f44897fa640 1 -- 172.21.15.42:0/2913605261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c00f040 con 0x557e4b9d3580 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f44897fa640 1 -- 172.21.15.42:0/2913605261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c007d00 con 0x557e4b9d3580 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f44897fa640 1 -- 172.21.15.42:0/2913605261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c019420 con 0x557e4b9d3580 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e4b9d2120 con 0x557e4b9d3580 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.309+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e4b9d25e0 con 0x557e4b9d3580 2024-02-16T00:11:25.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.310+0000 7f44897fa640 1 -- 172.21.15.42:0/2913605261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f459c019580 con 0x557e4b9d3580 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.310+0000 7f44897fa640 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f447c036830 0x7f447c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.310+0000 7f44897fa640 1 -- 172.21.15.42:0/2913605261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f459c04e040 con 0x557e4b9d3580 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.310+0000 7f45a3943640 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f447c036830 0x7f447c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a5e44800 1 Processor -- start 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a5e44800 1 -- start start 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a3943640 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f447c036830 0x7f447c038cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x557e4bad1c10 tx=0x7f4594040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a5e44800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4baf4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a5e44800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4b8465d0 con 0x557e4baf4880 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a4144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4baf4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a4144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4baf4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59336/0 (socket says 172.21.15.42:59336) 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a4144640 1 -- 172.21.15.42:0/759760275 learned_addr learned my addr 172.21.15.42:0/759760275 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a4144640 1 -- 172.21.15.42:0/759760275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e4baf5250 con 0x557e4baf4880 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f45a4144640 1 --2- 172.21.15.42:0/759760275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4baf4c80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f459c014870 tx=0x7f459c014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71ff2f248911aa1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f4482ffd640 1 -- 172.21.15.42:0/759760275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c0184e0 con 0x557e4baf4880 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.311+0000 7f4482ffd640 1 -- 172.21.15.42:0/759760275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c019c00 con 0x557e4baf4880 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f4482ffd640 1 -- 172.21.15.42:0/759760275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c040ad0 con 0x557e4baf4880 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 -- 172.21.15.42:0/759760275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 msgr2=0x557e4baf4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 --2- 172.21.15.42:0/759760275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4baf4c80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f459c014870 tx=0x7f459c014f30 comp rx=0 tx=0).stop 2024-02-16T00:11:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 -- 172.21.15.42:0/759760275 shutdown_connections 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 --2- 172.21.15.42:0/759760275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4baf4c80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 -- 172.21.15.42:0/759760275 >> 172.21.15.42:0/759760275 conn(0x557e4baf0b00 msgr2=0x557e4baeeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 -- 172.21.15.42:0/759760275 shutdown_connections 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 -- 172.21.15.42:0/759760275 wait complete. 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 Processor -- start 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 -- start start 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.312+0000 7f45a5e44800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4bafb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a5e44800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4bafbcb0 con 0x557e4baf4880 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a4144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4bafb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a4144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4bafb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59348/0 (socket says 172.21.15.42:59348) 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 learned_addr learned my addr 172.21.15.42:0/151834620 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e4b9d25e0 con 0x557e4baf4880 2024-02-16T00:11:25.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a4144640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4bafb770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f459c018fd0 tx=0x7f459c04c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f44817fa640 1 -- 172.21.15.42:0/151834620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c040070 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f44817fa640 1 -- 172.21.15.42:0/151834620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c031070 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f44817fa640 1 -- 172.21.15.42:0/151834620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f459c017710 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e4bafbeb0 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.313+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e4bafc310 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.314+0000 7f44817fa640 1 -- 172.21.15.42:0/151834620 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f459c017870 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.314+0000 7f44817fa640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f446c0367e0 0x7f446c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.314+0000 7f44817fa640 1 -- 172.21.15.42:0/151834620 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f459c038c70 con 0x557e4baf4880 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.314+0000 7f45a3943640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f446c0367e0 0x7f446c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.314+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.314+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4bb07490 0x557e4bb09950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0a0a0 con 0x557e4bb07490 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a3142640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4bb07490 0x557e4bb09950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a3943640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f446c0367e0 0x7f446c038ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4594007fd0 tx=0x7f4594033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a3142640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4bb07490 0x557e4bb09950 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 20 realm 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0a430 con 0x557e4bb07490 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.315+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0acb0 con 0x557e4bb07490 2024-02-16T00:11:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0b010 con 0x557e4bb07490 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bb0bd20 0x557e4bb0e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0e650 con 0x557e4bb0bd20 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a4144640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bb0bd20 0x557e4bb0e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a4144640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bb0bd20 0x557e4bb0e110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.316+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a5e44800 20 searching for the correct realm 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557e4bb10620 0x557e4bb12ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a3943640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557e4bb10620 0x557e4bb12ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a3943640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557e4bb10620 0x557e4bb12ae0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.317+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb0bd20 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a4144640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f459c019040 0x7f459c04c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a3142640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f459c019040 0x7f459c04c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a3142640 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f459c019040 0x7f459c04c670 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.318+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.319+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb0bd20 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.320+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb0bd20 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.321+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.322+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb0bd20 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.323+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb0bd20 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.324+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb10620 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.325+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.325+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x7f459c019040 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.325+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459800a0e0 con 0x7f459c019040 2024-02-16T00:11:25.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.325+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb07490 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.325+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.325+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb131b0 con 0x557e4bb0bd20 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0f0d0 con 0x557e4bb07490 2024-02-16T00:11:25.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0ed50 con 0x557e4bb07490 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f459800a0e0 con 0x557e4bb07490 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb0f9e0 con 0x557e4bb07490 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 zone default found 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 4 Realm: () 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:25.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 zonegroup default 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.326+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb135f0 con 0x7f459c019040 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb15470 con 0x557e4bb10620 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb157d0 con 0x557e4bb10620 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 started sync module instance, tier type = 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.327+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb14a40 con 0x557e4bb0bd20 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.328+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.328+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94000924151552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb14a40 con 0x557e4bb0bd20 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.328+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb16220 con 0x557e4bb07490 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.329+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94000924151552] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.330+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.330+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94000924155136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb14a40 con 0x557e4bb07490 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.330+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb16c70 con 0x557e4bb10620 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.331+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94000924155136] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.331+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.331+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94000924149152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb149c0 con 0x557e4bb10620 2024-02-16T00:11:25.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.331+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb17b00 con 0x557e4bb0bd20 2024-02-16T00:11:25.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.332+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94000924149152] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.332+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.332+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94000924161632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb17f20 con 0x557e4bb0bd20 2024-02-16T00:11:25.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.332+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb18890 con 0x557e4bb07490 2024-02-16T00:11:25.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.333+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94000924161632] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.333+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.333+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94000924165584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb17f20 con 0x557e4bb07490 2024-02-16T00:11:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.333+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb192f0 con 0x7f459c019040 2024-02-16T00:11:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.334+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.334+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94000924167648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb192f0 con 0x7f459c019040 2024-02-16T00:11:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.334+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb1a230 con 0x7f459c019040 2024-02-16T00:11:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.334+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94000924165584] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.335+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94000924167648] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.335+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.335+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94000924171536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb19550 con 0x7f459c019040 2024-02-16T00:11:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.335+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb1a690 con 0x7f459c019040 2024-02-16T00:11:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94000924171536] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94000924172784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb1a610 con 0x7f459c019040 2024-02-16T00:11:25.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=0 2024-02-16T00:11:25.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=1 2024-02-16T00:11:25.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=2 2024-02-16T00:11:25.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=3 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=4 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=5 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.336+0000 7f45a5e44800 20 add_watcher() i=6 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.337+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94000924172784] v27'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.337+0000 7f45a5e44800 20 add_watcher() i=7 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.337+0000 7f45a5e44800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.337+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb1dc20 con 0x557e4bb07490 2024-02-16T00:11:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.337+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.337+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94000924162688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb1afb0 con 0x557e4bb07490 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.338+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94000924162688] v27'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.338+0000 7f4459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 5 note: GC not initialized 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f4458fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:25.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 Filter name: none 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f43d27fc640 20 reqs_thread_entry: start 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb4fac0 con 0x557e4bb0bd20 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.339+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb503e0 con 0x557e4bb07490 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(63 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb50420 con 0x557e4bb0bd20 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb51b30 con 0x557e4bb07490 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.340+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 4.37 4:ee0f1f05:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb510f0 con 0x7f459c019040 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 4.15 4:abe4bfab:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb56310 con 0x557e4bb10620 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 4.2b 4:d618bfba:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb58ce0 con 0x557e4bb07490 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 4.15 4:aabdf911:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb5b690 con 0x557e4bb10620 2024-02-16T00:11:25.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 4.c 4:31d7e51e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb5e020 con 0x557e4bb07490 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 4.6 4:62d3c06f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb60ad0 con 0x557e4bb10620 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb63810 con 0x557e4bb10620 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 4.38 4:1ed234cf:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb66300 con 0x557e4bb07490 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:74 4.3d 4:bd5d1908:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb68ca0 con 0x557e4bb10620 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 4.21 4:85da9115:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb6bb10 con 0x7f459c019040 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 4.34 4:2ee72343:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb6e980 con 0x557e4bb0bd20 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(66 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(76 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(72 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(69 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(71 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.341+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(74 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.342+0000 7f45a5e44800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.342+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 6.d 6:b6a2947b:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb68ca0 con 0x557e4bb07490 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.342+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(77 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.342+0000 7f45a5e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.343+0000 7f4459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.343+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94000924162688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb39860 con 0x557e4bb07490 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.343+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94000924162688] v27'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.343+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94000924151552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb50bc0 con 0x557e4bb0bd20 2024-02-16T00:11:25.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.344+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94000924151552] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.344+0000 7f45a5e44800 20 remove_watcher() i=0 2024-02-16T00:11:25.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.344+0000 7f45a5e44800 2 removed watcher, disabling cache 2024-02-16T00:11:25.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.344+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94000924155136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb50bc0 con 0x557e4bb07490 2024-02-16T00:11:25.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.346+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94000924155136] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.346+0000 7f45a5e44800 20 remove_watcher() i=1 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.346+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94000924149152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb15d00 con 0x557e4bb10620 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.347+0000 7f45a3943640 1 -- 172.21.15.42:0/151834620 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94000924149152] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4594036030 con 0x557e4bb10620 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.347+0000 7f45a5e44800 20 remove_watcher() i=2 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.347+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94000924161632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb145a0 con 0x557e4bb0bd20 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.348+0000 7f45a4144640 1 -- 172.21.15.42:0/151834620 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94000924161632] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459c0083e0 con 0x557e4bb0bd20 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.348+0000 7f45a5e44800 20 remove_watcher() i=3 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.348+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94000924165584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb145a0 con 0x557e4bb07490 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.349+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94000924165584] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x557e4bb07490 2024-02-16T00:11:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.349+0000 7f45a5e44800 20 remove_watcher() i=4 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.349+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94000924167648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb145a0 con 0x7f459c019040 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.350+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94000924167648] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.350+0000 7f45a5e44800 20 remove_watcher() i=5 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.350+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94000924171536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb145a0 con 0x7f459c019040 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.351+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94000924171536] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.351+0000 7f45a5e44800 20 remove_watcher() i=6 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.351+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94000924172784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x557e4bb19d10 con 0x7f459c019040 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94000924172784] v27'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f459808d040 con 0x7f459c019040 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 20 remove_watcher() i=7 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f459c019040 msgr2=0x7f459c04c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f459c019040 0x7f459c04c670 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4bb07490 msgr2=0x557e4bb09950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4bb07490 0x557e4bb09950 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bb0bd20 msgr2=0x557e4bb0e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bb0bd20 0x557e4bb0e110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557e4bb10620 msgr2=0x557e4bb12ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x557e4bb10620 0x557e4bb12ae0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f446c0367e0 msgr2=0x7f446c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f446c0367e0 0x7f446c038ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4594007fd0 tx=0x7f4594033000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 msgr2=0x557e4bafb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a3142640 1 -- 172.21.15.42:0/151834620 reap_dead start 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4bafb770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f459c018fd0 tx=0x7f459c04c320 comp rx=0 tx=0).stop 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 shutdown_connections 2024-02-16T00:11:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/151834620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4baf4880 0x557e4bafb770 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 >> 172.21.15.42:0/151834620 conn(0x557e4baf0b00 msgr2=0x557e4baee160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 shutdown_connections 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/151834620 wait complete. 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f447c036830 msgr2=0x7f447c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f447c036830 0x7f447c038cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x557e4bad1c10 tx=0x7f4594040040 comp rx=0 tx=0).stop 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 msgr2=0x557e4b9d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.352+0000 7f45a5e44800 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 0x557e4b9d19f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x557e4bacb8b0 tx=0x7f459c00aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 shutdown_connections 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f447c036830 0x7f447c038cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/2913605261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3580 0x557e4b9d19f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 >> 172.21.15.42:0/2913605261 conn(0x557e4bad93b0 msgr2=0x557e4bad97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 shutdown_connections 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/2913605261 wait complete. 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4b9d7510 msgr2=0x557e4bad1240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4b9d7510 0x557e4bad1240 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bad3a50 msgr2=0x557e4bad5e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bad3a50 0x557e4bad5e40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f448c036790 msgr2=0x7f448c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f448c036790 0x7f448c038c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4598054000 tx=0x7f459804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 msgr2=0x557e4baca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4baca500 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4594006dd0 tx=0x7f4594000f40 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 shutdown_connections 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x557e4bad3a50 0x557e4bad5e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x557e4b9d7510 0x557e4bad1240 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f448c036790 0x7f448c038c50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 --2- 172.21.15.42:0/3144437110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e4b9d3a00 0x557e4baca500 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 >> 172.21.15.42:0/3144437110 conn(0x557e4b9cd4d0 msgr2=0x557e4babcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 shutdown_connections 2024-02-16T00:11:25.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.353+0000 7f45a5e44800 1 -- 172.21.15.42:0/3144437110 wait complete. 2024-02-16T00:11:25.394 INFO:teuthology.orchestra.run.smithi042.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7d041155-908e-42d6-a32d-d2f504649d95","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","marker":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T00:11:24.747887Z","creation_time":"2024-02-16T00:11:24.745033Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T00:11:25.395 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7d041155-908e-42d6-a32d-d2f504649d95', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'marker': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T00:11:24.747887Z', 'creation_time': '2024-02-16T00:11:24.745033Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T00:11:25.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-16T00:11:25.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-16T00:11:25.395 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-16T00:11:25.479 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:25.479 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:25.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92c4325800 1 Processor -- start 2024-02-16T00:11:25.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92c4325800 1 -- start start 2024-02-16T00:11:25.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92c4325800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562456ff8a80 0x562456ffae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92c4325800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562456f42bb0 con 0x562456ffb3b0 2024-02-16T00:11:25.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92c4325800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x562456efa450 con 0x562456ff8a80 2024-02-16T00:11:25.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92bff1b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562456ff8a80 0x562456ffae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92bff1b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562456ff8a80 0x562456ffae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59362/0 (socket says 172.21.15.42:59362) 2024-02-16T00:11:25.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92bff1b640 1 -- 172.21.15.42:0/3470657816 learned_addr learned my addr 172.21.15.42:0/3470657816 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92bf71a640 1 --1- 172.21.15.42:0/3470657816 >> v1:172.21.15.2:6789/0 conn(0x562456ffb3b0 0x562456ffd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60352/0 (socket says 172.21.15.42:60352) 2024-02-16T00:11:25.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92bff1b640 1 -- 172.21.15.42:0/3470657816 >> v1:172.21.15.2:6789/0 conn(0x562456ffb3b0 legacy=0x562456ffd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.477+0000 7f92bff1b640 1 -- 172.21.15.42:0/3470657816 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562456fffed0 con 0x562456ff8a80 2024-02-16T00:11:25.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.479+0000 7f92bff1b640 1 --2- 172.21.15.42:0/3470657816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ffae70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f92b000a520 tx=0x7f92b001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531552da6d911e7b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.479+0000 7f92bef19640 1 -- 172.21.15.42:0/3470657816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b0052570 con 0x562456ff8a80 2024-02-16T00:11:25.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.479+0000 7f92bef19640 1 -- 172.21.15.42:0/3470657816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b00526d0 con 0x562456ff8a80 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92bef19640 1 -- 172.21.15.42:0/3470657816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b0052990 con 0x562456ff8a80 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 -- 172.21.15.42:0/3470657816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 msgr2=0x562456ffae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 --2- 172.21.15.42:0/3470657816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ffae70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f92b000a520 tx=0x7f92b001cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 -- 172.21.15.42:0/3470657816 shutdown_connections 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 --2- 172.21.15.42:0/3470657816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ffae70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 -- 172.21.15.42:0/3470657816 >> 172.21.15.42:0/3470657816 conn(0x562456ff24d0 msgr2=0x562456ff48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 -- 172.21.15.42:0/3470657816 shutdown_connections 2024-02-16T00:11:25.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.480+0000 7f92c4325800 1 -- 172.21.15.42:0/3470657816 wait complete. 2024-02-16T00:11:25.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.491+0000 7f92c4325800 1 Processor -- start 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.491+0000 7f92c4325800 1 -- start start 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.491+0000 7f92c4325800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x5624570e7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.491+0000 7f92c4325800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562456ef7980 con 0x562456ff8a80 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f92bff1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x5624570e7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f92bff1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x5624570e7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59368/0 (socket says 172.21.15.42:59368) 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f92bff1b640 1 -- 172.21.15.42:0/2716500380 learned_addr learned my addr 172.21.15.42:0/2716500380 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f92bff1b640 1 -- 172.21.15.42:0/2716500380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0005de0 con 0x562456ff8a80 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f92bff1b640 1 --2- 172.21.15.42:0/2716500380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x5624570e7fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92b0055040 tx=0x7f92b004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32949e652c042f60 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f91ade0b640 1 -- 172.21.15.42:0/2716500380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b0052840 con 0x562456ff8a80 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f91ade0b640 1 -- 172.21.15.42:0/2716500380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b00529c0 con 0x562456ff8a80 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.492+0000 7f91ade0b640 1 -- 172.21.15.42:0/2716500380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b0052ca0 con 0x562456ff8a80 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 -- 172.21.15.42:0/2716500380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 msgr2=0x5624570e7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 --2- 172.21.15.42:0/2716500380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x5624570e7fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92b0055040 tx=0x7f92b004c000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 -- 172.21.15.42:0/2716500380 shutdown_connections 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 --2- 172.21.15.42:0/2716500380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x5624570e7fd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 -- 172.21.15.42:0/2716500380 >> 172.21.15.42:0/2716500380 conn(0x562456ff24d0 msgr2=0x5624570e38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 -- 172.21.15.42:0/2716500380 shutdown_connections 2024-02-16T00:11:25.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 -- 172.21.15.42:0/2716500380 wait complete. 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.493+0000 7f92c4325800 1 Processor -- start 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92c4325800 1 -- start start 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92c4325800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ff8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92c4325800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562456ef3160 con 0x562456ff8a80 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92bff1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ff8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92bff1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ff8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59384/0 (socket says 172.21.15.42:59384) 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92bff1b640 1 -- 172.21.15.42:0/4059172186 learned_addr learned my addr 172.21.15.42:0/4059172186 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92bff1b640 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562456fffed0 con 0x562456ff8a80 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f92bff1b640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ff8370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92b0005870 tx=0x7f92b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f91a7fff640 1 -- 172.21.15.42:0/4059172186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b006c070 con 0x562456ff8a80 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f91a7fff640 1 -- 172.21.15.42:0/4059172186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b005d690 con 0x562456ff8a80 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.494+0000 7f91a7fff640 1 -- 172.21.15.42:0/4059172186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b005d930 con 0x562456ff8a80 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.495+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562456ff88b0 con 0x562456ff8a80 2024-02-16T00:11:25.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.495+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562456ff6e60 con 0x562456ff8a80 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.495+0000 7f91a7fff640 1 -- 172.21.15.42:0/4059172186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f92b0059040 con 0x562456ff8a80 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.495+0000 7f91a7fff640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91a8036790 0x7f91a8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.495+0000 7f91a7fff640 1 -- 172.21.15.42:0/4059172186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f92b008d850 con 0x562456ff8a80 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92bf71a640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91a8036790 0x7f91a8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562456ffb3b0 0x5624570f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624570f8df0 con 0x562456ffb3b0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92c071c640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562456ffb3b0 0x5624570f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92bf71a640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91a8036790 0x7f91a8038c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000f60 tx=0x7f92b4001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92c071c640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562456ffb3b0 0x5624570f88b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92c071c640 1 -- 172.21.15.42:0/4059172186 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562456ffb3b0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.496+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624570f9150 con 0x562456ffb3b0 2024-02-16T00:11:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92c071c640 1 -- 172.21.15.42:0/4059172186 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f92b800a4a0 con 0x562456ffb3b0 2024-02-16T00:11:25.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5624570fab40 0x5624570fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624570fd770 con 0x5624570fab40 2024-02-16T00:11:25.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92bff1b640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5624570fab40 0x5624570fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92bff1b640 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5624570fab40 0x5624570fcfe0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92bff1b640 1 -- 172.21.15.42:0/4059172186 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f92b005c440 con 0x5624570fab40 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.497+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624570f9950 con 0x562456ffb3b0 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c071c640 1 -- 172.21.15.42:0/4059172186 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f92b800a4a0 con 0x562456ffb3b0 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624570f9d40 con 0x562456ffb3b0 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c071c640 1 -- 172.21.15.42:0/4059172186 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f92b800a4a0 con 0x562456ffb3b0 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c4325800 1 Processor -- start 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c4325800 1 -- start start 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c4325800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 0x56245710c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.498+0000 7f92c4325800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562456e95e80 con 0x56245710c5a0 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c071c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 0x56245710c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c071c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 0x56245710c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59392/0 (socket says 172.21.15.42:59392) 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c071c640 1 -- 172.21.15.42:0/2117773764 learned_addr learned my addr 172.21.15.42:0/2117773764 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c071c640 1 -- 172.21.15.42:0/2117773764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56245710cf00 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c071c640 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 0x56245710c9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x562456ff7d60 tx=0x7f92b8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f91a57fa640 1 -- 172.21.15.42:0/2117773764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b801d070 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f91a57fa640 1 -- 172.21.15.42:0/2117773764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8014450 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f91a57fa640 1 -- 172.21.15.42:0/2117773764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b8014710 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56245710d970 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.499+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56245710de30 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.500+0000 7f91a57fa640 1 -- 172.21.15.42:0/2117773764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f92b8020020 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.500+0000 7f91a57fa640 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9198036830 0x7f9198038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.500+0000 7f91a57fa640 1 -- 172.21.15.42:0/2117773764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f92b804dd80 con 0x56245710c5a0 2024-02-16T00:11:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.500+0000 7f92bff1b640 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9198036830 0x7f9198038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.500+0000 7f92c4325800 1 Processor -- start 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.500+0000 7f92c4325800 1 -- start start 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92bff1b640 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9198036830 0x7f9198038cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x562456ff79d0 tx=0x7f92b008bd10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c4325800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x562457119be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c4325800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562456e6b5d0 con 0x5624571197c0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c071c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x562457119be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c071c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x562457119be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59400/0 (socket says 172.21.15.42:59400) 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c071c640 1 -- 172.21.15.42:0/35631692 learned_addr learned my addr 172.21.15.42:0/35631692 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c071c640 1 -- 172.21.15.42:0/35631692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56245711a1b0 con 0x5624571197c0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f92c071c640 1 --2- 172.21.15.42:0/35631692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x562457119be0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f92b80149b0 tx=0x7f92b8011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70479b10990dffaf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f919effd640 1 -- 172.21.15.42:0/35631692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b80165c0 con 0x5624571197c0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f919effd640 1 -- 172.21.15.42:0/35631692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8014ba0 con 0x5624571197c0 2024-02-16T00:11:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.501+0000 7f919effd640 1 -- 172.21.15.42:0/35631692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b80133b0 con 0x5624571197c0 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- 172.21.15.42:0/35631692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 msgr2=0x562457119be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 --2- 172.21.15.42:0/35631692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x562457119be0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f92b80149b0 tx=0x7f92b8011f00 comp rx=0 tx=0).stop 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- 172.21.15.42:0/35631692 shutdown_connections 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 --2- 172.21.15.42:0/35631692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x562457119be0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- 172.21.15.42:0/35631692 >> 172.21.15.42:0/35631692 conn(0x562457115ae0 msgr2=0x562457113b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- 172.21.15.42:0/35631692 shutdown_connections 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- 172.21.15.42:0/35631692 wait complete. 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 Processor -- start 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- start start 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x5624571207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c4325800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562457120d30 con 0x5624571197c0 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c071c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x5624571207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c071c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x5624571207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59408/0 (socket says 172.21.15.42:59408) 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.502+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 learned_addr learned my addr 172.21.15.42:0/1150062705 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56245710de30 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f92c071c640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x5624571207f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f92b8043040 tx=0x7f92b804c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f919d7fa640 1 -- 172.21.15.42:0/1150062705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b8013850 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f919d7fa640 1 -- 172.21.15.42:0/1150062705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8014d10 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562457120f30 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f919d7fa640 1 -- 172.21.15.42:0/1150062705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b804d3e0 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.503+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562457121390 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f919d7fa640 1 -- 172.21.15.42:0/1150062705 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f92b8047070 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f919d7fa640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91880367e0 0x7f9188038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f919d7fa640 1 -- 172.21.15.42:0/1150062705 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f92b8052020 con 0x5624571197c0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f92bff1b640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91880367e0 0x7f9188038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56245712c460 0x56245712e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245712f070 con 0x56245712c460 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.504+0000 7f92bf71a640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56245712c460 0x56245712e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92bff1b640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91880367e0 0x7f9188038ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92b008d820 tx=0x7f92b0086000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92bf71a640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56245712c460 0x56245712e920 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 realm 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245712b9d0 con 0x56245712c460 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245712fb40 con 0x56245712c460 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.505+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457130050 con 0x56245712c460 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562457130e00 0x5624571331f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457133770 con 0x562457130e00 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c071c640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562457130e00 0x5624571331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c071c640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562457130e00 0x5624571331f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 20 searching for the correct realm 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562457135500 0x5624571378f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457137fa0 con 0x562457135500 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.506+0000 7f92bff1b640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562457135500 0x5624571378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.507+0000 7f92bff1b640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562457135500 0x5624571378f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.507+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.507+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457137fa0 con 0x562457130e00 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.507+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.507+0000 7f92c071c640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f92b8038070 0x7f92b802f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.507+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.508+0000 7f92bf71a640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f92b8038070 0x7f92b802f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.508+0000 7f92bf71a640 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f92b8038070 0x7f92b802f040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.508+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.508+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.508+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457130e00 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.509+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.510+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.510+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.510+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.510+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.510+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457130e00 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.511+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.512+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.513+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457130e00 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.514+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457130e00 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457135500 2024-02-16T00:11:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x7f92b8038070 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.515+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x56245712c460 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f92b8056060 con 0x562457130e00 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:25.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457133fe0 con 0x56245712c460 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457134390 con 0x56245712c460 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.516+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457134770 con 0x56245712c460 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 zone default found 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 4 Realm: () 2024-02-16T00:11:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 zonegroup default 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457134b60 con 0x7f92b8038070 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457139da0 con 0x562457135500 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.517+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713a100 con 0x562457135500 2024-02-16T00:11:25.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.518+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.518+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.518+0000 7f92c4325800 20 started sync module instance, tier type = 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.518+0000 7f92c4325800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.518+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457139680 con 0x562457130e00 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.519+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.519+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94714079711712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457139a30 con 0x562457130e00 2024-02-16T00:11:25.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.519+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713ada0 con 0x56245712c460 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.520+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94714079711712] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.520+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.520+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94714079716720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713af50 con 0x56245712c460 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.520+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713b9f0 con 0x562457135500 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.521+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94714079716720] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.521+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.521+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94714079720656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713bda0 con 0x562457135500 2024-02-16T00:11:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.521+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713c7d0 con 0x562457130e00 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.522+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.522+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94714079724240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713d060 con 0x562457130e00 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.522+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94714079720656] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.522+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713db10 con 0x56245712c460 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.523+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94714079724240] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.523+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.523+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94714079717920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713cb80 con 0x56245712c460 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.523+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713e0e0 con 0x7f92b8038070 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.524+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.524+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94714079730752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713e500 con 0x7f92b8038070 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.524+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94714079717920] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.524+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713ea80 con 0x7f92b8038070 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.525+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94714079730752] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.525+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.525+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94714079729168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713ec60 con 0x7f92b8038070 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.525+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713f460 con 0x7f92b8038070 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94714079729168] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94714079734880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713f520 con 0x7f92b8038070 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=0 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=1 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=2 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=3 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=4 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=5 2024-02-16T00:11:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.526+0000 7f92c4325800 20 add_watcher() i=6 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.527+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94714079734880] v27'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.527+0000 7f92c4325800 20 add_watcher() i=7 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.527+0000 7f92c4325800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.527+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624571429b0 con 0x56245712c460 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.528+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.528+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94714079748992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245713f690 con 0x56245712c460 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94714079748992] v27'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f9175fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f92c4325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f92c4325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f92c4325800 5 note: GC not initialized 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f9174fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f92c4325800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.529+0000 7f92c4325800 20 Filter name: none 2024-02-16T00:11:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f90ee7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457174410 con 0x56245712c460 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457174410 con 0x562457130e00 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.530+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457173130 con 0x562457130e00 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457175920 con 0x56245712c460 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 4.37 4:ee0f1f05:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457175370 con 0x7f92b8038070 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 4.15 4:abe4bfab:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245717a330 con 0x562457135500 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 4.2b 4:d618bfba:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245717cb50 con 0x56245712c460 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 4.15 4:aabdf911:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245717f450 con 0x562457135500 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 4.c 4:31d7e51e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457182180 con 0x56245712c460 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 4.6 4:62d3c06f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457184ae0 con 0x562457135500 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457187360 con 0x562457135500 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 4.38 4:1ed234cf:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457189f20 con 0x56245712c460 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:74 4.3d 4:bd5d1908:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56245718c860 con 0x562457135500 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(71 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 4.21 4:85da9115:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457181c90 con 0x7f92b8038070 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.531+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(66 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 4.34 4:2ee72343:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457174f80 con 0x562457130e00 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(72 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(74 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(69 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b400f610 con 0x56245712c460 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f92b400f610 con 0x7f92b8038070 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(76 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92c4325800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 6.d 6:b6a2947b:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5624571801b0 con 0x56245712c460 2024-02-16T00:11:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(77 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x56245712c460 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.532+0000 7f92c4325800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.533+0000 7f9175fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.533+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94714079748992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x56245712c460 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.534+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94714079748992] v27'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x56245712c460 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.534+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94714079711712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x562457130e00 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.535+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94714079711712] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.535+0000 7f92c4325800 20 remove_watcher() i=0 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.535+0000 7f92c4325800 2 removed watcher, disabling cache 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.535+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94714079716720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x56245712c460 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.536+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94714079716720] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x56245712c460 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.536+0000 7f92c4325800 20 remove_watcher() i=1 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.536+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94714079720656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x562457135500 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.537+0000 7f92bff1b640 1 -- 172.21.15.42:0/1150062705 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94714079720656] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b005c440 con 0x562457135500 2024-02-16T00:11:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.537+0000 7f92c4325800 20 remove_watcher() i=2 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.537+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94714079724240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x562457130e00 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.538+0000 7f92c071c640 1 -- 172.21.15.42:0/1150062705 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94714079724240] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b800a4a0 con 0x562457130e00 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.538+0000 7f92c4325800 20 remove_watcher() i=3 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.538+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94714079717920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x56245712c460 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.539+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94714079717920] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x56245712c460 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.539+0000 7f92c4325800 20 remove_watcher() i=4 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.539+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94714079730752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x7f92b8038070 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.540+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94714079730752] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x7f92b8038070 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.540+0000 7f92c4325800 20 remove_watcher() i=5 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.540+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94714079729168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x7f92b8038070 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.541+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94714079729168] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x7f92b8038070 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.541+0000 7f92c4325800 20 remove_watcher() i=6 2024-02-16T00:11:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.541+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94714079734880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562457172e20 con 0x7f92b8038070 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94714079734880] v27'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f92b4049040 con 0x7f92b8038070 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 20 remove_watcher() i=7 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f92b8038070 msgr2=0x7f92b802f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f92b8038070 0x7f92b802f040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56245712c460 msgr2=0x56245712e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56245712c460 0x56245712e920 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562457130e00 msgr2=0x5624571331f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562457130e00 0x5624571331f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562457135500 msgr2=0x5624571378f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562457135500 0x5624571378f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91880367e0 msgr2=0x7f9188038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91880367e0 0x7f9188038ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92b008d820 tx=0x7f92b0086000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 msgr2=0x5624571207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x5624571207f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f92b8043040 tx=0x7f92b804c060 comp rx=0 tx=0).stop 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92bf71a640 1 -- 172.21.15.42:0/1150062705 reap_dead start 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 shutdown_connections 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 --2- 172.21.15.42:0/1150062705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5624571197c0 0x5624571207f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 >> 172.21.15.42:0/1150062705 conn(0x562457115ae0 msgr2=0x562457113140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 shutdown_connections 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.542+0000 7f92c4325800 1 -- 172.21.15.42:0/1150062705 wait complete. 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9198036830 msgr2=0x7f9198038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9198036830 0x7f9198038cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x562456ff79d0 tx=0x7f92b008bd10 comp rx=0 tx=0).stop 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 msgr2=0x56245710c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 0x56245710c9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x562456ff7d60 tx=0x7f92b8018830 comp rx=0 tx=0).stop 2024-02-16T00:11:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 shutdown_connections 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9198036830 0x7f9198038cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/2117773764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56245710c5a0 0x56245710c9c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 >> 172.21.15.42:0/2117773764 conn(0x562457100640 msgr2=0x562457100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 shutdown_connections 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/2117773764 wait complete. 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562456ffb3b0 msgr2=0x5624570f88b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562456ffb3b0 0x5624570f88b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5624570fab40 msgr2=0x5624570fcfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5624570fab40 0x5624570fcfe0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91a8036790 msgr2=0x7f91a8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91a8036790 0x7f91a8038c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000f60 tx=0x7f92b4001370 comp rx=0 tx=0).stop 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 msgr2=0x562456ff8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ff8370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92b0005870 tx=0x7f92b0002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 shutdown_connections 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5624570fab40 0x5624570fcfe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562456ffb3b0 0x5624570f88b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f91a8036790 0x7f91a8038c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 --2- 172.21.15.42:0/4059172186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562456ff8a80 0x562456ff8370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 >> 172.21.15.42:0/4059172186 conn(0x562456ff24d0 msgr2=0x5624570e2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 shutdown_connections 2024-02-16T00:11:25.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.543+0000 7f92c4325800 1 -- 172.21.15.42:0/4059172186 wait complete. 2024-02-16T00:11:25.563 INFO:teuthology.orchestra.run.smithi042.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7d041155-908e-42d6-a32d-d2f504649d95","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","marker":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T00:11:24.747887Z","creation_time":"2024-02-16T00:11:24.745033Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-02-16T00:11:25.563 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7d041155-908e-42d6-a32d-d2f504649d95', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'marker': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T00:11:24.747887Z', 'creation_time': '2024-02-16T00:11:24.745033Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-02-16T00:11:25.570 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T00:11:25.570 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T00:11:25.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T00:11:25.570 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T00:11:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d3d42e800 1 Processor -- start 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d3d42e800 1 -- start start 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d3d42e800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e3e998300 0x561e3e99a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d3d42e800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561e3e8dfbb0 con 0x561e3e993e70 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d3d42e800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x561e3e897450 con 0x561e3e998300 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d37f32640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561e3e998300 0x561e3e99a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d38733640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561e3e993e70 0x561e3e994290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60364/0 (socket says 172.21.15.42:60364) 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.610+0000 7f3d38733640 1 -- 172.21.15.42:0/3617998648 learned_addr learned my addr 172.21.15.42:0/3617998648 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.611+0000 7f3d37731640 1 -- 172.21.15.42:0/3617998648 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266434699 0 0) 0x561e3e8dfbb0 con 0x561e3e993e70 2024-02-16T00:11:25.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.611+0000 7f3d37731640 1 -- 172.21.15.42:0/3617998648 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d20001e10 con 0x561e3e993e70 2024-02-16T00:11:25.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.611+0000 7f3d37f32640 1 -- 172.21.15.42:0/3617998648 >> v1:172.21.15.2:6789/0 conn(0x561e3e993e70 legacy=0x561e3e994290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.611+0000 7f3d37f32640 1 -- 172.21.15.42:0/3617998648 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3e99bd20 con 0x561e3e998300 2024-02-16T00:11:25.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.612+0000 7f3d37f32640 1 --2- 172.21.15.42:0/3617998648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e998300 0x561e3e99a6f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00a470 tx=0x7f3d2c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b36898546236ea8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d37731640 1 -- 172.21.15.42:0/3617998648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2c04ad60 con 0x561e3e998300 2024-02-16T00:11:25.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d37731640 1 -- 172.21.15.42:0/3617998648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c052440 con 0x561e3e998300 2024-02-16T00:11:25.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d37731640 1 -- 172.21.15.42:0/3617998648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2c0526e0 con 0x561e3e998300 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3617998648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e998300 msgr2=0x561e3e99a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3617998648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e998300 0x561e3e99a6f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00a470 tx=0x7f3d2c01cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3617998648 shutdown_connections 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3617998648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e998300 0x561e3e99a6f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3617998648 >> 172.21.15.42:0/3617998648 conn(0x561e3e98f4d0 msgr2=0x561e3e9918f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3617998648 shutdown_connections 2024-02-16T00:11:25.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.613+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3617998648 wait complete. 2024-02-16T00:11:25.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.624+0000 7f3d3d42e800 1 Processor -- start 2024-02-16T00:11:25.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d3d42e800 1 -- start start 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d3d42e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3e907f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d3d42e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3e894980 con 0x561e3e993e70 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d38733640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3e907f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d38733640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3e907f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59428/0 (socket says 172.21.15.42:59428) 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d38733640 1 -- 172.21.15.42:0/3461795117 learned_addr learned my addr 172.21.15.42:0/3461795117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d38733640 1 -- 172.21.15.42:0/3461795117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c005d20 con 0x561e3e993e70 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.625+0000 7f3d38733640 1 --2- 172.21.15.42:0/3461795117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3e907f30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3d28001c20 tx=0x7f3d2800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a43e08813c07b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3c2660c640 1 -- 172.21.15.42:0/3461795117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2800e470 con 0x561e3e993e70 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3c2660c640 1 -- 172.21.15.42:0/3461795117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800e5d0 con 0x561e3e993e70 2024-02-16T00:11:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3c2660c640 1 -- 172.21.15.42:0/3461795117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2800e930 con 0x561e3e993e70 2024-02-16T00:11:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3461795117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 msgr2=0x561e3e907f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3461795117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3e907f30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3d28001c20 tx=0x7f3d2800b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3461795117 shutdown_connections 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3461795117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3e907f30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3461795117 >> 172.21.15.42:0/3461795117 conn(0x561e3e98f4d0 msgr2=0x561e3ea7f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3461795117 shutdown_connections 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.626+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3461795117 wait complete. 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d3d42e800 1 Processor -- start 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d3d42e800 1 -- start start 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d3d42e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3ea8c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d3d42e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3e890160 con 0x561e3e993e70 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d38733640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3ea8c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d38733640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3ea8c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59434/0 (socket says 172.21.15.42:59434) 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d38733640 1 -- 172.21.15.42:0/1426557482 learned_addr learned my addr 172.21.15.42:0/1426557482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d38733640 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20001e10 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.627+0000 7f3d38733640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3ea8c550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x561e3e907560 tx=0x7f3d28000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.628+0000 7f3c24e09640 1 -- 172.21.15.42:0/1426557482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2801f070 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.628+0000 7f3c24e09640 1 -- 172.21.15.42:0/1426557482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28018770 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.628+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3ea8ca90 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.628+0000 7f3c24e09640 1 -- 172.21.15.42:0/1426557482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d28018a30 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.628+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3ea8cf70 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.628+0000 7f3c24e09640 1 -- 172.21.15.42:0/1426557482 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3d28018c20 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3c24e09640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c200367e0 0x7f3c20038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3c24e09640 1 -- 172.21.15.42:0/1426557482 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3d2804c450 con 0x561e3e993e70 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3d37f32640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c200367e0 0x7f3c20038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3e998300 0x561e3ea93290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ea93860 con 0x561e3e998300 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3d38f34640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3e998300 0x561e3ea93290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3d37f32640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c200367e0 0x7f3c20038ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c054000 tx=0x7f3d2c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.629+0000 7f3d38f34640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3e998300 0x561e3ea93290 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d38f34640 1 -- 172.21.15.42:0/1426557482 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3e998300 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ea90940 con 0x561e3e998300 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d38f34640 1 -- 172.21.15.42:0/1426557482 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3e998300 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3ea95aa0 0x561e3ea97e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ea98560 con 0x561e3ea95aa0 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d38733640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3ea95aa0 0x561e3ea97e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.630+0000 7f3d38733640 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3ea95aa0 0x561e3ea97e90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.631+0000 7f3d38733640 1 -- 172.21.15.42:0/1426557482 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3d28014070 con 0x561e3ea95aa0 2024-02-16T00:11:25.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.631+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ea94a20 con 0x561e3e998300 2024-02-16T00:11:25.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.631+0000 7f3d38f34640 1 -- 172.21.15.42:0/1426557482 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3e998300 2024-02-16T00:11:25.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.631+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ea94e30 con 0x561e3e998300 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.631+0000 7f3d38f34640 1 -- 172.21.15.42:0/1426557482 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3e998300 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d3d42e800 1 Processor -- start 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d3d42e800 1 -- start start 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d3d42e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 0x561e3eaa7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d3d42e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3e832e80 con 0x561e3eaa72e0 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d38f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 0x561e3eaa7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d38f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 0x561e3eaa7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59436/0 (socket says 172.21.15.42:59436) 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d38f34640 1 -- 172.21.15.42:0/2354712830 learned_addr learned my addr 172.21.15.42:0/2354712830 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.632+0000 7f3d38f34640 1 -- 172.21.15.42:0/2354712830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3eaa7c40 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3d38f34640 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 0x561e3eaa7700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561e3ea93bc0 tx=0x7f3d30018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3c1dffb640 1 -- 172.21.15.42:0/2354712830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d3001d070 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3c1dffb640 1 -- 172.21.15.42:0/2354712830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d300182e0 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3c1dffb640 1 -- 172.21.15.42:0/2354712830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d300145e0 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3eaa86b0 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3eaa8b70 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.633+0000 7f3c1dffb640 1 -- 172.21.15.42:0/2354712830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3d30020020 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3c1dffb640 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c100367e0 0x7f3c10038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3c1dffb640 1 -- 172.21.15.42:0/2354712830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3d3004db90 con 0x561e3eaa72e0 2024-02-16T00:11:25.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d38733640 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c100367e0 0x7f3c10038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d3d42e800 1 Processor -- start 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d3d42e800 1 -- start start 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d38733640 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c100367e0 0x7f3c10038ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x561e3ea93c30 tx=0x7f3d28018ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d3d42e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eab4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d3d42e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3e8085d0 con 0x561e3eab44e0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d38f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eab4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d38f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eab4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59442/0 (socket says 172.21.15.42:59442) 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.634+0000 7f3d38f34640 1 -- 172.21.15.42:0/2314381483 learned_addr learned my addr 172.21.15.42:0/2314381483 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d38f34640 1 -- 172.21.15.42:0/2314381483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3eab4ed0 con 0x561e3eab44e0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d38f34640 1 --2- 172.21.15.42:0/2314381483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eab4900 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d30013010 tx=0x7f3d30011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84e9898ded1210f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3c0f7fe640 1 -- 172.21.15.42:0/2314381483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d30040500 con 0x561e3eab44e0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3c0f7fe640 1 -- 172.21.15.42:0/2314381483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30014ac0 con 0x561e3eab44e0 2024-02-16T00:11:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3c0f7fe640 1 -- 172.21.15.42:0/2314381483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d3002b350 con 0x561e3eab44e0 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2314381483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 msgr2=0x561e3eab4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/2314381483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eab4900 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d30013010 tx=0x7f3d30011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2314381483 shutdown_connections 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/2314381483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eab4900 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2314381483 >> 172.21.15.42:0/2314381483 conn(0x561e3eab0840 msgr2=0x561e3eaae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.635+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2314381483 shutdown_connections 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2314381483 wait complete. 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d3d42e800 1 Processor -- start 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d3d42e800 1 -- start start 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d3d42e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eabb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d3d42e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3eabb9a0 con 0x561e3eab44e0 2024-02-16T00:11:25.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d38f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eabb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d38f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eabb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59450/0 (socket says 172.21.15.42:59450) 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 learned_addr learned my addr 172.21.15.42:0/3984004286 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.636+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3eaa8b70 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3d38f34640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eabb460 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d30014a40 tx=0x7f3d3004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3c0dffb640 1 -- 172.21.15.42:0/3984004286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d30032070 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3c0dffb640 1 -- 172.21.15.42:0/3984004286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30013c60 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e3eabbba0 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3c0dffb640 1 -- 172.21.15.42:0/3984004286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d300133b0 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3eabc000 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.637+0000 7f3c0dffb640 1 -- 172.21.15.42:0/3984004286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3d30013510 con 0x561e3eab44e0 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3c0dffb640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c000367e0 0x7f3c00038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3c0dffb640 1 -- 172.21.15.42:0/3984004286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3d30038c60 con 0x561e3eab44e0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d38733640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c000367e0 0x7f3c00038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3eac6f80 0x561e3eac9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eac9b90 con 0x561e3eac6f80 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d37f32640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3eac6f80 0x561e3eac9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d38733640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c000367e0 0x7f3c00038ca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d28016520 tx=0x7f3d28038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.638+0000 7f3d37f32640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3eac6f80 0x561e3eac9440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 realm 2024-02-16T00:11:25.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eac9f20 con 0x561e3eac6f80 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eaca7a0 con 0x561e3eac6f80 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eacab00 con 0x561e3eac6f80 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3eacb810 0x561e3eacdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eace140 con 0x561e3eacb810 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.639+0000 7f3d38f34640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3eacb810 0x561e3eacdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d38f34640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3eacb810 0x561e3eacdc00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d3d42e800 20 searching for the correct realm 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3eacfed0 0x561e3ead22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead2940 con 0x561e3eacfed0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d38733640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3eacfed0 0x561e3ead22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.640+0000 7f3d38733640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3eacfed0 0x561e3ead22c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.641+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.641+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead2940 con 0x561e3eacb810 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.641+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.641+0000 7f3d38f34640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3d30057040 0x7f3d30022740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.641+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.641+0000 7f3d37f32640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3d30057040 0x7f3d30022740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.642+0000 7f3d37f32640 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3d30057040 0x7f3d30022740 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.642+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.642+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.642+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.642+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.642+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacb810 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.643+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.644+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.644+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.644+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.644+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.645+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.645+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacb810 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.645+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.645+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.645+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.645+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.646+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.647+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacb810 2024-02-16T00:11:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.648+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.649+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.649+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacb810 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.649+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.649+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacfed0 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.649+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.649+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x7f3d30057040 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x7f3d30057040 2024-02-16T00:11:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eac6f80 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3d30055040 con 0x561e3eacb810 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.650+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eace9b0 con 0x561e3eac6f80 2024-02-16T00:11:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eaced60 con 0x561e3eac6f80 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d2c00a0e0 con 0x561e3eac6f80 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eacf140 con 0x561e3eac6f80 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 zone default found 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 4 Realm: () 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 zonegroup default 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eacf530 con 0x7f3d30057040 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.651+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead4740 con 0x561e3eacfed0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead4aa0 con 0x561e3eacfed0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 20 started sync module instance, tier type = 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.652+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead4020 con 0x561e3eacb810 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.653+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.653+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687900547968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead3fa0 con 0x561e3eacb810 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.653+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead5740 con 0x561e3eac6f80 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.654+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687900547968] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.654+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.654+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687900552704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead56c0 con 0x561e3eac6f80 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.654+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead6090 con 0x561e3eacfed0 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.655+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687900552704] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.656+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.656+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687900553760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead5640 con 0x561e3eacfed0 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.656+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead6ef0 con 0x561e3eacb810 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.657+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.657+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687900553760] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.657+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687900559952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead7310 con 0x561e3eacb810 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.657+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead7c80 con 0x561e3eac6f80 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.658+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.658+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687900559952] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.658+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687900561520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead7c80 con 0x561e3eac6f80 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.658+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead86c0 con 0x7f3d30057040 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.659+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.659+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687900565920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead8680 con 0x7f3d30057040 2024-02-16T00:11:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.659+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead95d0 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.659+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687900561520] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.660+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687900565920] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.660+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.660+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687900569872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead8860 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.660+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead9e50 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687900569872] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687900571728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eada110 con 0x7f3d30057040 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=0 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=1 2024-02-16T00:11:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=2 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=3 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=4 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=5 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=6 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687900571728] v27'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 20 add_watcher() i=7 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.661+0000 7f3d3d42e800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.662+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eadd140 con 0x561e3eac6f80 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.662+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.662+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687900572784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eada5a0 con 0x561e3eac6f80 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687900572784] v27'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3bee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 5 note: GC not initialized 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3bed7e2640 20 reqs_thread_entry: start 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 20 Filter name: none 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3b5effd640 20 reqs_thread_entry: start 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.663+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb0ee80 con 0x561e3eacb810 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb0f750 con 0x561e3eac6f80 2024-02-16T00:11:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(63 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb0e4c0 con 0x561e3eacb810 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.664+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb10f20 con 0x561e3eac6f80 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 4.37 4:ee0f1f05:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb10500 con 0x7f3d30057040 2024-02-16T00:11:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 4.15 4:abe4bfab:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb15a40 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 4.2b 4:d618bfba:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb18260 con 0x561e3eac6f80 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 4.15 4:aabdf911:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb1aba0 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 4.c 4:31d7e51e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb1d900 con 0x561e3eac6f80 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 4.6 4:62d3c06f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb20610 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb230a0 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 4.38 4:1ed234cf:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb259b0 con 0x561e3eac6f80 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:74 4.3d 4:bd5d1908:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb281d0 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 4.21 4:85da9115:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb2af30 con 0x7f3d30057040 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 4.34 4:2ee72343:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb2dbb0 con 0x561e3eacb810 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(71 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(76 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(72 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(69 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(66 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.665+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.666+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(74 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.666+0000 7f3d3d42e800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.666+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 6.d 6:b6a2947b:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb2a910 con 0x561e3eac6f80 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.666+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(77 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.666+0000 7f3d3d42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.667+0000 7f3bee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.667+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687900572784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3eb1d2c0 con 0x561e3eac6f80 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.668+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94687900572784] v27'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.668+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687900547968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead9c70 con 0x561e3eacb810 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.668+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94687900547968] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.669+0000 7f3d3d42e800 20 remove_watcher() i=0 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.669+0000 7f3d3d42e800 2 removed watcher, disabling cache 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.669+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687900552704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead9c70 con 0x561e3eac6f80 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.670+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94687900552704] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.670+0000 7f3d3d42e800 20 remove_watcher() i=1 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.670+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687900553760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead4e00 con 0x561e3eacfed0 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.671+0000 7f3d38733640 1 -- 172.21.15.42:0/3984004286 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94687900553760] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d28035070 con 0x561e3eacfed0 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.671+0000 7f3d3d42e800 20 remove_watcher() i=2 2024-02-16T00:11:25.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.671+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687900559952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead9c70 con 0x561e3eacb810 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.672+0000 7f3d38f34640 1 -- 172.21.15.42:0/3984004286 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94687900559952] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d3000a4a0 con 0x561e3eacb810 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.672+0000 7f3d3d42e800 20 remove_watcher() i=3 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.672+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687900561520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead6a50 con 0x561e3eac6f80 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.673+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94687900561520] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x561e3eac6f80 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.673+0000 7f3d3d42e800 20 remove_watcher() i=4 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.673+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687900565920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead9c70 con 0x7f3d30057040 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.674+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94687900565920] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.674+0000 7f3d3d42e800 20 remove_watcher() i=5 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.674+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687900569872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead7070 con 0x7f3d30057040 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.675+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94687900569872] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.675+0000 7f3d3d42e800 20 remove_watcher() i=6 2024-02-16T00:11:25.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.675+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687900571728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x561e3ead6a50 con 0x7f3d30057040 2024-02-16T00:11:25.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.675+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94687900571728] v27'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2c08d040 con 0x7f3d30057040 2024-02-16T00:11:25.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.675+0000 7f3d3d42e800 20 remove_watcher() i=7 2024-02-16T00:11:25.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3d30057040 msgr2=0x7f3d30022740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3d30057040 0x7f3d30022740 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3eac6f80 msgr2=0x561e3eac9440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3eac6f80 0x561e3eac9440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3eacb810 msgr2=0x561e3eacdc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3eacb810 0x561e3eacdc00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3eacfed0 msgr2=0x561e3ead22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561e3eacfed0 0x561e3ead22c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c000367e0 msgr2=0x7f3c00038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c000367e0 0x7f3c00038ca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d28016520 tx=0x7f3d28038000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 msgr2=0x561e3eabb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/3984004286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eab44e0 0x561e3eabb460 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d30014a40 tx=0x7f3d3004bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 reap_dead start 2024-02-16T00:11:25.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d37f32640 1 -- 172.21.15.42:0/3984004286 reap_dead start 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 shutdown_connections 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 >> 172.21.15.42:0/3984004286 conn(0x561e3eab0840 msgr2=0x561e3eaadea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 shutdown_connections 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/3984004286 wait complete. 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c100367e0 msgr2=0x7f3c10038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c100367e0 0x7f3c10038ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x561e3ea93c30 tx=0x7f3d28018ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 msgr2=0x561e3eaa7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 0x561e3eaa7700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561e3ea93bc0 tx=0x7f3d30018830 comp rx=0 tx=0).stop 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 shutdown_connections 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c100367e0 0x7f3c10038ca0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/2354712830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3eaa72e0 0x561e3eaa7700 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 >> 172.21.15.42:0/2354712830 conn(0x561e3ea9b380 msgr2=0x561e3ea9b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 shutdown_connections 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.676+0000 7f3d3d42e800 1 -- 172.21.15.42:0/2354712830 wait complete. 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3e998300 msgr2=0x561e3ea93290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3e998300 0x561e3ea93290 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3ea95aa0 msgr2=0x561e3ea97e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3ea95aa0 0x561e3ea97e90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c200367e0 msgr2=0x7f3c20038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c200367e0 0x7f3c20038ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c054000 tx=0x7f3d2c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 msgr2=0x561e3ea8c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3ea8c550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x561e3e907560 tx=0x7f3d28000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 shutdown_connections 2024-02-16T00:11:25.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561e3ea95aa0 0x561e3ea97e90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561e3e998300 0x561e3ea93290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3c200367e0 0x7f3c20038ca0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 --2- 172.21.15.42:0/1426557482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e3e993e70 0x561e3ea8c550 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 >> 172.21.15.42:0/1426557482 conn(0x561e3e98f4d0 msgr2=0x561e3ea7de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 shutdown_connections 2024-02-16T00:11:25.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.677+0000 7f3d3d42e800 1 -- 172.21.15.42:0/1426557482 wait complete. 2024-02-16T00:11:25.699 INFO:teuthology.orchestra.run.smithi042.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7d041155-908e-42d6-a32d-d2f504649d95","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","marker":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T00:11:24.747887Z","creation_time":"2024-02-16T00:11:24.745033Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T00:11:25.699 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7d041155-908e-42d6-a32d-d2f504649d95', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'marker': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T00:11:24.747887Z', 'creation_time': '2024-02-16T00:11:24.745033Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T00:11:25.699 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-16T00:11:25.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-16T00:11:25.699 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-02-16T00:11:25.783 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:25.783 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:25.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3fa0f800 1 Processor -- start 2024-02-16T00:11:25.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3fa0f800 1 -- start start 2024-02-16T00:11:25.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3fa0f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558799b96e90 0x558799b972b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3fa0f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558799ae2ba0 con 0x558799b980f0 2024-02-16T00:11:25.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3fa0f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x558799a9a450 con 0x558799b96e90 2024-02-16T00:11:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3b072640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558799b96e90 0x558799b972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3a871640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558799b980f0 0x558799b98570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60380/0 (socket says 172.21.15.42:60380) 2024-02-16T00:11:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3b072640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558799b96e90 0x558799b972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59466/0 (socket says 172.21.15.42:59466) 2024-02-16T00:11:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.781+0000 7f5f3a871640 1 -- 172.21.15.42:0/1341432284 learned_addr learned my addr 172.21.15.42:0/1341432284 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.782+0000 7f5f3b072640 1 -- 172.21.15.42:0/1341432284 >> v1:172.21.15.2:6789/0 conn(0x558799b980f0 legacy=0x558799b98570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.782+0000 7f5f3b072640 1 -- 172.21.15.42:0/1341432284 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558799b97980 con 0x558799b96e90 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.783+0000 7f5f3b072640 1 --2- 172.21.15.42:0/1341432284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799b972b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00a600 tx=0x7f5f2c01ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7589234a26b4d232 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3a070640 1 -- 172.21.15.42:0/1341432284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c00a200 con 0x558799b96e90 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3a070640 1 -- 172.21.15.42:0/1341432284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c00a360 con 0x558799b96e90 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3a070640 1 -- 172.21.15.42:0/1341432284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c0086e0 con 0x558799b96e90 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1341432284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 msgr2=0x558799b972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/1341432284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799b972b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00a600 tx=0x7f5f2c01ec40 comp rx=0 tx=0).stop 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1341432284 shutdown_connections 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/1341432284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799b972b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1341432284 >> 172.21.15.42:0/1341432284 conn(0x558799b924f0 msgr2=0x558799b94910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1341432284 shutdown_connections 2024-02-16T00:11:25.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.784+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1341432284 wait complete. 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.795+0000 7f5f3fa0f800 1 Processor -- start 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3fa0f800 1 -- start start 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3fa0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c8a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3fa0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558799a97980 con 0x558799b96e90 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3b072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c8a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3b072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c8a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59476/0 (socket says 172.21.15.42:59476) 2024-02-16T00:11:25.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3b072640 1 -- 172.21.15.42:0/1762138084 learned_addr learned my addr 172.21.15.42:0/1762138084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.796+0000 7f5f3b072640 1 -- 172.21.15.42:0/1762138084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c005d20 con 0x558799b96e90 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3b072640 1 --2- 172.21.15.42:0/1762138084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c8a5e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c056040 tx=0x7f5f2c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ba03cee1b87036 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5e2960a640 1 -- 172.21.15.42:0/1762138084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c007520 con 0x558799b96e90 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5e2960a640 1 -- 172.21.15.42:0/1762138084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0076a0 con 0x558799b96e90 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5e2960a640 1 -- 172.21.15.42:0/1762138084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c007980 con 0x558799b96e90 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1762138084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 msgr2=0x558799c8a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/1762138084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c8a5e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c056040 tx=0x7f5f2c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1762138084 shutdown_connections 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/1762138084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c8a5e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1762138084 >> 172.21.15.42:0/1762138084 conn(0x558799b924f0 msgr2=0x558799c81af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.797+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1762138084 shutdown_connections 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1762138084 wait complete. 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3fa0f800 1 Processor -- start 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3fa0f800 1 -- start start 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3fa0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c91c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3fa0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558799a93160 con 0x558799b96e90 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3b072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c91c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3b072640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c91c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59490/0 (socket says 172.21.15.42:59490) 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3b072640 1 -- 172.21.15.42:0/288802231 learned_addr learned my addr 172.21.15.42:0/288802231 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.798+0000 7f5f3b072640 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c050070 con 0x558799b96e90 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5f3b072640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c91c30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c005870 tx=0x7f5f2c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5e27e07640 1 -- 172.21.15.42:0/288802231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c008be0 con 0x558799b96e90 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5e27e07640 1 -- 172.21.15.42:0/288802231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c008d60 con 0x558799b96e90 2024-02-16T00:11:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558799c92170 con 0x558799b96e90 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5e27e07640 1 -- 172.21.15.42:0/288802231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c071410 con 0x558799b96e90 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558799c926b0 con 0x558799b96e90 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.799+0000 7f5e27e07640 1 -- 172.21.15.42:0/288802231 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5f2c005030 con 0x558799b96e90 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5e27e07640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e200367e0 0x7f5e20038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5e27e07640 1 -- 172.21.15.42:0/288802231 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5f2c08de40 con 0x558799b96e90 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5f3a871640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e200367e0 0x7f5e20038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799b980f0 0x558799c988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799c98e30 con 0x558799b980f0 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5f3b873640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799b980f0 0x558799c988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5f3a871640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e200367e0 0x7f5e20038ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000f60 tx=0x7f5f300012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.800+0000 7f5f3b873640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799b980f0 0x558799c988f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3b873640 1 -- 172.21.15.42:0/288802231 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f3400a4a0 con 0x558799b980f0 2024-02-16T00:11:25.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799c99220 con 0x558799b980f0 2024-02-16T00:11:25.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3b873640 1 -- 172.21.15.42:0/288802231 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5f3400a4a0 con 0x558799b980f0 2024-02-16T00:11:25.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799c9afe0 0x558799c9d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799c9daa0 con 0x558799c9afe0 2024-02-16T00:11:25.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3b072640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799c9afe0 0x558799c9d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.801+0000 7f5f3b072640 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799c9afe0 0x558799c9d3d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3b072640 1 -- 172.21.15.42:0/288802231 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799c9afe0 2024-02-16T00:11:25.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799c99e70 con 0x558799b980f0 2024-02-16T00:11:25.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3b873640 1 -- 172.21.15.42:0/288802231 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f3400a4a0 con 0x558799b980f0 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799c9a260 con 0x558799b980f0 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3b873640 1 -- 172.21.15.42:0/288802231 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5f3400a4a0 con 0x558799b980f0 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3fa0f800 1 Processor -- start 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.802+0000 7f5f3fa0f800 1 -- start start 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3fa0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 0x558799cacb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3fa0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558799a35e80 con 0x558799cac740 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3b873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 0x558799cacb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3b873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 0x558799cacb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59506/0 (socket says 172.21.15.42:59506) 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3b873640 1 -- 172.21.15.42:0/2090437900 learned_addr learned my addr 172.21.15.42:0/2090437900 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3b873640 1 -- 172.21.15.42:0/2090437900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558799cad0a0 con 0x558799cac740 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.803+0000 7f5f3b873640 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 0x558799cacb60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x558799c93030 tx=0x7f5f34018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.804+0000 7f5e25602640 1 -- 172.21.15.42:0/2090437900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f3401d070 con 0x558799cac740 2024-02-16T00:11:25.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.804+0000 7f5e25602640 1 -- 172.21.15.42:0/2090437900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340182e0 con 0x558799cac740 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.804+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558799cadb10 con 0x558799cac740 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.804+0000 7f5e25602640 1 -- 172.21.15.42:0/2090437900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f340145a0 con 0x558799cac740 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.804+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558799cadfd0 con 0x558799cac740 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.804+0000 7f5e25602640 1 -- 172.21.15.42:0/2090437900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5f34020020 con 0x558799cac740 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5e25602640 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e140367e0 0x7f5e14038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5e25602640 1 -- 172.21.15.42:0/2090437900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5f3404dc00 con 0x558799cac740 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3b072640 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e140367e0 0x7f5e14038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3fa0f800 1 Processor -- start 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3fa0f800 1 -- start start 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3b072640 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e140367e0 0x7f5e14038ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c054fd0 tx=0x7f5f2c053810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3fa0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cb9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3fa0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558799a0b5d0 con 0x558799cb9980 2024-02-16T00:11:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3b873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cb9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3b873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cb9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59512/0 (socket says 172.21.15.42:59512) 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3b873640 1 -- 172.21.15.42:0/1436605136 learned_addr learned my addr 172.21.15.42:0/1436605136 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.805+0000 7f5f3b873640 1 -- 172.21.15.42:0/1436605136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558799cba370 con 0x558799cb9980 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3b873640 1 --2- 172.21.15.42:0/1436605136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cb9da0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f3404bf80 tx=0x7f5f34011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce67d09ac9c50204 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5e1effd640 1 -- 172.21.15.42:0/1436605136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f340404b0 con 0x558799cb9980 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5e1effd640 1 -- 172.21.15.42:0/1436605136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3402b350 con 0x558799cb9980 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5e1effd640 1 -- 172.21.15.42:0/1436605136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f340133b0 con 0x558799cb9980 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1436605136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 msgr2=0x558799cb9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/1436605136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cb9da0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f3404bf80 tx=0x7f5f34011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1436605136 shutdown_connections 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/1436605136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cb9da0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1436605136 >> 172.21.15.42:0/1436605136 conn(0x558799cb5ca0 msgr2=0x558799cb3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1436605136 shutdown_connections 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.806+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/1436605136 wait complete. 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3fa0f800 1 Processor -- start 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3fa0f800 1 -- start start 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3fa0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cc09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3fa0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558799cc0ee0 con 0x558799cb9980 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3b873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cc09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3b873640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cc09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59520/0 (socket says 172.21.15.42:59520) 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 learned_addr learned my addr 172.21.15.42:0/2406658293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558799cadfd0 con 0x558799cb9980 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.807+0000 7f5f3b873640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cc09a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5f3404ae70 tx=0x7f5f3404bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5e1d7fa640 1 -- 172.21.15.42:0/2406658293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f34032070 con 0x558799cb9980 2024-02-16T00:11:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5e1d7fa640 1 -- 172.21.15.42:0/2406658293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3402b4c0 con 0x558799cb9980 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558799cc10e0 con 0x558799cb9980 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5e1d7fa640 1 -- 172.21.15.42:0/2406658293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f3404d780 con 0x558799cb9980 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558799cc1540 con 0x558799cb9980 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5e1d7fa640 1 -- 172.21.15.42:0/2406658293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5f3403e070 con 0x558799cb9980 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.808+0000 7f5e1d7fa640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e040367e0 0x7f5e04038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5e1d7fa640 1 -- 172.21.15.42:0/2406658293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5f34038c60 con 0x558799cb9980 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3b072640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e040367e0 0x7f5e04038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799ccc640 0x558799cceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799ccf250 con 0x558799ccc640 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3a871640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799ccc640 0x558799cceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3b072640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e040367e0 0x7f5e04038ca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0075f0 tx=0x7f5f2c08f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3a871640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799ccc640 0x558799cceb00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 20 realm 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.809+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799ccbb20 con 0x558799ccc640 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799ccfcd0 con 0x558799ccc640 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd01e0 con 0x558799ccc640 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799cd0f90 0x558799cd3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd3900 con 0x558799cd0f90 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.810+0000 7f5f3b873640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799cd0f90 0x558799cd3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3b873640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799cd0f90 0x558799cd3380 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3fa0f800 20 searching for the correct realm 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558799cd5690 0x558799cd7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd8130 con 0x558799cd5690 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3b072640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558799cd5690 0x558799cd7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.811+0000 7f5f3b072640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558799cd5690 0x558799cd7a80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.812+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.812+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd8130 con 0x558799cd0f90 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.812+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.812+0000 7f5f3b873640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5f34058040 0x7f5f34023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.812+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.812+0000 7f5f3a871640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5f34058040 0x7f5f34023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5f34058040 0x7f5f34023420 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.813+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd0f90 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.814+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd0f90 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.815+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.816+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.817+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.817+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.817+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.817+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.817+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.817+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd0f90 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x558799ccc640 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.818+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30006070 con 0x7f5f34058040 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd0f90 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.819+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd5690 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x7f5f34058040 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799ccc640 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f5f34040020 con 0x558799cd0f90 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3fa0f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3fa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3fa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3fa0f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3fa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.820+0000 7f5f3fa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd4170 con 0x558799ccc640 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd4520 con 0x558799ccc640 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd4900 con 0x558799ccc640 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 zone default found 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 4 Realm: () 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:25.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 zonegroup default 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.821+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd8570 con 0x7f5f34058040 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd3df0 con 0x558799cd5690 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cda4c0 con 0x558799cd5690 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 started sync module instance, tier type = 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.822+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cd99c0 con 0x558799cd0f90 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.823+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.823+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040889335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cda8e0 con 0x558799cd0f90 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.823+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdb120 con 0x558799ccc640 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.824+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94040889335424] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.824+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.824+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040889333088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdad80 con 0x558799ccc640 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.824+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdbbd0 con 0x558799cd5690 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.825+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94040889333088] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.826+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.826+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94040889338080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdad00 con 0x558799cd5690 2024-02-16T00:11:25.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.826+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdca60 con 0x558799cd0f90 2024-02-16T00:11:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.827+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94040889338080] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.827+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.827+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94040889345472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdce80 con 0x558799cd0f90 2024-02-16T00:11:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.827+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdd7f0 con 0x558799ccc640 2024-02-16T00:11:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.828+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94040889345472] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.828+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.828+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040889347008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdd7f0 con 0x558799ccc640 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.828+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde1a0 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.829+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.829+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94040889347008] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.829+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040889351360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde140 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.829+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdd390 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.830+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.830+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040889349008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdf080 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.830+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdfad0 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.830+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94040889351360] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94040889349008] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94040889357776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdebe0 con 0x7f5f34058040 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=0 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=1 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=2 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=3 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=4 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=5 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.831+0000 7f5f3fa0f800 20 add_watcher() i=6 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.832+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94040889357776] v27'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.832+0000 7f5f3fa0f800 20 add_watcher() i=7 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.832+0000 7f5f3fa0f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.832+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdebe0 con 0x558799ccc640 2024-02-16T00:11:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.832+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.832+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94040889353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799ce0300 con 0x558799ccc640 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94040889353280] v27'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5f3fa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5f3fa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5f3fa0f800 5 note: GC not initialized 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5df0fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.833+0000 7f5f3fa0f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3fa0f800 20 Filter name: none 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5d6a7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d14610 con 0x558799ccc640 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d14610 con 0x558799cd0f90 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.834+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d15b20 con 0x558799ccc640 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 4.37 4:ee0f1f05:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d17560 con 0x7f5f34058040 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 4.15 4:abe4bfab:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d1a1c0 con 0x558799cd5690 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 4.2b 4:d618bfba:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d1ce40 con 0x558799ccc640 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 4.15 4:aabdf911:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d1f6e0 con 0x558799cd5690 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 4.c 4:31d7e51e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d22310 con 0x558799ccc640 2024-02-16T00:11:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 4.6 4:62d3c06f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d24e50 con 0x558799cd5690 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d27850 con 0x558799cd5690 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 4.38 4:1ed234cf:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d24e50 con 0x558799ccc640 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 4.3d 4:bd5d1908:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d2c650 con 0x558799cd5690 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 4.21 4:85da9115:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d2ef90 con 0x7f5f34058040 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:75 4.34 4:2ee72343:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d318f0 con 0x558799cd0f90 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(65 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(67 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.835+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(74 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f30037040 con 0x7f5f34058040 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(75 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(70 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(68 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(72 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(71 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(69 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f30037040 con 0x558799ccc640 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(73 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.836+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d24930 con 0x558799cd0f90 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.837+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(76 foo.buckets [call] v27'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.837+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d24930 con 0x558799cd0f90 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(77 foo.buckets [call] v27'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3fa0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d24930 con 0x558799ccc640 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(78 foo [stat out=16b,read 0~358 out=358b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+374 (crc 0 0 0) 0x7f5f3004b040 con 0x558799ccc640 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3fa0f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799d24930 con 0x558799cd0f90 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.838+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.839+0000 7f5df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.839+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94040889353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cfe730 con 0x558799ccc640 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.840+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94040889353280] v27'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5f3004b040 con 0x558799ccc640 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.840+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94040889335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde440 con 0x558799cd0f90 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.841+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94040889335424] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.841+0000 7f5f3fa0f800 20 remove_watcher() i=0 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.841+0000 7f5f3fa0f800 2 removed watcher, disabling cache 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.841+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94040889333088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde440 con 0x558799ccc640 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.842+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94040889333088] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3004b040 con 0x558799ccc640 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.842+0000 7f5f3fa0f800 20 remove_watcher() i=1 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.842+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94040889338080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde440 con 0x558799cd5690 2024-02-16T00:11:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.843+0000 7f5f3b072640 1 -- 172.21.15.42:0/2406658293 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94040889338080] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f2c06e070 con 0x558799cd5690 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.843+0000 7f5f3fa0f800 20 remove_watcher() i=2 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.843+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94040889345472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde440 con 0x558799cd0f90 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.844+0000 7f5f3b873640 1 -- 172.21.15.42:0/2406658293 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94040889345472] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3403d030 con 0x558799cd0f90 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.844+0000 7f5f3fa0f800 20 remove_watcher() i=3 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.844+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94040889347008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdc5c0 con 0x558799ccc640 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.845+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94040889347008] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3004b040 con 0x558799ccc640 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.845+0000 7f5f3fa0f800 20 remove_watcher() i=4 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.845+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94040889351360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cde440 con 0x7f5f34058040 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.846+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94040889351360] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3004b040 con 0x7f5f34058040 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.846+0000 7f5f3fa0f800 20 remove_watcher() i=5 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.846+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94040889349008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cdc5c0 con 0x7f5f34058040 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.847+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94040889349008] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3004b040 con 0x7f5f34058040 2024-02-16T00:11:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.847+0000 7f5f3fa0f800 20 remove_watcher() i=6 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.847+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94040889357776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558799cddcc0 con 0x7f5f34058040 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94040889357776] v27'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f3004b040 con 0x7f5f34058040 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 20 remove_watcher() i=7 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5f34058040 msgr2=0x7f5f34023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f5f34058040 0x7f5f34023420 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799ccc640 msgr2=0x558799cceb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799ccc640 0x558799cceb00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799cd0f90 msgr2=0x558799cd3380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799cd0f90 0x558799cd3380 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558799cd5690 msgr2=0x558799cd7a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558799cd5690 0x558799cd7a80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e040367e0 msgr2=0x7f5e04038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e040367e0 0x7f5e04038ca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0075f0 tx=0x7f5f2c08f000 comp rx=0 tx=0).stop 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 msgr2=0x558799cc09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3a871640 1 -- 172.21.15.42:0/2406658293 reap_dead start 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cc09a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5f3404ae70 tx=0x7f5f3404bee0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 shutdown_connections 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2406658293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cb9980 0x558799cc09a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 >> 172.21.15.42:0/2406658293 conn(0x558799cb5ca0 msgr2=0x558799cb3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 shutdown_connections 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.848+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2406658293 wait complete. 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e140367e0 msgr2=0x7f5e14038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e140367e0 0x7f5e14038ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c054fd0 tx=0x7f5f2c053810 comp rx=0 tx=0).stop 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 msgr2=0x558799cacb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 0x558799cacb60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x558799c93030 tx=0x7f5f34018830 comp rx=0 tx=0).stop 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 shutdown_connections 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e140367e0 0x7f5e14038ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/2090437900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799cac740 0x558799cacb60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 >> 172.21.15.42:0/2090437900 conn(0x558799ca07e0 msgr2=0x558799ca0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 shutdown_connections 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/2090437900 wait complete. 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799b980f0 msgr2=0x558799c988f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799b980f0 0x558799c988f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799c9afe0 msgr2=0x558799c9d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799c9afe0 0x558799c9d3d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e200367e0 msgr2=0x7f5e20038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e200367e0 0x7f5e20038ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000f60 tx=0x7f5f300012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 msgr2=0x558799c91c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c91c30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c005870 tx=0x7f5f2c002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 shutdown_connections 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558799c9afe0 0x558799c9d3d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558799b980f0 0x558799c988f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5e200367e0 0x7f5e20038ca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 --2- 172.21.15.42:0/288802231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558799b96e90 0x558799c91c30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 >> 172.21.15.42:0/288802231 conn(0x558799b924f0 msgr2=0x558799c80350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 shutdown_connections 2024-02-16T00:11:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.849+0000 7f5f3fa0f800 1 -- 172.21.15.42:0/288802231 wait complete. 2024-02-16T00:11:25.871 INFO:teuthology.orchestra.run.smithi042.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-02-16T00:11:25.838613Z","last_stats_update":"2024-02-16T00:11:25.837592Z"} 2024-02-16T00:11:25.871 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-02-16T00:11:25.838613Z', 'last_stats_update': '2024-02-16T00:11:25.837592Z'} 2024-02-16T00:11:25.876 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:25.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-16T00:11:25.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-16T00:11:25.877 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-02-16T00:11:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.953+0000 7efd8092d800 1 Processor -- start 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.953+0000 7efd8092d800 1 -- start start 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd8092d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5563b13b7530 0x5563b13b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd8092d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5563b12fdba0 con 0x5563b13b3a20 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd8092d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5563b12b5450 con 0x5563b13b7530 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd7bdb2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5563b13b7530 0x5563b13b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd7c5b3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5563b13b3a20 0x5563b13b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60390/0 (socket says 172.21.15.42:60390) 2024-02-16T00:11:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd7bdb2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5563b13b7530 0x5563b13b9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59530/0 (socket says 172.21.15.42:59530) 2024-02-16T00:11:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd7c5b3640 1 -- 172.21.15.42:0/496381376 learned_addr learned my addr 172.21.15.42:0/496381376 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd7bdb2640 1 -- 172.21.15.42:0/496381376 >> v1:172.21.15.2:6789/0 conn(0x5563b13b3a20 legacy=0x5563b13b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.954+0000 7efd7bdb2640 1 -- 172.21.15.42:0/496381376 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b13bae70 con 0x5563b13b7530 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.956+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/496381376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b7530 0x5563b13b9920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd7000a470 tx=0x7efd7001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4644d1d5876d732 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.956+0000 7efd7b5b1640 1 -- 172.21.15.42:0/496381376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd70052570 con 0x5563b13b7530 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd7b5b1640 1 -- 172.21.15.42:0/496381376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd700526d0 con 0x5563b13b7530 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd7b5b1640 1 -- 172.21.15.42:0/496381376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd70052990 con 0x5563b13b7530 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 -- 172.21.15.42:0/496381376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b7530 msgr2=0x5563b13b9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 --2- 172.21.15.42:0/496381376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b7530 0x5563b13b9920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd7000a470 tx=0x7efd7001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 -- 172.21.15.42:0/496381376 shutdown_connections 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 --2- 172.21.15.42:0/496381376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b7530 0x5563b13b9920 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 -- 172.21.15.42:0/496381376 >> 172.21.15.42:0/496381376 conn(0x5563b13ad4f0 msgr2=0x5563b13af910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 -- 172.21.15.42:0/496381376 shutdown_connections 2024-02-16T00:11:25.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.957+0000 7efd8092d800 1 -- 172.21.15.42:0/496381376 wait complete. 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.968+0000 7efd8092d800 1 Processor -- start 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.968+0000 7efd8092d800 1 -- start start 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd8092d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14a3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd8092d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b12b2980 con 0x5563b13b3a20 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd7c5b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd7c5b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14a3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59536/0 (socket says 172.21.15.42:59536) 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd7c5b3640 1 -- 172.21.15.42:0/70616332 learned_addr learned my addr 172.21.15.42:0/70616332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd7c5b3640 1 -- 172.21.15.42:0/70616332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70005d20 con 0x5563b13b3a20 2024-02-16T00:11:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.969+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/70616332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14a3010 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0014a0 tx=0x7efd6c001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff4f5897675aedc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efc6a60c640 1 -- 172.21.15.42:0/70616332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c004520 con 0x5563b13b3a20 2024-02-16T00:11:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efc6a60c640 1 -- 172.21.15.42:0/70616332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c004680 con 0x5563b13b3a20 2024-02-16T00:11:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efc6a60c640 1 -- 172.21.15.42:0/70616332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c004980 con 0x5563b13b3a20 2024-02-16T00:11:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 -- 172.21.15.42:0/70616332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 msgr2=0x5563b14a3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 --2- 172.21.15.42:0/70616332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14a3010 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0014a0 tx=0x7efd6c001960 comp rx=0 tx=0).stop 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 -- 172.21.15.42:0/70616332 shutdown_connections 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 --2- 172.21.15.42:0/70616332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14a3010 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 -- 172.21.15.42:0/70616332 >> 172.21.15.42:0/70616332 conn(0x5563b13ad4f0 msgr2=0x5563b149e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 -- 172.21.15.42:0/70616332 shutdown_connections 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.970+0000 7efd8092d800 1 -- 172.21.15.42:0/70616332 wait complete. 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd8092d800 1 Processor -- start 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd8092d800 1 -- start start 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd8092d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd8092d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b12ae160 con 0x5563b13b3a20 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd7c5b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd7c5b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14aa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59548/0 (socket says 172.21.15.42:59548) 2024-02-16T00:11:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1630926864 learned_addr learned my addr 172.21.15.42:0/1630926864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b12fdba0 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14aa6d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0014a0 tx=0x7efd6c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efc68e09640 1 -- 172.21.15.42:0/1630926864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c013820 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.971+0000 7efc68e09640 1 -- 172.21.15.42:0/1630926864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c013980 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.972+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563b14aac10 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.972+0000 7efc68e09640 1 -- 172.21.15.42:0/1630926864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c013c20 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.972+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563b14ab0f0 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.972+0000 7efc68e09640 1 -- 172.21.15.42:0/1630926864 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efd6c028460 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.972+0000 7efc68e09640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc640367e0 0x7efc64038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efc68e09640 1 -- 172.21.15.42:0/1630926864 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7efd6c04c370 con 0x5563b13b3a20 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc640367e0 0x7efc64038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b13b7530 0x5563b14b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14b19b0 con 0x5563b13b7530 2024-02-16T00:11:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b13b7530 0x5563b14b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc640367e0 0x7efc64038ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd70054000 tx=0x7efd7004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b13b7530 0x5563b14b13e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1630926864 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b13b7530 2024-02-16T00:11:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.973+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14aea70 con 0x5563b13b7530 2024-02-16T00:11:25.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1630926864 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efd740083e0 con 0x5563b13b7530 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14b3bf0 0x5563b14b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14b66e0 con 0x5563b14b3bf0 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14b3bf0 0x5563b14b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14b3bf0 0x5563b14b5fe0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1630926864 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14b3bf0 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.974+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14b2b70 con 0x5563b13b7530 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.975+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1630926864 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efd740083e0 con 0x5563b13b7530 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.975+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14b2f60 con 0x5563b13b7530 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.975+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1630926864 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7efd740083e0 con 0x5563b13b7530 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.975+0000 7efd8092d800 1 Processor -- start 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.975+0000 7efd8092d800 1 -- start start 2024-02-16T00:11:25.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd8092d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 0x5563b14c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd8092d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b1250e80 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd7cdb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 0x5563b14c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd7cdb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 0x5563b14c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59562/0 (socket says 172.21.15.42:59562) 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd7cdb4640 1 -- 172.21.15.42:0/2754017162 learned_addr learned my addr 172.21.15.42:0/2754017162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd7cdb4640 1 -- 172.21.15.42:0/2754017162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b14c5e40 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 0x5563b14c5900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5563b14aba80 tx=0x7efd7400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efc61ffb640 1 -- 172.21.15.42:0/2754017162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd7400f040 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efc61ffb640 1 -- 172.21.15.42:0/2754017162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74007d00 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efc61ffb640 1 -- 172.21.15.42:0/2754017162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd74019420 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563b14c68b0 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.976+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563b14c6d70 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.977+0000 7efc61ffb640 1 -- 172.21.15.42:0/2754017162 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efd74019580 con 0x5563b14c54e0 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.977+0000 7efc61ffb640 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc540367e0 0x7efc54038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.977+0000 7efc61ffb640 1 -- 172.21.15.42:0/2754017162 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7efd7404e060 con 0x5563b14c54e0 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.977+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc540367e0 0x7efc54038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd8092d800 1 Processor -- start 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd8092d800 1 -- start start 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc540367e0 0x7efc54038ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5563b14b1db0 tx=0x7efd6c04a650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd8092d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd8092d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b12265d0 con 0x5563b14d2660 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd7cdb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd7cdb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59574/0 (socket says 172.21.15.42:59574) 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd7cdb4640 1 -- 172.21.15.42:0/3103514395 learned_addr learned my addr 172.21.15.42:0/3103514395 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd7cdb4640 1 -- 172.21.15.42:0/3103514395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b14d3050 con 0x5563b14d2660 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.978+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/3103514395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d2a80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efd7404c3e0 tx=0x7efd7404c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c939d4dac2a6b58e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efc537fe640 1 -- 172.21.15.42:0/3103514395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd74017e00 con 0x5563b14d2660 2024-02-16T00:11:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efc537fe640 1 -- 172.21.15.42:0/3103514395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd740183b0 con 0x5563b14d2660 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efc537fe640 1 -- 172.21.15.42:0/3103514395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd74019c00 con 0x5563b14d2660 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 -- 172.21.15.42:0/3103514395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 msgr2=0x5563b14d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 --2- 172.21.15.42:0/3103514395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d2a80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efd7404c3e0 tx=0x7efd7404c690 comp rx=0 tx=0).stop 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 -- 172.21.15.42:0/3103514395 shutdown_connections 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 --2- 172.21.15.42:0/3103514395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d2a80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 -- 172.21.15.42:0/3103514395 >> 172.21.15.42:0/3103514395 conn(0x5563b14ce9c0 msgr2=0x5563b14cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 -- 172.21.15.42:0/3103514395 shutdown_connections 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 -- 172.21.15.42:0/3103514395 wait complete. 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 Processor -- start 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.979+0000 7efd8092d800 1 -- start start 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd8092d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd8092d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b14d9b30 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd7cdb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd7cdb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59586/0 (socket says 172.21.15.42:59586) 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 learned_addr learned my addr 172.21.15.42:0/1846165867 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b14c6d70 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d95f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efd74014ab0 tx=0x7efd7404c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efc51ffb640 1 -- 172.21.15.42:0/1846165867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd74040070 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efc51ffb640 1 -- 172.21.15.42:0/1846165867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74031070 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efc51ffb640 1 -- 172.21.15.42:0/1846165867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd74019c00 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563b14d9d30 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.980+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563b14da190 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.981+0000 7efc51ffb640 1 -- 172.21.15.42:0/1846165867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efd740173b0 con 0x5563b14d2660 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.981+0000 7efc51ffb640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc440367e0 0x7efc44038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.981+0000 7efc51ffb640 1 -- 172.21.15.42:0/1846165867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7efd74038c70 con 0x5563b14d2660 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.981+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc440367e0 0x7efc44038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b14e53b0 0x5563b14e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14e7fc0 con 0x5563b14e53b0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b14e53b0 0x5563b14e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc440367e0 0x7efc44038ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd6c004fb0 tx=0x7efd6c041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b14e53b0 0x5563b14e7870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd70059040 con 0x5563b14e53b0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 20 realm 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.982+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14e83b0 con 0x5563b14e53b0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd70059040 con 0x5563b14e53b0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14e8c30 con 0x5563b14e53b0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd70059040 con 0x5563b14e53b0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14e8f90 con 0x5563b14e53b0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efd70059040 con 0x5563b14e53b0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14e9ca0 0x5563b14ec090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14ec6a0 con 0x5563b14e9ca0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14e9ca0 0x5563b14ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.983+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14e9ca0 0x5563b14ec090 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd8092d800 20 searching for the correct realm 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5563b14ee970 0x5563b14f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5563b14ee970 0x5563b14f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.984+0000 7efd7c5b3640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5563b14ee970 0x5563b14f0e30 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.985+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.985+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e9ca0 2024-02-16T00:11:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.985+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.985+0000 7efd7cdb4640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7efd74051070 0x7efd7402f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.985+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.985+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7efd74051070 0x7efd7402f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7efd74051070 0x7efd7402f830 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.986+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e9ca0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.987+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e9ca0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.988+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.989+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.990+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e9ca0 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.991+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e9ca0 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14ee970 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.992+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x7efd74051070 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e53b0 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1500 con 0x5563b14e9ca0 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14eded0 con 0x5563b14e53b0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.993+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14ece90 con 0x5563b14e53b0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14ed780 con 0x5563b14e53b0 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 zone default found 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 4 Realm: () 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 zonegroup default 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f1de0 con 0x7efd74051070 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f37f0 con 0x5563b14ee970 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.994+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f3c60 con 0x5563b14ee970 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.995+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.995+0000 7efd8092d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.995+0000 7efd8092d800 20 started sync module instance, tier type = 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.995+0000 7efd8092d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.995+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f2d90 con 0x5563b14e9ca0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.996+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.996+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93886664880720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4080 con 0x5563b14e9ca0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.996+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4880 con 0x5563b14e53b0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.997+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93886664880720] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.997+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.997+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93886664884352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4c30 con 0x5563b14e53b0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.997+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f5430 con 0x5563b14ee970 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.998+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93886664884352] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.998+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.998+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93886664887344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f5050 con 0x5563b14ee970 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.998+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f60d0 con 0x5563b14e9ca0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.999+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.999+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93886664887344] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.999+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93886664891920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f68f0 con 0x5563b14e9ca0 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:25.999+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f57d0 con 0x5563b14e53b0 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.000+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93886664891920] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.000+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.000+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93886664893264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f68b0 con 0x5563b14e53b0 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.000+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f7950 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.001+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.001+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93886664897712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f7d70 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.001+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93886664893264] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.001+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f8800 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.002+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93886664897712] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.002+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.002+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93886664901408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f78d0 con 0x7efd74051070 2024-02-16T00:11:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.002+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f9080 con 0x7efd74051070 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93886664901408] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93886664896160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f78d0 con 0x7efd74051070 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=0 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=1 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=2 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=3 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=4 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=5 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.003+0000 7efd8092d800 20 add_watcher() i=6 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.004+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93886664896160] v27'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.004+0000 7efd8092d800 20 add_watcher() i=7 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.004+0000 7efd8092d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.004+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14fc1b0 con 0x5563b14e53b0 2024-02-16T00:11:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.004+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.004+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93886664903648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f94a0 con 0x5563b14e53b0 2024-02-16T00:11:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.005+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93886664903648] v27'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efc32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 5 note: GC not initialized 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efc31fdb640 20 reqs_thread_entry: start 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 20 Filter name: none 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efba37fe640 20 reqs_thread_entry: start 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b152e140 con 0x5563b14e53b0 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:26.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.006+0000 7efd8092d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b152fce0 con 0x5563b14e9ca0 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b1531650 con 0x5563b14e53b0 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.007+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b1534cf0 con 0x5563b14e9ca0 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 foo.buckets [call] v27'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b1533ce0 con 0x5563b14e9ca0 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.009+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b1538950 con 0x5563b14e9ca0 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.010+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.010+0000 7efd8092d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.010+0000 7efd8092d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.010+0000 7efd8092d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.010+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93886665163952 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b1535650 con 0x7efd74051070 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== watch-notify(notify (1) cookie 93886664901408 notify 115964116993 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7efd70084040 con 0x7efd74051070 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efc537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 93886664901408 notifier 4474 bl.length()=338 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efc537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efc537fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efc537fe640 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7efc48003e90 con 0x7efd74051070 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(68 notify.6 [notify cookie 93886665163952 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.011+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== watch-notify(notify_complete (2) cookie 93886665163952 notify 115964116993 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7efd70079040 con 0x7efd74051070 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.012+0000 7efc32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.012+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93886664903648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14fb3a0 con 0x5563b14e53b0 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.013+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93886664903648] v27'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.013+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93886664880720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f8be0 con 0x5563b14e9ca0 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.014+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93886664880720] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.014+0000 7efd8092d800 20 remove_watcher() i=0 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.014+0000 7efd8092d800 2 removed watcher, disabling cache 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.014+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93886664884352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f3250 con 0x5563b14e53b0 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.015+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93886664884352] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.015+0000 7efd8092d800 20 remove_watcher() i=1 2024-02-16T00:11:26.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.015+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93886664887344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4080 con 0x5563b14ee970 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.016+0000 7efd7c5b3640 1 -- 172.21.15.42:0/1846165867 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93886664887344] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd6c024020 con 0x5563b14ee970 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.016+0000 7efd8092d800 20 remove_watcher() i=2 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.016+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93886664891920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4c30 con 0x5563b14e9ca0 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.017+0000 7efd7cdb4640 1 -- 172.21.15.42:0/1846165867 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93886664891920] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd740083e0 con 0x5563b14e9ca0 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.017+0000 7efd8092d800 20 remove_watcher() i=3 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.017+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93886664893264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4c30 con 0x5563b14e53b0 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.018+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93886664893264] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x5563b14e53b0 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.018+0000 7efd8092d800 20 remove_watcher() i=4 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.018+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93886664897712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4c30 con 0x7efd74051070 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.019+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93886664897712] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.019+0000 7efd8092d800 20 remove_watcher() i=5 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.019+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93886664901408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f74b0 con 0x7efd74051070 2024-02-16T00:11:26.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.020+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93886664901408] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.020+0000 7efd8092d800 20 remove_watcher() i=6 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.020+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93886664896160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5563b14f4c30 con 0x7efd74051070 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93886664896160] v27'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd70071040 con 0x7efd74051070 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 20 remove_watcher() i=7 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7efd74051070 msgr2=0x7efd7402f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7efd74051070 0x7efd7402f830 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b14e53b0 msgr2=0x5563b14e7870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b14e53b0 0x5563b14e7870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14e9ca0 msgr2=0x5563b14ec090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14e9ca0 0x5563b14ec090 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5563b14ee970 msgr2=0x5563b14f0e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5563b14ee970 0x5563b14f0e30 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc440367e0 msgr2=0x7efc44038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc440367e0 0x7efc44038ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd6c004fb0 tx=0x7efd6c041000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 msgr2=0x5563b14d95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd7bdb2640 1 -- 172.21.15.42:0/1846165867 reap_dead start 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d95f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efd74014ab0 tx=0x7efd7404c340 comp rx=0 tx=0).stop 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 shutdown_connections 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/1846165867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14d2660 0x5563b14d95f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 >> 172.21.15.42:0/1846165867 conn(0x5563b14ce9c0 msgr2=0x5563b14cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 shutdown_connections 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/1846165867 wait complete. 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc540367e0 msgr2=0x7efc54038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc540367e0 0x7efc54038ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5563b14b1db0 tx=0x7efd6c04a650 comp rx=0 tx=0).stop 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 msgr2=0x5563b14c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 0x5563b14c5900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5563b14aba80 tx=0x7efd7400aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 shutdown_connections 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc540367e0 0x7efc54038ca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 --2- 172.21.15.42:0/2754017162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b14c54e0 0x5563b14c5900 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 >> 172.21.15.42:0/2754017162 conn(0x5563b14b9580 msgr2=0x5563b14b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 shutdown_connections 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.021+0000 7efd8092d800 1 -- 172.21.15.42:0/2754017162 wait complete. 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b13b7530 msgr2=0x5563b14b13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b13b7530 0x5563b14b13e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14b3bf0 msgr2=0x5563b14b5fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14b3bf0 0x5563b14b5fe0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc640367e0 msgr2=0x7efc64038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc640367e0 0x7efc64038ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd70054000 tx=0x7efd7004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 msgr2=0x5563b14aa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14aa6d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0014a0 tx=0x7efd6c001250 comp rx=0 tx=0).stop 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 shutdown_connections 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5563b14b3bf0 0x5563b14b5fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5563b13b7530 0x5563b14b13e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc640367e0 0x7efc64038ca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 --2- 172.21.15.42:0/1630926864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5563b13b3a20 0x5563b14aa6d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 >> 172.21.15.42:0/1630926864 conn(0x5563b13ad4f0 msgr2=0x5563b149d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 shutdown_connections 2024-02-16T00:11:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.022+0000 7efd8092d800 1 -- 172.21.15.42:0/1630926864 wait complete. 2024-02-16T00:11:26.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T00:11:26.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T00:11:26.043 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-16T00:11:26.093 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.093 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9174813800 1 Processor -- start 2024-02-16T00:11:26.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9174813800 1 -- start start 2024-02-16T00:11:26.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9174813800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c028624350 0x55c028626740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9174813800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c02856bbd0 con 0x55c02861fec0 2024-02-16T00:11:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9174813800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c028523450 con 0x55c028624350 2024-02-16T00:11:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9171b11640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c028624350 0x55c028626740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9172312640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c02861fec0 0x55c0286202e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60406/0 (socket says 172.21.15.42:60406) 2024-02-16T00:11:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.091+0000 7f9172312640 1 -- 172.21.15.42:0/4290163023 learned_addr learned my addr 172.21.15.42:0/4290163023 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.092+0000 7f9171b11640 1 -- 172.21.15.42:0/4290163023 >> v1:172.21.15.2:6789/0 conn(0x55c02861fec0 legacy=0x55c0286202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.092+0000 7f9171b11640 1 -- 172.21.15.42:0/4290163023 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c028627d70 con 0x55c028624350 2024-02-16T00:11:26.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.093+0000 7f9171b11640 1 --2- 172.21.15.42:0/4290163023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028624350 0x55c028626740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f915c00a470 tx=0x7f915c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e900cedec41d763 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9171310640 1 -- 172.21.15.42:0/4290163023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915c052570 con 0x55c028624350 2024-02-16T00:11:26.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9171310640 1 -- 172.21.15.42:0/4290163023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c0526d0 con 0x55c028624350 2024-02-16T00:11:26.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9171310640 1 -- 172.21.15.42:0/4290163023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915c052990 con 0x55c028624350 2024-02-16T00:11:26.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 -- 172.21.15.42:0/4290163023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028624350 msgr2=0x55c028626740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 --2- 172.21.15.42:0/4290163023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028624350 0x55c028626740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f915c00a470 tx=0x7f915c01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:26.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 -- 172.21.15.42:0/4290163023 shutdown_connections 2024-02-16T00:11:26.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 --2- 172.21.15.42:0/4290163023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028624350 0x55c028626740 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 -- 172.21.15.42:0/4290163023 >> 172.21.15.42:0/4290163023 conn(0x55c02861b520 msgr2=0x55c02861d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 -- 172.21.15.42:0/4290163023 shutdown_connections 2024-02-16T00:11:26.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.094+0000 7f9174813800 1 -- 172.21.15.42:0/4290163023 wait complete. 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.105+0000 7f9174813800 1 Processor -- start 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.105+0000 7f9174813800 1 -- start start 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.105+0000 7f9174813800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028593f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.105+0000 7f9174813800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c028520980 con 0x55c02861fec0 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.106+0000 7f9172312640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028593f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.106+0000 7f9172312640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028593f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59606/0 (socket says 172.21.15.42:59606) 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.106+0000 7f9172312640 1 -- 172.21.15.42:0/4287057644 learned_addr learned my addr 172.21.15.42:0/4287057644 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.106+0000 7f9172312640 1 -- 172.21.15.42:0/4287057644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c005d20 con 0x55c02861fec0 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.106+0000 7f9172312640 1 --2- 172.21.15.42:0/4287057644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028593f80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f91640014d0 tx=0x7f9164001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5e9fc5351e5872 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9060608640 1 -- 172.21.15.42:0/4287057644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9164004520 con 0x55c02861fec0 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9060608640 1 -- 172.21.15.42:0/4287057644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164004680 con 0x55c02861fec0 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9060608640 1 -- 172.21.15.42:0/4287057644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9164004980 con 0x55c02861fec0 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 -- 172.21.15.42:0/4287057644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 msgr2=0x55c028593f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 --2- 172.21.15.42:0/4287057644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028593f80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f91640014d0 tx=0x7f9164001990 comp rx=0 tx=0).stop 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 -- 172.21.15.42:0/4287057644 shutdown_connections 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 --2- 172.21.15.42:0/4287057644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028593f80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 -- 172.21.15.42:0/4287057644 >> 172.21.15.42:0/4287057644 conn(0x55c02861b520 msgr2=0x55c02870b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 -- 172.21.15.42:0/4287057644 shutdown_connections 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.107+0000 7f9174813800 1 -- 172.21.15.42:0/4287057644 wait complete. 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9174813800 1 Processor -- start 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9174813800 1 -- start start 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9174813800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028718800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9174813800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02851c160 con 0x55c02861fec0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9172312640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028718800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9172312640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028718800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59610/0 (socket says 172.21.15.42:59610) 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9172312640 1 -- 172.21.15.42:0/1913906533 learned_addr learned my addr 172.21.15.42:0/1913906533 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.108+0000 7f9172312640 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02856bbd0 con 0x55c02861fec0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f9172312640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028718800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f91640014d0 tx=0x7f9164001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f905ee05640 1 -- 172.21.15.42:0/1913906533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9164014870 con 0x55c02861fec0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f905ee05640 1 -- 172.21.15.42:0/1913906533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640149f0 con 0x55c02861fec0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c028718d40 con 0x55c02861fec0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f905ee05640 1 -- 172.21.15.42:0/1913906533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9164014cd0 con 0x55c02861fec0 2024-02-16T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c028719220 con 0x55c02861fec0 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.109+0000 7f905ee05640 1 -- 172.21.15.42:0/1913906533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f916401e3f0 con 0x55c02861fec0 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f905ee05640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90580367e0 0x7f9058038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f905ee05640 1 -- 172.21.15.42:0/1913906533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f916404c3a0 con 0x55c02861fec0 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f9171b11640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90580367e0 0x7f9058038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028624350 0x55c02871f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02871fb60 con 0x55c028624350 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f9172b13640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028624350 0x55c02871f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f9171b11640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90580367e0 0x7f9058038ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f915c054000 tx=0x7f915c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.110+0000 7f9172b13640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028624350 0x55c02871f590 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9172b13640 1 -- 172.21.15.42:0/1913906533 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028624350 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02871cbd0 con 0x55c028624350 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9172b13640 1 -- 172.21.15.42:0/1913906533 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028624350 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028721da0 0x55c028724190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028724880 con 0x55c028721da0 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9172312640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028721da0 0x55c028724190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.111+0000 7f9172312640 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028721da0 0x55c028724190 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.112+0000 7f9172312640 1 -- 172.21.15.42:0/1913906533 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9164024070 con 0x55c028721da0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.112+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028720d20 con 0x55c028624350 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.112+0000 7f9172b13640 1 -- 172.21.15.42:0/1913906533 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028624350 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.112+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028721110 con 0x55c028624350 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.112+0000 7f9172b13640 1 -- 172.21.15.42:0/1913906533 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028624350 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.112+0000 7f9174813800 1 Processor -- start 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9174813800 1 -- start start 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9174813800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 0x55c028733a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9174813800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0284bee80 con 0x55c0287335f0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9172b13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 0x55c028733a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9172b13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 0x55c028733a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59616/0 (socket says 172.21.15.42:59616) 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9172b13640 1 -- 172.21.15.42:0/4166482253 learned_addr learned my addr 172.21.15.42:0/4166482253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.113+0000 7f9172b13640 1 -- 172.21.15.42:0/4166482253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c028733f50 con 0x55c0287335f0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9172b13640 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 0x55c028733a10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55c028719c00 tx=0x7f916c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9057fff640 1 -- 172.21.15.42:0/4166482253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916c00f040 con 0x55c0287335f0 2024-02-16T00:11:26.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9057fff640 1 -- 172.21.15.42:0/4166482253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c007d00 con 0x55c0287335f0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9057fff640 1 -- 172.21.15.42:0/4166482253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916c019420 con 0x55c0287335f0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0287349c0 con 0x55c0287335f0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c028734e80 con 0x55c0287335f0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.114+0000 7f9057fff640 1 -- 172.21.15.42:0/4166482253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f916c019580 con 0x55c0287335f0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9057fff640 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f904c0367e0 0x7f904c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9057fff640 1 -- 172.21.15.42:0/4166482253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f916c04e060 con 0x55c0287335f0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9172312640 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f904c0367e0 0x7f904c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9174813800 1 Processor -- start 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9174813800 1 -- start start 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9172312640 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f904c0367e0 0x7f904c038ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c02871ff60 tx=0x7f916404a680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9174813800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c028740c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9174813800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0284945d0 con 0x55c028740870 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9172b13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c028740c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9172b13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c028740c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59622/0 (socket says 172.21.15.42:59622) 2024-02-16T00:11:26.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9172b13640 1 -- 172.21.15.42:0/2433882603 learned_addr learned my addr 172.21.15.42:0/2433882603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.115+0000 7f9172b13640 1 -- 172.21.15.42:0/2433882603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c028741260 con 0x55c028740870 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9172b13640 1 --2- 172.21.15.42:0/2433882603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c028740c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f916c04c3e0 tx=0x7f916c019880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef27a5406b3089 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9055ffb640 1 -- 172.21.15.42:0/2433882603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916c019c00 con 0x55c028740870 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9055ffb640 1 -- 172.21.15.42:0/2433882603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c019d60 con 0x55c028740870 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9055ffb640 1 -- 172.21.15.42:0/2433882603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916c017520 con 0x55c028740870 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 -- 172.21.15.42:0/2433882603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 msgr2=0x55c028740c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 --2- 172.21.15.42:0/2433882603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c028740c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f916c04c3e0 tx=0x7f916c019880 comp rx=0 tx=0).stop 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 -- 172.21.15.42:0/2433882603 shutdown_connections 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 --2- 172.21.15.42:0/2433882603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c028740c90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 -- 172.21.15.42:0/2433882603 >> 172.21.15.42:0/2433882603 conn(0x55c02873cbd0 msgr2=0x55c02873ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 -- 172.21.15.42:0/2433882603 shutdown_connections 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.116+0000 7f9174813800 1 -- 172.21.15.42:0/2433882603 wait complete. 2024-02-16T00:11:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9174813800 1 Processor -- start 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9174813800 1 -- start start 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9174813800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c0287477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9174813800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c028747d10 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9172b13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c0287477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9172b13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c0287477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59626/0 (socket says 172.21.15.42:59626) 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 learned_addr learned my addr 172.21.15.42:0/339055848 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c028734e80 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.117+0000 7f9172b13640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c0287477d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f916c0148c0 tx=0x7f916c04c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9043fff640 1 -- 172.21.15.42:0/339055848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916c040070 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9043fff640 1 -- 172.21.15.42:0/339055848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c031070 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c028747f10 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9043fff640 1 -- 172.21.15.42:0/339055848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916c015c90 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c028748370 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9043fff640 1 -- 172.21.15.42:0/339055848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f916c03b170 con 0x55c028740870 2024-02-16T00:11:26.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9043fff640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f903c036830 0x7f903c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.118+0000 7f9043fff640 1 -- 172.21.15.42:0/339055848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f916c038c70 con 0x55c028740870 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9172312640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f903c036830 0x7f903c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9172312640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f903c036830 0x7f903c038cf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9164012fd0 tx=0x7f9164032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028753510 0x55c0287559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028756120 con 0x55c028753510 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9171b11640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028753510 0x55c0287559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.119+0000 7f9171b11640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028753510 0x55c0287559d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 realm 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287564b0 con 0x55c028753510 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028756d30 con 0x55c028753510 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028757090 con 0x55c028753510 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028757da0 0x55c02875a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.120+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875a7a0 con 0x55c028757da0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9172b13640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028757da0 0x55c02875a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9172b13640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028757da0 0x55c02875a190 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9174813800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9174813800 20 searching for the correct realm 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c02875ca70 0x55c02875ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.121+0000 7f9172312640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c02875ca70 0x55c02875ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9172312640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c02875ca70 0x55c02875ef30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028757da0 2024-02-16T00:11:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9172b13640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f916c051070 0x7f916c03b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.122+0000 7f9171b11640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f916c051070 0x7f916c03b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.123+0000 7f9171b11640 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f916c051070 0x7f916c03b820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.123+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.123+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.123+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.123+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028757da0 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.124+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.125+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.125+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.125+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.125+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.125+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.125+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028757da0 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.126+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.127+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.128+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.128+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.128+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.128+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.128+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.128+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028757da0 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.129+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028757da0 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c02875ca70 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x7f916c051070 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.130+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028753510 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875f600 con 0x55c028757da0 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875bfd0 con 0x55c028753510 2024-02-16T00:11:26.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875af90 con 0x55c028753510 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.131+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875b880 con 0x55c028753510 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 zone default found 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 4 Realm: () 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 zonegroup default 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02875fee0 con 0x7f916c051070 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028761920 con 0x55c02875ca70 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.132+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028761d90 con 0x55c02875ca70 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 20 started sync module instance, tier type = 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.133+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028760e90 con 0x55c028757da0 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.134+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.134+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283800908624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287621b0 con 0x55c028757da0 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.134+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287629b0 con 0x55c028753510 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.135+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.135+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283800908624] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.135+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283800912304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028762a70 con 0x55c028753510 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.135+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287633e0 con 0x55c02875ca70 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.136+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283800912304] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.136+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.136+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283800913360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287629f0 con 0x55c02875ca70 2024-02-16T00:11:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.136+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028764240 con 0x55c028757da0 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.137+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283800913360] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.137+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.137+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283800919456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028764660 con 0x55c028757da0 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.137+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028764fd0 con 0x55c028753510 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.138+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283800919456] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.138+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.138+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283800923408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028764660 con 0x55c028753510 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.138+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028765a10 con 0x7f916c051070 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.139+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283800923408] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.139+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.139+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283800925424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028764660 con 0x7f916c051070 2024-02-16T00:11:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.139+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766410 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.140+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283800925424] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.140+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.140+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283800920512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287663d0 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.140+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766de0 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283800920512] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283800928048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766350 con 0x7f916c051070 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=0 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=1 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=2 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=3 2024-02-16T00:11:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=4 2024-02-16T00:11:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=5 2024-02-16T00:11:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.141+0000 7f9174813800 20 add_watcher() i=6 2024-02-16T00:11:26.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.142+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283800928048] v27'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.142+0000 7f9174813800 20 add_watcher() i=7 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.142+0000 7f9174813800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.142+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02876a340 con 0x55c028753510 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.142+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.142+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283800931744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028767660 con 0x55c028753510 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.143+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283800931744] v27'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.143+0000 7f9028fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.143+0000 7f9174813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.143+0000 7f9174813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.143+0000 7f9174813800 5 note: GC not initialized 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f8fa37fe640 20 reqs_thread_entry: start 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f9174813800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f9174813800 20 Filter name: none 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f8fa17fa640 20 reqs_thread_entry: start 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f9174813800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.144+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02879c340 con 0x7f916c051070 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02879c340 con 0x7f916c051070 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.145+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02879af00 con 0x7f916c051070 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v27'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9174813800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9174813800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9174813800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94283801143904 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02879b630 con 0x7f916c051070 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== watch-notify(notify (1) cookie 94283800925424 notify 115964116994 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f915c084040 con 0x7f916c051070 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9055ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94283800925424 notifier 4481 bl.length()=523 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9055ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T00:11:26.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9055ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9055ffb640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9038003e90 con 0x7f916c051070 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(65 notify.5 [notify cookie 94283801143904 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.146+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.147+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== watch-notify(notify_complete (2) cookie 94283801143904 notify 115964116994 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f915c07a040 con 0x7f916c051070 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.147+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02879d830 con 0x7f916c051070 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9174813800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9174813800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9174813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94283801143824 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c02879fcf0 con 0x55c02875ca70 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== watch-notify(notify (1) cookie 94283800913360 notify 115964116997 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55c028719220 con 0x55c02875ca70 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f90557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94283800913360 notifier 4481 bl.length()=177 2024-02-16T00:11:26.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f90557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:11:26.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f90557fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:26.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(68 notify.2 [notify cookie 94283801143824 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f90557fa640 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f8fa80033f0 con 0x55c02875ca70 2024-02-16T00:11:26.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.148+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== watch-notify(notify_complete (2) cookie 94283801143824 notify 115964116997 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c028718d40 con 0x55c02875ca70 2024-02-16T00:11:26.165 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.149+0000 7f9028fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.149+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283800931744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028769a20 con 0x55c028753510 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.150+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94283800931744] v27'113 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.150+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283800908624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766da0 con 0x55c028757da0 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.151+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94283800908624] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.151+0000 7f9174813800 20 remove_watcher() i=0 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.151+0000 7f9174813800 2 removed watcher, disabling cache 2024-02-16T00:11:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.151+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283800912304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766da0 con 0x55c028753510 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.152+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94283800912304] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.152+0000 7f9174813800 20 remove_watcher() i=1 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.152+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283800913360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c0287621b0 con 0x55c02875ca70 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.153+0000 7f9172312640 1 -- 172.21.15.42:0/339055848 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94283800913360] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9164024070 con 0x55c02875ca70 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.153+0000 7f9174813800 20 remove_watcher() i=2 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.153+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283800919456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028762650 con 0x55c028757da0 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.154+0000 7f9172b13640 1 -- 172.21.15.42:0/339055848 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94283800919456] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c0083e0 con 0x55c028757da0 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.154+0000 7f9174813800 20 remove_watcher() i=3 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.154+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283800923408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028762650 con 0x55c028753510 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.155+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94283800923408] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x55c028753510 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.155+0000 7f9174813800 20 remove_watcher() i=4 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.155+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283800925424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028762650 con 0x7f916c051070 2024-02-16T00:11:26.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.156+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94283800925424] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.156+0000 7f9174813800 20 remove_watcher() i=5 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.156+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283800920512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766da0 con 0x7f916c051070 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.157+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94283800920512] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.157+0000 7f9174813800 20 remove_watcher() i=6 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.157+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283800928048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c028766da0 con 0x7f916c051070 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94283800928048] v27'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f915c059040 con 0x7f916c051070 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 20 remove_watcher() i=7 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f916c051070 msgr2=0x7f916c03b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f916c051070 0x7f916c03b820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028753510 msgr2=0x55c0287559d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028753510 0x55c0287559d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028757da0 msgr2=0x55c02875a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028757da0 0x55c02875a190 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c02875ca70 msgr2=0x55c02875ef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.158+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c02875ca70 0x55c02875ef30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f903c036830 msgr2=0x7f903c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f903c036830 0x7f903c038cf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9164012fd0 tx=0x7f9164032000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 msgr2=0x55c0287477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9171b11640 1 -- 172.21.15.42:0/339055848 reap_dead start 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c0287477d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f916c0148c0 tx=0x7f916c04c340 comp rx=0 tx=0).stop 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 shutdown_connections 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/339055848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c028740870 0x55c0287477d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 >> 172.21.15.42:0/339055848 conn(0x55c02873cbd0 msgr2=0x55c02873a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 shutdown_connections 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/339055848 wait complete. 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f904c0367e0 msgr2=0x7f904c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f904c0367e0 0x7f904c038ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c02871ff60 tx=0x7f916404a680 comp rx=0 tx=0).stop 2024-02-16T00:11:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 msgr2=0x55c028733a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 0x55c028733a10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55c028719c00 tx=0x7f916c00aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 shutdown_connections 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f904c0367e0 0x7f904c038ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/4166482253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c0287335f0 0x55c028733a10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 >> 172.21.15.42:0/4166482253 conn(0x55c028727690 msgr2=0x55c028727a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 shutdown_connections 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/4166482253 wait complete. 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028624350 msgr2=0x55c02871f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028624350 0x55c02871f590 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028721da0 msgr2=0x55c028724190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.159+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028721da0 0x55c028724190 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90580367e0 msgr2=0x7f9058038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90580367e0 0x7f9058038ca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f915c054000 tx=0x7f915c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 msgr2=0x55c028718800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028718800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f91640014d0 tx=0x7f9164001250 comp rx=0 tx=0).stop 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 shutdown_connections 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c028721da0 0x55c028724190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c028624350 0x55c02871f590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f90580367e0 0x7f9058038ca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 --2- 172.21.15.42:0/1913906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c02861fec0 0x55c028718800 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 >> 172.21.15.42:0/1913906533 conn(0x55c02861b520 msgr2=0x55c02870a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 shutdown_connections 2024-02-16T00:11:26.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.160+0000 7f9174813800 1 -- 172.21.15.42:0/1913906533 wait complete. 2024-02-16T00:11:26.177 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:26.182 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T00:11:26.186 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:26.186 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-02-16T00:11:26.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-02-16T00:11:26.187 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-02-16T00:11:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c4740f800 1 Processor -- start 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c4740f800 1 -- start start 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c4740f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555580235e70 0x555580236290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c4740f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555580181bb0 con 0x5555802370d0 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c4740f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x555580139450 con 0x555580235e70 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c42ae4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555580235e70 0x555580236290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c422e3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5555802370d0 0x555580237550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60414/0 (socket says 172.21.15.42:60414) 2024-02-16T00:11:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.226+0000 7f1c422e3640 1 -- 172.21.15.42:0/3097124324 learned_addr learned my addr 172.21.15.42:0/3097124324 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.227+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3097124324 >> v1:172.21.15.2:6789/0 conn(0x5555802370d0 legacy=0x555580237550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.227+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3097124324 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555580236960 con 0x555580235e70 2024-02-16T00:11:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.228+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/3097124324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x555580236290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400a470 tx=0x7f1c3401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bfe0eb979357dd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c41ae2640 1 -- 172.21.15.42:0/3097124324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c34052570 con 0x555580235e70 2024-02-16T00:11:26.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c41ae2640 1 -- 172.21.15.42:0/3097124324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c340526d0 con 0x555580235e70 2024-02-16T00:11:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c41ae2640 1 -- 172.21.15.42:0/3097124324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c34052990 con 0x555580235e70 2024-02-16T00:11:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 -- 172.21.15.42:0/3097124324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 msgr2=0x555580236290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3097124324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x555580236290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400a470 tx=0x7f1c3401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 -- 172.21.15.42:0/3097124324 shutdown_connections 2024-02-16T00:11:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3097124324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x555580236290 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 -- 172.21.15.42:0/3097124324 >> 172.21.15.42:0/3097124324 conn(0x5555802314d0 msgr2=0x5555802338f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 -- 172.21.15.42:0/3097124324 shutdown_connections 2024-02-16T00:11:26.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.229+0000 7f1c4740f800 1 -- 172.21.15.42:0/3097124324 wait complete. 2024-02-16T00:11:26.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c4740f800 1 Processor -- start 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c4740f800 1 -- start start 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c4740f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555803262d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c4740f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555580136980 con 0x555580235e70 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c42ae4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555803262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c42ae4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555803262d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59642/0 (socket says 172.21.15.42:59642) 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3536541828 learned_addr learned my addr 172.21.15.42:0/3536541828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.241+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3536541828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34005d20 con 0x555580235e70 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/3536541828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555803262d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1c34055040 tx=0x7f1c3404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539241a47fdf835f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1b30e09640 1 -- 172.21.15.42:0/3536541828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3400a180 con 0x555580235e70 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1b30e09640 1 -- 172.21.15.42:0/3536541828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3400a2e0 con 0x555580235e70 2024-02-16T00:11:26.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1b30e09640 1 -- 172.21.15.42:0/3536541828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c340529b0 con 0x555580235e70 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1c4740f800 1 -- 172.21.15.42:0/3536541828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 msgr2=0x5555803262d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3536541828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555803262d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1c34055040 tx=0x7f1c3404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1c4740f800 1 -- 172.21.15.42:0/3536541828 shutdown_connections 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3536541828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555803262d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.242+0000 7f1c4740f800 1 -- 172.21.15.42:0/3536541828 >> 172.21.15.42:0/3536541828 conn(0x5555802314d0 msgr2=0x555580321bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c4740f800 1 -- 172.21.15.42:0/3536541828 shutdown_connections 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c4740f800 1 -- 172.21.15.42:0/3536541828 wait complete. 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c4740f800 1 Processor -- start 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c4740f800 1 -- start start 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c4740f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555801a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c4740f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555580132160 con 0x555580235e70 2024-02-16T00:11:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c42ae4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555801a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c42ae4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555801a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59648/0 (socket says 172.21.15.42:59648) 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c42ae4640 1 -- 172.21.15.42:0/2731649337 learned_addr learned my addr 172.21.15.42:0/2731649337 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.243+0000 7f1c42ae4640 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3404e070 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.244+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555801a9f70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c34005870 tx=0x7f1c34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.244+0000 7f1b2f606640 1 -- 172.21.15.42:0/2731649337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3406a070 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.244+0000 7f1b2f606640 1 -- 172.21.15.42:0/2731649337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34052e10 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.244+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555580331560 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.244+0000 7f1b2f606640 1 -- 172.21.15.42:0/2731649337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3405d550 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.244+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555580331a40 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1b2f606640 1 -- 172.21.15.42:0/2731649337 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1c3405d6b0 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1b2f606640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b28036790 0x7f1b28038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1b2f606640 1 -- 172.21.15.42:0/2731649337 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1c3408d7a0 con 0x555580235e70 2024-02-16T00:11:26.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1c422e3640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b28036790 0x7f1b28038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5555802370d0 0x555580335470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580335a40 con 0x5555802370d0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1c432e5640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5555802370d0 0x555580335470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1c422e3640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b28036790 0x7f1b28038c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f60 tx=0x7f1c380012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.245+0000 7f1c432e5640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5555802370d0 0x555580335470 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c432e5640 1 -- 172.21.15.42:0/2731649337 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x5555802370d0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580332bc0 con 0x5555802370d0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c432e5640 1 -- 172.21.15.42:0/2731649337 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x5555802370d0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555580337cb0 0x55558033a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558033a790 con 0x555580337cb0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555580337cb0 0x55558033a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.246+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555580337cb0 0x55558033a0a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.247+0000 7f1c42ae4640 1 -- 172.21.15.42:0/2731649337 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1c34059040 con 0x555580337cb0 2024-02-16T00:11:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.247+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580336c30 con 0x5555802370d0 2024-02-16T00:11:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.247+0000 7f1c432e5640 1 -- 172.21.15.42:0/2731649337 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x5555802370d0 2024-02-16T00:11:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.247+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580337020 con 0x5555802370d0 2024-02-16T00:11:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.247+0000 7f1c432e5640 1 -- 172.21.15.42:0/2731649337 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x5555802370d0 2024-02-16T00:11:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.247+0000 7f1c4740f800 1 Processor -- start 2024-02-16T00:11:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c4740f800 1 -- start start 2024-02-16T00:11:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c4740f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 0x555580349980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c4740f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555800d4e80 con 0x555580349560 2024-02-16T00:11:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c432e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 0x555580349980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c432e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 0x555580349980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59660/0 (socket says 172.21.15.42:59660) 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c432e5640 1 -- 172.21.15.42:0/4024603341 learned_addr learned my addr 172.21.15.42:0/4024603341 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c432e5640 1 -- 172.21.15.42:0/4024603341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555580349ec0 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.248+0000 7f1c432e5640 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 0x555580349980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5555801a9cb0 tx=0x7f1c3c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1b2ce01640 1 -- 172.21.15.42:0/4024603341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c01d070 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1b2ce01640 1 -- 172.21.15.42:0/4024603341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0182e0 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55558034a930 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1b2ce01640 1 -- 172.21.15.42:0/4024603341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c0145a0 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55558034adf0 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1b2ce01640 1 -- 172.21.15.42:0/4024603341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1c3c020020 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.249+0000 7f1b2ce01640 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b1c0367e0 0x7f1b1c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1b2ce01640 1 -- 172.21.15.42:0/4024603341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1c3c04dbe0 con 0x555580349560 2024-02-16T00:11:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b1c0367e0 0x7f1b1c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c4740f800 1 Processor -- start 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c4740f800 1 -- start start 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b1c0367e0 0x7f1b1c038ca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x555580335e10 tx=0x7f1c340051b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c4740f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558032ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c4740f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555800aa5d0 con 0x55558032eb40 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c432e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558032ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c432e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558032ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59676/0 (socket says 172.21.15.42:59676) 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c432e5640 1 -- 172.21.15.42:0/1824142080 learned_addr learned my addr 172.21.15.42:0/1824142080 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.250+0000 7f1c432e5640 1 -- 172.21.15.42:0/1824142080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55558032d340 con 0x55558032eb40 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c432e5640 1 --2- 172.21.15.42:0/1824142080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558032ef60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c04bf70 tx=0x7f1c3c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f04f41ea05adfd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1b267fc640 1 -- 172.21.15.42:0/1824142080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c004730 con 0x55558032eb40 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1b267fc640 1 -- 172.21.15.42:0/1824142080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c02b350 con 0x55558032eb40 2024-02-16T00:11:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1b267fc640 1 -- 172.21.15.42:0/1824142080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c0400d0 con 0x55558032eb40 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 -- 172.21.15.42:0/1824142080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 msgr2=0x55558032ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 --2- 172.21.15.42:0/1824142080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558032ef60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c04bf70 tx=0x7f1c3c011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 -- 172.21.15.42:0/1824142080 shutdown_connections 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 --2- 172.21.15.42:0/1824142080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558032ef60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 -- 172.21.15.42:0/1824142080 >> 172.21.15.42:0/1824142080 conn(0x555580352ac0 msgr2=0x555580350b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 -- 172.21.15.42:0/1824142080 shutdown_connections 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.251+0000 7f1c4740f800 1 -- 172.21.15.42:0/1824142080 wait complete. 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c4740f800 1 Processor -- start 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c4740f800 1 -- start start 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c4740f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558035f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c4740f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55558035fe40 con 0x55558032eb40 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c432e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558035f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c432e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558035f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59680/0 (socket says 172.21.15.42:59680) 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 learned_addr learned my addr 172.21.15.42:0/3337804079 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55558034adf0 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.252+0000 7f1c432e5640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558035f900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c011f60 tx=0x7f1c3c04bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1b24ff9640 1 -- 172.21.15.42:0/3337804079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c033070 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1b24ff9640 1 -- 172.21.15.42:0/3337804079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c02b4c0 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1b24ff9640 1 -- 172.21.15.42:0/3337804079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c04d3e0 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555580360040 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555803604a0 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1b24ff9640 1 -- 172.21.15.42:0/3337804079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1c3c04d540 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.253+0000 7f1b24ff9640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b0c0367e0 0x7f1b0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1b24ff9640 1 -- 172.21.15.42:0/3337804079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1c3c04de40 con 0x55558032eb40 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b0c0367e0 0x7f1b0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55558036b670 0x55558036db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558036e280 con 0x55558036b670 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c422e3640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55558036b670 0x55558036db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b0c0367e0 0x7f1b0c038ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1c34005680 tx=0x7f1c34084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c422e3640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55558036b670 0x55558036db30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 20 realm 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.254+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558036aad0 con 0x55558036b670 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558036ed00 con 0x55558036b670 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558036e9a0 con 0x55558036b670 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55558036ffd0 0x5555803723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036ffd0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.255+0000 7f1c432e5640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55558036ffd0 0x5555803723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c432e5640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55558036ffd0 0x5555803723c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c4740f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c4740f800 20 searching for the correct realm 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5555803748e0 0x555580376da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580377470 con 0x5555803748e0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5555803748e0 0x555580376da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.256+0000 7f1c42ae4640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5555803748e0 0x555580376da0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.257+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.257+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580377470 con 0x55558036ffd0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.257+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.257+0000 7f1c432e5640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1c3c014070 0x7f1c3c02e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.257+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.257+0000 7f1c422e3640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1c3c014070 0x7f1c3c02e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1c3c014070 0x7f1c3c02e7d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.258+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036ffd0 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.259+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.260+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.260+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.260+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.260+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036ffd0 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.260+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.261+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.262+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036ffd0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x55558036b670 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.263+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38006070 con 0x7f1c3c014070 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036ffd0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.264+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x5555803748e0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x7f1c3c014070 2024-02-16T00:11:26.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036b670 2024-02-16T00:11:26.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580372900 con 0x55558036ffd0 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.265+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580373200 con 0x55558036b670 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5555803735b0 con 0x55558036b670 2024-02-16T00:11:26.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580373990 con 0x55558036b670 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 zone default found 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 4 Realm: () 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 zonegroup default 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.266+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5555803778b0 con 0x7f1c3c014070 2024-02-16T00:11:26.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580379730 con 0x5555803748e0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580379a90 con 0x5555803748e0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 started sync module instance, tier type = 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.267+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378d00 con 0x55558036ffd0 2024-02-16T00:11:26.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.268+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.268+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93825711706288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378d00 con 0x55558036ffd0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.268+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037a4e0 con 0x55558036b670 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.269+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93825711706288] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.269+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.269+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93825711710176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378d00 con 0x55558036b670 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.269+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037af40 con 0x5555803748e0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.270+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93825711710176] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.271+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.271+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93825711704160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378c80 con 0x5555803748e0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.271+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037bdd0 con 0x55558036ffd0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.272+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.272+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93825711704160] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.272+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93825711717168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037c620 con 0x55558036ffd0 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.272+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037b340 con 0x55558036b670 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.273+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93825711717168] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.273+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.273+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93825711718784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037c5a0 con 0x55558036b670 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.273+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037d680 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.274+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.274+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93825711718784] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.274+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93825711722976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037daa0 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.274+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037cbd0 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.274+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93825711722976] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.275+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.275+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93825711724032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037da20 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.275+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037e930 con 0x7f1c3c014070 2024-02-16T00:11:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93825711724032] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93825711727760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037e8b0 con 0x7f1c3c014070 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=0 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=1 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=2 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=3 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=4 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=5 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.276+0000 7f1c4740f800 20 add_watcher() i=6 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.277+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93825711727760] v27'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.277+0000 7f1c4740f800 20 add_watcher() i=7 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.277+0000 7f1c4740f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.277+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5555803821e0 con 0x55558036b670 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.277+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.277+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93825711729808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037f650 con 0x55558036b670 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93825711729808] v27'114 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1af97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1c4740f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1c4740f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1c4740f800 5 note: GC not initialized 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1a73fff640 20 reqs_thread_entry: start 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.278+0000 7f1c4740f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.279+0000 7f1c4740f800 20 Filter name: none 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.279+0000 7f1a71ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.279+0000 7f1c4740f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.279+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5555803b3940 con 0x55558036ffd0 2024-02-16T00:11:26.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.279+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.279+0000 7f1c4740f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.280+0000 7f1af97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.280+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93825711729808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037f650 con 0x55558036b670 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.281+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93825711729808] v27'115 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.281+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93825711706288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037f1b0 con 0x55558036ffd0 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.282+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93825711706288] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.282+0000 7f1c4740f800 20 remove_watcher() i=0 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.282+0000 7f1c4740f800 2 removed watcher, disabling cache 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.282+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93825711710176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5555803790b0 con 0x55558036b670 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.283+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93825711710176] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.283+0000 7f1c4740f800 20 remove_watcher() i=1 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.283+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93825711704160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5555803790b0 con 0x5555803748e0 2024-02-16T00:11:26.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.284+0000 7f1c42ae4640 1 -- 172.21.15.42:0/3337804079 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93825711704160] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c34059040 con 0x5555803748e0 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.284+0000 7f1c4740f800 20 remove_watcher() i=2 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.284+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93825711717168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378860 con 0x55558036ffd0 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.285+0000 7f1c432e5640 1 -- 172.21.15.42:0/3337804079 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93825711717168] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c3c00a4a0 con 0x55558036ffd0 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.285+0000 7f1c4740f800 20 remove_watcher() i=3 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.285+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93825711718784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378860 con 0x55558036b670 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.286+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93825711718784] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x55558036b670 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.286+0000 7f1c4740f800 20 remove_watcher() i=4 2024-02-16T00:11:26.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.286+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93825711722976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037c180 con 0x7f1c3c014070 2024-02-16T00:11:26.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.287+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93825711722976] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.287+0000 7f1c4740f800 20 remove_watcher() i=5 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.287+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93825711724032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555580378860 con 0x7f1c3c014070 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.288+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93825711724032] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.288+0000 7f1c4740f800 20 remove_watcher() i=6 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.288+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93825711727760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55558037c180 con 0x7f1c3c014070 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93825711727760] v27'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c38037040 con 0x7f1c3c014070 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 20 remove_watcher() i=7 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1c3c014070 msgr2=0x7f1c3c02e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1c3c014070 0x7f1c3c02e7d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55558036b670 msgr2=0x55558036db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55558036b670 0x55558036db30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55558036ffd0 msgr2=0x5555803723c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55558036ffd0 0x5555803723c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5555803748e0 msgr2=0x555580376da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5555803748e0 0x555580376da0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b0c0367e0 msgr2=0x7f1b0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b0c0367e0 0x7f1b0c038ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1c34005680 tx=0x7f1c34084000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 msgr2=0x55558035f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/3337804079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55558032eb40 0x55558035f900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c011f60 tx=0x7f1c3c04bf00 comp rx=0 tx=0).stop 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 reap_dead start 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c422e3640 1 -- 172.21.15.42:0/3337804079 reap_dead start 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 shutdown_connections 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 >> 172.21.15.42:0/3337804079 conn(0x555580352ac0 msgr2=0x555580350120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 shutdown_connections 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/3337804079 wait complete. 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b1c0367e0 msgr2=0x7f1b1c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b1c0367e0 0x7f1b1c038ca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x555580335e10 tx=0x7f1c340051b0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 msgr2=0x555580349980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 0x555580349980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5555801a9cb0 tx=0x7f1c3c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 shutdown_connections 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b1c0367e0 0x7f1b1c038ca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 --2- 172.21.15.42:0/4024603341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580349560 0x555580349980 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 >> 172.21.15.42:0/4024603341 conn(0x55558033d600 msgr2=0x55558033da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 shutdown_connections 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.289+0000 7f1c4740f800 1 -- 172.21.15.42:0/4024603341 wait complete. 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5555802370d0 msgr2=0x555580335470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5555802370d0 0x555580335470 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555580337cb0 msgr2=0x55558033a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555580337cb0 0x55558033a0a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b28036790 msgr2=0x7f1b28038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b28036790 0x7f1b28038c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f60 tx=0x7f1c380012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 msgr2=0x5555801a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555801a9f70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c34005870 tx=0x7f1c34002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 shutdown_connections 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555580337cb0 0x55558033a0a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5555802370d0 0x555580335470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1b28036790 0x7f1b28038c50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 --2- 172.21.15.42:0/2731649337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555580235e70 0x5555801a9f70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 >> 172.21.15.42:0/2731649337 conn(0x5555802314d0 msgr2=0x555580320470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 shutdown_connections 2024-02-16T00:11:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.290+0000 7f1c4740f800 1 -- 172.21.15.42:0/2731649337 wait complete. 2024-02-16T00:11:26.306 INFO:teuthology.orchestra.run.smithi042.stdout:{"key":"bucket:myfoo","ver":{"tag":"_tPD1lQOA7-g7fTOQZe6dR5U","ver":2},"mtime":"2024-02-16T00:11:26.010620Z","data":{"bucket":{"name":"myfoo","marker":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","bucket_id":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-02-16T00:11:24.745033Z","linked":false,"has_bucket_info":false}} 2024-02-16T00:11:26.306 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_tPD1lQOA7-g7fTOQZe6dR5U', 'ver': 2}, 'mtime': '2024-02-16T00:11:26.010620Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'bucket_id': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-02-16T00:11:24.745033Z', 'linked': False, 'has_bucket_info': False}} 2024-02-16T00:11:26.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1'] 2024-02-16T00:11:26.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1'] 2024-02-16T00:11:26.307 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.390+0000 7f0c3e23d800 1 Processor -- start 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.390+0000 7f0c3e23d800 1 -- start start 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3e23d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562c4ff68320 0x562c4ff6a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3e23d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562c4feafc50 con 0x562c4ff63e90 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3e23d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x562c4fe67450 con 0x562c4ff68320 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3b53b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562c4ff68320 0x562c4ff6a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3bd3c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x562c4ff63e90 0x562c4ff642b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60418/0 (socket says 172.21.15.42:60418) 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3b53b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562c4ff68320 0x562c4ff6a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59682/0 (socket says 172.21.15.42:59682) 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/4107782924 learned_addr learned my addr 172.21.15.42:0/4107782924 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3b53b640 1 -- 172.21.15.42:0/4107782924 >> v1:172.21.15.2:6789/0 conn(0x562c4ff63e90 legacy=0x562c4ff642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.391+0000 7f0c3b53b640 1 -- 172.21.15.42:0/4107782924 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c4ff6bd40 con 0x562c4ff68320 2024-02-16T00:11:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.393+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/4107782924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff68320 0x562c4ff6a710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000a470 tx=0x7f0c3001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4c6602e44bd748 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.393+0000 7f0c3ad3a640 1 -- 172.21.15.42:0/4107782924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c30052570 con 0x562c4ff68320 2024-02-16T00:11:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.393+0000 7f0c3ad3a640 1 -- 172.21.15.42:0/4107782924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c300526d0 con 0x562c4ff68320 2024-02-16T00:11:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.393+0000 7f0c3ad3a640 1 -- 172.21.15.42:0/4107782924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c30052990 con 0x562c4ff68320 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 -- 172.21.15.42:0/4107782924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff68320 msgr2=0x562c4ff6a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/4107782924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff68320 0x562c4ff6a710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000a470 tx=0x7f0c3001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 -- 172.21.15.42:0/4107782924 shutdown_connections 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/4107782924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff68320 0x562c4ff6a710 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 -- 172.21.15.42:0/4107782924 >> 172.21.15.42:0/4107782924 conn(0x562c4ff5f4f0 msgr2=0x562c4ff61910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 -- 172.21.15.42:0/4107782924 shutdown_connections 2024-02-16T00:11:26.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.394+0000 7f0c3e23d800 1 -- 172.21.15.42:0/4107782924 wait complete. 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3e23d800 1 Processor -- start 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3e23d800 1 -- start start 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3e23d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c50053fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3e23d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4fe64980 con 0x562c4ff63e90 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3bd3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c50053fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3bd3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c50053fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59684/0 (socket says 172.21.15.42:59684) 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.405+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/3188191045 learned_addr learned my addr 172.21.15.42:0/3188191045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.406+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/3188191045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30005d20 con 0x562c4ff63e90 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.406+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/3188191045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c50053fd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c001c80 tx=0x7f0c2c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d127b095c58505 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.406+0000 7f0b29e0b640 1 -- 172.21.15.42:0/3188191045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c00e470 con 0x562c4ff63e90 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.406+0000 7f0b29e0b640 1 -- 172.21.15.42:0/3188191045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c00e5d0 con 0x562c4ff63e90 2024-02-16T00:11:26.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.406+0000 7f0b29e0b640 1 -- 172.21.15.42:0/3188191045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c00e8d0 con 0x562c4ff63e90 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- 172.21.15.42:0/3188191045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 msgr2=0x562c50053fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/3188191045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c50053fd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c001c80 tx=0x7f0c2c00b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- 172.21.15.42:0/3188191045 shutdown_connections 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/3188191045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c50053fd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- 172.21.15.42:0/3188191045 >> 172.21.15.42:0/3188191045 conn(0x562c4ff5f4f0 msgr2=0x562c5004f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- 172.21.15.42:0/3188191045 shutdown_connections 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- 172.21.15.42:0/3188191045 wait complete. 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 Processor -- start 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- start start 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c5005f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3e23d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4fe60160 con 0x562c4ff63e90 2024-02-16T00:11:26.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3bd3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c5005f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3bd3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c5005f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59692/0 (socket says 172.21.15.42:59692) 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.407+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/521651163 learned_addr learned my addr 172.21.15.42:0/521651163 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c4feafc50 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c5005f330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c001c80 tx=0x7f0c2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0b23fff640 1 -- 172.21.15.42:0/521651163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c01f070 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0b23fff640 1 -- 172.21.15.42:0/521651163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c018640 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c4fed8010 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0b23fff640 1 -- 172.21.15.42:0/521651163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c0188e0 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.408+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c5005f870 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0b23fff640 1 -- 172.21.15.42:0/521651163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0c2c018b10 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0b23fff640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b24036790 0x7f0b24038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0b23fff640 1 -- 172.21.15.42:0/521651163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0c2c04c340 con 0x562c4ff63e90 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b24036790 0x7f0b24038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c4ff68320 0x562c50063460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c50063a30 con 0x562c4ff68320 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.409+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c4ff68320 0x562c50063460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b24036790 0x7f0b24038c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c30054000 tx=0x7f0c3004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c4ff68320 0x562c50063460 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3c53d640 1 -- 172.21.15.42:0/521651163 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c3400a4a0 con 0x562c4ff68320 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c50060a40 con 0x562c4ff68320 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3c53d640 1 -- 172.21.15.42:0/521651163 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c3400a4a0 con 0x562c4ff68320 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c50065ca0 0x562c50068090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c50068780 con 0x562c50065ca0 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.410+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c50065ca0 0x562c50068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.411+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c50065ca0 0x562c50068090 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.411+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/521651163 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0c2c014070 con 0x562c50065ca0 2024-02-16T00:11:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.411+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c50064c20 con 0x562c4ff68320 2024-02-16T00:11:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.411+0000 7f0c3c53d640 1 -- 172.21.15.42:0/521651163 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0c3400a4a0 con 0x562c4ff68320 2024-02-16T00:11:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.411+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c50065010 con 0x562c4ff68320 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.411+0000 7f0c3c53d640 1 -- 172.21.15.42:0/521651163 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0c3400a4a0 con 0x562c4ff68320 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3e23d800 1 Processor -- start 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3e23d800 1 -- start start 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3e23d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 0x562c50077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3e23d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4fe02e80 con 0x562c50077550 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3c53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 0x562c50077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3c53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 0x562c50077970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59700/0 (socket says 172.21.15.42:59700) 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.412+0000 7f0c3c53d640 1 -- 172.21.15.42:0/27587916 learned_addr learned my addr 172.21.15.42:0/27587916 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0c3c53d640 1 -- 172.21.15.42:0/27587916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c50077eb0 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 0x562c50077970 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x562c4fed7d50 tx=0x7f0c34018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0b217fa640 1 -- 172.21.15.42:0/27587916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c3401d070 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0b217fa640 1 -- 172.21.15.42:0/27587916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340182e0 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c50078920 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0b217fa640 1 -- 172.21.15.42:0/27587916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c340145a0 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.413+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c50078de0 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0b217fa640 1 -- 172.21.15.42:0/27587916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0c34020020 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0b217fa640 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b140367e0 0x7f0b14038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0b217fa640 1 -- 172.21.15.42:0/27587916 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0c3404db60 con 0x562c50077550 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b140367e0 0x7f0b14038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0c3e23d800 1 Processor -- start 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0c3e23d800 1 -- start start 2024-02-16T00:11:26.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b140367e0 0x7f0b14038ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x562c50063e00 tx=0x7f0c2c040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0c3e23d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5005cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.414+0000 7f0c3e23d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4fdd85d0 con 0x562c5005c9b0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0c3c53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5005cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0c3c53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5005cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59702/0 (socket says 172.21.15.42:59702) 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0c3c53d640 1 -- 172.21.15.42:0/418710511 learned_addr learned my addr 172.21.15.42:0/418710511 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0c3c53d640 1 -- 172.21.15.42:0/418710511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c5005b1a0 con 0x562c5005c9b0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/418710511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5005cdd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c3404bf70 tx=0x7f0c34013570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be9642b1fb9a5c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0b1affd640 1 -- 172.21.15.42:0/418710511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c34016440 con 0x562c5005c9b0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0b1affd640 1 -- 172.21.15.42:0/418710511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340165a0 con 0x562c5005c9b0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0b1affd640 1 -- 172.21.15.42:0/418710511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c34004750 con 0x562c5005c9b0 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.415+0000 7f0c3e23d800 1 -- 172.21.15.42:0/418710511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 msgr2=0x562c5005cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/418710511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5005cdd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c3404bf70 tx=0x7f0c34013570 comp rx=0 tx=0).stop 2024-02-16T00:11:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 -- 172.21.15.42:0/418710511 shutdown_connections 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/418710511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5005cdd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 -- 172.21.15.42:0/418710511 >> 172.21.15.42:0/418710511 conn(0x562c50080ab0 msgr2=0x562c5007eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 -- 172.21.15.42:0/418710511 shutdown_connections 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 -- 172.21.15.42:0/418710511 wait complete. 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 Processor -- start 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 -- start start 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5008d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3e23d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c5008dec0 con 0x562c5005c9b0 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3c53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5008d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3c53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5008d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59712/0 (socket says 172.21.15.42:59712) 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.416+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 learned_addr learned my addr 172.21.15.42:0/1605744005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c50078de0 con 0x562c5005c9b0 2024-02-16T00:11:26.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5008d980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c34048010 tx=0x7f0c3404bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0b197fa640 1 -- 172.21.15.42:0/1605744005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c34034070 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0b197fa640 1 -- 172.21.15.42:0/1605744005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340116f0 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c5008e0c0 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0b197fa640 1 -- 172.21.15.42:0/1605744005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c34013890 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.417+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c5008e520 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0b197fa640 1 -- 172.21.15.42:0/1605744005 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0c34014910 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0b197fa640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b040367e0 0x7f0b04038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0b197fa640 1 -- 172.21.15.42:0/1605744005 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0c340073b0 con 0x562c5005c9b0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b040367e0 0x7f0b04038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b040367e0 0x7f0b04038ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c04c2b0 tx=0x7f0c2c025000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.418+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c500996a0 0x562c5009bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c5009c2b0 con 0x562c500996a0 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c500996a0 0x562c5009bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c500996a0 0x562c5009bb60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c30059040 con 0x562c500996a0 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 20 realm 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c5009c6a0 con 0x562c500996a0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c30059040 con 0x562c500996a0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.419+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c5009cf20 con 0x562c500996a0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c30059040 con 0x562c500996a0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c5009d280 con 0x562c500996a0 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c30059040 con 0x562c500996a0 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c5009df90 0x562c500a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c5009df90 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c5009df90 0x562c500a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.420+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c5009df90 0x562c500a0380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0c3404ddb0 con 0x562c5009df90 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3e23d800 20 searching for the correct realm 2024-02-16T00:11:26.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562c500a2c60 0x562c500a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a57f0 con 0x562c500a2c60 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562c500a2c60 0x562c500a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.421+0000 7f0c3bd3c640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562c500a2c60 0x562c500a5120 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.422+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.422+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a57f0 con 0x562c5009df90 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.422+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c3404ddb0 con 0x562c5009df90 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.422+0000 7f0c3c53d640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0c3402bc20 0x7f0c340480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.422+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.422+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0c3402bc20 0x7f0c340480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0c3402bc20 0x7f0c340480b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.423+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c5009df90 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.424+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c5009df90 2024-02-16T00:11:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.425+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.426+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.427+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.428+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.428+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c5009df90 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.428+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.428+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.428+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.428+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c5009df90 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.429+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.430+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.430+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x7f0c3402bc20 2024-02-16T00:11:26.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.430+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.430+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.430+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.430+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c5009df90 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a1060 con 0x562c500996a0 2024-02-16T00:11:26.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a1410 con 0x562c500996a0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.431+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a17f0 con 0x562c500996a0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 zone default found 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 4 Realm: () 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 zonegroup default 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a5c30 con 0x7f0c3402bc20 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a7ab0 con 0x562c500a2c60 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.432+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a7e10 con 0x562c500a2c60 2024-02-16T00:11:26.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.433+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.433+0000 7f0c3e23d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.433+0000 7f0c3e23d800 20 started sync module instance, tier type = 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.433+0000 7f0c3e23d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.433+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a7080 con 0x562c5009df90 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.434+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.434+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748321412192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a7080 con 0x562c5009df90 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.434+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a8780 con 0x562c500996a0 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.435+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94748321412192] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.435+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.435+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748321416384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a7080 con 0x562c500996a0 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.435+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a91f0 con 0x562c500a2c60 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.436+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.436+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748321418448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a9a80 con 0x562c500a2c60 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.436+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500aa520 con 0x562c5009df90 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.436+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94748321416384] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.437+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94748321418448] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.437+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.437+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748321423360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a95a0 con 0x562c5009df90 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.437+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500aaee0 con 0x562c500996a0 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.438+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.438+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748321425984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500ab300 con 0x562c500996a0 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.438+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500abda0 con 0x7f0c3402bc20 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.438+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94748321423360] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.439+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.439+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748321429632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500abd60 con 0x7f0c3402bc20 2024-02-16T00:11:26.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.439+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94748321425984] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.439+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500ac800 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.440+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94748321429632] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.440+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.440+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748321427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500ac2f0 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.440+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500acca0 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94748321427168] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748321410016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500acca0 con 0x7f0c3402bc20 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=0 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=1 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=2 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=3 2024-02-16T00:11:26.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=4 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=5 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.441+0000 7f0c3e23d800 20 add_watcher() i=6 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.442+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94748321410016] v27'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.442+0000 7f0c3e23d800 20 add_watcher() i=7 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.442+0000 7f0c3e23d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.442+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500acca0 con 0x562c500996a0 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.442+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.442+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748321435792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500ad950 con 0x562c500996a0 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.443+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94748321435792] v27'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.443+0000 7f0af1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.443+0000 7f0c3e23d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.443+0000 7f0c3e23d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.443+0000 7f0c3e23d800 5 note: GC not initialized 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0af0fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0c3e23d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0c3e23d800 20 Filter name: none 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0a6a7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0c3e23d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.444+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e21d0 con 0x7f0c3402bc20 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:26.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e3d30 con 0x562c5009df90 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5730 con 0x562c500996a0 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.445+0000 7f0c3e23d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.446+0000 7f0c3e23d800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.446+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e9c60 con 0x562c5009df90 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.446+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 foo.buckets [call] v27'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.447+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500efc60 con 0x562c500996a0 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(66 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v27'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94748321668528 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500ea050 con 0x562c5009df90 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== watch-notify(notify (1) cookie 94748321412192 notify 115964117011 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f0c34069040 con 0x562c5009df90 2024-02-16T00:11:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0b1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94748321412192 notifier 4495 bl.length()=725 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0b1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(67 notify.0 [notify cookie 94748321668528 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0b1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0b1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0b1affd640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0b00003e90 con 0x562c5009df90 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== watch-notify(notify_complete (2) cookie 94748321668528 notify 115964117011 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562c5008e520 con 0x562c5009df90 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_sources= new_sources= 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential sources added=[] removed=[] 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_dests= new_dests= 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential dests added=[] removed=[] 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.448+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x7f0c3402bc20 2024-02-16T00:11:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.449+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 fud.buckets [call] v27'3 uv3 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.449+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x562c5009df90 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3e23d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3e23d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3e23d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94748321679072 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x7f0c3402bc20 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== watch-notify(notify (1) cookie 94748321427168 notify 115964116995 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f0c30084040 con 0x7f0c3402bc20 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0b1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94748321427168 notifier 4495 bl.length()=314 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0b1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0b1affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(71 notify.6 [notify cookie 94748321679072 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0b1affd640 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0b000041f0 con 0x7f0c3402bc20 2024-02-16T00:11:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.451+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== watch-notify(notify_complete (2) cookie 94748321679072 notify 115964116995 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0c30079040 con 0x7f0c3402bc20 2024-02-16T00:11:26.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.452+0000 7f0af1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.452+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748321435792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x562c500996a0 2024-02-16T00:11:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.453+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94748321435792] v27'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.453+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748321412192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x562c5009df90 2024-02-16T00:11:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.454+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94748321412192] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.454+0000 7f0c3e23d800 20 remove_watcher() i=0 2024-02-16T00:11:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.454+0000 7f0c3e23d800 2 removed watcher, disabling cache 2024-02-16T00:11:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.454+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748321416384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500996a0 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.455+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94748321416384] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.455+0000 7f0c3e23d800 20 remove_watcher() i=1 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.455+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748321418448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500a0990 con 0x562c500a2c60 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.456+0000 7f0c3bd3c640 1 -- 172.21.15.42:0/1605744005 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94748321418448] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c2c014070 con 0x562c500a2c60 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.456+0000 7f0c3e23d800 20 remove_watcher() i=2 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.456+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748321423360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x562c5009df90 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.457+0000 7f0c3c53d640 1 -- 172.21.15.42:0/1605744005 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94748321423360] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c34062040 con 0x562c5009df90 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.457+0000 7f0c3e23d800 20 remove_watcher() i=3 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.457+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748321425984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x562c500996a0 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.458+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94748321425984] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x562c500996a0 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.458+0000 7f0c3e23d800 20 remove_watcher() i=4 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.458+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748321429632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x7f0c3402bc20 2024-02-16T00:11:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.459+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94748321429632] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.459+0000 7f0c3e23d800 20 remove_watcher() i=5 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.459+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748321427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x7f0c3402bc20 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.460+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94748321427168] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.460+0000 7f0c3e23d800 20 remove_watcher() i=6 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.460+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748321410016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562c500e5eb0 con 0x7f0c3402bc20 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94748321410016] v27'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0c30071040 con 0x7f0c3402bc20 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 20 remove_watcher() i=7 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0c3402bc20 msgr2=0x7f0c340480b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0c3402bc20 0x7f0c340480b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c500996a0 msgr2=0x562c5009bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c500996a0 0x562c5009bb60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c5009df90 msgr2=0x562c500a0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c5009df90 0x562c500a0380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562c500a2c60 msgr2=0x562c500a5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562c500a2c60 0x562c500a5120 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b040367e0 msgr2=0x7f0b04038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b040367e0 0x7f0b04038ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c04c2b0 tx=0x7f0c2c025000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 msgr2=0x562c5008d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/1605744005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c5005c9b0 0x562c5008d980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c34048010 tx=0x7f0c3404bf00 comp rx=0 tx=0).stop 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 reap_dead start 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3b53b640 1 -- 172.21.15.42:0/1605744005 reap_dead start 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 shutdown_connections 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 >> 172.21.15.42:0/1605744005 conn(0x562c50080ab0 msgr2=0x562c5007e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 shutdown_connections 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.461+0000 7f0c3e23d800 1 -- 172.21.15.42:0/1605744005 wait complete. 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b140367e0 msgr2=0x7f0b14038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b140367e0 0x7f0b14038ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x562c50063e00 tx=0x7f0c2c040040 comp rx=0 tx=0).stop 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 msgr2=0x562c50077970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 0x562c50077970 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x562c4fed7d50 tx=0x7f0c34018830 comp rx=0 tx=0).stop 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 shutdown_connections 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b140367e0 0x7f0b14038ca0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/27587916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c50077550 0x562c50077970 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 >> 172.21.15.42:0/27587916 conn(0x562c5006b5f0 msgr2=0x562c5006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 shutdown_connections 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/27587916 wait complete. 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c4ff68320 msgr2=0x562c50063460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c4ff68320 0x562c50063460 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c50065ca0 msgr2=0x562c50068090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c50065ca0 0x562c50068090 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b24036790 msgr2=0x7f0b24038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b24036790 0x7f0b24038c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c30054000 tx=0x7f0c3004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 msgr2=0x562c5005f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c5005f330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c001c80 tx=0x7f0c2c000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 shutdown_connections 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562c50065ca0 0x562c50068090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562c4ff68320 0x562c50063460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b24036790 0x7f0b24038c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 --2- 172.21.15.42:0/521651163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c4ff63e90 0x562c5005f330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 >> 172.21.15.42:0/521651163 conn(0x562c4ff5f4f0 msgr2=0x562c5004e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 shutdown_connections 2024-02-16T00:11:26.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.462+0000 7f0c3e23d800 1 -- 172.21.15.42:0/521651163 wait complete. 2024-02-16T00:11:26.482 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T00:11:26.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T00:11:26.482 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T00:11:26.524 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.524 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1cf42800 1 Processor -- start 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1cf42800 1 -- start start 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1cf42800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa2c3fb3d0 0x55fa2c403ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1cf42800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fa2c345bb0 con 0x55fa2c3f9890 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1cf42800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fa2c2fd450 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1844a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa2c3fb3d0 0x55fa2c403ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1844a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55fa2c3fb3d0 0x55fa2c403ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59714/0 (socket says 172.21.15.42:59714) 2024-02-16T00:11:26.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d1844a640 1 -- 172.21.15.42:0/1496231580 learned_addr learned my addr 172.21.15.42:0/1496231580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.522+0000 7f1d18c4b640 1 --1- 172.21.15.42:0/1496231580 >> v1:172.21.15.2:6789/0 conn(0x55fa2c3f9890 0x55fa2c3f9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60434/0 (socket says 172.21.15.42:60434) 2024-02-16T00:11:26.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.523+0000 7f1d17c49640 1 -- 172.21.15.42:0/1496231580 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751167982 0 0) 0x55fa2c345bb0 con 0x55fa2c3f9890 2024-02-16T00:11:26.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.523+0000 7f1d17c49640 1 -- 172.21.15.42:0/1496231580 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d00001e10 con 0x55fa2c3f9890 2024-02-16T00:11:26.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.523+0000 7f1d1844a640 1 -- 172.21.15.42:0/1496231580 >> v1:172.21.15.2:6789/0 conn(0x55fa2c3f9890 legacy=0x55fa2c3f9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.523+0000 7f1d1844a640 1 -- 172.21.15.42:0/1496231580 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2c36e180 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1844a640 1 --2- 172.21.15.42:0/1496231580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3fb3d0 0x55fa2c403ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800a520 tx=0x7f1d0801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fada182c1d88414 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d17c49640 1 -- 172.21.15.42:0/1496231580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d08052570 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d17c49640 1 -- 172.21.15.42:0/1496231580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d080526d0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d17c49640 1 -- 172.21.15.42:0/1496231580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d08052970 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1496231580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3fb3d0 msgr2=0x55fa2c403ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1496231580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3fb3d0 0x55fa2c403ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800a520 tx=0x7f1d0801ce00 comp rx=0 tx=0).stop 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1496231580 shutdown_connections 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1496231580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3fb3d0 0x55fa2c403ed0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1496231580 >> 172.21.15.42:0/1496231580 conn(0x55fa2c3f54d0 msgr2=0x55fa2c3f78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1496231580 shutdown_connections 2024-02-16T00:11:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.525+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1496231580 wait complete. 2024-02-16T00:11:26.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d1cf42800 1 Processor -- start 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d1cf42800 1 -- start start 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d1cf42800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d1cf42800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2c2fa980 con 0x55fa2c3f9890 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d18c4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d18c4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4ed0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59720/0 (socket says 172.21.15.42:59720) 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d18c4b640 1 -- 172.21.15.42:0/3036405525 learned_addr learned my addr 172.21.15.42:0/3036405525 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.537+0000 7f1d18c4b640 1 -- 172.21.15.42:0/3036405525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08005de0 con 0x55fa2c3f9890 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/3036405525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4ed0c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c006de0 tx=0x7f1d0c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ea085e3ff029a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1c06e0d640 1 -- 172.21.15.42:0/3036405525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c013420 con 0x55fa2c3f9890 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1c06e0d640 1 -- 172.21.15.42:0/3036405525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c013580 con 0x55fa2c3f9890 2024-02-16T00:11:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1c06e0d640 1 -- 172.21.15.42:0/3036405525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c0138e0 con 0x55fa2c3f9890 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3036405525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 msgr2=0x55fa2c4ed0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/3036405525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4ed0c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c006de0 tx=0x7f1d0c001a20 comp rx=0 tx=0).stop 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3036405525 shutdown_connections 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/3036405525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4ed0c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3036405525 >> 172.21.15.42:0/3036405525 conn(0x55fa2c3f54d0 msgr2=0x55fa2c4e89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3036405525 shutdown_connections 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.538+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3036405525 wait complete. 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d1cf42800 1 Processor -- start 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d1cf42800 1 -- start start 2024-02-16T00:11:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d1cf42800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d1cf42800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2c2f6160 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d18c4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d18c4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59728/0 (socket says 172.21.15.42:59728) 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d18c4b640 1 -- 172.21.15.42:0/1595938481 learned_addr learned my addr 172.21.15.42:0/1595938481 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d18c4b640 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00001e10 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.539+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4f47f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00f000 tx=0x7f1d0c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.540+0000 7f1c0560a640 1 -- 172.21.15.42:0/1595938481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c006680 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.540+0000 7f1c0560a640 1 -- 172.21.15.42:0/1595938481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c004a40 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.540+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa2c4f4d30 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.540+0000 7f1c0560a640 1 -- 172.21.15.42:0/1595938481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c004d20 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.540+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa2c4f5210 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.540+0000 7f1c0560a640 1 -- 172.21.15.42:0/1595938481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1d0c01e420 con 0x55fa2c3f9890 2024-02-16T00:11:26.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1c0560a640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1c00036790 0x7f1c00038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1c0560a640 1 -- 172.21.15.42:0/1595938481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1d0c04c3d0 con 0x55fa2c3f9890 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1d1844a640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1c00036790 0x7f1c00038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c3fb3d0 0x55fa2c4fb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c4fbb40 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1d1944c640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c3fb3d0 0x55fa2c4fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1d1844a640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1c00036790 0x7f1c00038c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d08054000 tx=0x7f1d0804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.541+0000 7f1d1944c640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c3fb3d0 0x55fa2c4fb550 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d1944c640 1 -- 172.21.15.42:0/1595938481 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c4f8be0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d1944c640 1 -- 172.21.15.42:0/1595938481 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c4fdd50 0x55fa2c500140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c500830 con 0x55fa2c4fdd50 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c4fdd50 0x55fa2c500140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.542+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c4fdd50 0x55fa2c500140 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.543+0000 7f1d18c4b640 1 -- 172.21.15.42:0/1595938481 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c4fdd50 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.543+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c4fccd0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.543+0000 7f1d1944c640 1 -- 172.21.15.42:0/1595938481 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.543+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c4fd120 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.543+0000 7f1d1944c640 1 -- 172.21.15.42:0/1595938481 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c3fb3d0 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.543+0000 7f1d1cf42800 1 Processor -- start 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1cf42800 1 -- start start 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1cf42800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 0x55fa2c50fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1cf42800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2c298e80 con 0x55fa2c50f5f0 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1944c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 0x55fa2c50fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1944c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 0x55fa2c50fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59738/0 (socket says 172.21.15.42:59738) 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1944c640 1 -- 172.21.15.42:0/3400333539 learned_addr learned my addr 172.21.15.42:0/3400333539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1944c640 1 -- 172.21.15.42:0/3400333539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2c50ff50 con 0x55fa2c50f5f0 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1944c640 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 0x55fa2c50fa10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55fa2c4f5bf0 tx=0x7f1d1000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1bfe7fc640 1 -- 172.21.15.42:0/3400333539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d1000f040 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1bfe7fc640 1 -- 172.21.15.42:0/3400333539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10007d00 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.544+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa2c5109c0 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.545+0000 7f1bfe7fc640 1 -- 172.21.15.42:0/3400333539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10019420 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.545+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa2c510e80 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.545+0000 7f1bfe7fc640 1 -- 172.21.15.42:0/3400333539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1d10019580 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.545+0000 7f1bfe7fc640 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1bf0036830 0x7f1bf0038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.545+0000 7f1bfe7fc640 1 -- 172.21.15.42:0/3400333539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1d1004e390 con 0x55fa2c50f5f0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.545+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1bf0036830 0x7f1bf0038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1cf42800 1 Processor -- start 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1cf42800 1 -- start start 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1bf0036830 0x7f1bf0038cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55fa2c4fbf10 tx=0x7f1d0c027f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1cf42800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c51ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1cf42800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2c26e5d0 con 0x55fa2c51c8a0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1944c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c51ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1944c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c51ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59742/0 (socket says 172.21.15.42:59742) 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1944c640 1 -- 172.21.15.42:0/2233075078 learned_addr learned my addr 172.21.15.42:0/2233075078 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1944c640 1 -- 172.21.15.42:0/2233075078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2c51d290 con 0x55fa2c51c8a0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1d1944c640 1 --2- 172.21.15.42:0/2233075078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c51ccc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1d1004c710 tx=0x7f1d10017c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99121d00844955f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.546+0000 7f1beffff640 1 -- 172.21.15.42:0/2233075078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10023790 con 0x55fa2c51c8a0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1beffff640 1 -- 172.21.15.42:0/2233075078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d100238f0 con 0x55fa2c51c8a0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1beffff640 1 -- 172.21.15.42:0/2233075078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10022de0 con 0x55fa2c51c8a0 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 -- 172.21.15.42:0/2233075078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 msgr2=0x55fa2c51ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/2233075078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c51ccc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1d1004c710 tx=0x7f1d10017c00 comp rx=0 tx=0).stop 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 -- 172.21.15.42:0/2233075078 shutdown_connections 2024-02-16T00:11:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/2233075078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c51ccc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 -- 172.21.15.42:0/2233075078 >> 172.21.15.42:0/2233075078 conn(0x55fa2c518b70 msgr2=0x55fa2c516bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 -- 172.21.15.42:0/2233075078 shutdown_connections 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 -- 172.21.15.42:0/2233075078 wait complete. 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 Processor -- start 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.547+0000 7f1d1cf42800 1 -- start start 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1cf42800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c523880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1cf42800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2c523dc0 con 0x55fa2c51c8a0 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1944c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c523880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1944c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c523880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59756/0 (socket says 172.21.15.42:59756) 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 learned_addr learned my addr 172.21.15.42:0/615636986 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2c510e80 con 0x55fa2c51c8a0 2024-02-16T00:11:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1944c640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c523880 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1d1004b600 tx=0x7f1d1004c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1bee7fc640 1 -- 172.21.15.42:0/615636986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10032070 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1bee7fc640 1 -- 172.21.15.42:0/615636986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10022ab0 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa2c523fc0 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1bee7fc640 1 -- 172.21.15.42:0/615636986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10015c40 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.548+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa2c524480 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.549+0000 7f1bee7fc640 1 -- 172.21.15.42:0/615636986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1d10018a30 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.549+0000 7f1bee7fc640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1be4036740 0x7f1be4038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.549+0000 7f1bee7fc640 1 -- 172.21.15.42:0/615636986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1d10038c60 con 0x55fa2c51c8a0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.549+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1be4036740 0x7f1be4038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.550+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1be4036740 0x7f1be4038c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0046b0 tx=0x7f1d0c035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.550+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.550+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c52f410 0x55fa2c5318d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.550+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c532020 con 0x55fa2c52f410 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.550+0000 7f1d1844a640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c52f410 0x55fa2c5318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.550+0000 7f1d1844a640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c52f410 0x55fa2c5318d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 realm 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c5323b0 con 0x55fa2c52f410 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c532bb0 con 0x55fa2c52f410 2024-02-16T00:11:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c532f10 con 0x55fa2c52f410 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c533c20 0x55fa2c536010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c533c20 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.551+0000 7f1d1944c640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c533c20 0x55fa2c536010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d1944c640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c533c20 0x55fa2c536010 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d1cf42800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d1cf42800 20 searching for the correct realm 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55fa2c5388f0 0x55fa2c53adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53b480 con 0x55fa2c5388f0 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55fa2c5388f0 0x55fa2c53adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.552+0000 7f1d18c4b640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55fa2c5388f0 0x55fa2c53adb0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.553+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.553+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53b480 con 0x55fa2c533c20 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.553+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.553+0000 7f1d1944c640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1d10019040 0x7f1d1004ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.553+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.553+0000 7f1d1844a640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1d10019040 0x7f1d1004ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.554+0000 7f1d1844a640 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1d10019040 0x7f1d1004ca40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.554+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.554+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.554+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.554+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c533c20 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.555+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.556+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.556+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.556+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.556+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c533c20 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.557+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.558+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.559+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.559+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.559+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.559+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c533c20 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.559+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.559+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.560+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c533c20 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c5388f0 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x7f1d10019040 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c52f410 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.561+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536620 con 0x55fa2c533c20 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c536cf0 con 0x55fa2c52f410 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c5370a0 con 0x55fa2c52f410 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.562+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c537480 con 0x55fa2c52f410 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 zone default found 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 4 Realm: () 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 zonegroup default 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53b8c0 con 0x7f1d10019040 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c537e10 con 0x55fa2c5388f0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.563+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53d860 con 0x55fa2c5388f0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.564+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.564+0000 7f1d1cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.564+0000 7f1d1cf42800 20 started sync module instance, tier type = 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.564+0000 7f1d1cf42800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.564+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53cd10 con 0x55fa2c533c20 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.565+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.565+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94532973875664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53dc80 con 0x55fa2c533c20 2024-02-16T00:11:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.565+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53e480 con 0x55fa2c52f410 2024-02-16T00:11:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.566+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.566+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94532973878880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53e900 con 0x55fa2c52f410 2024-02-16T00:11:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.566+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53f3d0 con 0x55fa2c5388f0 2024-02-16T00:11:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.566+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94532973875664] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.567+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.567+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94532973883056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53f780 con 0x55fa2c5388f0 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.567+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c540220 con 0x55fa2c533c20 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.567+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94532973878880] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.568+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94532973883056] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.568+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.568+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94532973873264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53e360 con 0x55fa2c533c20 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.568+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c540be0 con 0x55fa2c52f410 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.569+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.569+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94532973889344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c541000 con 0x55fa2c52f410 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.569+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c541a80 con 0x7f1d10019040 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.569+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94532973873264] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.570+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.570+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94532973889344] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.570+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94532973892992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c541a40 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.570+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c540b60 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.571+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94532973892992] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.571+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.571+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94532973890400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c541fa0 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.571+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c542950 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94532973890400] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94532973886720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c542910 con 0x7f1d10019040 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=0 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=1 2024-02-16T00:11:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=2 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=3 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=4 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=5 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1cf42800 20 add_watcher() i=6 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.572+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94532973886720] v27'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.573+0000 7f1d1cf42800 20 add_watcher() i=7 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.573+0000 7f1d1cf42800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.573+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c5428f0 con 0x55fa2c52f410 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.573+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.573+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94532973899056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c5435f0 con 0x55fa2c52f410 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.574+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94532973899056] v27'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.574+0000 7f1bcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.574+0000 7f1d1cf42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.574+0000 7f1d1cf42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.574+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c5459d0 con 0x55fa2c52f410 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.575+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'45 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.575+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c545990 con 0x7f1d10019040 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.577+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'20 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.577+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c54f2b0 con 0x55fa2c5388f0 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.578+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'20 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.578+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c54fc80 con 0x55fa2c52f410 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.578+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'119 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.579+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c54e7b0 con 0x55fa2c533c20 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.579+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'38 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.579+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c54e7b0 con 0x55fa2c5388f0 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.580+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'33 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.580+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c550e60 con 0x55fa2c52f410 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.581+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.581+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c550e60 con 0x7f1d10019040 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.582+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'28 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.583+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c550ef0 con 0x55fa2c533c20 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.583+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.583+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551420 con 0x55fa2c5388f0 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.584+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.584+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551950 con 0x55fa2c533c20 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.585+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'39 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.585+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551df0 con 0x7f1d10019040 2024-02-16T00:11:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.586+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.586+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551df0 con 0x55fa2c533c20 2024-02-16T00:11:26.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.587+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'20 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.587+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551df0 con 0x7f1d10019040 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.588+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'39 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.588+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551df0 con 0x55fa2c52f410 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.589+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'120 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.589+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551df0 con 0x55fa2c5388f0 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.590+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'32 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.590+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551c20 con 0x55fa2c533c20 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.591+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'40 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.591+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551c20 con 0x55fa2c5388f0 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.592+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.592+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c52f410 2024-02-16T00:11:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.593+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.593+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c52f410 2024-02-16T00:11:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.594+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'121 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.594+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.595+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'33 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.595+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c533c20 2024-02-16T00:11:26.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.596+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'32 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.596+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.597+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.597+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.597+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.597+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.598+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.598+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.599+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'34 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.599+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x7f1d10019040 2024-02-16T00:11:26.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.600+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.600+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.601+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.601+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x7f1d10019040 2024-02-16T00:11:26.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.602+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.602+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c5388f0 2024-02-16T00:11:26.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.603+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.603+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x7f1d10019040 2024-02-16T00:11:26.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.604+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'40 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.604+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c551bd0 con 0x55fa2c533c20 2024-02-16T00:11:26.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.605+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1bcdfe3640 20 reqs_thread_entry: start 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 20 Filter name: none 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1b3f7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c57bb90 con 0x7f1d10019040 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.606+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c57dbb0 con 0x7f1d10019040 2024-02-16T00:11:26.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.607+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.611 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T00:11:26.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.607+0000 7f1bcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.607+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94532973899056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c54fc80 con 0x55fa2c52f410 2024-02-16T00:11:26.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.608+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94532973899056] v27'122 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.608+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94532973875664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c542d30 con 0x55fa2c533c20 2024-02-16T00:11:26.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.609+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94532973875664] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.609+0000 7f1d1cf42800 20 remove_watcher() i=0 2024-02-16T00:11:26.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.609+0000 7f1d1cf42800 2 removed watcher, disabling cache 2024-02-16T00:11:26.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.609+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94532973878880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c542d30 con 0x55fa2c52f410 2024-02-16T00:11:26.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.611+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94532973878880] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.611+0000 7f1d1cf42800 20 remove_watcher() i=1 2024-02-16T00:11:26.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.611+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94532973883056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c542d30 con 0x55fa2c5388f0 2024-02-16T00:11:26.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.612+0000 7f1d18c4b640 1 -- 172.21.15.42:0/615636986 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94532973883056] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0c0117f0 con 0x55fa2c5388f0 2024-02-16T00:11:26.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.612+0000 7f1d1cf42800 20 remove_watcher() i=2 2024-02-16T00:11:26.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.612+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94532973873264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53eeb0 con 0x55fa2c533c20 2024-02-16T00:11:26.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.613+0000 7f1d1944c640 1 -- 172.21.15.42:0/615636986 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94532973873264] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d100083e0 con 0x55fa2c533c20 2024-02-16T00:11:26.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.613+0000 7f1d1cf42800 20 remove_watcher() i=3 2024-02-16T00:11:26.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.613+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94532973889344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c542d30 con 0x55fa2c52f410 2024-02-16T00:11:26.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.614+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94532973889344] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x55fa2c52f410 2024-02-16T00:11:26.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.614+0000 7f1d1cf42800 20 remove_watcher() i=4 2024-02-16T00:11:26.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.614+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94532973892992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c53eeb0 con 0x7f1d10019040 2024-02-16T00:11:26.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.615+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94532973892992] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.615+0000 7f1d1cf42800 20 remove_watcher() i=5 2024-02-16T00:11:26.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.615+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94532973890400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c540740 con 0x7f1d10019040 2024-02-16T00:11:26.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.616+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94532973890400] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.616+0000 7f1d1cf42800 20 remove_watcher() i=6 2024-02-16T00:11:26.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.616+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94532973886720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55fa2c541580 con 0x7f1d10019040 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94532973886720] v27'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d08052b00 con 0x7f1d10019040 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 20 remove_watcher() i=7 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1d10019040 msgr2=0x7f1d1004ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1d10019040 0x7f1d1004ca40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c52f410 msgr2=0x55fa2c5318d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c52f410 0x55fa2c5318d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c533c20 msgr2=0x55fa2c536010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c533c20 0x55fa2c536010 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55fa2c5388f0 msgr2=0x55fa2c53adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55fa2c5388f0 0x55fa2c53adb0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1be4036740 msgr2=0x7f1be4038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1be4036740 0x7f1be4038c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0046b0 tx=0x7f1d0c035000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 msgr2=0x55fa2c523880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/615636986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c51c8a0 0x55fa2c523880 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1d1004b600 tx=0x7f1d1004c670 comp rx=0 tx=0).stop 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 reap_dead start 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1844a640 1 -- 172.21.15.42:0/615636986 reap_dead start 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 shutdown_connections 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 >> 172.21.15.42:0/615636986 conn(0x55fa2c518b70 msgr2=0x55fa2c5161d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 shutdown_connections 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/615636986 wait complete. 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1bf0036830 msgr2=0x7f1bf0038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1bf0036830 0x7f1bf0038cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55fa2c4fbf10 tx=0x7f1d0c027f70 comp rx=0 tx=0).stop 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 msgr2=0x55fa2c50fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 0x55fa2c50fa10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55fa2c4f5bf0 tx=0x7f1d1000aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 shutdown_connections 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1bf0036830 0x7f1bf0038cf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/3400333539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c50f5f0 0x55fa2c50fa10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 >> 172.21.15.42:0/3400333539 conn(0x55fa2c503690 msgr2=0x55fa2c503a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 shutdown_connections 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.617+0000 7f1d1cf42800 1 -- 172.21.15.42:0/3400333539 wait complete. 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c3fb3d0 msgr2=0x55fa2c4fb550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c3fb3d0 0x55fa2c4fb550 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c4fdd50 msgr2=0x55fa2c500140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c4fdd50 0x55fa2c500140 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1c00036790 msgr2=0x7f1c00038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1c00036790 0x7f1c00038c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d08054000 tx=0x7f1d0804e000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 msgr2=0x55fa2c4f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4f47f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00f000 tx=0x7f1d0c000f40 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 shutdown_connections 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55fa2c4fdd50 0x55fa2c500140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55fa2c3fb3d0 0x55fa2c4fb550 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1c00036790 0x7f1c00038c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 --2- 172.21.15.42:0/1595938481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fa2c3f9890 0x55fa2c4f47f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 >> 172.21.15.42:0/1595938481 conn(0x55fa2c3f54d0 msgr2=0x55fa2c4e7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 shutdown_connections 2024-02-16T00:11:26.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.618+0000 7f1d1cf42800 1 -- 172.21.15.42:0/1595938481 wait complete. 2024-02-16T00:11:26.628 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T00:11:26.629 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-16T00:11:26.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-16T00:11:26.629 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-02-16T00:11:26.713 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.711+0000 7f4ba1411800 1 Processor -- start 2024-02-16T00:11:26.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.711+0000 7f4ba1411800 1 -- start start 2024-02-16T00:11:26.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4ba1411800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563b02b124d0 0x563b02b148c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4ba1411800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563b02a58ba0 con 0x563b02b0e040 2024-02-16T00:11:26.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4ba1411800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x563b02a10450 con 0x563b02b124d0 2024-02-16T00:11:26.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9c301640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563b02b124d0 0x563b02b148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9cb02640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x563b02b0e040 0x563b02b0e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60442/0 (socket says 172.21.15.42:60442) 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9c301640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563b02b124d0 0x563b02b148c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59770/0 (socket says 172.21.15.42:59770) 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9cb02640 1 -- 172.21.15.42:0/3476602726 learned_addr learned my addr 172.21.15.42:0/3476602726 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9bb00640 1 -- 172.21.15.42:0/3476602726 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120667058 0 0) 0x563b02a58ba0 con 0x563b02b0e040 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9bb00640 1 -- 172.21.15.42:0/3476602726 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84001e10 con 0x563b02b0e040 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9c301640 1 -- 172.21.15.42:0/3476602726 >> v1:172.21.15.2:6789/0 conn(0x563b02b0e040 legacy=0x563b02b0e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.712+0000 7f4b9c301640 1 -- 172.21.15.42:0/3476602726 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b02b15ef0 con 0x563b02b124d0 2024-02-16T00:11:26.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.714+0000 7f4b9c301640 1 --2- 172.21.15.42:0/3476602726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b124d0 0x563b02b148c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000a470 tx=0x7f4b9001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5264ec0675f4e87e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.714+0000 7f4b9bb00640 1 -- 172.21.15.42:0/3476602726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b9004ad60 con 0x563b02b124d0 2024-02-16T00:11:26.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.714+0000 7f4b9bb00640 1 -- 172.21.15.42:0/3476602726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90052440 con 0x563b02b124d0 2024-02-16T00:11:26.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.714+0000 7f4b9bb00640 1 -- 172.21.15.42:0/3476602726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b90052700 con 0x563b02b124d0 2024-02-16T00:11:26.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 -- 172.21.15.42:0/3476602726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b124d0 msgr2=0x563b02b148c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 --2- 172.21.15.42:0/3476602726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b124d0 0x563b02b148c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000a470 tx=0x7f4b9001cc80 comp rx=0 tx=0).stop 2024-02-16T00:11:26.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 -- 172.21.15.42:0/3476602726 shutdown_connections 2024-02-16T00:11:26.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 --2- 172.21.15.42:0/3476602726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b124d0 0x563b02b148c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 -- 172.21.15.42:0/3476602726 >> 172.21.15.42:0/3476602726 conn(0x563b02b095e0 msgr2=0x563b02b0ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 -- 172.21.15.42:0/3476602726 shutdown_connections 2024-02-16T00:11:26.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.715+0000 7f4ba1411800 1 -- 172.21.15.42:0/3476602726 wait complete. 2024-02-16T00:11:26.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.726+0000 7f4ba1411800 1 Processor -- start 2024-02-16T00:11:26.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.726+0000 7f4ba1411800 1 -- start start 2024-02-16T00:11:26.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4ba1411800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02bfde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4ba1411800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b02a0d980 con 0x563b02b0e040 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4b9cb02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02bfde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4b9cb02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02bfde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59782/0 (socket says 172.21.15.42:59782) 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4b9cb02640 1 -- 172.21.15.42:0/1838454218 learned_addr learned my addr 172.21.15.42:0/1838454218 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4b9cb02640 1 -- 172.21.15.42:0/1838454218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90005d20 con 0x563b02b0e040 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.727+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/1838454218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02bfde80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c001ca0 tx=0x7f4b8c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daea8041476e087a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4a8ae0d640 1 -- 172.21.15.42:0/1838454218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c00e470 con 0x563b02b0e040 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4a8ae0d640 1 -- 172.21.15.42:0/1838454218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c00e5d0 con 0x563b02b0e040 2024-02-16T00:11:26.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4a8ae0d640 1 -- 172.21.15.42:0/1838454218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c00e8f0 con 0x563b02b0e040 2024-02-16T00:11:26.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 -- 172.21.15.42:0/1838454218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 msgr2=0x563b02bfde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 --2- 172.21.15.42:0/1838454218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02bfde80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c001ca0 tx=0x7f4b8c00b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 -- 172.21.15.42:0/1838454218 shutdown_connections 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 --2- 172.21.15.42:0/1838454218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02bfde80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 -- 172.21.15.42:0/1838454218 >> 172.21.15.42:0/1838454218 conn(0x563b02b095e0 msgr2=0x563b02bf97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 -- 172.21.15.42:0/1838454218 shutdown_connections 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.728+0000 7f4ba1411800 1 -- 172.21.15.42:0/1838454218 wait complete. 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4ba1411800 1 Processor -- start 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4ba1411800 1 -- start start 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4ba1411800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02c05540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4ba1411800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b02a09160 con 0x563b02b0e040 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4b9cb02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02c05540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4b9cb02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02c05540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59798/0 (socket says 172.21.15.42:59798) 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4b9cb02640 1 -- 172.21.15.42:0/952345871 learned_addr learned my addr 172.21.15.42:0/952345871 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4b9cb02640 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84001e10 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.729+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02c05540 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0011e0 tx=0x7f4b8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.730+0000 7f4a8960a640 1 -- 172.21.15.42:0/952345871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c01f070 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.730+0000 7f4a8960a640 1 -- 172.21.15.42:0/952345871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c018770 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.730+0000 7f4a8960a640 1 -- 172.21.15.42:0/952345871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c018a70 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.730+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b02c05a80 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.730+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b02c05f60 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.730+0000 7f4a8960a640 1 -- 172.21.15.42:0/952345871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b8c018ce0 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4a8960a640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a840367e0 0x7f4a84038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4a8960a640 1 -- 172.21.15.42:0/952345871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4b8c04c3d0 con 0x563b02b0e040 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4b9c301640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a840367e0 0x7f4a84038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02b124d0 0x563b02c0c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c0c850 con 0x563b02b124d0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4b9d303640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02b124d0 0x563b02c0c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4b9c301640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a840367e0 0x7f4a84038ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b90054000 tx=0x7f4b9004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.731+0000 7f4b9d303640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02b124d0 0x563b02c0c280 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4b9d303640 1 -- 172.21.15.42:0/952345871 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02b124d0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c09930 con 0x563b02b124d0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4b9d303640 1 -- 172.21.15.42:0/952345871 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02b124d0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c0ea90 0x563b02c10e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c11550 con 0x563b02c0ea90 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c0ea90 0x563b02c10e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.732+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c0ea90 0x563b02c10e80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.733+0000 7f4b9cb02640 1 -- 172.21.15.42:0/952345871 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c0ea90 2024-02-16T00:11:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.733+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c0da10 con 0x563b02b124d0 2024-02-16T00:11:26.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.733+0000 7f4b9d303640 1 -- 172.21.15.42:0/952345871 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02b124d0 2024-02-16T00:11:26.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.733+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c0de20 con 0x563b02b124d0 2024-02-16T00:11:26.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.733+0000 7f4b9d303640 1 -- 172.21.15.42:0/952345871 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02b124d0 2024-02-16T00:11:26.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.733+0000 7f4ba1411800 1 Processor -- start 2024-02-16T00:11:26.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4ba1411800 1 -- start start 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4ba1411800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 0x563b02a81740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4ba1411800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b029abe80 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4b9d303640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 0x563b02a81740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4b9d303640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 0x563b02a81740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59812/0 (socket says 172.21.15.42:59812) 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4b9d303640 1 -- 172.21.15.42:0/304967007 learned_addr learned my addr 172.21.15.42:0/304967007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4b9d303640 1 -- 172.21.15.42:0/304967007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b02a81c80 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.734+0000 7f4b9d303640 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 0x563b02a81740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x563b02c0cbb0 tx=0x7f4b94018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4a827fc640 1 -- 172.21.15.42:0/304967007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b9401d070 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4a827fc640 1 -- 172.21.15.42:0/304967007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b940182e0 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b02a81ed0 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4a827fc640 1 -- 172.21.15.42:0/304967007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b940145e0 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b02a82390 con 0x563b02a832d0 2024-02-16T00:11:26.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4a827fc640 1 -- 172.21.15.42:0/304967007 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b94020020 con 0x563b02a832d0 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.735+0000 7f4a827fc640 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a74036830 0x7f4a74038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4a827fc640 1 -- 172.21.15.42:0/304967007 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4b9404dc50 con 0x563b02a832d0 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a74036830 0x7f4a74038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4ba1411800 1 Processor -- start 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4ba1411800 1 -- start start 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a74036830 0x7f4a74038cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x563b02c0cc20 tx=0x7f4b8c017f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4ba1411800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c2fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4ba1411800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b029815d0 con 0x563b02c2f730 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4b9d303640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c2fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4b9d303640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c2fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59816/0 (socket says 172.21.15.42:59816) 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4b9d303640 1 -- 172.21.15.42:0/2766990667 learned_addr learned my addr 172.21.15.42:0/2766990667 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.736+0000 7f4b9d303640 1 -- 172.21.15.42:0/2766990667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b02c30120 con 0x563b02c2f730 2024-02-16T00:11:26.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4b9d303640 1 --2- 172.21.15.42:0/2766990667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c2fb50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4b94013010 tx=0x7f4b94011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf86fe781163bf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4a73fff640 1 -- 172.21.15.42:0/2766990667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b94016570 con 0x563b02c2f730 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4a73fff640 1 -- 172.21.15.42:0/2766990667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94014ac0 con 0x563b02c2f730 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4a73fff640 1 -- 172.21.15.42:0/2766990667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b9402b350 con 0x563b02c2f730 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 -- 172.21.15.42:0/2766990667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 msgr2=0x563b02c2fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2766990667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c2fb50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4b94013010 tx=0x7f4b94011460 comp rx=0 tx=0).stop 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 -- 172.21.15.42:0/2766990667 shutdown_connections 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2766990667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c2fb50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 -- 172.21.15.42:0/2766990667 >> 172.21.15.42:0/2766990667 conn(0x563b02c2ba90 msgr2=0x563b02c29af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 -- 172.21.15.42:0/2766990667 shutdown_connections 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.737+0000 7f4ba1411800 1 -- 172.21.15.42:0/2766990667 wait complete. 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4ba1411800 1 Processor -- start 2024-02-16T00:11:26.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4ba1411800 1 -- start start 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4ba1411800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c36690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4ba1411800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b02c36bd0 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4b9d303640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c36690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4b9d303640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c36690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59828/0 (socket says 172.21.15.42:59828) 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 learned_addr learned my addr 172.21.15.42:0/2539117941 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b02a82390 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4b9d303640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c36690 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4b9403e040 tx=0x7f4b9404bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4a727fc640 1 -- 172.21.15.42:0/2539117941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b94014c30 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.738+0000 7f4a727fc640 1 -- 172.21.15.42:0/2539117941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b940133b0 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b02c36dd0 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4a727fc640 1 -- 172.21.15.42:0/2539117941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b94013690 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b02c37290 con 0x563b02c2f730 2024-02-16T00:11:26.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4a727fc640 1 -- 172.21.15.42:0/2539117941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4b94022740 con 0x563b02c2f730 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4a727fc640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a680367e0 0x7f4a68038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4a727fc640 1 -- 172.21.15.42:0/2539117941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4b94038c80 con 0x563b02c2f730 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.739+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a680367e0 0x7f4a68038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.740+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a680367e0 0x7f4a68038ca0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c016750 tx=0x7f4b8c041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.740+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.740+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02c42260 0x563b02c44720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.740+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c44e70 con 0x563b02c42260 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.740+0000 7f4b9c301640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02c42260 0x563b02c44720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4b9c301640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02c42260 0x563b02c44720 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b9000a100 con 0x563b02c42260 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 realm 2024-02-16T00:11:26.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c45200 con 0x563b02c42260 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c45a80 con 0x563b02c42260 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c45de0 con 0x563b02c42260 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.741+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c46af0 0x563b02c48ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c46af0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4b9d303640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c46af0 0x563b02c48ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4b9d303640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c46af0 0x563b02c48ee0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4ba1411800 20 searching for the correct realm 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x563b02c4b800 0x563b02c4dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4e390 con 0x563b02c4b800 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.742+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x563b02c4b800 0x563b02c4dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.743+0000 7f4b9cb02640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x563b02c4b800 0x563b02c4dcc0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.743+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.743+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4e390 con 0x563b02c46af0 2024-02-16T00:11:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.743+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.743+0000 7f4b9d303640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4b94014070 0x7f4b9403c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.743+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.744+0000 7f4b9c301640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4b94014070 0x7f4b9403c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.744+0000 7f4b9c301640 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4b94014070 0x7f4b9403c480 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.744+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.744+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.744+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.744+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c46af0 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.745+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.746+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c46af0 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.747+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.748+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c46af0 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.749+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c46af0 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c4b800 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.750+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x7f4b94014070 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c42260 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c494f0 con 0x563b02c46af0 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.751+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c49c00 con 0x563b02c42260 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c49fb0 con 0x563b02c42260 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4a390 con 0x563b02c42260 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 zone default found 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 4 Realm: () 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 zonegroup default 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4e7d0 con 0x7f4b94014070 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.752+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4ad50 con 0x563b02c4b800 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c50770 con 0x563b02c4b800 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 started sync module instance, tier type = 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.753+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4fc20 con 0x563b02c46af0 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.754+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.754+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94811449524480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4fc20 con 0x563b02c46af0 2024-02-16T00:11:26.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.754+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c51260 con 0x563b02c42260 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.755+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94811449524480] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.755+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.755+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94811449527648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4fc20 con 0x563b02c42260 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.755+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c51d00 con 0x563b02c4b800 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.756+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94811449527648] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.756+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.756+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94811449522048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4fba0 con 0x563b02c4b800 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.756+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c52b60 con 0x563b02c46af0 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.757+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94811449522048] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.757+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.757+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94811449534144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c52ae0 con 0x563b02c46af0 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.757+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c539c0 con 0x563b02c42260 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.758+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.758+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94811449537824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c53de0 con 0x563b02c42260 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.758+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94811449534144] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.758+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c52f10 con 0x7f4b94014070 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.759+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.759+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94811449537824] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.759+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94811449541520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c52f10 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.760+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c54e80 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.760+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94811449541520] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.760+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.760+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94811449538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c54e80 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.760+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c557f0 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94811449538880] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94811449542768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c557f0 con 0x7f4b94014070 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=0 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=1 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=2 2024-02-16T00:11:26.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=3 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=4 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=5 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.761+0000 7f4ba1411800 20 add_watcher() i=6 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.762+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94811449542768] v27'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.762+0000 7f4ba1411800 20 add_watcher() i=7 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.762+0000 7f4ba1411800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.762+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c58cb0 con 0x563b02c42260 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.763+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.763+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94811449558608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c55960 con 0x563b02c42260 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94811449558608] v27'123 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4a52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 5 note: GC not initialized 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4a51fe3640 20 reqs_thread_entry: start 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 20 Filter name: none 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f49c37fe640 20 reqs_thread_entry: start 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.764+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c8ac20 con 0x7f4b94014070 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:26.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c8c780 con 0x563b02c46af0 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.765+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c8e170 con 0x563b02c42260 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.766+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c91830 con 0x7f4b94014070 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.767+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(65 fud.buckets [call] v27'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.767+0000 7f4ba1411800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.767+0000 7f4ba1411800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.767+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c90820 con 0x563b02c46af0 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.768+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.768+0000 7f4ba1411800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.768+0000 7f4ba1411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.768+0000 7f4ba1411800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.768+0000 7f4ba1411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.768+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c953b0 con 0x563b02c46af0 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4ba1411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4ba1411800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4ba1411800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94811449806416 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c921b0 con 0x7f4b94014070 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== watch-notify(notify (1) cookie 94811449538880 notify 115964116996 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7f4b90083040 con 0x7f4b94014070 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4a73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94811449538880 notifier 4509 bl.length()=338 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4a73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4a73fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(68 notify.6 [notify cookie 94811449806416 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.769+0000 7f4a73fff640 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f4a60003e90 con 0x7f4b94014070 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.770+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.770+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== watch-notify(notify_complete (2) cookie 94811449806416 notify 115964116996 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4b90079040 con 0x7f4b94014070 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.770+0000 7f4a52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.770+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94811449558608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c577c0 con 0x563b02c42260 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.772+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94811449558608] v27'124 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.772+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94811449524480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c58650 con 0x563b02c46af0 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.772+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94811449524480] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.772+0000 7f4ba1411800 20 remove_watcher() i=0 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.772+0000 7f4ba1411800 2 removed watcher, disabling cache 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.772+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94811449527648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c50100 con 0x563b02c42260 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.773+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94811449527648] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.773+0000 7f4ba1411800 20 remove_watcher() i=1 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.773+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94811449522048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c50100 con 0x563b02c4b800 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.774+0000 7f4b9cb02640 1 -- 172.21.15.42:0/2539117941 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94811449522048] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b8c014070 con 0x563b02c4b800 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.774+0000 7f4ba1411800 20 remove_watcher() i=2 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.774+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94811449534144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4f780 con 0x563b02c46af0 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.775+0000 7f4b9d303640 1 -- 172.21.15.42:0/2539117941 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94811449534144] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b9400a4a0 con 0x563b02c46af0 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.775+0000 7f4ba1411800 20 remove_watcher() i=3 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.775+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94811449537824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c526c0 con 0x563b02c42260 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.776+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94811449537824] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x563b02c42260 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.776+0000 7f4ba1411800 20 remove_watcher() i=4 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.776+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94811449541520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c4f780 con 0x7f4b94014070 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.777+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94811449541520] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.777+0000 7f4ba1411800 20 remove_watcher() i=5 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.777+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94811449538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c53520 con 0x7f4b94014070 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.778+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94811449538880] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.778+0000 7f4ba1411800 20 remove_watcher() i=6 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.778+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94811449542768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x563b02c526c0 con 0x7f4b94014070 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94811449542768] v27'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b900525b0 con 0x7f4b94014070 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 20 remove_watcher() i=7 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4b94014070 msgr2=0x7f4b9403c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4b94014070 0x7f4b9403c480 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02c42260 msgr2=0x563b02c44720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02c42260 0x563b02c44720 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c46af0 msgr2=0x563b02c48ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c46af0 0x563b02c48ee0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x563b02c4b800 msgr2=0x563b02c4dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x563b02c4b800 0x563b02c4dcc0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a680367e0 msgr2=0x7f4a68038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a680367e0 0x7f4a68038ca0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c016750 tx=0x7f4b8c041000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 msgr2=0x563b02c36690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4b9c301640 1 -- 172.21.15.42:0/2539117941 reap_dead start 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.779+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c36690 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4b9403e040 tx=0x7f4b9404bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 shutdown_connections 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/2539117941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02c2f730 0x563b02c36690 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 >> 172.21.15.42:0/2539117941 conn(0x563b02c2ba90 msgr2=0x563b02c290f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 shutdown_connections 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/2539117941 wait complete. 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a74036830 msgr2=0x7f4a74038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a74036830 0x7f4a74038cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x563b02c0cc20 tx=0x7f4b8c017f90 comp rx=0 tx=0).stop 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 msgr2=0x563b02a81740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 0x563b02a81740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x563b02c0cbb0 tx=0x7f4b94018830 comp rx=0 tx=0).stop 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 shutdown_connections 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a74036830 0x7f4a74038cf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/304967007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02a832d0 0x563b02a81740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 >> 172.21.15.42:0/304967007 conn(0x563b02c143e0 msgr2=0x563b02c147e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 shutdown_connections 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/304967007 wait complete. 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02b124d0 msgr2=0x563b02c0c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02b124d0 0x563b02c0c280 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c0ea90 msgr2=0x563b02c10e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c0ea90 0x563b02c10e80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a840367e0 msgr2=0x7f4a84038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a840367e0 0x7f4a84038ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b90054000 tx=0x7f4b9004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 msgr2=0x563b02c05540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.780+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02c05540 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0011e0 tx=0x7f4b8c000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 shutdown_connections 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563b02c0ea90 0x563b02c10e80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563b02b124d0 0x563b02c0c280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4a840367e0 0x7f4a84038ca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 --2- 172.21.15.42:0/952345871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b02b0e040 0x563b02c05540 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 >> 172.21.15.42:0/952345871 conn(0x563b02b095e0 msgr2=0x563b02bfc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 shutdown_connections 2024-02-16T00:11:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.781+0000 7f4ba1411800 1 -- 172.21.15.42:0/952345871 wait complete. 2024-02-16T00:11:26.800 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1'] 2024-02-16T00:11:26.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1'] 2024-02-16T00:11:26.801 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:26.850 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.850 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.848+0000 7f517bc0f800 1 Processor -- start 2024-02-16T00:11:26.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.848+0000 7f517bc0f800 1 -- start start 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.848+0000 7f517bc0f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555c3be6d530 0x555c3be6f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.848+0000 7f517bc0f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555c3bdb3c50 con 0x555c3be69a20 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.848+0000 7f517bc0f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x555c3bd6b450 con 0x555c3be6d530 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.849+0000 7f5176a83640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555c3be6d530 0x555c3be6f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.849+0000 7f5177284640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x555c3be69a20 0x555c3be6be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60456/0 (socket says 172.21.15.42:60456) 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.849+0000 7f5177284640 1 -- 172.21.15.42:0/2827250592 learned_addr learned my addr 172.21.15.42:0/2827250592 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.849+0000 7f5176a83640 1 -- 172.21.15.42:0/2827250592 >> v1:172.21.15.2:6789/0 conn(0x555c3be69a20 legacy=0x555c3be6be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.849+0000 7f5176a83640 1 -- 172.21.15.42:0/2827250592 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c3be70e70 con 0x555c3be6d530 2024-02-16T00:11:26.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f5176a83640 1 --2- 172.21.15.42:0/2827250592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be6d530 0x555c3be6f920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f516c00a470 tx=0x7f516c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c69d93d60c5b043 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f5176282640 1 -- 172.21.15.42:0/2827250592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f516c052570 con 0x555c3be6d530 2024-02-16T00:11:26.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f5176282640 1 -- 172.21.15.42:0/2827250592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c0526d0 con 0x555c3be6d530 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f5176282640 1 -- 172.21.15.42:0/2827250592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f516c052990 con 0x555c3be6d530 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f517bc0f800 1 -- 172.21.15.42:0/2827250592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be6d530 msgr2=0x555c3be6f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f517bc0f800 1 --2- 172.21.15.42:0/2827250592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be6d530 0x555c3be6f920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f516c00a470 tx=0x7f516c01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f517bc0f800 1 -- 172.21.15.42:0/2827250592 shutdown_connections 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.851+0000 7f517bc0f800 1 --2- 172.21.15.42:0/2827250592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be6d530 0x555c3be6f920 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.852+0000 7f517bc0f800 1 -- 172.21.15.42:0/2827250592 >> 172.21.15.42:0/2827250592 conn(0x555c3be634f0 msgr2=0x555c3be65910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.852+0000 7f517bc0f800 1 -- 172.21.15.42:0/2827250592 shutdown_connections 2024-02-16T00:11:26.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.852+0000 7f517bc0f800 1 -- 172.21.15.42:0/2827250592 wait complete. 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.863+0000 7f517bc0f800 1 Processor -- start 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.863+0000 7f517bc0f800 1 -- start start 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f517bc0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf59060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f517bc0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3bd68980 con 0x555c3be69a20 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f5177284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf59060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f5177284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf59060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59852/0 (socket says 172.21.15.42:59852) 2024-02-16T00:11:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f5177284640 1 -- 172.21.15.42:0/2014780350 learned_addr learned my addr 172.21.15.42:0/2014780350 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f5177284640 1 -- 172.21.15.42:0/2014780350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c005d20 con 0x555c3be69a20 2024-02-16T00:11:26.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f5177284640 1 --2- 172.21.15.42:0/2014780350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf59060 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5168001bc0 tx=0x7f516800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cbee2b91d4ccc3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f506560a640 1 -- 172.21.15.42:0/2014780350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f516800e470 con 0x555c3be69a20 2024-02-16T00:11:26.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f506560a640 1 -- 172.21.15.42:0/2014780350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516800e5f0 con 0x555c3be69a20 2024-02-16T00:11:26.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.864+0000 7f506560a640 1 -- 172.21.15.42:0/2014780350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f516800e950 con 0x555c3be69a20 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 -- 172.21.15.42:0/2014780350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 msgr2=0x555c3bf59060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 --2- 172.21.15.42:0/2014780350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf59060 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5168001bc0 tx=0x7f516800b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 -- 172.21.15.42:0/2014780350 shutdown_connections 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 --2- 172.21.15.42:0/2014780350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf59060 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 -- 172.21.15.42:0/2014780350 >> 172.21.15.42:0/2014780350 conn(0x555c3be634f0 msgr2=0x555c3bf54980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 -- 172.21.15.42:0/2014780350 shutdown_connections 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 -- 172.21.15.42:0/2014780350 wait complete. 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.865+0000 7f517bc0f800 1 Processor -- start 2024-02-16T00:11:26.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f517bc0f800 1 -- start start 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f517bc0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f517bc0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3bd64160 con 0x555c3be69a20 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5177284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5177284640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59856/0 (socket says 172.21.15.42:59856) 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5177284640 1 -- 172.21.15.42:0/4252747517 learned_addr learned my addr 172.21.15.42:0/4252747517 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5177284640 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c3bdb3c50 con 0x555c3be69a20 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5177284640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf606f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f516800b700 tx=0x7f5168000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5063e07640 1 -- 172.21.15.42:0/4252747517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f516801f070 con 0x555c3be69a20 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5063e07640 1 -- 172.21.15.42:0/4252747517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51680197c0 con 0x555c3be69a20 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c3bf60c30 con 0x555c3be69a20 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.866+0000 7f5063e07640 1 -- 172.21.15.42:0/4252747517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5168019aa0 con 0x555c3be69a20 2024-02-16T00:11:26.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.867+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c3bf61110 con 0x555c3be69a20 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.867+0000 7f5063e07640 1 -- 172.21.15.42:0/4252747517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5168019c00 con 0x555c3be69a20 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f5063e07640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f505c0367e0 0x7f505c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f5063e07640 1 -- 172.21.15.42:0/4252747517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f516804c6d0 con 0x555c3be69a20 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f5176a83640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f505c0367e0 0x7f505c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3be6d530 0x555c3bf67400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bf679d0 con 0x555c3be6d530 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f5177a85640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3be6d530 0x555c3bf67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f5176a83640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f505c0367e0 0x7f505c038ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f516c054000 tx=0x7f516c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.868+0000 7f5177a85640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3be6d530 0x555c3bf67400 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f5177a85640 1 -- 172.21.15.42:0/4252747517 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f517000a4a0 con 0x555c3be6d530 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bf64ab0 con 0x555c3be6d530 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f5177a85640 1 -- 172.21.15.42:0/4252747517 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f517000a4a0 con 0x555c3be6d530 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bf69c40 0x555c3bf6c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bf6c720 con 0x555c3bf69c40 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f5177284640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bf69c40 0x555c3bf6c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.869+0000 7f5177284640 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bf69c40 0x555c3bf6c030 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.870+0000 7f5177284640 1 -- 172.21.15.42:0/4252747517 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f51680175a0 con 0x555c3bf69c40 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.870+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bf68b90 con 0x555c3be6d530 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.870+0000 7f5177a85640 1 -- 172.21.15.42:0/4252747517 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f517000a4a0 con 0x555c3be6d530 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.870+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bf68f80 con 0x555c3be6d530 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.870+0000 7f5177a85640 1 -- 172.21.15.42:0/4252747517 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f517000a4a0 con 0x555c3be6d530 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f517bc0f800 1 Processor -- start 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f517bc0f800 1 -- start start 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f517bc0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 0x555c3be67a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f517bc0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3bd06e80 con 0x555c3be695c0 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f5177a85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 0x555c3be67a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f5177a85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 0x555c3be67a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59872/0 (socket says 172.21.15.42:59872) 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f5177a85640 1 -- 172.21.15.42:0/897684424 learned_addr learned my addr 172.21.15.42:0/897684424 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.871+0000 7f5177a85640 1 -- 172.21.15.42:0/897684424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c3be67f70 con 0x555c3be695c0 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.872+0000 7f5177a85640 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 0x555c3be67a30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x555c3bf61aa0 tx=0x7f5170018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.872+0000 7f5061602640 1 -- 172.21.15.42:0/897684424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517001d070 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.872+0000 7f5061602640 1 -- 172.21.15.42:0/897684424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51700182e0 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.872+0000 7f5061602640 1 -- 172.21.15.42:0/897684424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51700145a0 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.872+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c3be681c0 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.872+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c3be68680 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.873+0000 7f5061602640 1 -- 172.21.15.42:0/897684424 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5170020020 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.873+0000 7f5061602640 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50500367c0 0x7f5050038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.873+0000 7f5061602640 1 -- 172.21.15.42:0/897684424 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f517004dbd0 con 0x555c3be695c0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.873+0000 7f5177284640 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50500367c0 0x7f5050038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f517bc0f800 1 Processor -- start 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f517bc0f800 1 -- start start 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f5177284640 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50500367c0 0x7f5050038c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51680177f0 tx=0x7f5168019eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f517bc0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf7b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f517bc0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3bcdc5d0 con 0x555c3bf7b340 2024-02-16T00:11:26.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f5177a85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf7b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f5177a85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf7b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59880/0 (socket says 172.21.15.42:59880) 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f5177a85640 1 -- 172.21.15.42:0/4063792594 learned_addr learned my addr 172.21.15.42:0/4063792594 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.874+0000 7f5177a85640 1 -- 172.21.15.42:0/4063792594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c3bf7bd30 con 0x555c3bf7b340 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f5177a85640 1 --2- 172.21.15.42:0/4063792594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf7b760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f517004bf50 tx=0x7f5170013870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a707f48eda745536 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f505affd640 1 -- 172.21.15.42:0/4063792594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5170016440 con 0x555c3bf7b340 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f505affd640 1 -- 172.21.15.42:0/4063792594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51700165a0 con 0x555c3bf7b340 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f505affd640 1 -- 172.21.15.42:0/4063792594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517002b480 con 0x555c3bf7b340 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 -- 172.21.15.42:0/4063792594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 msgr2=0x555c3bf7b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4063792594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf7b760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f517004bf50 tx=0x7f5170013870 comp rx=0 tx=0).stop 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 -- 172.21.15.42:0/4063792594 shutdown_connections 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4063792594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf7b760 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 -- 172.21.15.42:0/4063792594 >> 172.21.15.42:0/4063792594 conn(0x555c3bf86bc0 msgr2=0x555c3bf84c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 -- 172.21.15.42:0/4063792594 shutdown_connections 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.875+0000 7f517bc0f800 1 -- 172.21.15.42:0/4063792594 wait complete. 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f517bc0f800 1 Processor -- start 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f517bc0f800 1 -- start start 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f517bc0f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf95c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f517bc0f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c3bf96150 con 0x555c3bf7b340 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f5177a85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf95c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f5177a85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf95c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59890/0 (socket says 172.21.15.42:59890) 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 learned_addr learned my addr 172.21.15.42:0/1599199603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c3be68680 con 0x555c3bf7b340 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f5177a85640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf95c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5170047010 tx=0x7f517004beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f50597fa640 1 -- 172.21.15.42:0/1599199603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5170032070 con 0x555c3bf7b340 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f50597fa640 1 -- 172.21.15.42:0/1599199603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517002bdb0 con 0x555c3bf7b340 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c3bf96350 con 0x555c3bf7b340 2024-02-16T00:11:26.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.876+0000 7f50597fa640 1 -- 172.21.15.42:0/1599199603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5170013df0 con 0x555c3bf7b340 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.877+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c3bf96810 con 0x555c3bf7b340 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.877+0000 7f50597fa640 1 -- 172.21.15.42:0/1599199603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5170022740 con 0x555c3bf7b340 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.877+0000 7f50597fa640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50400367e0 0x7f5040038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.877+0000 7f50597fa640 1 -- 172.21.15.42:0/1599199603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5170037c50 con 0x555c3bf7b340 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f5177284640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50400367e0 0x7f5040038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f5177284640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50400367e0 0x7f5040038ca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5168000fd0 tx=0x7f5168038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3bfa18b0 0x555c3bfa3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa44c0 con 0x555c3bfa18b0 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f5176a83640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3bfa18b0 0x555c3bfa3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.878+0000 7f5176a83640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3bfa18b0 0x555c3bfa3d70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 realm 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa4850 con 0x555c3bfa18b0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa50d0 con 0x555c3bfa18b0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa5430 con 0x555c3bfa18b0 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bfa6140 0x555c3bfa8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.879+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa6140 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f5177a85640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bfa6140 0x555c3bfa8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f5177a85640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bfa6140 0x555c3bfa8530 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f517000a4a0 con 0x555c3bfa6140 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f517bc0f800 20 searching for the correct realm 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555c3bfaae10 0x555c3bfad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfad9a0 con 0x555c3bfaae10 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f5177284640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555c3bfaae10 0x555c3bfad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.880+0000 7f5177284640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555c3bfaae10 0x555c3bfad2d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.881+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.881+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfad9a0 con 0x555c3bfa6140 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.881+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517000a4a0 con 0x555c3bfa6140 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.881+0000 7f5177a85640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f51700133b0 0x7f517004a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.881+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.882+0000 7f5176a83640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f51700133b0 0x7f517004a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.882+0000 7f5176a83640 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f51700133b0 0x7f517004a5d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.882+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.882+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.882+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.882+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa6140 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.883+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa6140 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.884+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.885+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.886+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa6140 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.887+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa6140 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.888+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x7f51700133b0 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa6140 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.889+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa9210 con 0x555c3bfa18b0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa95c0 con 0x555c3bfa18b0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa99a0 con 0x555c3bfa18b0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 zone default found 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 4 Realm: () 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 zonegroup default 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfadde0 con 0x7f51700133b0 2024-02-16T00:11:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.890+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfafc60 con 0x555c3bfaae10 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaffc0 con 0x555c3bfaae10 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 20 started sync module instance, tier type = 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:26.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.891+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaf230 con 0x555c3bfa6140 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.892+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.892+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854631655152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaf230 con 0x555c3bfa6140 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.892+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb0a40 con 0x555c3bfa18b0 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.893+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854631655152] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.893+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.893+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854631658816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaf230 con 0x555c3bfa18b0 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.893+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb14c0 con 0x555c3bfaae10 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.894+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854631658816] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.895+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.895+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854631652752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaf1b0 con 0x555c3bfaae10 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.895+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb2320 con 0x555c3bfa6140 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.895+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854631652752] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.896+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.896+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854631665280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb2740 con 0x555c3bfa6140 2024-02-16T00:11:26.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.896+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb30b0 con 0x555c3bfa18b0 2024-02-16T00:11:26.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.896+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854631668752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb3070 con 0x555c3bfa18b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb4030 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854631665280] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854631672656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb4030 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb4a30 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.897+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854631668752] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.898+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854631672656] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.898+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.898+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854631666336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb4550 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb5280 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854631666336] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854631670832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb4550 con 0x7f51700133b0 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=0 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=1 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=2 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=3 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=4 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=5 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.899+0000 7f517bc0f800 20 add_watcher() i=6 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.900+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854631670832] v27'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.900+0000 7f517bc0f800 20 add_watcher() i=7 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.900+0000 7f517bc0f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.900+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb83d0 con 0x555c3bfa18b0 2024-02-16T00:11:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.901+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.901+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854631677408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb56a0 con 0x555c3bfa18b0 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854631677408] v27'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f502dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 5 note: GC not initialized 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f502cfe1640 20 reqs_thread_entry: start 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 20 Filter name: none 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f4fa67fc640 20 reqs_thread_entry: start 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.902+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfea380 con 0x555c3bfa18b0 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfebf20 con 0x555c3bfa6140 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.903+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfed910 con 0x555c3bfa18b0 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.904+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bff1e60 con 0x7f51700133b0 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.905+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(65 fud.buckets [call] v27'5 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.905+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bff7e70 con 0x555c3bfa18b0 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.906+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v27'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.906+0000 7f517bc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.906+0000 7f517bc0f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.906+0000 7f517bc0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.906+0000 7f517bc0f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.906+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93854631911312 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bff2250 con 0x555c3bfa6140 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== watch-notify(notify (1) cookie 93854631655152 notify 115964117012 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f5170067040 con 0x555c3bfa6140 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f505affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117012 cookie 93854631655152 notifier 4516 bl.length()=725 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f505affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f505affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f505affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(67 notify.0 [notify cookie 93854631911312 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f505affd640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f503c003e90 con 0x555c3bfa6140 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== watch-notify(notify_complete (2) cookie 93854631911312 notify 115964117012 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555c3bf96810 con 0x555c3bfa6140 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f517bc0f800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_sources= new_sources= 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f517bc0f800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential sources added=[] removed=[] 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f517bc0f800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_dests= new_dests= 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f517bc0f800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential dests added=[] removed=[] 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.907+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bff6640 con 0x555c3bfa6140 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.908+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(69 foo.buckets [call] v27'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.908+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bff7650 con 0x555c3bfa6140 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f517bc0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f517bc0f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f517bc0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93854631911280 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bff6ae0 con 0x7f51700133b0 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== watch-notify(notify (1) cookie 93854631666336 notify 115964116997 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f516c084040 con 0x7f51700133b0 2024-02-16T00:11:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f505a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 93854631666336 notifier 4516 bl.length()=314 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.6 [notify cookie 93854631911280 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f505a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f505a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.909+0000 7f505a7fc640 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f4fac0033f0 con 0x7f51700133b0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.910+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.910+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== watch-notify(notify_complete (2) cookie 93854631911280 notify 115964116997 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f516c07a040 con 0x7f51700133b0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.911+0000 7f502dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.911+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854631677408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfeeb10 con 0x555c3bfa18b0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.912+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93854631677408] v27'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.912+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854631655152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb4de0 con 0x555c3bfa6140 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.912+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93854631655152] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.912+0000 7f517bc0f800 20 remove_watcher() i=0 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.912+0000 7f517bc0f800 2 removed watcher, disabling cache 2024-02-16T00:11:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.913+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854631658816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfa18b0 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.913+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93854631658816] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.913+0000 7f517bc0f800 20 remove_watcher() i=1 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.913+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854631652752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfa8b40 con 0x555c3bfaae10 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.914+0000 7f5177284640 1 -- 172.21.15.42:0/1599199603 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93854631652752] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5168055040 con 0x555c3bfaae10 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.914+0000 7f517bc0f800 20 remove_watcher() i=2 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.914+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854631665280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaed90 con 0x555c3bfa6140 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.915+0000 7f5177a85640 1 -- 172.21.15.42:0/1599199603 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93854631665280] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170060040 con 0x555c3bfa6140 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.915+0000 7f517bc0f800 20 remove_watcher() i=3 2024-02-16T00:11:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.915+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854631668752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb1e80 con 0x555c3bfa18b0 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.916+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93854631668752] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x555c3bfa18b0 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.916+0000 7f517bc0f800 20 remove_watcher() i=4 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.916+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854631672656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaed90 con 0x7f51700133b0 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.917+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93854631672656] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.917+0000 7f517bc0f800 20 remove_watcher() i=5 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.917+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854631666336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfb2c10 con 0x7f51700133b0 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.918+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93854631666336] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.918+0000 7f517bc0f800 20 remove_watcher() i=6 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.918+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854631670832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x555c3bfaed90 con 0x7f51700133b0 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93854631670832] v27'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f516c059040 con 0x7f51700133b0 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 20 remove_watcher() i=7 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f51700133b0 msgr2=0x7f517004a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f51700133b0 0x7f517004a5d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3bfa18b0 msgr2=0x555c3bfa3d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3bfa18b0 0x555c3bfa3d70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bfa6140 msgr2=0x555c3bfa8530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.919+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bfa6140 0x555c3bfa8530 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555c3bfaae10 msgr2=0x555c3bfad2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x555c3bfaae10 0x555c3bfad2d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50400367e0 msgr2=0x7f5040038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50400367e0 0x7f5040038ca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5168000fd0 tx=0x7f5168038000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 msgr2=0x555c3bf95c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/1599199603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3bf7b340 0x555c3bf95c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5170047010 tx=0x7f517004beb0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 reap_dead start 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f5176a83640 1 -- 172.21.15.42:0/1599199603 reap_dead start 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 shutdown_connections 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 >> 172.21.15.42:0/1599199603 conn(0x555c3bf86bc0 msgr2=0x555c3bf84c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 shutdown_connections 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/1599199603 wait complete. 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50500367c0 msgr2=0x7f5050038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50500367c0 0x7f5050038c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51680177f0 tx=0x7f5168019eb0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 msgr2=0x555c3be67a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 0x555c3be67a30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x555c3bf61aa0 tx=0x7f5170018830 comp rx=0 tx=0).stop 2024-02-16T00:11:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 shutdown_connections 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f50500367c0 0x7f5050038c80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/897684424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be695c0 0x555c3be67a30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 >> 172.21.15.42:0/897684424 conn(0x555c3bf6f560 msgr2=0x555c3bf6f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 shutdown_connections 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/897684424 wait complete. 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3be6d530 msgr2=0x555c3bf67400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3be6d530 0x555c3bf67400 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bf69c40 msgr2=0x555c3bf6c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.920+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bf69c40 0x555c3bf6c030 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f505c0367e0 msgr2=0x7f505c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f505c0367e0 0x7f505c038ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f516c054000 tx=0x7f516c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 msgr2=0x555c3bf606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf606f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f516800b700 tx=0x7f5168000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 shutdown_connections 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555c3bf69c40 0x555c3bf6c030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555c3be6d530 0x555c3bf67400 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f505c0367e0 0x7f505c038ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 --2- 172.21.15.42:0/4252747517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c3be69a20 0x555c3bf606f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 >> 172.21.15.42:0/4252747517 conn(0x555c3be634f0 msgr2=0x555c3bf531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 shutdown_connections 2024-02-16T00:11:26.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.921+0000 7f517bc0f800 1 -- 172.21.15.42:0/4252747517 wait complete. 2024-02-16T00:11:26.936 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T00:11:26.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T00:11:26.936 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T00:11:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.976+0000 7f1069175800 1 Processor -- start 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.976+0000 7f1069175800 1 -- start start 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.976+0000 7f1069175800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562d5f58e020 0x562d5f58e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.976+0000 7f1069175800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562d5f4d8bb0 con 0x562d5f58f280 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.976+0000 7f1069175800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x562d5f490450 con 0x562d5f58e020 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.977+0000 7f1066c7b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x562d5f58e020 0x562d5f58e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.977+0000 7f106647a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x562d5f58f280 0x562d5f58f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60464/0 (socket says 172.21.15.42:60464) 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.977+0000 7f106647a640 1 -- 172.21.15.42:0/3017209234 learned_addr learned my addr 172.21.15.42:0/3017209234 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.977+0000 7f1066c7b640 1 -- 172.21.15.42:0/3017209234 >> v1:172.21.15.2:6789/0 conn(0x562d5f58f280 legacy=0x562d5f58f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.977+0000 7f1066c7b640 1 -- 172.21.15.42:0/3017209234 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5f58eb10 con 0x562d5f58e020 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1066c7b640 1 --2- 172.21.15.42:0/3017209234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f58e440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f105800a470 tx=0x7f105801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aff76344755c87e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1065c79640 1 -- 172.21.15.42:0/3017209234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1058052570 con 0x562d5f58e020 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1065c79640 1 -- 172.21.15.42:0/3017209234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580526d0 con 0x562d5f58e020 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1065c79640 1 -- 172.21.15.42:0/3017209234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1058052990 con 0x562d5f58e020 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 -- 172.21.15.42:0/3017209234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 msgr2=0x562d5f58e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 --2- 172.21.15.42:0/3017209234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f58e440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f105800a470 tx=0x7f105801cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 -- 172.21.15.42:0/3017209234 shutdown_connections 2024-02-16T00:11:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 --2- 172.21.15.42:0/3017209234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f58e440 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 -- 172.21.15.42:0/3017209234 >> 172.21.15.42:0/3017209234 conn(0x562d5f5895c0 msgr2=0x562d5f58b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 -- 172.21.15.42:0/3017209234 shutdown_connections 2024-02-16T00:11:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.979+0000 7f1069175800 1 -- 172.21.15.42:0/3017209234 wait complete. 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1069175800 1 Processor -- start 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1069175800 1 -- start start 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1069175800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f67e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1069175800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5f48d980 con 0x562d5f58e020 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1066c7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f67e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1066c7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f67e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59914/0 (socket says 172.21.15.42:59914) 2024-02-16T00:11:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.991+0000 7f1066c7b640 1 -- 172.21.15.42:0/2929120701 learned_addr learned my addr 172.21.15.42:0/2929120701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.992+0000 7f1066c7b640 1 -- 172.21.15.42:0/2929120701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058005d20 con 0x562d5f58e020 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.992+0000 7f1066c7b640 1 --2- 172.21.15.42:0/2929120701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f67e3e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1058055040 tx=0x7f105804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69f377e2371920 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.992+0000 7f0f54e09640 1 -- 172.21.15.42:0/2929120701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f105800a180 con 0x562d5f58e020 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.992+0000 7f0f54e09640 1 -- 172.21.15.42:0/2929120701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800a2e0 con 0x562d5f58e020 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.992+0000 7f0f54e09640 1 -- 172.21.15.42:0/2929120701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10580529b0 con 0x562d5f58e020 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- 172.21.15.42:0/2929120701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 msgr2=0x562d5f67e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 --2- 172.21.15.42:0/2929120701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f67e3e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1058055040 tx=0x7f105804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- 172.21.15.42:0/2929120701 shutdown_connections 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 --2- 172.21.15.42:0/2929120701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f67e3e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- 172.21.15.42:0/2929120701 >> 172.21.15.42:0/2929120701 conn(0x562d5f5895c0 msgr2=0x562d5f679d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- 172.21.15.42:0/2929120701 shutdown_connections 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- 172.21.15.42:0/2929120701 wait complete. 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 Processor -- start 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- start start 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f503050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1069175800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5f489160 con 0x562d5f58e020 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1066c7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f503050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1066c7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f503050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59920/0 (socket says 172.21.15.42:59920) 2024-02-16T00:11:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.993+0000 7f1066c7b640 1 -- 172.21.15.42:0/1821269376 learned_addr learned my addr 172.21.15.42:0/1821269376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f1066c7b640 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105804e070 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f1066c7b640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f503050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1058005870 tx=0x7f1058002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f0f53606640 1 -- 172.21.15.42:0/1821269376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f105806a070 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f0f53606640 1 -- 172.21.15.42:0/1821269376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1058052e10 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d5f501740 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f0f53606640 1 -- 172.21.15.42:0/1821269376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f105805d550 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.994+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d5f501c20 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f0f53606640 1 -- 172.21.15.42:0/1821269376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f105805d6b0 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f0f53606640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f4c036790 0x7f0f4c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f0f53606640 1 -- 172.21.15.42:0/1821269376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f105808d7a0 con 0x562d5f58e020 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f106647a640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f4c036790 0x7f0f4c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f58f280 0x562d5f68ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f502300 con 0x562d5f58f280 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f106747c640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f58f280 0x562d5f68ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f106647a640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f4c036790 0x7f0f4c038c50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f105c000f60 tx=0x7f105c0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.995+0000 7f106747c640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f58f280 0x562d5f68ec70 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f106747c640 1 -- 172.21.15.42:0/1821269376 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f106000a4a0 con 0x562d5f58f280 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f68f1b0 con 0x562d5f58f280 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f106747c640 1 -- 172.21.15.42:0/1821269376 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f106000a4a0 con 0x562d5f58f280 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f690f50 0x562d5f693340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f693a30 con 0x562d5f690f50 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f1066c7b640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f690f50 0x562d5f693340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.996+0000 7f1066c7b640 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f690f50 0x562d5f693340 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.997+0000 7f1066c7b640 1 -- 172.21.15.42:0/1821269376 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1058059040 con 0x562d5f690f50 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.997+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f68fed0 con 0x562d5f58f280 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.997+0000 7f106747c640 1 -- 172.21.15.42:0/1821269376 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f106000a4a0 con 0x562d5f58f280 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.997+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6902c0 con 0x562d5f58f280 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.997+0000 7f106747c640 1 -- 172.21.15.42:0/1821269376 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f106000a4a0 con 0x562d5f58f280 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f1069175800 1 Processor -- start 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f1069175800 1 -- start start 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f1069175800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 0x562d5f6a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f1069175800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5f42be80 con 0x562d5f6a2800 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f106747c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 0x562d5f6a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f106747c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 0x562d5f6a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59924/0 (socket says 172.21.15.42:59924) 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f106747c640 1 -- 172.21.15.42:0/2363034955 learned_addr learned my addr 172.21.15.42:0/2363034955 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.998+0000 7f106747c640 1 -- 172.21.15.42:0/2363034955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5f6a3160 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f106747c640 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 0x562d5f6a2c20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x562d5f502a40 tx=0x7f1060018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f0f50e01640 1 -- 172.21.15.42:0/2363034955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106001d070 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f0f50e01640 1 -- 172.21.15.42:0/2363034955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060014450 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f0f50e01640 1 -- 172.21.15.42:0/2363034955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1060014730 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d5f6a3bd0 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d5f6a4090 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:26.999+0000 7f0f50e01640 1 -- 172.21.15.42:0/2363034955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1060020020 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f0f50e01640 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f400367e0 0x7f0f40038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f0f50e01640 1 -- 172.21.15.42:0/2363034955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f106004de00 con 0x562d5f6a2800 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f1066c7b640 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f400367e0 0x7f0f40038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f1069175800 1 Processor -- start 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f1069175800 1 -- start start 2024-02-16T00:11:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f1066c7b640 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f400367e0 0x7f0f40038ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x562d5f501ea0 tx=0x7f10580051b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f1069175800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f1069175800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5f4015d0 con 0x562d5f6afa90 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f106747c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f106747c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59936/0 (socket says 172.21.15.42:59936) 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.000+0000 7f106747c640 1 -- 172.21.15.42:0/2136435070 learned_addr learned my addr 172.21.15.42:0/2136435070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f106747c640 1 -- 172.21.15.42:0/2136435070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5f6b0460 con 0x562d5f6afa90 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f106747c640 1 --2- 172.21.15.42:0/2136435070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6afe90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f106004c150 tx=0x7f1060013920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b71405562a9bd9c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f0f4a7fc640 1 -- 172.21.15.42:0/2136435070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1060016570 con 0x562d5f6afa90 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f0f4a7fc640 1 -- 172.21.15.42:0/2136435070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060014c10 con 0x562d5f6afa90 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f0f4a7fc640 1 -- 172.21.15.42:0/2136435070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106002b350 con 0x562d5f6afa90 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 -- 172.21.15.42:0/2136435070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 msgr2=0x562d5f6afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 --2- 172.21.15.42:0/2136435070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6afe90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f106004c150 tx=0x7f1060013920 comp rx=0 tx=0).stop 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 -- 172.21.15.42:0/2136435070 shutdown_connections 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 --2- 172.21.15.42:0/2136435070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6afe90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 -- 172.21.15.42:0/2136435070 >> 172.21.15.42:0/2136435070 conn(0x562d5f6abd60 msgr2=0x562d5f6a9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 -- 172.21.15.42:0/2136435070 shutdown_connections 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.001+0000 7f1069175800 1 -- 172.21.15.42:0/2136435070 wait complete. 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f1069175800 1 Processor -- start 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f1069175800 1 -- start start 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f1069175800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f1069175800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5f6b6f20 con 0x562d5f6afa90 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f106747c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f106747c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59948/0 (socket says 172.21.15.42:59948) 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 learned_addr learned my addr 172.21.15.42:0/176176411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5f6a4090 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.002+0000 7f106747c640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6b69e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f106004b070 tx=0x7f106004c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f0f48ff9640 1 -- 172.21.15.42:0/176176411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1060011920 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f0f48ff9640 1 -- 172.21.15.42:0/176176411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060014d80 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d5f6b7120 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f0f48ff9640 1 -- 172.21.15.42:0/176176411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1060013ba0 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d5f6b75e0 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f0f48ff9640 1 -- 172.21.15.42:0/176176411 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1060054020 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f0f48ff9640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f300367e0 0x7f0f30038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.003+0000 7f0f48ff9640 1 -- 172.21.15.42:0/176176411 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1060038c80 con 0x562d5f6afa90 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.004+0000 7f1066c7b640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f300367e0 0x7f0f30038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.004+0000 7f1066c7b640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f300367e0 0x7f0f30038ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1058005680 tx=0x7f1058084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.004+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.004+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f6c2670 0x562d5f6c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.004+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6c5280 con 0x562d5f6c2670 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.004+0000 7f106647a640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f6c2670 0x562d5f6c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f106647a640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f6c2670 0x562d5f6c4b30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 realm 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6c1ad0 con 0x562d5f6c2670 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6c5d00 con 0x562d5f6c2670 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.005+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6c6580 con 0x562d5f6c2670 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f6c6f60 0x562d5f6c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6c9a20 con 0x562d5f6c6f60 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f106747c640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f6c6f60 0x562d5f6c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f106747c640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f6c6f60 0x562d5f6c9350 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 20 searching for the correct realm 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562d5f6cb9a0 0x562d5f6cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6ce530 con 0x562d5f6cb9a0 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.006+0000 7f1066c7b640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562d5f6cb9a0 0x562d5f6cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.007+0000 7f1066c7b640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562d5f6cb9a0 0x562d5f6cde60 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.007+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.007+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6ce530 con 0x562d5f6c6f60 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.007+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.007+0000 7f106747c640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f10600133b0 0x7f10600080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.007+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.008+0000 7f106647a640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f10600133b0 0x7f10600080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.008+0000 7f106647a640 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f10600133b0 0x7f10600080c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.008+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.008+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.009+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c6f60 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.010+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c6f60 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.011+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.012+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.013+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.013+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.013+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.013+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.013+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.013+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c6f60 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.014+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.014+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.014+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.014+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.014+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.014+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c6f60 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6cb9a0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.015+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x7f10600133b0 2024-02-16T00:11:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c2670 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f106004a030 con 0x562d5f6c6f60 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.016+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6ca290 con 0x562d5f6c2670 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6ca640 con 0x562d5f6c2670 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6caa20 con 0x562d5f6c2670 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 zone default found 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 4 Realm: () 2024-02-16T00:11:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 zonegroup default 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6caea0 con 0x7f10600133b0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.017+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d0350 con 0x562d5f6cb9a0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d06b0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 20 started sync module instance, tier type = 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.018+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6cfc30 con 0x562d5f6c6f60 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.019+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.019+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94752874493840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6cffe0 con 0x562d5f6c6f60 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.019+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d1440 con 0x562d5f6c2670 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.020+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94752874493840] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.020+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.020+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94752874499088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d15f0 con 0x562d5f6c2670 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.020+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d20c0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.021+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.021+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94752874503072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d2910 con 0x562d5f6cb9a0 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.021+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94752874499088] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.021+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d3390 con 0x562d5f6c6f60 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.022+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94752874503072] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.022+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.022+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94752874507920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d3350 con 0x562d5f6c6f60 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.023+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d3cc0 con 0x562d5f6c2670 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.023+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.023+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94752874510368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d4120 con 0x562d5f6c2670 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.023+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d4bd0 con 0x7f10600133b0 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.023+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94752874507920] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.024+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94752874510368] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.024+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.024+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94752874514128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d4b90 con 0x7f10600133b0 2024-02-16T00:11:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.025+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d3db0 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.025+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94752874514128] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.025+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.025+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94752874505328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d52b0 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.025+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d5d80 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94752874505328] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94752874518624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d61e0 con 0x7f10600133b0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=0 2024-02-16T00:11:27.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=1 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=2 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=3 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=4 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=5 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.026+0000 7f1069175800 20 add_watcher() i=6 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.027+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94752874518624] v27'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.027+0000 7f1069175800 20 add_watcher() i=7 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.027+0000 7f1069175800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.027+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d9620 con 0x562d5f6c2670 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.028+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.028+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94752874519872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d6a90 con 0x562d5f6c2670 2024-02-16T00:11:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.029+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94752874519872] v27'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.029+0000 7f0f1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.029+0000 7f1069175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.029+0000 7f1069175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.029+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e1c00 con 0x562d5f6c2670 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.030+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'46 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.030+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e2290 con 0x7f10600133b0 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.031+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'21 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.031+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e26b0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.032+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'21 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.032+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6dd930 con 0x562d5f6c2670 2024-02-16T00:11:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.033+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'128 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.033+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6dd490 con 0x562d5f6c6f60 2024-02-16T00:11:27.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.034+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'41 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.034+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e3bf0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.035+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'35 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.035+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e45c0 con 0x562d5f6c2670 2024-02-16T00:11:27.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.036+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.036+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e45c0 con 0x7f10600133b0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.037+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'30 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.037+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e45c0 con 0x562d5f6c6f60 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.038+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.038+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e0d30 con 0x562d5f6cb9a0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.039+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.039+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e0d30 con 0x562d5f6c6f60 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.039+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'42 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.039+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e5300 con 0x7f10600133b0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.040+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.041+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e5300 con 0x562d5f6c6f60 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.041+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.041+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e51c0 con 0x7f10600133b0 2024-02-16T00:11:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.043+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'41 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.043+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e51c0 con 0x562d5f6c2670 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.044+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'129 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.044+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e51c0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.045+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'35 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.045+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e5660 con 0x562d5f6c6f60 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.046+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'43 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.046+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e5660 con 0x562d5f6cb9a0 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.047+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.047+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e5660 con 0x562d5f6c2670 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.048+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.048+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6c2670 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.048+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'130 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.048+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.049+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'36 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.049+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6c6f60 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.050+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'33 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.050+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.051+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.051+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.052+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'33 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.052+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.053+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.053+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.054+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'36 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.054+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x7f10600133b0 2024-02-16T00:11:27.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.055+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.056+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.056+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.056+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x7f10600133b0 2024-02-16T00:11:27.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.058+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.058+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6cb9a0 2024-02-16T00:11:27.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.059+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.059+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x7f10600133b0 2024-02-16T00:11:27.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.060+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'42 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.060+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6e55d0 con 0x562d5f6c6f60 2024-02-16T00:11:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.060+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f0e97fff640 20 reqs_thread_entry: start 2024-02-16T00:11:27.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:27.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 20 Filter name: none 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f0e95ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f70ef70 con 0x7f10600133b0 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.061+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f70ef70 con 0x7f10600133b0 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1069175800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1069175800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94752874218000 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f711980 con 0x562d5f6cb9a0 2024-02-16T00:11:27.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== watch-notify(notify (1) cookie 94752874503072 notify 115964116998 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x562d5f501c20 con 0x562d5f6cb9a0 2024-02-16T00:11:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f0f4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94752874503072 notifier 4523 bl.length()=170 2024-02-16T00:11:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(96 notify.2 [notify cookie 94752874218000 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f0f4a7fc640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0f2c003d50 con 0x562d5f6cb9a0 2024-02-16T00:11:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== watch-notify(notify_complete (2) cookie 94752874218000 notify 115964116998 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562d5f501740 con 0x562d5f6cb9a0 2024-02-16T00:11:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.062+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f68c210 con 0x7f10600133b0 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.063+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v27'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.063+0000 7f1069175800 10 removing email index: 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.063+0000 7f1069175800 10 removing user buckets index 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.063+0000 7f1069175800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.063+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94752874218000 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f711960 con 0x7f10600133b0 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== watch-notify(notify (1) cookie 94752874505328 notify 115964116998 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f105c035040 con 0x7f10600133b0 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f0f49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94752874505328 notifier 4523 bl.length()=160 2024-02-16T00:11:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(99 notify.6 [notify cookie 94752874218000 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f0f49ffb640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0e9c0032b0 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== watch-notify(notify_complete (2) cookie 94752874218000 notify 115964116998 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562d5f4d8bb0 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.064+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f68c210 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(101 fud.buckets [delete] v27'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f1069175800 10 removing user index: fud 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f1069175800 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f1069175800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94752874218000 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f7108e0 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== watch-notify(notify (1) cookie 94752874514128 notify 115964116999 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x562d5f4d8bb0 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f0f49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94752874514128 notifier 4523 bl.length()=152 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(102 notify.5 [notify cookie 94752874218000 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f0f49ffb640 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0e9c0032b0 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.065+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.066+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== watch-notify(notify_complete (2) cookie 94752874218000 notify 115964116999 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f105c03da90 con 0x7f10600133b0 2024-02-16T00:11:27.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.066+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f712970 con 0x7f10600133b0 2024-02-16T00:11:27.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.067+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(104 fud [call,call,delete] v27'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.067+0000 7f0f1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.067+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94752874519872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6dea50 con 0x562d5f6c2670 2024-02-16T00:11:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.068+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94752874519872] v27'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.068+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94752874493840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d5d40 con 0x562d5f6c6f60 2024-02-16T00:11:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.069+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94752874493840] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.069+0000 7f1069175800 20 remove_watcher() i=0 2024-02-16T00:11:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.069+0000 7f1069175800 2 removed watcher, disabling cache 2024-02-16T00:11:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.069+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94752874499088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d5d40 con 0x562d5f6c2670 2024-02-16T00:11:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.070+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94752874499088] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.070+0000 7f1069175800 20 remove_watcher() i=1 2024-02-16T00:11:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.070+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94752874503072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d0c10 con 0x562d5f6cb9a0 2024-02-16T00:11:27.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.071+0000 7f1066c7b640 1 -- 172.21.15.42:0/176176411 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94752874503072] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1058059040 con 0x562d5f6cb9a0 2024-02-16T00:11:27.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.071+0000 7f1069175800 20 remove_watcher() i=2 2024-02-16T00:11:27.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.071+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94752874507920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d5d40 con 0x562d5f6c6f60 2024-02-16T00:11:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.072+0000 7f106747c640 1 -- 172.21.15.42:0/176176411 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94752874507920] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1060046070 con 0x562d5f6c6f60 2024-02-16T00:11:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.072+0000 7f1069175800 20 remove_watcher() i=3 2024-02-16T00:11:27.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.072+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94752874510368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d5d40 con 0x562d5f6c2670 2024-02-16T00:11:27.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.073+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94752874510368] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x562d5f6c2670 2024-02-16T00:11:27.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.073+0000 7f1069175800 20 remove_watcher() i=4 2024-02-16T00:11:27.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.073+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94752874514128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d3820 con 0x7f10600133b0 2024-02-16T00:11:27.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.074+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94752874514128] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.074+0000 7f1069175800 20 remove_watcher() i=5 2024-02-16T00:11:27.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.074+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94752874505328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d5d40 con 0x7f10600133b0 2024-02-16T00:11:27.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.075+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94752874505328] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.075+0000 7f1069175800 20 remove_watcher() i=6 2024-02-16T00:11:27.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.075+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94752874518624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x562d5f6d3820 con 0x7f10600133b0 2024-02-16T00:11:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94752874518624] v27'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f105c006070 con 0x7f10600133b0 2024-02-16T00:11:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 20 remove_watcher() i=7 2024-02-16T00:11:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f10600133b0 msgr2=0x7f10600080c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f10600133b0 0x7f10600080c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f6c2670 msgr2=0x562d5f6c4b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f6c2670 0x562d5f6c4b30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f6c6f60 msgr2=0x562d5f6c9350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f6c6f60 0x562d5f6c9350 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562d5f6cb9a0 msgr2=0x562d5f6cde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x562d5f6cb9a0 0x562d5f6cde60 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f300367e0 msgr2=0x7f0f30038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f300367e0 0x7f0f30038ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1058005680 tx=0x7f1058084000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 msgr2=0x562d5f6b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 --2- 172.21.15.42:0/176176411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6afa90 0x562d5f6b69e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f106004b070 tx=0x7f106004c0e0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 reap_dead start 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f106647a640 1 -- 172.21.15.42:0/176176411 reap_dead start 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 shutdown_connections 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.076+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 >> 172.21.15.42:0/176176411 conn(0x562d5f6abd60 msgr2=0x562d5f6a93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 shutdown_connections 2024-02-16T00:11:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/176176411 wait complete. 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f400367e0 msgr2=0x7f0f40038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f400367e0 0x7f0f40038ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x562d5f501ea0 tx=0x7f10580051b0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 msgr2=0x562d5f6a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 0x562d5f6a2c20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x562d5f502a40 tx=0x7f1060018830 comp rx=0 tx=0).stop 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 shutdown_connections 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f400367e0 0x7f0f40038ca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/2363034955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f6a2800 0x562d5f6a2c20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 >> 172.21.15.42:0/2363034955 conn(0x562d5f6968a0 msgr2=0x562d5f696ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 shutdown_connections 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/2363034955 wait complete. 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f58f280 msgr2=0x562d5f68ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f58f280 0x562d5f68ec70 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f690f50 msgr2=0x562d5f693340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f690f50 0x562d5f693340 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f4c036790 msgr2=0x7f0f4c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f4c036790 0x7f0f4c038c50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f105c000f60 tx=0x7f105c0012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 msgr2=0x562d5f503050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f503050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1058005870 tx=0x7f1058002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 shutdown_connections 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x562d5f690f50 0x562d5f693340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x562d5f58f280 0x562d5f68ec70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f4c036790 0x7f0f4c038c50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 --2- 172.21.15.42:0/1821269376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d5f58e020 0x562d5f503050 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 >> 172.21.15.42:0/1821269376 conn(0x562d5f5895c0 msgr2=0x562d5f67cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.077+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 shutdown_connections 2024-02-16T00:11:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.078+0000 7f1069175800 1 -- 172.21.15.42:0/1821269376 wait complete. 2024-02-16T00:11:27.088 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T00:11:27.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T00:11:27.089 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-16T00:11:27.181 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:27.181 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:27.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.178+0000 7f1047f2f800 1 Processor -- start 2024-02-16T00:11:27.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1047f2f800 1 -- start start 2024-02-16T00:11:27.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1047f2f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d39c4ac450 0x55d39c4ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1047f2f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d39c3f2b50 con 0x55d39c4a7fc0 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1047f2f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d39c3aa450 con 0x55d39c4ac450 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1043433640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d39c4ac450 0x55d39c4ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1043433640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d39c4ac450 0x55d39c4ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59964/0 (socket says 172.21.15.42:59964) 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1043c34640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55d39c4a7fc0 0x55d39c4a83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60478/0 (socket says 172.21.15.42:60478) 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1043433640 1 -- 172.21.15.42:0/411242722 learned_addr learned my addr 172.21.15.42:0/411242722 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1043433640 1 -- 172.21.15.42:0/411242722 >> v1:172.21.15.2:6789/0 conn(0x55d39c4a7fc0 legacy=0x55d39c4a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.179+0000 7f1043433640 1 -- 172.21.15.42:0/411242722 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39c4afe70 con 0x55d39c4ac450 2024-02-16T00:11:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.181+0000 7f1043433640 1 --2- 172.21.15.42:0/411242722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4ac450 0x55d39c4ae840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f102c00a520 tx=0x7f102c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52bd6b6ad8e2ade server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.181+0000 7f1042c32640 1 -- 172.21.15.42:0/411242722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102c052570 con 0x55d39c4ac450 2024-02-16T00:11:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.181+0000 7f1042c32640 1 -- 172.21.15.42:0/411242722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0526d0 con 0x55d39c4ac450 2024-02-16T00:11:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.181+0000 7f1042c32640 1 -- 172.21.15.42:0/411242722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102c052990 con 0x55d39c4ac450 2024-02-16T00:11:27.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 -- 172.21.15.42:0/411242722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4ac450 msgr2=0x55d39c4ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 --2- 172.21.15.42:0/411242722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4ac450 0x55d39c4ae840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f102c00a520 tx=0x7f102c01cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 -- 172.21.15.42:0/411242722 shutdown_connections 2024-02-16T00:11:27.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 --2- 172.21.15.42:0/411242722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4ac450 0x55d39c4ae840 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 -- 172.21.15.42:0/411242722 >> 172.21.15.42:0/411242722 conn(0x55d39c4a3560 msgr2=0x55d39c4a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 -- 172.21.15.42:0/411242722 shutdown_connections 2024-02-16T00:11:27.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.182+0000 7f1047f2f800 1 -- 172.21.15.42:0/411242722 wait complete. 2024-02-16T00:11:27.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.193+0000 7f1047f2f800 1 Processor -- start 2024-02-16T00:11:27.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.193+0000 7f1047f2f800 1 -- start start 2024-02-16T00:11:27.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.193+0000 7f1047f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c598050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.193+0000 7f1047f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c3a7980 con 0x55d39c4a7fc0 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.194+0000 7f1043c34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c598050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.194+0000 7f1043c34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c598050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59970/0 (socket says 172.21.15.42:59970) 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.194+0000 7f1043c34640 1 -- 172.21.15.42:0/2667098503 learned_addr learned my addr 172.21.15.42:0/2667098503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.194+0000 7f1043c34640 1 -- 172.21.15.42:0/2667098503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c005de0 con 0x55d39c4a7fc0 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.194+0000 7f1043c34640 1 --2- 172.21.15.42:0/2667098503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c598050 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1034001d30 tx=0x7f103400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51815e36429c7975 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.194+0000 7f0f31e0b640 1 -- 172.21.15.42:0/2667098503 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1034014070 con 0x55d39c4a7fc0 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f0f31e0b640 1 -- 172.21.15.42:0/2667098503 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400f450 con 0x55d39c4a7fc0 2024-02-16T00:11:27.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f0f31e0b640 1 -- 172.21.15.42:0/2667098503 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103400f730 con 0x55d39c4a7fc0 2024-02-16T00:11:27.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 -- 172.21.15.42:0/2667098503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 msgr2=0x55d39c598050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 --2- 172.21.15.42:0/2667098503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c598050 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1034001d30 tx=0x7f103400b600 comp rx=0 tx=0).stop 2024-02-16T00:11:27.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 -- 172.21.15.42:0/2667098503 shutdown_connections 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 --2- 172.21.15.42:0/2667098503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c598050 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 -- 172.21.15.42:0/2667098503 >> 172.21.15.42:0/2667098503 conn(0x55d39c4a3560 msgr2=0x55d39c593970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 -- 172.21.15.42:0/2667098503 shutdown_connections 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.195+0000 7f1047f2f800 1 -- 172.21.15.42:0/2667098503 wait complete. 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1047f2f800 1 Processor -- start 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1047f2f800 1 -- start start 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1047f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c59f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1047f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c3a3160 con 0x55d39c4a7fc0 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1043c34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c59f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1043c34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c59f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59980/0 (socket says 172.21.15.42:59980) 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1043c34640 1 -- 172.21.15.42:0/1375169539 learned_addr learned my addr 172.21.15.42:0/1375169539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1043c34640 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39c3f2b50 con 0x55d39c4a7fc0 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1043c34640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c59f700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x55d39c598de0 tx=0x7f1034000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f0f2bfff640 1 -- 172.21.15.42:0/1375169539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1034014050 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f0f2bfff640 1 -- 172.21.15.42:0/1375169539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103401b9b0 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.196+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d39c59fc40 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.197+0000 7f0f2bfff640 1 -- 172.21.15.42:0/1375169539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103401bc90 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.197+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d39c5a0120 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.197+0000 7f0f2bfff640 1 -- 172.21.15.42:0/1375169539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1034022020 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.197+0000 7f0f2bfff640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f2c0367e0 0x7f0f2c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f0f2bfff640 1 -- 172.21.15.42:0/1375169539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f1034008030 con 0x55d39c4a7fc0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1043433640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f2c0367e0 0x7f0f2c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c4ac450 0x55d39c5a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5a6a80 con 0x55d39c4ac450 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1044435640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c4ac450 0x55d39c5a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1043433640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f2c0367e0 0x7f0f2c038ca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f102c054000 tx=0x7f102c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1044435640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c4ac450 0x55d39c5a6460 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1044435640 1 -- 172.21.15.42:0/1375169539 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c4ac450 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.198+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5a3af0 con 0x55d39c4ac450 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1044435640 1 -- 172.21.15.42:0/1375169539 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c4ac450 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5a8cc0 0x55d39c5ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ab780 con 0x55d39c5a8cc0 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1043c34640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5a8cc0 0x55d39c5ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1043c34640 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5a8cc0 0x55d39c5ab0b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1043c34640 1 -- 172.21.15.42:0/1375169539 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5a8cc0 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.199+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5a7c40 con 0x55d39c4ac450 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1044435640 1 -- 172.21.15.42:0/1375169539 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c4ac450 2024-02-16T00:11:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5a8050 con 0x55d39c4ac450 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1044435640 1 -- 172.21.15.42:0/1375169539 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c4ac450 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1047f2f800 1 Processor -- start 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1047f2f800 1 -- start start 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1047f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 0x55d39c5ba990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.200+0000 7f1047f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c345e80 con 0x55d39c5ba570 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1044435640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 0x55d39c5ba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1044435640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 0x55d39c5ba990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59990/0 (socket says 172.21.15.42:59990) 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1044435640 1 -- 172.21.15.42:0/691649402 learned_addr learned my addr 172.21.15.42:0/691649402 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1044435640 1 -- 172.21.15.42:0/691649402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39c5baed0 con 0x55d39c5ba570 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1044435640 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 0x55d39c5ba990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x55d39c5a6de0 tx=0x7f103c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f0f297fa640 1 -- 172.21.15.42:0/691649402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103c01d070 con 0x55d39c5ba570 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f0f297fa640 1 -- 172.21.15.42:0/691649402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c0182e0 con 0x55d39c5ba570 2024-02-16T00:11:27.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f0f297fa640 1 -- 172.21.15.42:0/691649402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103c0145e0 con 0x55d39c5ba570 2024-02-16T00:11:27.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d39c5bb940 con 0x55d39c5ba570 2024-02-16T00:11:27.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.201+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d39c5bbe00 con 0x55d39c5ba570 2024-02-16T00:11:27.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.202+0000 7f0f297fa640 1 -- 172.21.15.42:0/691649402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f103c020020 con 0x55d39c5ba570 2024-02-16T00:11:27.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.202+0000 7f0f297fa640 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f1c036830 0x7f0f1c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.202+0000 7f0f297fa640 1 -- 172.21.15.42:0/691649402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f103c04dc50 con 0x55d39c5ba570 2024-02-16T00:11:27.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.202+0000 7f1043c34640 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f1c036830 0x7f0f1c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.202+0000 7f1047f2f800 1 Processor -- start 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1047f2f800 1 -- start start 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1043c34640 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f1c036830 0x7f0f1c038cf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55d39c5a6e50 tx=0x7f1034019f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1047f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1047f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c31b5d0 con 0x55d39c5c7800 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1044435640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1044435640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59992/0 (socket says 172.21.15.42:59992) 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1044435640 1 -- 172.21.15.42:0/1429660513 learned_addr learned my addr 172.21.15.42:0/1429660513 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1044435640 1 -- 172.21.15.42:0/1429660513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39c5c81f0 con 0x55d39c5c7800 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f1044435640 1 --2- 172.21.15.42:0/1429660513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5c7c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f103c013010 tx=0x7f103c011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67d7fe5d8bd2766 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f0f22ffd640 1 -- 172.21.15.42:0/1429660513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103c016570 con 0x55d39c5c7800 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f0f22ffd640 1 -- 172.21.15.42:0/1429660513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c014ac0 con 0x55d39c5c7800 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.203+0000 7f0f22ffd640 1 -- 172.21.15.42:0/1429660513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103c02b350 con 0x55d39c5c7800 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- 172.21.15.42:0/1429660513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 msgr2=0x55d39c5c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1429660513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5c7c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f103c013010 tx=0x7f103c011460 comp rx=0 tx=0).stop 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- 172.21.15.42:0/1429660513 shutdown_connections 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1429660513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5c7c20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- 172.21.15.42:0/1429660513 >> 172.21.15.42:0/1429660513 conn(0x55d39c5c3ad0 msgr2=0x55d39c5c1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- 172.21.15.42:0/1429660513 shutdown_connections 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- 172.21.15.42:0/1429660513 wait complete. 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 Processor -- start 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- start start 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.204+0000 7f1047f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c5cec90 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1044435640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1044435640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:59998/0 (socket says 172.21.15.42:59998) 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 learned_addr learned my addr 172.21.15.42:0/4202123167 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39c5bbe00 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1044435640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5ce750 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f103c04aec0 tx=0x7f103c04bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f0f217fa640 1 -- 172.21.15.42:0/4202123167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103c014c30 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f0f217fa640 1 -- 172.21.15.42:0/4202123167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c0133b0 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d39c5cee90 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f0f217fa640 1 -- 172.21.15.42:0/4202123167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103c013690 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.205+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d39c5cf350 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.206+0000 7f0f217fa640 1 -- 172.21.15.42:0/4202123167 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f103c022740 con 0x55d39c5c7800 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.206+0000 7f0f217fa640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f0c0367e0 0x7f0f0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.206+0000 7f0f217fa640 1 -- 172.21.15.42:0/4202123167 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f103c038c80 con 0x55d39c5c7800 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.206+0000 7f1043c34640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f0c0367e0 0x7f0f0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1043c34640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f0c0367e0 0x7f0f0c038ca0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f103401b620 tx=0x7f1034031040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c5da310 0x55d39c5dc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5dcf20 con 0x55d39c5da310 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1043433640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c5da310 0x55d39c5dc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1043433640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c5da310 0x55d39c5dc7d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 20 realm 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5dd2b0 con 0x55d39c5da310 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.207+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ddab0 con 0x55d39c5da310 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5dde10 con 0x55d39c5da310 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5deb20 0x55d39c5e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5deb20 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1044435640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5deb20 0x55d39c5e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.208+0000 7f1044435640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5deb20 0x55d39c5e0f10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1047f2f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1047f2f800 20 searching for the correct realm 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d39c5e37f0 0x55d39c5e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e6380 con 0x55d39c5e37f0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1043c34640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d39c5e37f0 0x55d39c5e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.209+0000 7f1043c34640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d39c5e37f0 0x55d39c5e5cb0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.210+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.210+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e6380 con 0x55d39c5deb20 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.210+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.210+0000 7f1044435640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f103c014070 0x7f103c02c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.210+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.210+0000 7f1043433640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f103c014070 0x7f103c02c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f103c014070 0x7f103c02c820 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.211+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5deb20 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.212+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5deb20 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.213+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.214+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.215+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5deb20 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.216+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5deb20 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5e37f0 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.217+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x7f103c014070 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5da310 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1520 con 0x55d39c5deb20 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.218+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1bf0 con 0x55d39c5da310 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e1fa0 con 0x55d39c5da310 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e2380 con 0x55d39c5da310 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 zone default found 2024-02-16T00:11:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 4 Realm: () 2024-02-16T00:11:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 zonegroup default 2024-02-16T00:11:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e67c0 con 0x7f103c014070 2024-02-16T00:11:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.219+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e8640 con 0x55d39c5e37f0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e89a0 con 0x55d39c5e37f0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 started sync module instance, tier type = 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.220+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7ad0 con 0x55d39c5deb20 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.221+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.221+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94367349899200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7ad0 con 0x55d39c5deb20 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.221+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e9310 con 0x55d39c5da310 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.222+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94367349899200] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.222+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.222+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94367349903440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7ad0 con 0x55d39c5da310 2024-02-16T00:11:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.222+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e9da0 con 0x55d39c5e37f0 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.223+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94367349903440] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.223+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.223+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94367349896752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7a50 con 0x55d39c5e37f0 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.223+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eac00 con 0x55d39c5deb20 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.224+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94367349896752] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.224+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.224+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94367349909344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eb020 con 0x55d39c5deb20 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.224+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eb990 con 0x55d39c5da310 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.225+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.225+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94367349912816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eb950 con 0x55d39c5da310 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.225+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ec8f0 con 0x7f103c014070 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.225+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94367349909344] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.226+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94367349912816] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.226+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.226+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94367349916720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ebb30 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.226+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ed140 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.227+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.227+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94367349918000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ed1f0 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.227+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5edca0 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.227+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94367349916720] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94367349918000] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94367349921696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ecd50 con 0x7f103c014070 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=0 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=1 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=2 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=3 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=4 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=5 2024-02-16T00:11:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.228+0000 7f1047f2f800 20 add_watcher() i=6 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.229+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94367349921696] v27'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.229+0000 7f1047f2f800 20 add_watcher() i=7 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.229+0000 7f1047f2f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.229+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5f0da0 con 0x55d39c5da310 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.229+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.229+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94367349910400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ee210 con 0x55d39c5da310 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.230+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94367349910400] v27'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.230+0000 7f0ef9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.230+0000 7f1047f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.230+0000 7f1047f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 5 note: GC not initialized 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f0ef8fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 20 Filter name: none 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f0e727fc640 20 reqs_thread_entry: start 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T00:11:27.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c622e40 con 0x7f103c014070 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.231+0000 7f1047f2f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T00:11:27.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c621420 con 0x7f103c014070 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:11:27.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.232+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~386 in=386b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c6258c0 con 0x7f103c014070 2024-02-16T00:11:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~386] v27'7 uv7 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1047f2f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-16T00:11:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1047f2f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1047f2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94367350145840 in=589b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c626420 con 0x55d39c5deb20 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== watch-notify(notify (1) cookie 94367349909344 notify 115964117013 ret 0) v3 ==== 619+0+0 (crc 0 0 0) 0x55d39c5cee90 con 0x55d39c5deb20 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f0f22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117013 cookie 94367349909344 notifier 4530 bl.length()=577 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f0f22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f0f22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 notify.3 [notify cookie 94367350145840 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f0f22ffd640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0f08003e90 con 0x55d39c5deb20 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.233+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.234+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== watch-notify(notify_complete (2) cookie 94367350145840 notify 115964117013 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f103c03b020 con 0x55d39c5deb20 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.234+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c6237c0 con 0x7f103c014070 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v27'8 uv8 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1047f2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1047f2f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1047f2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94367350141728 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c623740 con 0x55d39c5e37f0 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== watch-notify(notify (1) cookie 94367349896752 notify 115964116999 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x55d39c5a0120 con 0x55d39c5e37f0 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f0f227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94367349896752 notifier 4530 bl.length()=192 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f0f227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f0f227fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f0f227fc640 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f0e780033f0 con 0x55d39c5e37f0 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(68 notify.2 [notify cookie 94367350141728 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== watch-notify(notify_complete (2) cookie 94367350141728 notify 115964116999 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d39c59fc40 con 0x55d39c5e37f0 2024-02-16T00:11:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.235+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.267 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.236+0000 7f0ef9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.236+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94367349910400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5f0820 con 0x55d39c5da310 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.237+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94367349910400] v27'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.237+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94367349899200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eab80 con 0x55d39c5deb20 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.238+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94367349899200] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.238+0000 7f1047f2f800 20 remove_watcher() i=0 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.238+0000 7f1047f2f800 2 removed watcher, disabling cache 2024-02-16T00:11:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.238+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94367349903440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eab80 con 0x55d39c5da310 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.239+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94367349903440] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.239+0000 7f1047f2f800 20 remove_watcher() i=1 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.239+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94367349896752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eab80 con 0x55d39c5e37f0 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.240+0000 7f1043c34640 1 -- 172.21.15.42:0/4202123167 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94367349896752] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034016070 con 0x55d39c5e37f0 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.240+0000 7f1047f2f800 20 remove_watcher() i=2 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.240+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94367349909344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7630 con 0x55d39c5deb20 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.241+0000 7f1044435640 1 -- 172.21.15.42:0/4202123167 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94367349909344] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55d39c5deb20 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.241+0000 7f1047f2f800 20 remove_watcher() i=3 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.241+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94367349912816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7630 con 0x55d39c5da310 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.242+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94367349912816] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x55d39c5da310 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.242+0000 7f1047f2f800 20 remove_watcher() i=4 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.242+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94367349916720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5eb4f0 con 0x7f103c014070 2024-02-16T00:11:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.243+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94367349916720] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.243+0000 7f1047f2f800 20 remove_watcher() i=5 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.243+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94367349918000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5e7630 con 0x7f103c014070 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.244+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94367349918000] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.244+0000 7f1047f2f800 20 remove_watcher() i=6 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.244+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94367349921696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d39c5ec930 con 0x7f103c014070 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94367349921696] v27'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c052aa0 con 0x7f103c014070 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 20 remove_watcher() i=7 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f103c014070 msgr2=0x7f103c02c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f103c014070 0x7f103c02c820 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c5da310 msgr2=0x55d39c5dc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c5da310 0x55d39c5dc7d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5deb20 msgr2=0x55d39c5e0f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5deb20 0x55d39c5e0f10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d39c5e37f0 msgr2=0x55d39c5e5cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d39c5e37f0 0x55d39c5e5cb0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f0c0367e0 msgr2=0x7f0f0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f0c0367e0 0x7f0f0c038ca0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f103401b620 tx=0x7f1034031040 comp rx=0 tx=0).stop 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 msgr2=0x55d39c5ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1043433640 1 -- 172.21.15.42:0/4202123167 reap_dead start 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5ce750 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f103c04aec0 tx=0x7f103c04bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 shutdown_connections 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/4202123167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5c7800 0x55d39c5ce750 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 >> 172.21.15.42:0/4202123167 conn(0x55d39c5c3ad0 msgr2=0x55d39c5c1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 shutdown_connections 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/4202123167 wait complete. 2024-02-16T00:11:27.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f1c036830 msgr2=0x7f0f1c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f1c036830 0x7f0f1c038cf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55d39c5a6e50 tx=0x7f1034019f90 comp rx=0 tx=0).stop 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 msgr2=0x55d39c5ba990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.245+0000 7f1047f2f800 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 0x55d39c5ba990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x55d39c5a6de0 tx=0x7f103c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 shutdown_connections 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f1c036830 0x7f0f1c038cf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/691649402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c5ba570 0x55d39c5ba990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 >> 172.21.15.42:0/691649402 conn(0x55d39c5ae610 msgr2=0x55d39c5aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 shutdown_connections 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/691649402 wait complete. 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c4ac450 msgr2=0x55d39c5a6460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c4ac450 0x55d39c5a6460 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5a8cc0 msgr2=0x55d39c5ab0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5a8cc0 0x55d39c5ab0b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f2c0367e0 msgr2=0x7f0f2c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f2c0367e0 0x7f0f2c038ca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f102c054000 tx=0x7f102c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 msgr2=0x55d39c59f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c59f700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x55d39c598de0 tx=0x7f1034000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 shutdown_connections 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d39c5a8cc0 0x55d39c5ab0b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d39c4ac450 0x55d39c5a6460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0f2c0367e0 0x7f0f2c038ca0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 --2- 172.21.15.42:0/1375169539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d39c4a7fc0 0x55d39c59f700 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 >> 172.21.15.42:0/1375169539 conn(0x55d39c4a3560 msgr2=0x55d39c596a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 shutdown_connections 2024-02-16T00:11:27.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.246+0000 7f1047f2f800 1 -- 172.21.15.42:0/1375169539 wait complete. 2024-02-16T00:11:27.278 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:27.279 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T00:11:27.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T00:11:27.279 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-02-16T00:11:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:27.325 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.322+0000 7f74cb60f800 1 Processor -- start 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.322+0000 7f74cb60f800 1 -- start start 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74cb60f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ff07353320 0x55ff07355710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74cb60f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ff0729ac50 con 0x55ff0734ee90 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74cb60f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ff07252450 con 0x55ff07353320 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74c64e3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ff07353320 0x55ff07355710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74c6ce4640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55ff0734ee90 0x55ff0734f2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60494/0 (socket says 172.21.15.42:60494) 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74c6ce4640 1 -- 172.21.15.42:0/1370562374 learned_addr learned my addr 172.21.15.42:0/1370562374 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:27.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74c64e3640 1 -- 172.21.15.42:0/1370562374 >> v1:172.21.15.2:6789/0 conn(0x55ff0734ee90 legacy=0x55ff0734f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.323+0000 7f74c64e3640 1 -- 172.21.15.42:0/1370562374 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff07356d40 con 0x55ff07353320 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.325+0000 7f74c64e3640 1 --2- 172.21.15.42:0/1370562374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07353320 0x55ff07355710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f74b000a470 tx=0x7f74b001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22491c2dd28e141e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.325+0000 7f74c5ce2640 1 -- 172.21.15.42:0/1370562374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74b0052570 con 0x55ff07353320 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.325+0000 7f74c5ce2640 1 -- 172.21.15.42:0/1370562374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b00526d0 con 0x55ff07353320 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.325+0000 7f74c5ce2640 1 -- 172.21.15.42:0/1370562374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74b0052990 con 0x55ff07353320 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 -- 172.21.15.42:0/1370562374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07353320 msgr2=0x55ff07355710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1370562374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07353320 0x55ff07355710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f74b000a470 tx=0x7f74b001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 -- 172.21.15.42:0/1370562374 shutdown_connections 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1370562374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07353320 0x55ff07355710 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 -- 172.21.15.42:0/1370562374 >> 172.21.15.42:0/1370562374 conn(0x55ff0734a4f0 msgr2=0x55ff0734c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 -- 172.21.15.42:0/1370562374 shutdown_connections 2024-02-16T00:11:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.326+0000 7f74cb60f800 1 -- 172.21.15.42:0/1370562374 wait complete. 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.337+0000 7f74cb60f800 1 Processor -- start 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.337+0000 7f74cb60f800 1 -- start start 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.337+0000 7f74cb60f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff0743ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.337+0000 7f74cb60f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff0724f980 con 0x55ff0734ee90 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.337+0000 7f74c6ce4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff0743ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f74c6ce4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff0743ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60010/0 (socket says 172.21.15.42:60010) 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f74c6ce4640 1 -- 172.21.15.42:0/1419546173 learned_addr learned my addr 172.21.15.42:0/1419546173 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f74c6ce4640 1 -- 172.21.15.42:0/1419546173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0005d20 con 0x55ff0734ee90 2024-02-16T00:11:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/1419546173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff0743ee90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f74b8001bf0 tx=0x7f74b800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdea3fbf44583bda server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f73b4e09640 1 -- 172.21.15.42:0/1419546173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74b800e470 con 0x55ff0734ee90 2024-02-16T00:11:27.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f73b4e09640 1 -- 172.21.15.42:0/1419546173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800e5f0 con 0x55ff0734ee90 2024-02-16T00:11:27.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.338+0000 7f73b4e09640 1 -- 172.21.15.42:0/1419546173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74b800e910 con 0x55ff0734ee90 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- 172.21.15.42:0/1419546173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 msgr2=0x55ff0743ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1419546173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff0743ee90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f74b8001bf0 tx=0x7f74b800b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- 172.21.15.42:0/1419546173 shutdown_connections 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1419546173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff0743ee90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- 172.21.15.42:0/1419546173 >> 172.21.15.42:0/1419546173 conn(0x55ff0734a4f0 msgr2=0x55ff0743a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- 172.21.15.42:0/1419546173 shutdown_connections 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- 172.21.15.42:0/1419546173 wait complete. 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 Processor -- start 2024-02-16T00:11:27.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- start start 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff07447630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74cb60f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff0724b160 con 0x55ff0734ee90 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74c6ce4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff07447630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74c6ce4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff07447630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60026/0 (socket says 172.21.15.42:60026) 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.339+0000 7f74c6ce4640 1 -- 172.21.15.42:0/1952450767 learned_addr learned my addr 172.21.15.42:0/1952450767 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f74c6ce4640 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff0729ac50 con 0x55ff0734ee90 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff07447630 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000f60 tx=0x7f74b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f73b3606640 1 -- 172.21.15.42:0/1952450767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74b801f070 con 0x55ff0734ee90 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f73b3606640 1 -- 172.21.15.42:0/1952450767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80197c0 con 0x55ff0734ee90 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f73b3606640 1 -- 172.21.15.42:0/1952450767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74b8019a60 con 0x55ff0734ee90 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff07447b70 con 0x55ff0734ee90 2024-02-16T00:11:27.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.340+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff07448050 con 0x55ff0734ee90 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f73b3606640 1 -- 172.21.15.42:0/1952450767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f74b8019bc0 con 0x55ff0734ee90 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f73b3606640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73ac036790 0x7f73ac038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f73b3606640 1 -- 172.21.15.42:0/1952450767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f74b804c6f0 con 0x55ff0734ee90 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f74c64e3640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73ac036790 0x7f73ac038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07353320 0x55ff0744e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0744e920 con 0x55ff07353320 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.341+0000 7f74c74e5640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07353320 0x55ff0744e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74c64e3640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73ac036790 0x7f73ac038c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f74b0054000 tx=0x7f74b004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74c74e5640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07353320 0x55ff0744e350 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74c74e5640 1 -- 172.21.15.42:0/1952450767 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07353320 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0744ba20 con 0x55ff07353320 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74c74e5640 1 -- 172.21.15.42:0/1952450767 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07353320 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07450b60 0x55ff07452f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07453620 con 0x55ff07450b60 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.342+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07450b60 0x55ff07452f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.343+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07450b60 0x55ff07452f50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.343+0000 7f74c6ce4640 1 -- 172.21.15.42:0/1952450767 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f74b800d590 con 0x55ff07450b60 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.343+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0744fae0 con 0x55ff07353320 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.343+0000 7f74c74e5640 1 -- 172.21.15.42:0/1952450767 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07353320 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.343+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0744fef0 con 0x55ff07353320 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.343+0000 7f74c74e5640 1 -- 172.21.15.42:0/1952450767 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07353320 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74cb60f800 1 Processor -- start 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74cb60f800 1 -- start start 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74cb60f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 0x55ff07442540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74cb60f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff071ede80 con 0x55ff074440d0 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 0x55ff07442540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 0x55ff07442540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60028/0 (socket says 172.21.15.42:60028) 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.344+0000 7f74c74e5640 1 -- 172.21.15.42:0/3344311096 learned_addr learned my addr 172.21.15.42:0/3344311096 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f74c74e5640 1 -- 172.21.15.42:0/3344311096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff07442a80 con 0x55ff074440d0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f74c74e5640 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 0x55ff07442540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x55ff0744ec80 tx=0x7f74c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f73b0e01640 1 -- 172.21.15.42:0/3344311096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74c001d070 con 0x55ff074440d0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f73b0e01640 1 -- 172.21.15.42:0/3344311096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c00182e0 con 0x55ff074440d0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f73b0e01640 1 -- 172.21.15.42:0/3344311096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74c00145e0 con 0x55ff074440d0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff07442cd0 con 0x55ff074440d0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.345+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff07443190 con 0x55ff074440d0 2024-02-16T00:11:27.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f73b0e01640 1 -- 172.21.15.42:0/3344311096 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f74c0020020 con 0x55ff074440d0 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f73b0e01640 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73a00367e0 0x7f73a0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f73b0e01640 1 -- 172.21.15.42:0/3344311096 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f74c004dc10 con 0x55ff074440d0 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73a00367e0 0x7f73a0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74cb60f800 1 Processor -- start 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73a00367e0 0x7f73a0038ca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ff0744ecf0 tx=0x7f74b8019ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74cb60f800 1 -- start start 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74cb60f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07471c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74cb60f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff071c35d0 con 0x55ff07471800 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07471c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07471c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60032/0 (socket says 172.21.15.42:60032) 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.346+0000 7f74c74e5640 1 -- 172.21.15.42:0/1441552720 learned_addr learned my addr 172.21.15.42:0/1441552720 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74c74e5640 1 -- 172.21.15.42:0/1441552720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff074721f0 con 0x55ff07471800 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74c74e5640 1 --2- 172.21.15.42:0/1441552720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07471c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f74c0013010 tx=0x7f74c0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac412db9a53fe200 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f73aa7fc640 1 -- 172.21.15.42:0/1441552720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74c0016440 con 0x55ff07471800 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f73aa7fc640 1 -- 172.21.15.42:0/1441552720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c00165a0 con 0x55ff07471800 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f73aa7fc640 1 -- 172.21.15.42:0/1441552720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74c0014bf0 con 0x55ff07471800 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 -- 172.21.15.42:0/1441552720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 msgr2=0x55ff07471c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1441552720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07471c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f74c0013010 tx=0x7f74c0011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 -- 172.21.15.42:0/1441552720 shutdown_connections 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1441552720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07471c20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 -- 172.21.15.42:0/1441552720 >> 172.21.15.42:0/1441552720 conn(0x55ff0746db60 msgr2=0x55ff0746bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 -- 172.21.15.42:0/1441552720 shutdown_connections 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.347+0000 7f74cb60f800 1 -- 172.21.15.42:0/1441552720 wait complete. 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74cb60f800 1 Processor -- start 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74cb60f800 1 -- start start 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74cb60f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07478770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74cb60f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff07478cb0 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07478770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07478770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60038/0 (socket says 172.21.15.42:60038) 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 learned_addr learned my addr 172.21.15.42:0/263381754 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.348+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff07443190 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f74c74e5640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07478770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f74c0047010 tx=0x7f74c004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f73a8ff9640 1 -- 172.21.15.42:0/263381754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74c00116f0 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f73a8ff9640 1 -- 172.21.15.42:0/263381754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c00148c0 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff07478eb0 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f73a8ff9640 1 -- 172.21.15.42:0/263381754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74c0013500 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff07478eb0 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.349+0000 7f73a8ff9640 1 -- 172.21.15.42:0/263381754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f74c0013660 con 0x55ff07471800 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f73a8ff9640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73900367e0 0x7f7390038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f73a8ff9640 1 -- 172.21.15.42:0/263381754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f74c0038c80 con 0x55ff07471800 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73900367e0 0x7f7390038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73900367e0 0x7f7390038ca0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74b800efd0 tx=0x7f74b8036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07484230 0x55ff074866f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07486e40 con 0x55ff07484230 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.350+0000 7f74c64e3640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07484230 0x55ff074866f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74c64e3640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07484230 0x55ff074866f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 realm 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074871d0 con 0x55ff07484230 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07487a50 con 0x55ff07484230 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.351+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07487db0 con 0x55ff07484230 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07488ac0 0x55ff0748aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07488ac0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74c74e5640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07488ac0 0x55ff0748aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74c74e5640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07488ac0 0x55ff0748aeb0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 20 searching for the correct realm 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ff0748d7f0 0x55ff0748fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07490380 con 0x55ff0748d7f0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.352+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ff0748d7f0 0x55ff0748fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.353+0000 7f74c6ce4640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ff0748d7f0 0x55ff0748fcb0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.353+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.353+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07490380 con 0x55ff07488ac0 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.353+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.354+0000 7f74c74e5640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f74c0014070 0x7f74c0023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.354+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.354+0000 7f74c64e3640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f74c0014070 0x7f74c0023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.354+0000 7f74c64e3640 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f74c0014070 0x7f74c0023420 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.354+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.354+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.355+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07488ac0 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.356+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.356+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.356+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.356+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.356+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.356+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07488ac0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.357+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.358+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.359+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.359+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.359+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.359+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.359+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.359+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07488ac0 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.360+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07488ac0 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff0748d7f0 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.361+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x7f74c0014070 2024-02-16T00:11:27.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07484230 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748b500 con 0x55ff07488ac0 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.362+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748bbf0 con 0x55ff07484230 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748bfa0 con 0x55ff07484230 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0748c380 con 0x55ff07484230 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 zone default found 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 4 Realm: () 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 zonegroup default 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074907c0 con 0x7f74c0014070 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.363+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07492640 con 0x55ff0748d7f0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074929a0 con 0x55ff0748d7f0 2024-02-16T00:11:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 started sync module instance, tier type = 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.364+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07491c10 con 0x55ff07488ac0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.365+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.365+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94553827254528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07491c10 con 0x55ff07488ac0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.365+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074933a0 con 0x55ff07484230 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.366+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.366+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94553827254528] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.366+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94553827258016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07493360 con 0x55ff07484230 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.366+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07493e10 con 0x55ff0748d7f0 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.367+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94553827258016] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.367+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.367+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94553827260752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07494170 con 0x55ff0748d7f0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.367+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07494c10 con 0x55ff07488ac0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.368+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94553827260752] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.368+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.368+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94553827264240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07494fc0 con 0x55ff07488ac0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.368+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07495a30 con 0x55ff07484230 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.369+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.369+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94553827267856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074959f0 con 0x55ff07484230 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.369+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074969b0 con 0x7f74c0014070 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.369+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94553827264240] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.370+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94553827267856] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.370+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.370+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94553827271888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07495bd0 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.370+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07497200 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.371+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94553827271888] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.371+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.371+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94553827252080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07497070 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.371+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07497870 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94553827252080] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94553827274160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074976f0 con 0x7f74c0014070 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=0 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=1 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=2 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=3 2024-02-16T00:11:27.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=4 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=5 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.372+0000 7f74cb60f800 20 add_watcher() i=6 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.373+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94553827274160] v27'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.373+0000 7f74cb60f800 20 add_watcher() i=7 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.373+0000 7f74cb60f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.373+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0749ad40 con 0x55ff07484230 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.373+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.373+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94553827275216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff0749ad40 con 0x55ff07484230 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.374+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94553827275216] v27'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.374+0000 7f737d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.374+0000 7f74cb60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.374+0000 7f74cb60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f74cb60f800 5 note: GC not initialized 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f72f7fff640 20 reqs_thread_entry: start 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f74cb60f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f74cb60f800 20 Filter name: none 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f72f5ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f74cb60f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.375+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074cce60 con 0x7f74c0014070 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=386 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074ce9a0 con 0x55ff07488ac0 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d0280 con 0x55ff07484230 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.376+0000 7f74cb60f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.377+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d4750 con 0x55ff07488ac0 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.378+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(65 foo.buckets [call] v27'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.378+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 8.f 8:f6e6227e:root::.bucket.meta.testx%3amyfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d8060 con 0x55ff0748d7f0 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [create,call,writefull 0~371,setxattr (203)] v27'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74cb60f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x7 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74cb60f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74cb60f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74cb60f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94553827532368 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d7b60 con 0x7f74c0014070 2024-02-16T00:11:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== watch-notify(notify (1) cookie 94553827274160 notify 115964117000 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7f74b0084040 con 0x7f74c0014070 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f73aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94553827274160 notifier 4537 bl.length()=806 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f73aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x7 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f73aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f73aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(67 notify.7 [notify cookie 94553827532368 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f73aa7fc640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f738c003e90 con 0x7f74c0014070 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.379+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.380+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== watch-notify(notify_complete (2) cookie 94553827532368 notify 115964117000 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74b007a040 con 0x7f74c0014070 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.380+0000 7f74cb60f800 20 handle_bi_update(): bucket=testx:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_sources= new_sources= 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.380+0000 7f74cb60f800 20 handle_bi_update(): bucket=testx:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential sources added=[] removed=[] 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.380+0000 7f74cb60f800 20 handle_bi_update(): bucket=testx:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_dests= new_dests= 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.380+0000 7f74cb60f800 20 handle_bi_update(): bucket=testx:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential dests added=[] removed=[] 2024-02-16T00:11:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.380+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d7c40 con 0x55ff07484230 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.381+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v27'4 uv4 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.381+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d7c40 con 0x55ff07484230 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v27'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94553827539168 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d8bc0 con 0x55ff07484230 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== watch-notify(notify (1) cookie 94553827267856 notify 115964117003 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x7f74b007a040 con 0x55ff07484230 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f73a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94553827267856 notifier 4537 bl.length()=348 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f73a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f73a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T00:11:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(71 notify.4 [notify cookie 94553827539168 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f73a9ffb640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f72fc0033f0 con 0x55ff07484230 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94553827539168 notify 115964117003 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ff07356d40 con 0x55ff07484230 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.382+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94553827539168 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d52e0 con 0x7f74c0014070 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== watch-notify(notify (1) cookie 94553827252080 notify 115964117001 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55ff07356d40 con 0x7f74c0014070 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f73aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94553827252080 notifier 4537 bl.length()=149 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f73aa7fc640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f738c003e90 con 0x7f74c0014070 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(73 notify.6 [notify cookie 94553827539168 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== watch-notify(notify_complete (2) cookie 94553827539168 notify 115964117001 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74b004e070 con 0x7f74c0014070 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.383+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d4e40 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(75 myfoo [call,delete] v27'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f74cb60f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 from cache 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f74cb60f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94553827510528 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074ce9a0 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== watch-notify(notify (1) cookie 94553827254528 notify 115964117014 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f74c004de70 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f73a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117014 cookie 94553827254528 notifier 4537 bl.length()=206 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f73a9ffb640 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f72fc0033d0 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.384+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(76 notify.0 [notify cookie 94553827510528 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.385+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(77 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.385+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== watch-notify(notify_complete (2) cookie 94553827510528 notify 115964117014 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74c003b020 con 0x55ff07488ac0 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.385+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d78e0 con 0x55ff07484230 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.386+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(78 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call,delete] v27'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.387+0000 7f737d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.387+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94553827275216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074d78e0 con 0x55ff07484230 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.388+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94553827275216] v27'135 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.388+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94553827254528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074971d0 con 0x55ff07488ac0 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.389+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94553827254528] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.389+0000 7f74cb60f800 20 remove_watcher() i=0 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.389+0000 7f74cb60f800 2 removed watcher, disabling cache 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.389+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94553827258016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07492100 con 0x55ff07484230 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.390+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94553827258016] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.390+0000 7f74cb60f800 20 remove_watcher() i=1 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.390+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94553827260752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07492100 con 0x55ff0748d7f0 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.391+0000 7f74c6ce4640 1 -- 172.21.15.42:0/263381754 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94553827260752] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b800d590 con 0x55ff0748d7f0 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.391+0000 7f74cb60f800 20 remove_watcher() i=2 2024-02-16T00:11:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.391+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94553827264240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07493950 con 0x55ff07488ac0 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.392+0000 7f74c74e5640 1 -- 172.21.15.42:0/263381754 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94553827264240] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74c000a4a0 con 0x55ff07488ac0 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.392+0000 7f74cb60f800 20 remove_watcher() i=3 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.392+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94553827267856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07492100 con 0x55ff07484230 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.393+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94553827267856] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x55ff07484230 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.393+0000 7f74cb60f800 20 remove_watcher() i=4 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.393+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94553827271888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07493950 con 0x7f74c0014070 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.394+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94553827271888] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.394+0000 7f74cb60f800 20 remove_watcher() i=5 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.394+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94553827252080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff07492100 con 0x7f74c0014070 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.395+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94553827252080] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.395+0000 7f74cb60f800 20 remove_watcher() i=6 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.395+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94553827274160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ff074964d0 con 0x7f74c0014070 2024-02-16T00:11:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.395+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94553827274160] v27'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b0059040 con 0x7f74c0014070 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 20 remove_watcher() i=7 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f74c0014070 msgr2=0x7f74c0023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f74c0014070 0x7f74c0023420 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07484230 msgr2=0x55ff074866f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07484230 0x55ff074866f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07488ac0 msgr2=0x55ff0748aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07488ac0 0x55ff0748aeb0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ff0748d7f0 msgr2=0x55ff0748fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ff0748d7f0 0x55ff0748fcb0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73900367e0 msgr2=0x7f7390038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73900367e0 0x7f7390038ca0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74b800efd0 tx=0x7f74b8036000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 msgr2=0x55ff07478770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74c64e3640 1 -- 172.21.15.42:0/263381754 reap_dead start 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07478770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f74c0047010 tx=0x7f74c004bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 shutdown_connections 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/263381754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff07471800 0x55ff07478770 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 >> 172.21.15.42:0/263381754 conn(0x55ff0746db60 msgr2=0x55ff0746b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 shutdown_connections 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/263381754 wait complete. 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73a00367e0 msgr2=0x7f73a0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73a00367e0 0x7f73a0038ca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ff0744ecf0 tx=0x7f74b8019ef0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 msgr2=0x55ff07442540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 0x55ff07442540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x55ff0744ec80 tx=0x7f74c0018830 comp rx=0 tx=0).stop 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 shutdown_connections 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73a00367e0 0x7f73a0038ca0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 --2- 172.21.15.42:0/3344311096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff074440d0 0x55ff07442540 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 >> 172.21.15.42:0/3344311096 conn(0x55ff074564b0 msgr2=0x55ff074568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 shutdown_connections 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.396+0000 7f74cb60f800 1 -- 172.21.15.42:0/3344311096 wait complete. 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07353320 msgr2=0x55ff0744e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07353320 0x55ff0744e350 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07450b60 msgr2=0x55ff07452f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07450b60 0x55ff07452f50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73ac036790 msgr2=0x7f73ac038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73ac036790 0x7f73ac038c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f74b0054000 tx=0x7f74b004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 msgr2=0x55ff07447630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff07447630 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000f60 tx=0x7f74b8000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 shutdown_connections 2024-02-16T00:11:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ff07450b60 0x55ff07452f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ff07353320 0x55ff0744e350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f73ac036790 0x7f73ac038c50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 --2- 172.21.15.42:0/1952450767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff0734ee90 0x55ff07447630 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 >> 172.21.15.42:0/1952450767 conn(0x55ff0734a4f0 msgr2=0x55ff07439010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 shutdown_connections 2024-02-16T00:11:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.397+0000 7f74cb60f800 1 -- 172.21.15.42:0/1952450767 wait complete. 2024-02-16T00:11:27.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-02-16T00:11:27.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-02-16T00:11:27.423 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-02-16T00:11:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9bbbda800 1 Processor -- start 2024-02-16T00:11:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9bbbda800 1 -- start start 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9bbbda800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5598b27cb300 0x5598b27cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9bbbda800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5598b2712bb0 con 0x5598b27c6e70 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9bbbda800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5598b26ca450 con 0x5598b27cb300 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9b8ed8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5598b27cb300 0x5598b27cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9b96d9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5598b27c6e70 0x5598b27c7290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60510/0 (socket says 172.21.15.42:60510) 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2425975429 learned_addr learned my addr 172.21.15.42:0/2425975429 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2425975429 >> v1:172.21.15.2:6789/0 conn(0x5598b27c6e70 legacy=0x5598b27c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.462+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2425975429 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b27ced20 con 0x5598b27cb300 2024-02-16T00:11:27.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.464+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/2425975429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27cb300 0x5598b27cd6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000a470 tx=0x7fe9b001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a692783419dc1315 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.464+0000 7fe9abfff640 1 -- 172.21.15.42:0/2425975429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0052570 con 0x5598b27cb300 2024-02-16T00:11:27.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.464+0000 7fe9abfff640 1 -- 172.21.15.42:0/2425975429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b00526d0 con 0x5598b27cb300 2024-02-16T00:11:27.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.464+0000 7fe9abfff640 1 -- 172.21.15.42:0/2425975429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0052990 con 0x5598b27cb300 2024-02-16T00:11:27.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2425975429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27cb300 msgr2=0x5598b27cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2425975429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27cb300 0x5598b27cd6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000a470 tx=0x7fe9b001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:27.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2425975429 shutdown_connections 2024-02-16T00:11:27.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2425975429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27cb300 0x5598b27cd6f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2425975429 >> 172.21.15.42:0/2425975429 conn(0x5598b27c24d0 msgr2=0x5598b27c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2425975429 shutdown_connections 2024-02-16T00:11:27.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.465+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2425975429 wait complete. 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.476+0000 7fe9bbbda800 1 Processor -- start 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.476+0000 7fe9bbbda800 1 -- start start 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.476+0000 7fe9bbbda800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.476+0000 7fe9bbbda800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b26c7980 con 0x5598b27c6e70 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe9b96d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe9b96d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60042/0 (socket says 172.21.15.42:60042) 2024-02-16T00:11:27.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2385265351 learned_addr learned my addr 172.21.15.42:0/2385265351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2385265351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0005d20 con 0x5598b27c6e70 2024-02-16T00:11:27.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/2385265351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28b6ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001bf0 tx=0x7fe9ac00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2066a9a8667ea718 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe8a7606640 1 -- 172.21.15.42:0/2385265351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac010070 con 0x5598b27c6e70 2024-02-16T00:11:27.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe8a7606640 1 -- 172.21.15.42:0/2385265351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00b110 con 0x5598b27c6e70 2024-02-16T00:11:27.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.477+0000 7fe8a7606640 1 -- 172.21.15.42:0/2385265351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac009460 con 0x5598b27c6e70 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2385265351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 msgr2=0x5598b28b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2385265351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28b6ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001bf0 tx=0x7fe9ac00b850 comp rx=0 tx=0).stop 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2385265351 shutdown_connections 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2385265351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28b6ef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2385265351 >> 172.21.15.42:0/2385265351 conn(0x5598b27c24d0 msgr2=0x5598b28b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2385265351 shutdown_connections 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2385265351 wait complete. 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.478+0000 7fe9bbbda800 1 Processor -- start 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9bbbda800 1 -- start start 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9bbbda800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9bbbda800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b26c3160 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9b96d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9b96d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60052/0 (socket says 172.21.15.42:60052) 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9b96d9640 1 -- 172.21.15.42:0/1709800836 learned_addr learned my addr 172.21.15.42:0/1709800836 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9b96d9640 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b2712bb0 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28c1890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001bf0 tx=0x7fe9ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe8a5e03640 1 -- 172.21.15.42:0/1709800836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac0095a0 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe8a5e03640 1 -- 172.21.15.42:0/1709800836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac009700 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598b28c1dd0 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe8a5e03640 1 -- 172.21.15.42:0/1709800836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac009a00 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.479+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598b28c22b0 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.480+0000 7fe8a5e03640 1 -- 172.21.15.42:0/1709800836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe9ac01e070 con 0x5598b27c6e70 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.480+0000 7fe8a5e03640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8a00367e0 0x7fe8a0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.480+0000 7fe8a5e03640 1 -- 172.21.15.42:0/1709800836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe9ac04ba50 con 0x5598b27c6e70 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8a00367e0 0x7fe8a0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b27cb300 0x5598b28c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28c8b90 con 0x5598b27cb300 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b27cb300 0x5598b28c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8a00367e0 0x7fe8a0038ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0054000 tx=0x7fe9b004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b27cb300 0x5598b28c85f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9b9eda640 1 -- 172.21.15.42:0/1709800836 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b27cb300 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.481+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28c5c80 con 0x5598b27cb300 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9b9eda640 1 -- 172.21.15.42:0/1709800836 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b27cb300 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b28cada0 0x5598b28cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28cd860 con 0x5598b28cada0 2024-02-16T00:11:27.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b28cada0 0x5598b28cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b28cada0 0x5598b28cd190 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9b96d9640 1 -- 172.21.15.42:0/1709800836 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b28cada0 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.482+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28c9cf0 con 0x5598b27cb300 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9b9eda640 1 -- 172.21.15.42:0/1709800836 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b27cb300 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28ca0e0 con 0x5598b27cb300 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9b9eda640 1 -- 172.21.15.42:0/1709800836 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b27cb300 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9bbbda800 1 Processor -- start 2024-02-16T00:11:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9bbbda800 1 -- start start 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9bbbda800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 0x5598b28dca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.483+0000 7fe9bbbda800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b2665e80 con 0x5598b28dc610 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9b9eda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 0x5598b28dca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9b9eda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 0x5598b28dca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60056/0 (socket says 172.21.15.42:60056) 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9b9eda640 1 -- 172.21.15.42:0/3811073242 learned_addr learned my addr 172.21.15.42:0/3811073242 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9b9eda640 1 -- 172.21.15.42:0/3811073242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b28dcf70 con 0x5598b28dc610 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 0x5598b28dca30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5598b28c2940 tx=0x7fe9b4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe89effd640 1 -- 172.21.15.42:0/3811073242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b401d070 con 0x5598b28dc610 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe89effd640 1 -- 172.21.15.42:0/3811073242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b40182e0 con 0x5598b28dc610 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598b28dd9e0 con 0x5598b28dc610 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe89effd640 1 -- 172.21.15.42:0/3811073242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b40145c0 con 0x5598b28dc610 2024-02-16T00:11:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.484+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598b28ddea0 con 0x5598b28dc610 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.485+0000 7fe89effd640 1 -- 172.21.15.42:0/3811073242 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe9b4020020 con 0x5598b28dc610 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.485+0000 7fe89effd640 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe890036830 0x7fe890038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.485+0000 7fe89effd640 1 -- 172.21.15.42:0/3811073242 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe9b404dc50 con 0x5598b28dc610 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.485+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe890036830 0x7fe890038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9bbbda800 1 Processor -- start 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9bbbda800 1 -- start start 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe890036830 0x7fe890038cf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00cfd0 tx=0x7fe9ac00b3b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9bbbda800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9bbbda800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b263b5d0 con 0x5598b28e9880 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9b9eda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9b9eda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28e9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60058/0 (socket says 172.21.15.42:60058) 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9b9eda640 1 -- 172.21.15.42:0/692719378 learned_addr learned my addr 172.21.15.42:0/692719378 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9b9eda640 1 -- 172.21.15.42:0/692719378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b28ea270 con 0x5598b28e9880 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.486+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/692719378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28e9ca0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4011680 tx=0x7fe9b4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52593cccf7e9d553 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe89cff9640 1 -- 172.21.15.42:0/692719378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b402b480 con 0x5598b28e9880 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe89cff9640 1 -- 172.21.15.42:0/692719378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4040180 con 0x5598b28e9880 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe89cff9640 1 -- 172.21.15.42:0/692719378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b4040460 con 0x5598b28e9880 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 -- 172.21.15.42:0/692719378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 msgr2=0x5598b28e9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/692719378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28e9ca0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4011680 tx=0x7fe9b4011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 -- 172.21.15.42:0/692719378 shutdown_connections 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/692719378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28e9ca0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 -- 172.21.15.42:0/692719378 >> 172.21.15.42:0/692719378 conn(0x5598b28e5b50 msgr2=0x5598b28e3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 -- 172.21.15.42:0/692719378 shutdown_connections 2024-02-16T00:11:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 -- 172.21.15.42:0/692719378 wait complete. 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 Processor -- start 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.487+0000 7fe9bbbda800 1 -- start start 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9bbbda800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9bbbda800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b28f0d20 con 0x5598b28e9880 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9b9eda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9b9eda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28f07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60072/0 (socket says 172.21.15.42:60072) 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 learned_addr learned my addr 172.21.15.42:0/2680875187 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b28ddea0 con 0x5598b28e9880 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.488+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28f07e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40118b0 tx=0x7fe9b404bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.489+0000 7fe88effd640 1 -- 172.21.15.42:0/2680875187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b4014a50 con 0x5598b28e9880 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.489+0000 7fe88effd640 1 -- 172.21.15.42:0/2680875187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4014bb0 con 0x5598b28e9880 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.489+0000 7fe88effd640 1 -- 172.21.15.42:0/2680875187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9b40228b0 con 0x5598b28e9880 2024-02-16T00:11:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.489+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598b28f0f20 con 0x5598b28e9880 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.489+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598b28f1380 con 0x5598b28e9880 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.489+0000 7fe88effd640 1 -- 172.21.15.42:0/2680875187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe9b4022a10 con 0x5598b28e9880 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe88effd640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8840367e0 0x7fe884038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe88effd640 1 -- 172.21.15.42:0/2680875187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe9b402ecf0 con 0x5598b28e9880 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8840367e0 0x7fe884038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b28fc430 0x5598b28fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28ff040 con 0x5598b28fc430 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b28fc430 0x5598b28fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8840367e0 0x7fe884038ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac013ff0 tx=0x7fe9ac032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.490+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b28fc430 0x5598b28fe8f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 realm 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28ff3d0 con 0x5598b28fc430 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28ffc50 con 0x5598b28fc430 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b28fffb0 con 0x5598b28fc430 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b2900cc0 0x5598b29030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2900cc0 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.491+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b2900cc0 0x5598b29030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b2900cc0 0x5598b29030b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b2900cc0 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9bbbda800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9bbbda800 20 searching for the correct realm 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5598b2905580 0x5598b2907a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2908110 con 0x5598b2905580 2024-02-16T00:11:27.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5598b2905580 0x5598b2907a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.492+0000 7fe9b96d9640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5598b2905580 0x5598b2907a40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.493+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.493+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2908110 con 0x5598b2900cc0 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.493+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b2900cc0 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.493+0000 7fe9b9eda640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe9b4014070 0x7fe9b40283e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.493+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.493+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe9b4014070 0x7fe9b40283e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe9b4014070 0x7fe9b40283e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.494+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2900cc0 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b2900cc0 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.495+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2900cc0 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b2900cc0 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.496+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.497+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.498+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2900cc0 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b2900cc0 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.499+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2900cc0 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe9b400a4a0 con 0x5598b2900cc0 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2905580 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x7fe9b4014070 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.500+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b28fc430 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29035f0 con 0x5598b2900cc0 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2903ef0 con 0x5598b28fc430 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.501+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29042a0 con 0x5598b28fc430 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2904680 con 0x5598b28fc430 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 zone default found 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 4 Realm: () 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:27.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 zonegroup default 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2908550 con 0x7fe9b4014070 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290a3d0 con 0x5598b2905580 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.502+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290a730 con 0x5598b2905580 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.503+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.503+0000 7fe9bbbda800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.503+0000 7fe9bbbda800 20 started sync module instance, tier type = 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.503+0000 7fe9bbbda800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.503+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2909860 con 0x5598b2900cc0 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.504+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.504+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114319211840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2909860 con 0x5598b2900cc0 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.504+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290b120 con 0x5598b28fc430 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.505+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114319211840] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.505+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.505+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114319215616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2909860 con 0x5598b28fc430 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.505+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290bbc0 con 0x5598b2905580 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.506+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114319215616] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.506+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.506+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114319209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29097e0 con 0x5598b2905580 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.506+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290ca20 con 0x5598b2900cc0 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.507+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114319209408] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.507+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.507+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114319222144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290ce40 con 0x5598b2900cc0 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.507+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290d7b0 con 0x5598b28fc430 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.508+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114319222144] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.508+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.508+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114319226096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290ce40 con 0x5598b28fc430 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.508+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290e1d0 con 0x7fe9b4014070 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.509+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.509+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114319226096] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.509+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114319228112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290e630 con 0x7fe9b4014070 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.509+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290c9c0 con 0x7fe9b4014070 2024-02-16T00:11:27.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.510+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114319228112] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.510+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.510+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114319229328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290e5b0 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.510+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f580 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114319229328] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114319231968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f540 con 0x7fe9b4014070 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=0 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=1 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=2 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=3 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=4 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=5 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.511+0000 7fe9bbbda800 20 add_watcher() i=6 2024-02-16T00:11:27.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.512+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114319231968] v27'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.512+0000 7fe9bbbda800 20 add_watcher() i=7 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.512+0000 7fe9bbbda800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.512+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2912ad0 con 0x5598b28fc430 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.512+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.512+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114319233024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290fe00 con 0x5598b28fc430 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.513+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114319233024] v27'136 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.513+0000 7fe86f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 5 note: GC not initialized 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe86e7e4640 20 reqs_thread_entry: start 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 20 Filter name: none 2024-02-16T00:11:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe7dffff640 20 reqs_thread_entry: start 2024-02-16T00:11:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.514+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2944570 con 0x5598b28fc430 2024-02-16T00:11:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.515+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.515+0000 7fe9bbbda800 20 rados_obj.operate() r=0 bl.length=193 2024-02-16T00:11:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.515+0000 7fe86f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.515+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114319233024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b2911a60 con 0x5598b28fc430 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.516+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94114319233024] v27'137 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.516+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114319211840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f000 con 0x5598b2900cc0 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.517+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94114319211840] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.517+0000 7fe9bbbda800 20 remove_watcher() i=0 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.517+0000 7fe9bbbda800 2 removed watcher, disabling cache 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.517+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114319215616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f000 con 0x5598b28fc430 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.519+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94114319215616] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.519+0000 7fe9bbbda800 20 remove_watcher() i=1 2024-02-16T00:11:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.519+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114319209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f000 con 0x5598b2905580 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.519+0000 7fe9b96d9640 1 -- 172.21.15.42:0/2680875187 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94114319209408] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9ac01d030 con 0x5598b2905580 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.520+0000 7fe9bbbda800 20 remove_watcher() i=2 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.520+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114319222144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29093c0 con 0x5598b2900cc0 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.521+0000 7fe9b9eda640 1 -- 172.21.15.42:0/2680875187 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94114319222144] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b405f040 con 0x5598b2900cc0 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.521+0000 7fe9bbbda800 20 remove_watcher() i=3 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.521+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114319226096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f000 con 0x5598b28fc430 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.521+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94114319226096] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x5598b28fc430 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.521+0000 7fe9bbbda800 20 remove_watcher() i=4 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.522+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114319228112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290c580 con 0x7fe9b4014070 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.522+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94114319228112] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.522+0000 7fe9bbbda800 20 remove_watcher() i=5 2024-02-16T00:11:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.522+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114319229328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b29093c0 con 0x7fe9b4014070 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.523+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94114319229328] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.523+0000 7fe9bbbda800 20 remove_watcher() i=6 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.523+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114319231968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5598b290f000 con 0x7fe9b4014070 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94114319231968] v27'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9b0059040 con 0x7fe9b4014070 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 20 remove_watcher() i=7 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe9b4014070 msgr2=0x7fe9b40283e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe9b4014070 0x7fe9b40283e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b28fc430 msgr2=0x5598b28fe8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b28fc430 0x5598b28fe8f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b2900cc0 msgr2=0x5598b29030b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b2900cc0 0x5598b29030b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5598b2905580 msgr2=0x5598b2907a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5598b2905580 0x5598b2907a40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8840367e0 msgr2=0x7fe884038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8840367e0 0x7fe884038ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac013ff0 tx=0x7fe9ac032000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 msgr2=0x5598b28f07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9b8ed8640 1 -- 172.21.15.42:0/2680875187 reap_dead start 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28f07e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40118b0 tx=0x7fe9b404bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 shutdown_connections 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/2680875187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28e9880 0x5598b28f07e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 >> 172.21.15.42:0/2680875187 conn(0x5598b28e5b50 msgr2=0x5598b28e31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 shutdown_connections 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/2680875187 wait complete. 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe890036830 msgr2=0x7fe890038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe890036830 0x7fe890038cf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00cfd0 tx=0x7fe9ac00b3b0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 msgr2=0x5598b28dca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.525+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 0x5598b28dca30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5598b28c2940 tx=0x7fe9b4018830 comp rx=0 tx=0).stop 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 shutdown_connections 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe890036830 0x7fe890038cf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/3811073242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b28dc610 0x5598b28dca30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 >> 172.21.15.42:0/3811073242 conn(0x5598b28d06b0 msgr2=0x5598b28d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 shutdown_connections 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/3811073242 wait complete. 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b27cb300 msgr2=0x5598b28c85f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b27cb300 0x5598b28c85f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b28cada0 msgr2=0x5598b28cd190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b28cada0 0x5598b28cd190 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8a00367e0 msgr2=0x7fe8a0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8a00367e0 0x7fe8a0038ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0054000 tx=0x7fe9b004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 msgr2=0x5598b28c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28c1890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001bf0 tx=0x7fe9ac000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 shutdown_connections 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5598b28cada0 0x5598b28cd190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5598b27cb300 0x5598b28c85f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe8a00367e0 0x7fe8a0038ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 --2- 172.21.15.42:0/1709800836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598b27c6e70 0x5598b28c1890 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 >> 172.21.15.42:0/1709800836 conn(0x5598b27c24d0 msgr2=0x5598b28b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 shutdown_connections 2024-02-16T00:11:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.526+0000 7fe9bbbda800 1 -- 172.21.15.42:0/1709800836 wait complete. 2024-02-16T00:11:27.549 INFO:teuthology.orchestra.run.smithi042.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"5enmoyHNd2khbyk0LGZElFee","ver":2},"mtime":"2024-02-16T00:11:27.382400Z","data":{"bucket":{"name":"myfoo","marker":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","bucket_id":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-02-16T00:11:24.745033Z","linked":true,"has_bucket_info":false}} 2024-02-16T00:11:27.549 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '5enmoyHNd2khbyk0LGZElFee', 'ver': 2}, 'mtime': '2024-02-16T00:11:27.382400Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'bucket_id': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-02-16T00:11:24.745033Z', 'linked': True, 'has_bucket_info': False}} 2024-02-16T00:11:27.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-16T00:11:27.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-16T00:11:27.550 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-02-16T00:11:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.631+0000 7f95cd311800 1 Processor -- start 2024-02-16T00:11:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.631+0000 7f95cd311800 1 -- start start 2024-02-16T00:11:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95cd311800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d00555c610 0x55d00555ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95cd311800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d0054a2ba0 con 0x55d005558b00 2024-02-16T00:11:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95cd311800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d00545a450 con 0x55d00555c610 2024-02-16T00:11:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95ca60f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d00555c610 0x55d00555ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95ca60f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55d00555c610 0x55d00555ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60076/0 (socket says 172.21.15.42:60076) 2024-02-16T00:11:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95ca60f640 1 -- 172.21.15.42:0/1238917709 learned_addr learned my addr 172.21.15.42:0/1238917709 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95cae10640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55d005558b00 0x55d00555aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60516/0 (socket says 172.21.15.42:60516) 2024-02-16T00:11:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95ca60f640 1 -- 172.21.15.42:0/1238917709 >> v1:172.21.15.2:6789/0 conn(0x55d005558b00 legacy=0x55d00555aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.632+0000 7f95ca60f640 1 -- 172.21.15.42:0/1238917709 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00555ff50 con 0x55d00555c610 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.634+0000 7f95ca60f640 1 --2- 172.21.15.42:0/1238917709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d00555c610 0x55d00555ea00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f95c000a520 tx=0x7f95c001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39c828c620e157b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.634+0000 7f95c9e0e640 1 -- 172.21.15.42:0/1238917709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c0052570 con 0x55d00555c610 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.634+0000 7f95c9e0e640 1 -- 172.21.15.42:0/1238917709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c00526d0 con 0x55d00555c610 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.634+0000 7f95c9e0e640 1 -- 172.21.15.42:0/1238917709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c0052990 con 0x55d00555c610 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 -- 172.21.15.42:0/1238917709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d00555c610 msgr2=0x55d00555ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 --2- 172.21.15.42:0/1238917709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d00555c610 0x55d00555ea00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f95c000a520 tx=0x7f95c001cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 -- 172.21.15.42:0/1238917709 shutdown_connections 2024-02-16T00:11:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 --2- 172.21.15.42:0/1238917709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d00555c610 0x55d00555ea00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 -- 172.21.15.42:0/1238917709 >> 172.21.15.42:0/1238917709 conn(0x55d0055524f0 msgr2=0x55d005554910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 -- 172.21.15.42:0/1238917709 shutdown_connections 2024-02-16T00:11:27.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.635+0000 7f95cd311800 1 -- 172.21.15.42:0/1238917709 wait complete. 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cd311800 1 Processor -- start 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cd311800 1 -- start start 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cd311800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d005647fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cd311800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d005457980 con 0x55d005558b00 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cae10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d005647fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cae10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d005647fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60086/0 (socket says 172.21.15.42:60086) 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.646+0000 7f95cae10640 1 -- 172.21.15.42:0/1893284973 learned_addr learned my addr 172.21.15.42:0/1893284973 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.647+0000 7f95cae10640 1 -- 172.21.15.42:0/1893284973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0005de0 con 0x55d005558b00 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.647+0000 7f95cae10640 1 --2- 172.21.15.42:0/1893284973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d005647fb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001c80 tx=0x7f95bc00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47960ec47af02254 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.647+0000 7f94b8e09640 1 -- 172.21.15.42:0/1893284973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc014070 con 0x55d005558b00 2024-02-16T00:11:27.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.647+0000 7f94b8e09640 1 -- 172.21.15.42:0/1893284973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00f450 con 0x55d005558b00 2024-02-16T00:11:27.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.647+0000 7f94b8e09640 1 -- 172.21.15.42:0/1893284973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc00f790 con 0x55d005558b00 2024-02-16T00:11:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- 172.21.15.42:0/1893284973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 msgr2=0x55d005647fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 --2- 172.21.15.42:0/1893284973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d005647fb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001c80 tx=0x7f95bc00b600 comp rx=0 tx=0).stop 2024-02-16T00:11:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- 172.21.15.42:0/1893284973 shutdown_connections 2024-02-16T00:11:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 --2- 172.21.15.42:0/1893284973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d005647fb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- 172.21.15.42:0/1893284973 >> 172.21.15.42:0/1893284973 conn(0x55d0055524f0 msgr2=0x55d0056438d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- 172.21.15.42:0/1893284973 shutdown_connections 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- 172.21.15.42:0/1893284973 wait complete. 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 Processor -- start 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- start start 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d00564f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cd311800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d005453160 con 0x55d005558b00 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cae10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d00564f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cae10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d00564f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60088/0 (socket says 172.21.15.42:60088) 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.648+0000 7f95cae10640 1 -- 172.21.15.42:0/3263035134 learned_addr learned my addr 172.21.15.42:0/3263035134 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f95cae10640 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0054a2ba0 con 0x55d005558b00 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f95cae10640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d00564f690 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004000 tx=0x7f95bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f94b7606640 1 -- 172.21.15.42:0/3263035134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc014050 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f94b7606640 1 -- 172.21.15.42:0/3263035134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc01b850 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d00564fbd0 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f94b7606640 1 -- 172.21.15.42:0/3263035134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc01bb10 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.649+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0056500b0 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f94b7606640 1 -- 172.21.15.42:0/3263035134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f95bc022020 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f94b7606640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94b0036790 0x7f94b0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f94b7606640 1 -- 172.21.15.42:0/3263035134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f95bc008030 con 0x55d005558b00 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f95ca60f640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94b0036790 0x7f94b0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d00555c610 0x55d0056563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056569a0 con 0x55d00555c610 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.650+0000 7f95cb611640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d00555c610 0x55d0056563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95ca60f640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94b0036790 0x7f94b0038c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f95c0054000 tx=0x7f95c004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cb611640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d00555c610 0x55d0056563d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cb611640 1 -- 172.21.15.42:0/3263035134 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d00555c610 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005653a30 con 0x55d00555c610 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cb611640 1 -- 172.21.15.42:0/3263035134 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d00555c610 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005658be0 0x55d00565afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00565b6a0 con 0x55d005658be0 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.651+0000 7f95cae10640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005658be0 0x55d00565afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.652+0000 7f95cae10640 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005658be0 0x55d00565afd0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.652+0000 7f95cae10640 1 -- 172.21.15.42:0/3263035134 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f95bc016070 con 0x55d005658be0 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.652+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005657b60 con 0x55d00555c610 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.652+0000 7f95cb611640 1 -- 172.21.15.42:0/3263035134 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d00555c610 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.652+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005657f70 con 0x55d00555c610 2024-02-16T00:11:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cb611640 1 -- 172.21.15.42:0/3263035134 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d00555c610 2024-02-16T00:11:27.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cd311800 1 Processor -- start 2024-02-16T00:11:27.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cd311800 1 -- start start 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cd311800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 0x55d005556ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cd311800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0053f5e80 con 0x55d005558660 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cb611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 0x55d005556ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cb611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 0x55d005556ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60104/0 (socket says 172.21.15.42:60104) 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.653+0000 7f95cb611640 1 -- 172.21.15.42:0/1694275394 learned_addr learned my addr 172.21.15.42:0/1694275394 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f95cb611640 1 -- 172.21.15.42:0/1694275394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d005557010 con 0x55d005558660 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f95cb611640 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 0x55d005556ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55d005656d00 tx=0x7f95c4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f94b4e01640 1 -- 172.21.15.42:0/1694275394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c401d070 con 0x55d005558660 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f94b4e01640 1 -- 172.21.15.42:0/1694275394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40182e0 con 0x55d005558660 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f94b4e01640 1 -- 172.21.15.42:0/1694275394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c40145e0 con 0x55d005558660 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d005557260 con 0x55d005558660 2024-02-16T00:11:27.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.654+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d005557720 con 0x55d005558660 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f94b4e01640 1 -- 172.21.15.42:0/1694275394 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f95c4020020 con 0x55d005558660 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f94b4e01640 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94a40367e0 0x7f94a4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f94b4e01640 1 -- 172.21.15.42:0/1694275394 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f95c404db90 con 0x55d005558660 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f95cae10640 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94a40367e0 0x7f94a4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f95cd311800 1 Processor -- start 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f95cd311800 1 -- start start 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f95cae10640 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94a40367e0 0x7f94a4038ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55d005656d70 tx=0x7f95bc04a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f95cd311800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d005679d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.655+0000 7f95cd311800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0053cb5d0 con 0x55d005679940 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cb611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d005679d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cb611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d005679d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60106/0 (socket says 172.21.15.42:60106) 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cb611640 1 -- 172.21.15.42:0/3562306700 learned_addr learned my addr 172.21.15.42:0/3562306700 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cb611640 1 -- 172.21.15.42:0/3562306700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00567a310 con 0x55d005679940 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cb611640 1 --2- 172.21.15.42:0/3562306700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d005679d40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f95c4013010 tx=0x7f95c4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9d479b6d1c04df server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f94ae7fc640 1 -- 172.21.15.42:0/3562306700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c4040500 con 0x55d005679940 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f94ae7fc640 1 -- 172.21.15.42:0/3562306700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c4014ac0 con 0x55d005679940 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f94ae7fc640 1 -- 172.21.15.42:0/3562306700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c402b350 con 0x55d005679940 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cd311800 1 -- 172.21.15.42:0/3562306700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 msgr2=0x55d005679d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.656+0000 7f95cd311800 1 --2- 172.21.15.42:0/3562306700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d005679d40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f95c4013010 tx=0x7f95c4011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 -- 172.21.15.42:0/3562306700 shutdown_connections 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 --2- 172.21.15.42:0/3562306700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d005679d40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 -- 172.21.15.42:0/3562306700 >> 172.21.15.42:0/3562306700 conn(0x55d005675c10 msgr2=0x55d005673c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 -- 172.21.15.42:0/3562306700 shutdown_connections 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 -- 172.21.15.42:0/3562306700 wait complete. 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 Processor -- start 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 -- start start 2024-02-16T00:11:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d00566d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cd311800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00566dd60 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cb611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d00566d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cb611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d00566d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60108/0 (socket says 172.21.15.42:60108) 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 learned_addr learned my addr 172.21.15.42:0/2743181960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.657+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d005557720 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f95cb611640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d00566d820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f95c404aec0 tx=0x7f95c404bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f94acff9640 1 -- 172.21.15.42:0/2743181960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c4032070 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f94acff9640 1 -- 172.21.15.42:0/2743181960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c4013c60 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d00566df60 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f94acff9640 1 -- 172.21.15.42:0/2743181960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95c40133b0 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d00566a3a0 con 0x55d005679940 2024-02-16T00:11:27.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.658+0000 7f94acff9640 1 -- 172.21.15.42:0/2743181960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f95c4013510 con 0x55d005679940 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f94acff9640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94940367e0 0x7f9494038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f94acff9640 1 -- 172.21.15.42:0/2743181960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f95c4038c60 con 0x55d005679940 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f95cae10640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94940367e0 0x7f9494038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f95cae10640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94940367e0 0x7f9494038ca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f95bc04a5b0 tx=0x7f95bc032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d005690870 0x55d005692d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005693480 con 0x55d005690870 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.659+0000 7f95ca60f640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d005690870 0x55d005692d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95ca60f640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d005690870 0x55d005692d30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 realm 2024-02-16T00:11:27.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005693810 con 0x55d005690870 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005694010 con 0x55d005690870 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.660+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005694370 con 0x55d005690870 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005695080 0x55d005697470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005697a80 con 0x55d005695080 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cb611640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005695080 0x55d005697470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cb611640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005695080 0x55d005697470 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 20 searching for the correct realm 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d0056999d0 0x55d00569be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569c560 con 0x55d0056999d0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.661+0000 7f95cae10640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d0056999d0 0x55d00569be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.662+0000 7f95cae10640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d0056999d0 0x55d00569be90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.662+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.662+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569c560 con 0x55d005695080 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.662+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.663+0000 7f95cb611640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f95c4057040 0x7f95c4022740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.663+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.663+0000 7f95ca60f640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f95c4057040 0x7f95c4022740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.663+0000 7f95ca60f640 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f95c4057040 0x7f95c4022740 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.663+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.664+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005695080 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.665+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005695080 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.666+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.667+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.668+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.668+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.668+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.668+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005695080 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.668+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.668+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.669+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005695080 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d0056999d0 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x7f95c4057040 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005690870 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.670+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f95c4055040 con 0x55d005695080 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005697dd0 con 0x55d005690870 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005698180 con 0x55d005690870 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d005698560 con 0x55d005690870 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 zone default found 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 4 Realm: () 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 zonegroup default 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.671+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569c9a0 con 0x7f95c4057040 2024-02-16T00:11:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569e820 con 0x55d0056999d0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.672+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569eb80 con 0x55d0056999d0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.673+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.673+0000 7f95cd311800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.673+0000 7f95cd311800 20 started sync module instance, tier type = 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.673+0000 7f95cd311800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.673+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569dcb0 con 0x55d005695080 2024-02-16T00:11:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.674+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.674+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351932383600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569dcb0 con 0x55d005695080 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.674+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569f4f0 con 0x55d005690870 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.675+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.675+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351932387408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d00569f510 con 0x55d005690870 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.675+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a04e0 con 0x55d0056999d0 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.675+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351932383600] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.676+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.676+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351932381200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a0d30 con 0x55d0056999d0 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.676+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a16a0 con 0x55d005695080 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.676+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351932387408] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.677+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351932381200] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.677+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.677+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351932389584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a16a0 con 0x55d005695080 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.677+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a2060 con 0x55d005690870 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.678+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.678+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351932398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a2480 con 0x55d005690870 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.678+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a2f10 con 0x7f95c4057040 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.678+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351932389584] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.679+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351932398528] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.679+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.679+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351932402224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a1fe0 con 0x7f95c4057040 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.679+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a3760 con 0x7f95c4057040 2024-02-16T00:11:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.680+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351932402224] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.680+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.680+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351932396032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a1fe0 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.680+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a3d70 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351932396032] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351932405840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a3d30 con 0x7f95c4057040 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=0 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=1 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=2 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=3 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=4 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=5 2024-02-16T00:11:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.681+0000 7f95cd311800 20 add_watcher() i=6 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.682+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351932405840] v27'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.682+0000 7f95cd311800 20 add_watcher() i=7 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.682+0000 7f95cd311800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.682+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a72e0 con 0x55d005690870 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.682+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.682+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351932404288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056a4650 con 0x55d005690870 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351932404288] v27'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f94817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f95cd311800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f95cd311800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f95cd311800 5 note: GC not initialized 2024-02-16T00:11:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f93fbfff640 20 reqs_thread_entry: start 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.683+0000 7f95cd311800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 20 Filter name: none 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f93f9ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056d9280 con 0x55d005690870 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dae20 con 0x55d005690870 2024-02-16T00:11:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=193 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.684+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 8.f 8:f6e6227e:root::.bucket.meta.testx%3amyfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dc7e0 con 0x55d0056999d0 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 20 rados_obj.operate() r=0 bl.length=371 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.685+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e0e70 con 0x55d005690870 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.686+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v27'6 uv6 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.686+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e4730 con 0x55d005690870 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(66 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [create,call,writefull 0~352,setxattr (123)] v27'7 uv7 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cd311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x7 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cd311800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cd311800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cd311800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94351932663008 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e4170 con 0x55d005695080 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== watch-notify(notify (1) cookie 94351932383600 notify 115964117015 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x55d00566df60 con 0x55d005695080 2024-02-16T00:11:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f94ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117015 cookie 94351932383600 notifier 4551 bl.length()=701 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f94ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x7 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f94ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f94ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f94ae7fc640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9490003e90 con 0x55d005695080 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.687+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(67 notify.0 [notify cookie 94351932663008 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c400a4a0 con 0x55d005695080 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== watch-notify(notify_complete (2) cookie 94351932663008 notify 115964117015 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f95c4068020 con 0x55d005695080 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cd311800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_sources= new_sources= 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cd311800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential sources added=[] removed=[] 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cd311800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_dests= new_dests= 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cd311800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential dests added=[] removed=[] 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.688+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e42b0 con 0x55d005695080 2024-02-16T00:11:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.689+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(69 foo.buckets [call] v27'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f95c406a040 con 0x55d005695080 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.689+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e36f0 con 0x55d005695080 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.690+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f95c406a040 con 0x55d005695080 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.690+0000 7f95cd311800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.690+0000 7f95cd311800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.690+0000 7f95cd311800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.690+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94351932669456 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e4d80 con 0x7f95c4057040 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== watch-notify(notify (1) cookie 94351932396032 notify 115964117002 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f95c0085040 con 0x7f95c4057040 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f94adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94351932396032 notifier 4551 bl.length()=314 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f94adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(71 notify.6 [notify cookie 94351932669456 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f94adffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f94adffb640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f94000033f0 con 0x7f95c4057040 2024-02-16T00:11:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== watch-notify(notify_complete (2) cookie 94351932669456 notify 115964117002 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f95c007b040 con 0x7f95c4057040 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95cd311800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95cd311800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94351932669456 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e14d0 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== watch-notify(notify (1) cookie 94351932398528 notify 115964117004 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7f95c007b040 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f94adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94351932398528 notifier 4551 bl.length()=155 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f94adffb640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f94000033f0 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.691+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(73 notify.4 [notify cookie 94351932669456 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.692+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.692+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== watch-notify(notify_complete (2) cookie 94351932669456 notify 115964117004 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d00555ff50 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.692+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e44c0 con 0x55d005690870 2024-02-16T00:11:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(75 testx/myfoo [call,delete] v27'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95cd311800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 from cache 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95cd311800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.9 7:93e5b521:::notify.7:head [notify cookie 94351932669456 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056e44c0 con 0x7f95c4057040 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== watch-notify(notify (1) cookie 94351932405840 notify 115964117003 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x55d00555ff50 con 0x7f95c4057040 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f94ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94351932405840 notifier 4551 bl.length()=212 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f94ae7fc640 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9490003e90 con 0x7f95c4057040 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(76 notify.7 [notify cookie 94351932669456 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(77 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== watch-notify(notify_complete (2) cookie 94351932669456 notify 115964117003 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f95c004e070 con 0x7f95c4057040 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.693+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:78 8.f 8:f6e6227e:root::.bucket.meta.testx%3amyfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce60 con 0x55d0056999d0 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.694+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call,delete] v27'2 uv2 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.695+0000 7f94817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.695+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351932404288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056c32a0 con 0x55d005690870 2024-02-16T00:11:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.696+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94351932404288] v27'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.696+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351932383600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x55d005695080 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.697+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94351932383600] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c406a040 con 0x55d005695080 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.697+0000 7f95cd311800 20 remove_watcher() i=0 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.697+0000 7f95cd311800 2 removed watcher, disabling cache 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.697+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351932387408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x55d005690870 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.698+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94351932387408] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.698+0000 7f95cd311800 20 remove_watcher() i=1 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.698+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351932381200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x55d0056999d0 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.699+0000 7f95cae10640 1 -- 172.21.15.42:0/2743181960 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94351932381200] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95bc016070 con 0x55d0056999d0 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.699+0000 7f95cd311800 20 remove_watcher() i=2 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.699+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351932389584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x55d005695080 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.700+0000 7f95cb611640 1 -- 172.21.15.42:0/2743181960 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94351932389584] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c406a040 con 0x55d005695080 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.700+0000 7f95cd311800 20 remove_watcher() i=3 2024-02-16T00:11:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.700+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351932398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x55d005690870 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.701+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94351932398528] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x55d005690870 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.701+0000 7f95cd311800 20 remove_watcher() i=4 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.701+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351932402224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x7f95c4057040 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.702+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94351932402224] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.702+0000 7f95cd311800 20 remove_watcher() i=5 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.702+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351932396032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x7f95c4057040 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.703+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94351932396032] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.703+0000 7f95cd311800 20 remove_watcher() i=6 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.703+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351932405840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55d0056dce40 con 0x7f95c4057040 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94351932405840] v27'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f95c0052b00 con 0x7f95c4057040 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 20 remove_watcher() i=7 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f95c4057040 msgr2=0x7f95c4022740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f95c4057040 0x7f95c4022740 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d005690870 msgr2=0x55d005692d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d005690870 0x55d005692d30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005695080 msgr2=0x55d005697470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005695080 0x55d005697470 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d0056999d0 msgr2=0x55d00569be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55d0056999d0 0x55d00569be90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94940367e0 msgr2=0x7f9494038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94940367e0 0x7f9494038ca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f95bc04a5b0 tx=0x7f95bc032000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 msgr2=0x55d00566d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d00566d820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f95c404aec0 tx=0x7f95c404bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95ca60f640 1 -- 172.21.15.42:0/2743181960 reap_dead start 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 shutdown_connections 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 --2- 172.21.15.42:0/2743181960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005679940 0x55d00566d820 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 >> 172.21.15.42:0/2743181960 conn(0x55d005675c10 msgr2=0x55d005673270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 shutdown_connections 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.704+0000 7f95cd311800 1 -- 172.21.15.42:0/2743181960 wait complete. 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94a40367e0 msgr2=0x7f94a4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94a40367e0 0x7f94a4038ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55d005656d70 tx=0x7f95bc04a2d0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 msgr2=0x55d005556ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 0x55d005556ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55d005656d00 tx=0x7f95c4018830 comp rx=0 tx=0).stop 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 shutdown_connections 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94a40367e0 0x7f94a4038ca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/1694275394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558660 0x55d005556ad0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 >> 172.21.15.42:0/1694275394 conn(0x55d00565e560 msgr2=0x55d00565e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 shutdown_connections 2024-02-16T00:11:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/1694275394 wait complete. 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d00555c610 msgr2=0x55d0056563d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d00555c610 0x55d0056563d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005658be0 msgr2=0x55d00565afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005658be0 0x55d00565afd0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94b0036790 msgr2=0x7f94b0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94b0036790 0x7f94b0038c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f95c0054000 tx=0x7f95c004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 msgr2=0x55d00564f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d00564f690 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004000 tx=0x7f95bc000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 shutdown_connections 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55d005658be0 0x55d00565afd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55d00555c610 0x55d0056563d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f94b0036790 0x7f94b0038c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 --2- 172.21.15.42:0/3263035134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d005558b00 0x55d00564f690 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 >> 172.21.15.42:0/3263035134 conn(0x55d0055524f0 msgr2=0x55d005642130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 shutdown_connections 2024-02-16T00:11:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.705+0000 7f95cd311800 1 -- 172.21.15.42:0/3263035134 wait complete. 2024-02-16T00:11:27.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T00:11:27.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T00:11:27.748 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-02-16T00:11:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:27.792 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:27.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe690f22800 1 Processor -- start 2024-02-16T00:11:27.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe690f22800 1 -- start start 2024-02-16T00:11:27.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe690f22800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559f4b35aa20 0x559f4b35ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe690f22800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559f4b2a4ba0 con 0x559f4b35d350 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe690f22800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x559f4b25c450 con 0x559f4b35aa20 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe68ccb7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559f4b35aa20 0x559f4b35ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe68c4b6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x559f4b35d350 0x559f4b35f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60532/0 (socket says 172.21.15.42:60532) 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.790+0000 7fe68c4b6640 1 -- 172.21.15.42:0/427531111 learned_addr learned my addr 172.21.15.42:0/427531111 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.791+0000 7fe68ccb7640 1 -- 172.21.15.42:0/427531111 >> v1:172.21.15.2:6789/0 conn(0x559f4b35d350 legacy=0x559f4b35f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.791+0000 7fe68ccb7640 1 -- 172.21.15.42:0/427531111 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4b361e70 con 0x559f4b35aa20 2024-02-16T00:11:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.791+0000 7fe68bcb5640 1 -- 172.21.15.42:0/427531111 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806530861 0 0) 0x559f4b2a4ba0 con 0x559f4b35d350 2024-02-16T00:11:27.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.792+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/427531111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35ce10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe68400a470 tx=0x7fe68401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbdea031da8f2d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe68bcb5640 1 -- 172.21.15.42:0/427531111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684052570 con 0x559f4b35aa20 2024-02-16T00:11:27.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe68bcb5640 1 -- 172.21.15.42:0/427531111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840526d0 con 0x559f4b35aa20 2024-02-16T00:11:27.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe68bcb5640 1 -- 172.21.15.42:0/427531111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684052990 con 0x559f4b35aa20 2024-02-16T00:11:27.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 -- 172.21.15.42:0/427531111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 msgr2=0x559f4b35ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 --2- 172.21.15.42:0/427531111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35ce10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe68400a470 tx=0x7fe68401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:27.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 -- 172.21.15.42:0/427531111 shutdown_connections 2024-02-16T00:11:27.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 --2- 172.21.15.42:0/427531111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35ce10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 -- 172.21.15.42:0/427531111 >> 172.21.15.42:0/427531111 conn(0x559f4b3544f0 msgr2=0x559f4b356910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 -- 172.21.15.42:0/427531111 shutdown_connections 2024-02-16T00:11:27.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.793+0000 7fe690f22800 1 -- 172.21.15.42:0/427531111 wait complete. 2024-02-16T00:11:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.804+0000 7fe690f22800 1 Processor -- start 2024-02-16T00:11:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.804+0000 7fe690f22800 1 -- start start 2024-02-16T00:11:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe690f22800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b449ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe690f22800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4b259980 con 0x559f4b35aa20 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe68ccb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b449ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe68ccb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b449ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60130/0 (socket says 172.21.15.42:60130) 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe68ccb7640 1 -- 172.21.15.42:0/3454741879 learned_addr learned my addr 172.21.15.42:0/3454741879 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe68ccb7640 1 -- 172.21.15.42:0/3454741879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684005d20 con 0x559f4b35aa20 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/3454741879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b449ef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe684055040 tx=0x7fe68404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb34c6221ea87fb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.805+0000 7fe57ae0d640 1 -- 172.21.15.42:0/3454741879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe68400a170 con 0x559f4b35aa20 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe57ae0d640 1 -- 172.21.15.42:0/3454741879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68400a2d0 con 0x559f4b35aa20 2024-02-16T00:11:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe57ae0d640 1 -- 172.21.15.42:0/3454741879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684052990 con 0x559f4b35aa20 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 -- 172.21.15.42:0/3454741879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 msgr2=0x559f4b449ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 --2- 172.21.15.42:0/3454741879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b449ef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe684055040 tx=0x7fe68404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 -- 172.21.15.42:0/3454741879 shutdown_connections 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 --2- 172.21.15.42:0/3454741879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b449ef0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 -- 172.21.15.42:0/3454741879 >> 172.21.15.42:0/3454741879 conn(0x559f4b3544f0 msgr2=0x559f4b4456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 -- 172.21.15.42:0/3454741879 shutdown_connections 2024-02-16T00:11:27.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.806+0000 7fe690f22800 1 -- 172.21.15.42:0/3454741879 wait complete. 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe690f22800 1 Processor -- start 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe690f22800 1 -- start start 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe690f22800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe690f22800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4b255160 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe68ccb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe68ccb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60138/0 (socket says 172.21.15.42:60138) 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe68ccb7640 1 -- 172.21.15.42:0/1154545025 learned_addr learned my addr 172.21.15.42:0/1154545025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe68ccb7640 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4b361e70 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35a310 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe684000c00 tx=0x7fe684002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe57960a640 1 -- 172.21.15.42:0/1154545025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684068780 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.807+0000 7fe57960a640 1 -- 172.21.15.42:0/1154545025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684068900 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.808+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f4b35a850 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.808+0000 7fe57960a640 1 -- 172.21.15.42:0/1154545025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe684068be0 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.808+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f4b358e00 con 0x559f4b35aa20 2024-02-16T00:11:27.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.808+0000 7fe57960a640 1 -- 172.21.15.42:0/1154545025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe684068d40 con 0x559f4b35aa20 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.808+0000 7fe57960a640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe574036790 0x7fe574038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.808+0000 7fe57960a640 1 -- 172.21.15.42:0/1154545025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe68408e360 con 0x559f4b35aa20 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe68c4b6640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe574036790 0x7fe574038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b35d350 0x559f4b45a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b45ab60 con 0x559f4b35d350 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b35d350 0x559f4b45a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe68c4b6640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe574036790 0x7fe574038c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe674000c00 tx=0x7fe6740013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b35d350 0x559f4b45a620 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe68d4b8640 1 -- 172.21.15.42:0/1154545025 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b35d350 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.809+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b45aec0 con 0x559f4b35d350 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe68d4b8640 1 -- 172.21.15.42:0/1154545025 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b35d350 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b45c8b0 0x559f4b45ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b45f4b0 con 0x559f4b45c8b0 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b45c8b0 0x559f4b45ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b45c8b0 0x559f4b45ed20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe68ccb7640 1 -- 172.21.15.42:0/1154545025 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe684063070 con 0x559f4b45c8b0 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.810+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b45b6c0 con 0x559f4b35d350 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.811+0000 7fe68d4b8640 1 -- 172.21.15.42:0/1154545025 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b35d350 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.811+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b45bab0 con 0x559f4b35d350 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.811+0000 7fe68d4b8640 1 -- 172.21.15.42:0/1154545025 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b35d350 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.811+0000 7fe690f22800 1 Processor -- start 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.811+0000 7fe690f22800 1 -- start start 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe690f22800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 0x559f4b46e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe690f22800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4b1f7e80 con 0x559f4b46e2c0 2024-02-16T00:11:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe68d4b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 0x559f4b46e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe68d4b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 0x559f4b46e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60152/0 (socket says 172.21.15.42:60152) 2024-02-16T00:11:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2250014131 learned_addr learned my addr 172.21.15.42:0/2250014131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2250014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4b46ec20 con 0x559f4b46e2c0 2024-02-16T00:11:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.812+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 0x559f4b46e6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x559f4b359770 tx=0x7fe67c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe5727fc640 1 -- 172.21.15.42:0/2250014131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe67c01d070 con 0x559f4b46e2c0 2024-02-16T00:11:27.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe5727fc640 1 -- 172.21.15.42:0/2250014131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0182e0 con 0x559f4b46e2c0 2024-02-16T00:11:27.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe5727fc640 1 -- 172.21.15.42:0/2250014131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe67c0145e0 con 0x559f4b46e2c0 2024-02-16T00:11:27.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f4b46f690 con 0x559f4b46e2c0 2024-02-16T00:11:27.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f4b46fb50 con 0x559f4b46e2c0 2024-02-16T00:11:27.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe5727fc640 1 -- 172.21.15.42:0/2250014131 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe67c020020 con 0x559f4b46e2c0 2024-02-16T00:11:27.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.813+0000 7fe5727fc640 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5640367e0 0x7fe564038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe5727fc640 1 -- 172.21.15.42:0/2250014131 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe67c04db90 con 0x559f4b46e2c0 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5640367e0 0x7fe564038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe690f22800 1 Processor -- start 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5640367e0 0x7fe564038ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x559f4b359930 tx=0x7fe68408ca10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe690f22800 1 -- start start 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe690f22800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b47b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe690f22800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4b1cd5d0 con 0x559f4b47b550 2024-02-16T00:11:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe68d4b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b47b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe68d4b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b47b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60166/0 (socket says 172.21.15.42:60166) 2024-02-16T00:11:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.814+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2283962390 learned_addr learned my addr 172.21.15.42:0/2283962390 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2283962390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4b47bf40 con 0x559f4b47b550 2024-02-16T00:11:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/2283962390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b47b970 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe67c013010 tx=0x7fe67c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd5484cf9a6ac7c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe563fff640 1 -- 172.21.15.42:0/2283962390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe67c040500 con 0x559f4b47b550 2024-02-16T00:11:27.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe563fff640 1 -- 172.21.15.42:0/2283962390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c014ac0 con 0x559f4b47b550 2024-02-16T00:11:27.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe563fff640 1 -- 172.21.15.42:0/2283962390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe67c02b350 con 0x559f4b47b550 2024-02-16T00:11:27.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe690f22800 1 -- 172.21.15.42:0/2283962390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 msgr2=0x559f4b47b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe690f22800 1 --2- 172.21.15.42:0/2283962390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b47b970 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe67c013010 tx=0x7fe67c011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:27.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe690f22800 1 -- 172.21.15.42:0/2283962390 shutdown_connections 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe690f22800 1 --2- 172.21.15.42:0/2283962390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b47b970 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe690f22800 1 -- 172.21.15.42:0/2283962390 >> 172.21.15.42:0/2283962390 conn(0x559f4b477820 msgr2=0x559f4b475880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.815+0000 7fe690f22800 1 -- 172.21.15.42:0/2283962390 shutdown_connections 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe690f22800 1 -- 172.21.15.42:0/2283962390 wait complete. 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe690f22800 1 Processor -- start 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe690f22800 1 -- start start 2024-02-16T00:11:27.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe690f22800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b4824c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe690f22800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4b482a00 con 0x559f4b47b550 2024-02-16T00:11:27.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe68d4b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b4824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe68d4b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b4824c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60178/0 (socket says 172.21.15.42:60178) 2024-02-16T00:11:27.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 learned_addr learned my addr 172.21.15.42:0/2289383990 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.816+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4b46fb50 con 0x559f4b47b550 2024-02-16T00:11:27.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b4824c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe67c014a40 tx=0x7fe67c04bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe5627fc640 1 -- 172.21.15.42:0/2289383990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe67c032070 con 0x559f4b47b550 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe5627fc640 1 -- 172.21.15.42:0/2289383990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c013c60 con 0x559f4b47b550 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f4b482c00 con 0x559f4b47b550 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe5627fc640 1 -- 172.21.15.42:0/2289383990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe67c0133b0 con 0x559f4b47b550 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f4b483060 con 0x559f4b47b550 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.817+0000 7fe5627fc640 1 -- 172.21.15.42:0/2289383990 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe67c013510 con 0x559f4b47b550 2024-02-16T00:11:27.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe5627fc640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5580367e0 0x7fe558038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe5627fc640 1 -- 172.21.15.42:0/2289383990 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe67c038c60 con 0x559f4b47b550 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5580367e0 0x7fe558038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5580367e0 0x7fe558038ca0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe68408e2d0 tx=0x7fe684084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b48e080 0x559f4b490540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b490c90 con 0x559f4b48e080 2024-02-16T00:11:27.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.818+0000 7fe68c4b6640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b48e080 0x559f4b490540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe68c4b6640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b48e080 0x559f4b490540 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 realm 2024-02-16T00:11:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b48d4e0 con 0x559f4b48e080 2024-02-16T00:11:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b491710 con 0x559f4b48e080 2024-02-16T00:11:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.819+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b491f90 con 0x559f4b48e080 2024-02-16T00:11:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b492970 0x559f4b494d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4954d0 con 0x559f4b492970 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b492970 0x559f4b494d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b492970 0x559f4b494d60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 20 searching for the correct realm 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559f4b497480 0x559f4b499940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b499fc0 con 0x559f4b497480 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.820+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559f4b497480 0x559f4b499940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.821+0000 7fe68ccb7640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559f4b497480 0x559f4b499940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.821+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.821+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b499fc0 con 0x559f4b492970 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.821+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.821+0000 7fe68d4b8640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe67c057040 0x7fe67c022740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.821+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67c055040 con 0x7fe67c057040 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.822+0000 7fe68c4b6640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe67c057040 0x7fe67c022740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.822+0000 7fe68c4b6640 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe67c057040 0x7fe67c022740 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.822+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x7fe67c057040 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.822+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67c055040 con 0x559f4b48e080 2024-02-16T00:11:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.822+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.822+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67c055040 con 0x559f4b48e080 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67c055040 con 0x7fe67c057040 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x7fe67c057040 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x7fe67c057040 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b492970 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.823+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.824+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.824+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b48e080 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.824+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.824+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.824+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x7fe67c057040 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.824+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b48e080 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b492970 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.825+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x7fe67c057040 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b48e080 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.826+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b48e080 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x7fe67c057040 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b492970 2024-02-16T00:11:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b48e080 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67400f5f0 con 0x559f4b48e080 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.827+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.828+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.828+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.828+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.828+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.828+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.828+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b492970 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.829+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.829+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b497480 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.829+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.829+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x7fe67c057040 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.829+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.829+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b48e080 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe67402c040 con 0x559f4b492970 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4958a0 con 0x559f4b48e080 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.830+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b495c50 con 0x559f4b48e080 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b496030 con 0x559f4b48e080 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 zone default found 2024-02-16T00:11:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 4 Realm: () 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 zonegroup default 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b496420 con 0x7fe67c057040 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49bde0 con 0x559f4b497480 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.831+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49c140 con 0x559f4b497480 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.832+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.832+0000 7fe690f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.832+0000 7fe690f22800 20 started sync module instance, tier type = 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.832+0000 7fe690f22800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.832+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49b6c0 con 0x559f4b492970 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.833+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.833+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94142651281952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49b640 con 0x559f4b492970 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.833+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49cde0 con 0x559f4b48e080 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.834+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94142651281952] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.834+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.834+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94142651286688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49cd60 con 0x559f4b48e080 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.834+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49d6d0 con 0x559f4b497480 2024-02-16T00:11:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.835+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.835+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94142651290160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49ded0 con 0x559f4b497480 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.835+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49e960 con 0x559f4b492970 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.835+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94142651286688] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.836+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.836+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94142651290160] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.836+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94142651294848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49ed10 con 0x559f4b492970 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.836+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49da70 con 0x559f4b48e080 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.837+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94142651294848] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.837+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.837+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94142651287744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49da70 con 0x559f4b48e080 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.837+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49fcf0 con 0x7fe67c057040 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.838+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94142651287744] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.838+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.838+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94142651298368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49fcf0 con 0x7fe67c057040 2024-02-16T00:11:27.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.838+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a0660 con 0x7fe67c057040 2024-02-16T00:11:27.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.839+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94142651298368] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.839+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.839+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94142651302816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49fcf0 con 0x7fe67c057040 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.839+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1020 con 0x7fe67c057040 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94142651302816] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94142651299920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1020 con 0x7fe67c057040 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=0 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=1 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=2 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=3 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=4 2024-02-16T00:11:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=5 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.840+0000 7fe690f22800 20 add_watcher() i=6 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.841+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94142651299920] v27'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.841+0000 7fe690f22800 20 add_watcher() i=7 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.841+0000 7fe690f22800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.841+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a0fd0 con 0x559f4b48e080 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.841+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.841+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94142651307120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1d30 con 0x559f4b48e080 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.842+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94142651307120] v27'140 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.842+0000 7fe542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.842+0000 7fe690f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.842+0000 7fe690f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.843+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a40f0 con 0x559f4b48e080 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.844+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'47 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.844+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a40b0 con 0x7fe67c057040 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.845+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'22 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.845+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ad980 con 0x559f4b497480 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.846+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'22 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.846+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ae350 con 0x559f4b48e080 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.847+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'141 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.847+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4acdd0 con 0x559f4b492970 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.848+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.848+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4acdd0 con 0x559f4b497480 2024-02-16T00:11:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.849+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'37 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.849+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4af530 con 0x559f4b48e080 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.850+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.850+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4af530 con 0x7fe67c057040 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.851+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'32 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.851+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4af530 con 0x559f4b492970 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.852+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.852+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4afb00 con 0x559f4b497480 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.853+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.853+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4afff0 con 0x559f4b492970 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.854+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'45 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.854+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4abe50 con 0x7fe67c057040 2024-02-16T00:11:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.855+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.855+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4abe50 con 0x559f4b492970 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.856+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.856+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4abe50 con 0x7fe67c057040 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.857+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'43 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.857+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab750 con 0x559f4b48e080 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.858+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'142 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.858+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4abe50 con 0x559f4b497480 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.859+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'38 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.859+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab920 con 0x559f4b492970 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.860+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'46 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.860+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab920 con 0x559f4b497480 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.861+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.861+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab920 con 0x559f4b48e080 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.862+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.862+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab920 con 0x559f4b48e080 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.863+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'143 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.863+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab920 con 0x559f4b497480 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.864+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'39 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.864+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4ab920 con 0x559f4b492970 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.865+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'34 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.865+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b497480 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.866+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.866+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b497480 2024-02-16T00:11:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.866+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'34 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.866+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b497480 2024-02-16T00:11:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.867+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.867+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b497480 2024-02-16T00:11:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.868+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'38 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.868+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x7fe67c057040 2024-02-16T00:11:27.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.869+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.869+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b497480 2024-02-16T00:11:27.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.870+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'28 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.870+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x7fe67c057040 2024-02-16T00:11:27.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.871+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'33 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.871+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b497480 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.872+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.872+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x7fe67c057040 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.873+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'44 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.873+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4b0b10 con 0x559f4b492970 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.874+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.874+0000 7fe541fe3640 20 reqs_thread_entry: start 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.874+0000 7fe690f22800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.874+0000 7fe690f22800 20 Filter name: none 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe4b37fe640 20 reqs_thread_entry: start 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T00:11:27.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 20 rados->read ofs=0 len=0 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4da3c0 con 0x7fe67c057040 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 20 rados_obj.operate() r=0 bl.length=386 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4dc8a0 con 0x559f4b48e080 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.875+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94142651539344 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4dcd40 con 0x559f4b497480 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== watch-notify(notify (1) cookie 94142651290160 notify 115964117000 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x559f4b358e00 con 0x559f4b497480 2024-02-16T00:11:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe563fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94142651290160 notifier 4558 bl.length()=170 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe563fff640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe550003d50 con 0x559f4b497480 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(96 notify.2 [notify cookie 94142651539344 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== watch-notify(notify_complete (2) cookie 94142651539344 notify 115964117000 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559f4b35a850 con 0x559f4b497480 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.876+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4d9f90 con 0x7fe67c057040 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v27'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe690f22800 10 removing email index: 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe690f22800 10 removing user buckets index 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe690f22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94142651539344 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4dcd40 con 0x559f4b48e080 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== watch-notify(notify (1) cookie 94142651287744 notify 115964117005 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x7fe67403d830 con 0x559f4b48e080 2024-02-16T00:11:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe5637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94142651287744 notifier 4558 bl.length()=175 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe5637fe640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe4c00032e0 con 0x559f4b48e080 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.877+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(99 notify.4 [notify cookie 94142651539344 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.878+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== watch-notify(notify_complete (2) cookie 94142651539344 notify 115964117005 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe67403da90 con 0x559f4b48e080 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.878+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.878+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4d9f90 con 0x559f4b48e080 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v27'8 uv8 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe690f22800 10 removing user index: testx$tenanteduser 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe690f22800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe690f22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94142651539440 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4dbe50 con 0x559f4b492970 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== watch-notify(notify (1) cookie 94142651294848 notify 115964117016 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x559f4b482c00 con 0x559f4b492970 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe563fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117016 cookie 94142651294848 notifier 4558 bl.length()=167 2024-02-16T00:11:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe563fff640 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe550003d50 con 0x559f4b492970 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(102 notify.3 [notify cookie 94142651539440 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c00a4a0 con 0x559f4b492970 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== watch-notify(notify_complete (2) cookie 94142651539440 notify 115964117016 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe67c068020 con 0x559f4b492970 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.879+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4d9ff0 con 0x7fe67c057040 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.880+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v27'10 uv10 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.881+0000 7fe542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.881+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94142651307120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4d9ff0 con 0x559f4b48e080 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.882+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94142651307120] v27'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.882+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94142651281952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1470 con 0x559f4b492970 2024-02-16T00:11:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.883+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94142651281952] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c06a040 con 0x559f4b492970 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.883+0000 7fe690f22800 20 remove_watcher() i=0 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.883+0000 7fe690f22800 2 removed watcher, disabling cache 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.883+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94142651286688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1470 con 0x559f4b48e080 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.884+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94142651286688] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.884+0000 7fe690f22800 20 remove_watcher() i=1 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.884+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94142651290160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49c4a0 con 0x559f4b497480 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.885+0000 7fe68ccb7640 1 -- 172.21.15.42:0/2289383990 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94142651290160] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe684063070 con 0x559f4b497480 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.885+0000 7fe690f22800 20 remove_watcher() i=2 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.885+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94142651294848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1470 con 0x559f4b492970 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.886+0000 7fe68d4b8640 1 -- 172.21.15.42:0/2289383990 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94142651294848] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe67c06a040 con 0x559f4b492970 2024-02-16T00:11:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.886+0000 7fe690f22800 20 remove_watcher() i=3 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.886+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94142651287744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49d230 con 0x559f4b48e080 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.887+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94142651287744] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x559f4b48e080 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.887+0000 7fe690f22800 20 remove_watcher() i=4 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.887+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94142651298368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49e480 con 0x7fe67c057040 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.888+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94142651298368] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.888+0000 7fe690f22800 20 remove_watcher() i=5 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.888+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94142651302816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b4a1470 con 0x7fe67c057040 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.889+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94142651302816] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.889+0000 7fe690f22800 20 remove_watcher() i=6 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.889+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94142651299920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x559f4b49d230 con 0x7fe67c057040 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94142651299920] v27'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe674038040 con 0x7fe67c057040 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 20 remove_watcher() i=7 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe67c057040 msgr2=0x7fe67c022740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe67c057040 0x7fe67c022740 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b48e080 msgr2=0x559f4b490540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b48e080 0x559f4b490540 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b492970 msgr2=0x559f4b494d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b492970 0x559f4b494d60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559f4b497480 msgr2=0x559f4b499940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559f4b497480 0x559f4b499940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5580367e0 msgr2=0x7fe558038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5580367e0 0x7fe558038ca0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe68408e2d0 tx=0x7fe684084000 comp rx=0 tx=0).stop 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 msgr2=0x559f4b4824c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2289383990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b47b550 0x559f4b4824c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe67c014a40 tx=0x7fe67c04bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe68c4b6640 1 -- 172.21.15.42:0/2289383990 reap_dead start 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 shutdown_connections 2024-02-16T00:11:27.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 >> 172.21.15.42:0/2289383990 conn(0x559f4b477820 msgr2=0x559f4b474e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 shutdown_connections 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2289383990 wait complete. 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5640367e0 msgr2=0x7fe564038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.890+0000 7fe690f22800 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5640367e0 0x7fe564038ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x559f4b359930 tx=0x7fe68408ca10 comp rx=0 tx=0).stop 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 msgr2=0x559f4b46e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 0x559f4b46e6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x559f4b359770 tx=0x7fe67c018830 comp rx=0 tx=0).stop 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 shutdown_connections 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe5640367e0 0x7fe564038ca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/2250014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b46e2c0 0x559f4b46e6e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 >> 172.21.15.42:0/2250014131 conn(0x559f4b462360 msgr2=0x559f4b462760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 shutdown_connections 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/2250014131 wait complete. 2024-02-16T00:11:27.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b35d350 msgr2=0x559f4b45a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b35d350 0x559f4b45a620 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b45c8b0 msgr2=0x559f4b45ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b45c8b0 0x559f4b45ed20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe574036790 msgr2=0x7fe574038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe574036790 0x7fe574038c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe674000c00 tx=0x7fe6740013b0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 msgr2=0x559f4b35a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35a310 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe684000c00 tx=0x7fe684002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 shutdown_connections 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559f4b45c8b0 0x559f4b45ed20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559f4b35d350 0x559f4b45a620 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe574036790 0x7fe574038c50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 --2- 172.21.15.42:0/1154545025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559f4b35aa20 0x559f4b35a310 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 >> 172.21.15.42:0/1154545025 conn(0x559f4b3544f0 msgr2=0x559f4b44b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 shutdown_connections 2024-02-16T00:11:27.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.891+0000 7fe690f22800 1 -- 172.21.15.42:0/1154545025 wait complete. 2024-02-16T00:11:27.908 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-16T00:11:27.911 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-02-16T00:11:27.913 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:27.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-16T00:11:27.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-16T00:11:27.914 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-02-16T00:11:27.957 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:27.957 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:27.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.955+0000 7ff9551ad800 1 Processor -- start 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.955+0000 7ff9551ad800 1 -- start start 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.955+0000 7ff9551ad800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5583abc123f0 0x5583abc1aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.955+0000 7ff9551ad800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5583abb5cba0 con 0x5583abc108b0 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.955+0000 7ff9551ad800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5583abb14450 con 0x5583abc123f0 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.956+0000 7ff9524ab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5583abc123f0 0x5583abc1aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.956+0000 7ff952cac640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5583abc108b0 0x5583abc10cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60538/0 (socket says 172.21.15.42:60538) 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.956+0000 7ff952cac640 1 -- 172.21.15.42:0/1311032468 learned_addr learned my addr 172.21.15.42:0/1311032468 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.956+0000 7ff9524ab640 1 -- 172.21.15.42:0/1311032468 >> v1:172.21.15.2:6789/0 conn(0x5583abc108b0 legacy=0x5583abc10cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.956+0000 7ff9524ab640 1 -- 172.21.15.42:0/1311032468 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583abb851a0 con 0x5583abc123f0 2024-02-16T00:11:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9524ab640 1 --2- 172.21.15.42:0/1311032468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc123f0 0x5583abc1aef0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00a470 tx=0x7ff93c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8727f53c85f77f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff951caa640 1 -- 172.21.15.42:0/1311032468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff93c04ad40 con 0x5583abc123f0 2024-02-16T00:11:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff951caa640 1 -- 172.21.15.42:0/1311032468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c052440 con 0x5583abc123f0 2024-02-16T00:11:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff951caa640 1 -- 172.21.15.42:0/1311032468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff93c04aea0 con 0x5583abc123f0 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9551ad800 1 -- 172.21.15.42:0/1311032468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc123f0 msgr2=0x5583abc1aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1311032468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc123f0 0x5583abc1aef0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00a470 tx=0x7ff93c01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9551ad800 1 -- 172.21.15.42:0/1311032468 shutdown_connections 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1311032468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc123f0 0x5583abc1aef0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9551ad800 1 -- 172.21.15.42:0/1311032468 >> 172.21.15.42:0/1311032468 conn(0x5583abc0c4f0 msgr2=0x5583abc0e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.958+0000 7ff9551ad800 1 -- 172.21.15.42:0/1311032468 shutdown_connections 2024-02-16T00:11:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.959+0000 7ff9551ad800 1 -- 172.21.15.42:0/1311032468 wait complete. 2024-02-16T00:11:27.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff9551ad800 1 Processor -- start 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff9551ad800 1 -- start start 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff9551ad800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff9551ad800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583abb11980 con 0x5583abc108b0 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff952cac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff952cac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd042a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60198/0 (socket says 172.21.15.42:60198) 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff952cac640 1 -- 172.21.15.42:0/2290436236 learned_addr learned my addr 172.21.15.42:0/2290436236 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.970+0000 7ff952cac640 1 -- 172.21.15.42:0/2290436236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c005d20 con 0x5583abc108b0 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff952cac640 1 --2- 172.21.15.42:0/2290436236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd042a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff944006f70 tx=0x7ff944001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32d81f514aab4cd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff840e09640 1 -- 172.21.15.42:0/2290436236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff944006320 con 0x5583abc108b0 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff840e09640 1 -- 172.21.15.42:0/2290436236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944004520 con 0x5583abc108b0 2024-02-16T00:11:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff840e09640 1 -- 172.21.15.42:0/2290436236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff944004880 con 0x5583abc108b0 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff9551ad800 1 -- 172.21.15.42:0/2290436236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 msgr2=0x5583abd042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff9551ad800 1 --2- 172.21.15.42:0/2290436236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd042a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff944006f70 tx=0x7ff944001930 comp rx=0 tx=0).stop 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff9551ad800 1 -- 172.21.15.42:0/2290436236 shutdown_connections 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff9551ad800 1 --2- 172.21.15.42:0/2290436236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd042a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.971+0000 7ff9551ad800 1 -- 172.21.15.42:0/2290436236 >> 172.21.15.42:0/2290436236 conn(0x5583abc0c4f0 msgr2=0x5583abcffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff9551ad800 1 -- 172.21.15.42:0/2290436236 shutdown_connections 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff9551ad800 1 -- 172.21.15.42:0/2290436236 wait complete. 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff9551ad800 1 Processor -- start 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff9551ad800 1 -- start start 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff9551ad800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd0b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff9551ad800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583abb0d160 con 0x5583abc108b0 2024-02-16T00:11:27.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff952cac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd0b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff952cac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd0b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60214/0 (socket says 172.21.15.42:60214) 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff952cac640 1 -- 172.21.15.42:0/1103604611 learned_addr learned my addr 172.21.15.42:0/1103604611 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.972+0000 7ff952cac640 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583abb5cba0 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.973+0000 7ff952cac640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd0b9b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff94400f000 tx=0x7ff944000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.973+0000 7ff83f606640 1 -- 172.21.15.42:0/1103604611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff944023030 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.973+0000 7ff83f606640 1 -- 172.21.15.42:0/1103604611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944013820 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.973+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583abd0bef0 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.973+0000 7ff83f606640 1 -- 172.21.15.42:0/1103604611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff944013ae0 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.973+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583abd0c3d0 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff83f606640 1 -- 172.21.15.42:0/1103604611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff944026070 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff83f606640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff838036790 0x7ff838038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff83f606640 1 -- 172.21.15.42:0/1103604611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff944024070 con 0x5583abc108b0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff9524ab640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff838036790 0x7ff838038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abc123f0 0x5583abd12740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd12d10 con 0x5583abc123f0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff9534ad640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abc123f0 0x5583abd12740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff9524ab640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff838036790 0x7ff838038c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff93c054000 tx=0x7ff93c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.974+0000 7ff9534ad640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abc123f0 0x5583abd12740 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff9534ad640 1 -- 172.21.15.42:0/1103604611 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abc123f0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd0fda0 con 0x5583abc123f0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff9534ad640 1 -- 172.21.15.42:0/1103604611 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abc123f0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd14f50 0x5583abd17340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd17a40 con 0x5583abd14f50 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff952cac640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd14f50 0x5583abd17340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.975+0000 7ff952cac640 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd14f50 0x5583abd17340 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.976+0000 7ff952cac640 1 -- 172.21.15.42:0/1103604611 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd14f50 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.976+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd13ed0 con 0x5583abc123f0 2024-02-16T00:11:27.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.976+0000 7ff9534ad640 1 -- 172.21.15.42:0/1103604611 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abc123f0 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.976+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd142c0 con 0x5583abc123f0 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.976+0000 7ff9534ad640 1 -- 172.21.15.42:0/1103604611 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abc123f0 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.976+0000 7ff9551ad800 1 Processor -- start 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9551ad800 1 -- start start 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9551ad800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 0x5583abd26bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9551ad800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583abaafe80 con 0x5583abd267d0 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9534ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 0x5583abd26bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9534ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 0x5583abd26bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60224/0 (socket says 172.21.15.42:60224) 2024-02-16T00:11:27.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9534ad640 1 -- 172.21.15.42:0/818925833 learned_addr learned my addr 172.21.15.42:0/818925833 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9534ad640 1 -- 172.21.15.42:0/818925833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583abd27130 con 0x5583abd267d0 2024-02-16T00:11:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.977+0000 7ff9534ad640 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 0x5583abd26bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5583abd0cdb0 tx=0x7ff94c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.978+0000 7ff83ce01640 1 -- 172.21.15.42:0/818925833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff94c00f040 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.978+0000 7ff83ce01640 1 -- 172.21.15.42:0/818925833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c007d00 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.978+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583abd27ba0 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.978+0000 7ff83ce01640 1 -- 172.21.15.42:0/818925833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff94c019420 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.978+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583abd28060 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.978+0000 7ff83ce01640 1 -- 172.21.15.42:0/818925833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff94c019580 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff83ce01640 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff82c036830 0x7ff82c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff83ce01640 1 -- 172.21.15.42:0/818925833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff94c04e390 con 0x5583abd267d0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff952cac640 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff82c036830 0x7ff82c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9551ad800 1 Processor -- start 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9551ad800 1 -- start start 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff952cac640 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff82c036830 0x7ff82c038cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5583abd13110 tx=0x7ff94404a310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9551ad800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd33ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9551ad800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583aba855d0 con 0x5583abd33ad0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9534ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd33ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9534ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd33ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60238/0 (socket says 172.21.15.42:60238) 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.979+0000 7ff9534ad640 1 -- 172.21.15.42:0/2404697148 learned_addr learned my addr 172.21.15.42:0/2404697148 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9534ad640 1 -- 172.21.15.42:0/2404697148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583abd344c0 con 0x5583abd33ad0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9534ad640 1 --2- 172.21.15.42:0/2404697148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd33ef0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff94c04c710 tx=0x7ff94c017be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df592a25305ad4ee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff8367fc640 1 -- 172.21.15.42:0/2404697148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff94c023790 con 0x5583abd33ad0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff8367fc640 1 -- 172.21.15.42:0/2404697148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c023910 con 0x5583abd33ad0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff8367fc640 1 -- 172.21.15.42:0/2404697148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff94c022e20 con 0x5583abd33ad0 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 -- 172.21.15.42:0/2404697148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 msgr2=0x5583abd33ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 --2- 172.21.15.42:0/2404697148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd33ef0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff94c04c710 tx=0x7ff94c017be0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 -- 172.21.15.42:0/2404697148 shutdown_connections 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 --2- 172.21.15.42:0/2404697148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd33ef0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 -- 172.21.15.42:0/2404697148 >> 172.21.15.42:0/2404697148 conn(0x5583abd2fd50 msgr2=0x5583abd2ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 -- 172.21.15.42:0/2404697148 shutdown_connections 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.980+0000 7ff9551ad800 1 -- 172.21.15.42:0/2404697148 wait complete. 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9551ad800 1 Processor -- start 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9551ad800 1 -- start start 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9551ad800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd3a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9551ad800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583abd3aee0 con 0x5583abd33ad0 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9534ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd3a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9534ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd3a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60244/0 (socket says 172.21.15.42:60244) 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 learned_addr learned my addr 172.21.15.42:0/776044048 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.981+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583abd28060 con 0x5583abd33ad0 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.982+0000 7ff9534ad640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd3a9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff94c04e300 tx=0x7ff94c048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.982+0000 7ff834ff9640 1 -- 172.21.15.42:0/776044048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff94c022ab0 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.982+0000 7ff834ff9640 1 -- 172.21.15.42:0/776044048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c015af0 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.982+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583abd3b0e0 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.982+0000 7ff834ff9640 1 -- 172.21.15.42:0/776044048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff94c015d90 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.982+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583abd3b5a0 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff834ff9640 1 -- 172.21.15.42:0/776044048 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff94c018a30 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff834ff9640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff81c036770 0x7ff81c038c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff834ff9640 1 -- 172.21.15.42:0/776044048 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff94c04d030 con 0x5583abd33ad0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff952cac640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff81c036770 0x7ff81c038c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff952cac640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff81c036770 0x7ff81c038c30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff94404a6c0 tx=0x7ff944031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abd46640 0x5583abd48b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd49250 con 0x5583abd46640 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.983+0000 7ff9524ab640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abd46640 0x5583abd48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9524ab640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abd46640 0x5583abd48b00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 realm 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd49640 con 0x5583abd46640 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd49ec0 con 0x5583abd46640 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.984+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd4a220 con 0x5583abd46640 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd4af30 0x5583abd4d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd4d970 con 0x5583abd4af30 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9534ad640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd4af30 0x5583abd4d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9534ad640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd4af30 0x5583abd4d320 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 20 searching for the correct realm 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5583abd4fc60 0x5583abd52120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.985+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.986+0000 7ff952cac640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5583abd4fc60 0x5583abd52120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.986+0000 7ff952cac640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5583abd4fc60 0x5583abd52120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.986+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.986+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4af30 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9534ad640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff94c061060 0x7ff94c019880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9524ab640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff94c061060 0x7ff94c019880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9524ab640 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff94c061060 0x7ff94c019880 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.987+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4af30 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.988+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.989+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4af30 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.990+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.991+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4af30 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.992+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4af30 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4fc60 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.993+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x7ff94c061060 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd46640 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd527f0 con 0x5583abd4af30 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.994+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd4f1c0 con 0x5583abd46640 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd4e180 con 0x5583abd46640 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd4eab0 con 0x5583abd46640 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 zone default found 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 4 Realm: () 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 zonegroup default 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd530d0 con 0x7ff94c061060 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.995+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd54b70 con 0x5583abd4fc60 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd54fc0 con 0x5583abd4fc60 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 20 started sync module instance, tier type = 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.996+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd54080 con 0x5583abd4af30 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.997+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.997+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024011957568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd553e0 con 0x5583abd4af30 2024-02-16T00:11:28.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.997+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd55be0 con 0x5583abd46640 2024-02-16T00:11:28.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.998+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024011957568] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.998+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.998+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024011961312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd55f90 con 0x5583abd46640 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.998+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd56790 con 0x5583abd4fc60 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.999+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.999+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024011964608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd56f90 con 0x5583abd4fc60 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:27.999+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd57990 con 0x5583abd4af30 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.000+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024011961312] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.000+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024011964608] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.000+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.001+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024011967216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd55800 con 0x5583abd4af30 2024-02-16T00:11:28.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.001+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd58210 con 0x5583abd46640 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.002+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024011967216] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.002+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.002+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024011969680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd58210 con 0x5583abd46640 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.002+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd58c40 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.003+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024011969680] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.003+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.003+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024011974496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd58210 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.003+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd59670 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.004+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024011974496] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.004+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.004+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024011971952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd59810 con 0x7ff94c061060 2024-02-16T00:11:28.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.004+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd5a010 con 0x7ff94c061060 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024011971952] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024011978064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd59f30 con 0x7ff94c061060 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=0 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=1 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=2 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=3 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=4 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=5 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.005+0000 7ff9551ad800 20 add_watcher() i=6 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.006+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024011978064] v27'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.006+0000 7ff9551ad800 20 add_watcher() i=7 2024-02-16T00:11:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.006+0000 7ff9551ad800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.006+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd5d5a0 con 0x5583abd46640 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.006+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.006+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024011979248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd5d5a0 con 0x5583abd46640 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.007+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024011979248] v27'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.007+0000 7ff8097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.007+0000 7ff9551ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.007+0000 7ff9551ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.007+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd65ed0 con 0x5583abd46640 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.008+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'48 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.009+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd664a0 con 0x7ff94c061060 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.010+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'23 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.010+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd669d0 con 0x5583abd4fc60 2024-02-16T00:11:28.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.011+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'23 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.011+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd673a0 con 0x5583abd46640 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.012+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'146 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.012+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd61da0 con 0x5583abd4af30 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.013+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'47 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.013+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd61da0 con 0x5583abd4fc60 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.013+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'39 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.014+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd68580 con 0x5583abd46640 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.015+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.015+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd68610 con 0x7ff94c061060 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.016+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'34 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.016+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd686a0 con 0x5583abd4af30 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.017+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.017+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd68bd0 con 0x5583abd4fc60 2024-02-16T00:11:28.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.018+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.018+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69100 con 0x5583abd4af30 2024-02-16T00:11:28.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.018+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'48 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.019+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69630 con 0x7ff94c061060 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.019+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.020+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69630 con 0x5583abd4af30 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.020+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'23 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.020+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69820 con 0x7ff94c061060 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.021+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'45 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.021+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69820 con 0x5583abd46640 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.022+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'147 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.022+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69820 con 0x5583abd4fc60 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.023+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'41 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.023+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69ba0 con 0x5583abd4af30 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.024+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'49 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.024+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.025+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.025+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd46640 2024-02-16T00:11:28.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.026+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.026+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd46640 2024-02-16T00:11:28.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.027+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'148 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.027+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.028+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'42 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.028+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4af30 2024-02-16T00:11:28.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.029+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'35 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.029+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.030+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.030+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.031+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.031+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.032+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.032+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.033+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'40 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.033+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x7ff94c061060 2024-02-16T00:11:28.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.034+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.034+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.035+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'29 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.035+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x7ff94c061060 2024-02-16T00:11:28.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.036+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'35 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.036+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4fc60 2024-02-16T00:11:28.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.037+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.037+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x7ff94c061060 2024-02-16T00:11:28.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.038+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'46 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.038+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd69b40 con 0x5583abd4af30 2024-02-16T00:11:28.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.039+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.039+0000 7ff783fff640 20 reqs_thread_entry: start 2024-02-16T00:11:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 20 Filter name: none 2024-02-16T00:11:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff781ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd650e0 con 0x5583abd4af30 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd65630 con 0x5583abd46640 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.040+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(95 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 20 get_obj_state: octx=0x7ff93c00a400 obj=myfoo:four state=0x5583abd961c8 s->prefetch_data=0 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 3.6s0 3:635de12d:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd96fe0 con 0x5583abd46640 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(96 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+865 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 10 manifest: total_size = 4 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.2044054849494087792 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 20 get_obj_state: octx=0x7ff93c00a400 obj=myfoo:four state=0x5583abd961c8 s->prefetch_data=0 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 20 prepare_atomic_modification: state is not atomic. state=0x5583abd961c8 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 2024-02-16T00:11:28.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.041+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9b7f0 con 0x5583abd4fc60 2024-02-16T00:11:28.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.042+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(97 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [stat,call,call] v27'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.042+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 3.6s0 3:635de12d:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9b7f0 con 0x5583abd46640 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.043+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(98 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1_four [call] v27'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.043+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:99 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd4fc60 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.045+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(99 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [stat,call,call] v27'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.045+0000 7ff8367fc640 20 handle_completion(): completion ok for obj=four 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.045+0000 7ff8097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.045+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024011979248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd46640 2024-02-16T00:11:28.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.046+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94024011979248] v27'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.046+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024011957568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd4af30 2024-02-16T00:11:28.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.047+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94024011957568] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.047+0000 7ff9551ad800 20 remove_watcher() i=0 2024-02-16T00:11:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.047+0000 7ff9551ad800 2 removed watcher, disabling cache 2024-02-16T00:11:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.047+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024011961312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd46640 2024-02-16T00:11:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.048+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94024011961312] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.048+0000 7ff9551ad800 20 remove_watcher() i=1 2024-02-16T00:11:28.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.048+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024011964608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd4fc60 2024-02-16T00:11:28.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.049+0000 7ff952cac640 1 -- 172.21.15.42:0/776044048 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94024011964608] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff944013d50 con 0x5583abd4fc60 2024-02-16T00:11:28.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.049+0000 7ff9551ad800 20 remove_watcher() i=2 2024-02-16T00:11:28.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.049+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024011967216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd4af30 2024-02-16T00:11:28.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.050+0000 7ff9534ad640 1 -- 172.21.15.42:0/776044048 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94024011967216] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff94c0083e0 con 0x5583abd4af30 2024-02-16T00:11:28.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.050+0000 7ff9551ad800 20 remove_watcher() i=3 2024-02-16T00:11:28.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.050+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024011969680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x5583abd46640 2024-02-16T00:11:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.050+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94024011969680] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x5583abd46640 2024-02-16T00:11:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.050+0000 7ff9551ad800 20 remove_watcher() i=4 2024-02-16T00:11:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.051+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024011974496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x7ff94c061060 2024-02-16T00:11:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.051+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94024011974496] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.051+0000 7ff9551ad800 20 remove_watcher() i=5 2024-02-16T00:11:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.051+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024011971952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x7ff94c061060 2024-02-16T00:11:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.052+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94024011971952] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.052+0000 7ff9551ad800 20 remove_watcher() i=6 2024-02-16T00:11:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.052+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024011978064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5583abd9bd90 con 0x7ff94c061060 2024-02-16T00:11:28.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.053+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94024011978064] v27'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff93c00a0a0 con 0x7ff94c061060 2024-02-16T00:11:28.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.053+0000 7ff9551ad800 20 remove_watcher() i=7 2024-02-16T00:11:28.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff94c061060 msgr2=0x7ff94c019880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff94c061060 0x7ff94c019880 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abd46640 msgr2=0x5583abd48b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abd46640 0x5583abd48b00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd4af30 msgr2=0x5583abd4d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd4af30 0x5583abd4d320 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5583abd4fc60 msgr2=0x5583abd52120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5583abd4fc60 0x5583abd52120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff81c036770 msgr2=0x7ff81c038c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff81c036770 0x7ff81c038c30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff94404a6c0 tx=0x7ff944031000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 msgr2=0x5583abd3a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/776044048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd33ad0 0x5583abd3a9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff94c04e300 tx=0x7ff94c048040 comp rx=0 tx=0).stop 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 reap_dead start 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9524ab640 1 -- 172.21.15.42:0/776044048 reap_dead start 2024-02-16T00:11:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 shutdown_connections 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 >> 172.21.15.42:0/776044048 conn(0x5583abd2fd50 msgr2=0x5583abd2d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 shutdown_connections 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/776044048 wait complete. 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff82c036830 msgr2=0x7ff82c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff82c036830 0x7ff82c038cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5583abd13110 tx=0x7ff94404a310 comp rx=0 tx=0).stop 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 msgr2=0x5583abd26bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 0x5583abd26bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5583abd0cdb0 tx=0x7ff94c00aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 shutdown_connections 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff82c036830 0x7ff82c038cf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 --2- 172.21.15.42:0/818925833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abd267d0 0x5583abd26bf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 >> 172.21.15.42:0/818925833 conn(0x5583abd1a870 msgr2=0x5583abd1ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 shutdown_connections 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.054+0000 7ff9551ad800 1 -- 172.21.15.42:0/818925833 wait complete. 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abc123f0 msgr2=0x5583abd12740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abc123f0 0x5583abd12740 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd14f50 msgr2=0x5583abd17340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd14f50 0x5583abd17340 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff838036790 msgr2=0x7ff838038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff838036790 0x7ff838038c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff93c054000 tx=0x7ff93c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 msgr2=0x5583abd0b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd0b9b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff94400f000 tx=0x7ff944000f40 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 shutdown_connections 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5583abd14f50 0x5583abd17340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5583abc123f0 0x5583abd12740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff838036790 0x7ff838038c50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 --2- 172.21.15.42:0/1103604611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5583abc108b0 0x5583abd0b9b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 >> 172.21.15.42:0/1103604611 conn(0x5583abc0c4f0 msgr2=0x5583abcfe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 shutdown_connections 2024-02-16T00:11:28.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.055+0000 7ff9551ad800 1 -- 172.21.15.42:0/1103604611 wait complete. 2024-02-16T00:11:28.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T00:11:28.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T00:11:28.066 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T00:11:28.108 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:28.108 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:28.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f8262016800 1 Processor -- start 2024-02-16T00:11:28.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f8262016800 1 -- start start 2024-02-16T00:11:28.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f8262016800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643c31d8120 0x5643c3267b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f8262016800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5643c31afbb0 con 0x5643c32680b0 2024-02-16T00:11:28.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f8262016800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5643c3167450 con 0x5643c31d8120 2024-02-16T00:11:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f825d761640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5643c31d8120 0x5643c3267b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f825cf60640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5643c32680b0 0x5643c326a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60542/0 (socket says 172.21.15.42:60542) 2024-02-16T00:11:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f825cf60640 1 -- 172.21.15.42:0/3213091285 learned_addr learned my addr 172.21.15.42:0/3213091285 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f825d761640 1 -- 172.21.15.42:0/3213091285 >> v1:172.21.15.2:6789/0 conn(0x5643c32680b0 legacy=0x5643c326a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.106+0000 7f825d761640 1 -- 172.21.15.42:0/3213091285 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c326ce10 con 0x5643c31d8120 2024-02-16T00:11:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.108+0000 7f825d761640 1 --2- 172.21.15.42:0/3213091285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3267b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f825000a470 tx=0x7f825001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fec0f38462b3d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.108+0000 7f824ffff640 1 -- 172.21.15.42:0/3213091285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8250052570 con 0x5643c31d8120 2024-02-16T00:11:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.108+0000 7f824ffff640 1 -- 172.21.15.42:0/3213091285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500526d0 con 0x5643c31d8120 2024-02-16T00:11:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.108+0000 7f824ffff640 1 -- 172.21.15.42:0/3213091285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8250052990 con 0x5643c31d8120 2024-02-16T00:11:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 -- 172.21.15.42:0/3213091285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 msgr2=0x5643c3267b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 --2- 172.21.15.42:0/3213091285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3267b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f825000a470 tx=0x7f825001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 -- 172.21.15.42:0/3213091285 shutdown_connections 2024-02-16T00:11:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 --2- 172.21.15.42:0/3213091285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3267b10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 -- 172.21.15.42:0/3213091285 >> 172.21.15.42:0/3213091285 conn(0x5643c325f4d0 msgr2=0x5643c32618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 -- 172.21.15.42:0/3213091285 shutdown_connections 2024-02-16T00:11:28.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.109+0000 7f8262016800 1 -- 172.21.15.42:0/3213091285 wait complete. 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.120+0000 7f8262016800 1 Processor -- start 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.120+0000 7f8262016800 1 -- start start 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.120+0000 7f8262016800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3354f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.120+0000 7f8262016800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c3164980 con 0x5643c31d8120 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f825d761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3354f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f825d761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3354f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60266/0 (socket says 172.21.15.42:60266) 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f825d761640 1 -- 172.21.15.42:0/2862208707 learned_addr learned my addr 172.21.15.42:0/2862208707 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f825d761640 1 -- 172.21.15.42:0/2862208707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250005d20 con 0x5643c31d8120 2024-02-16T00:11:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f825d761640 1 --2- 172.21.15.42:0/2862208707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3354f70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8250055040 tx=0x7f825004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1a7dcaae079c29 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f814b606640 1 -- 172.21.15.42:0/2862208707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825000a180 con 0x5643c31d8120 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f814b606640 1 -- 172.21.15.42:0/2862208707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000a300 con 0x5643c31d8120 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.121+0000 7f814b606640 1 -- 172.21.15.42:0/2862208707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82500529b0 con 0x5643c31d8120 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 -- 172.21.15.42:0/2862208707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 msgr2=0x5643c3354f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 --2- 172.21.15.42:0/2862208707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3354f70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8250055040 tx=0x7f825004c000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 -- 172.21.15.42:0/2862208707 shutdown_connections 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 --2- 172.21.15.42:0/2862208707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c3354f70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 -- 172.21.15.42:0/2862208707 >> 172.21.15.42:0/2862208707 conn(0x5643c325f4d0 msgr2=0x5643c3350890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 -- 172.21.15.42:0/2862208707 shutdown_connections 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.122+0000 7f8262016800 1 -- 172.21.15.42:0/2862208707 wait complete. 2024-02-16T00:11:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8262016800 1 Processor -- start 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8262016800 1 -- start start 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8262016800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c335c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8262016800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c3160160 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f825d761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c335c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f825d761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c335c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60276/0 (socket says 172.21.15.42:60276) 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f825d761640 1 -- 172.21.15.42:0/4193879237 learned_addr learned my addr 172.21.15.42:0/4193879237 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f825d761640 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c326ce10 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f825d761640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c335c530 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f825005f040 tx=0x7f8250002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8149e03640 1 -- 172.21.15.42:0/4193879237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825006a070 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8149e03640 1 -- 172.21.15.42:0/4193879237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825005d420 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.123+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643c335ca70 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.124+0000 7f8149e03640 1 -- 172.21.15.42:0/4193879237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825005d6c0 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.124+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643c335cf50 con 0x5643c31d8120 2024-02-16T00:11:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.124+0000 7f8149e03640 1 -- 172.21.15.42:0/4193879237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f825005d820 con 0x5643c31d8120 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.124+0000 7f8149e03640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81440367e0 0x7f8144038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.124+0000 7f8149e03640 1 -- 172.21.15.42:0/4193879237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f825008dc50 con 0x5643c31d8120 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f825cf60640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81440367e0 0x7f8144038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c32680b0 0x5643c3363230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33637d0 con 0x5643c32680b0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f825df62640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c32680b0 0x5643c3363230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f825cf60640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81440367e0 0x7f8144038ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8254000f60 tx=0x7f82540012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f825df62640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c32680b0 0x5643c3363230 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f825df62640 1 -- 172.21.15.42:0/4193879237 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c32680b0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.125+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c3360940 con 0x5643c32680b0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f825df62640 1 -- 172.21.15.42:0/4193879237 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c32680b0 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c3365a40 0x5643c3367e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c3368520 con 0x5643c3365a40 2024-02-16T00:11:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f825d761640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c3365a40 0x5643c3367e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f825d761640 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c3365a40 0x5643c3367e30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f825d761640 1 -- 172.21.15.42:0/4193879237 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8250059040 con 0x5643c3365a40 2024-02-16T00:11:28.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.126+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c3364990 con 0x5643c32680b0 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f825df62640 1 -- 172.21.15.42:0/4193879237 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c32680b0 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c3364d80 con 0x5643c32680b0 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f825df62640 1 -- 172.21.15.42:0/4193879237 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c32680b0 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f8262016800 1 Processor -- start 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f8262016800 1 -- start start 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f8262016800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 0x5643c3263af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.127+0000 7f8262016800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c3102e80 con 0x5643c3265680 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f825df62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 0x5643c3263af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f825df62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 0x5643c3263af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60282/0 (socket says 172.21.15.42:60282) 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f825df62640 1 -- 172.21.15.42:0/2261689513 learned_addr learned my addr 172.21.15.42:0/2261689513 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f825df62640 1 -- 172.21.15.42:0/2261689513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c3264030 con 0x5643c3265680 2024-02-16T00:11:28.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f825df62640 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 0x5643c3263af0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x5643c335d930 tx=0x7f8258018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f8142ffd640 1 -- 172.21.15.42:0/2261689513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825801d070 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f8142ffd640 1 -- 172.21.15.42:0/2261689513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580182e0 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f8142ffd640 1 -- 172.21.15.42:0/2261689513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82580145a0 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.128+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643c3264220 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.129+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643c32646e0 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.129+0000 7f8142ffd640 1 -- 172.21.15.42:0/2261689513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8258020020 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.129+0000 7f8142ffd640 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8134036830 0x7f8134038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.129+0000 7f8142ffd640 1 -- 172.21.15.42:0/2261689513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f825804dc20 con 0x5643c3265680 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.129+0000 7f825d761640 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8134036830 0x7f8134038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f8262016800 1 Processor -- start 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f8262016800 1 -- start start 2024-02-16T00:11:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f825d761640 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8134036830 0x7f8134038cf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f825008c060 tx=0x7f8250052f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f8262016800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c3386af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f8262016800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c30d85d0 con 0x5643c33866d0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f825df62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c3386af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f825df62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c3386af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60286/0 (socket says 172.21.15.42:60286) 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f825df62640 1 -- 172.21.15.42:0/1426535057 learned_addr learned my addr 172.21.15.42:0/1426535057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f825df62640 1 -- 172.21.15.42:0/1426535057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c33870c0 con 0x5643c33866d0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.130+0000 7f825df62640 1 --2- 172.21.15.42:0/1426535057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c3386af0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f825804bfa0 tx=0x7f82580139b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa45f78c25ea46f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8140ff9640 1 -- 172.21.15.42:0/1426535057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8258016440 con 0x5643c33866d0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8140ff9640 1 -- 172.21.15.42:0/1426535057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580165a0 con 0x5643c33866d0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8140ff9640 1 -- 172.21.15.42:0/1426535057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f825802b4a0 con 0x5643c33866d0 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 -- 172.21.15.42:0/1426535057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 msgr2=0x5643c3386af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 --2- 172.21.15.42:0/1426535057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c3386af0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f825804bfa0 tx=0x7f82580139b0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 -- 172.21.15.42:0/1426535057 shutdown_connections 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 --2- 172.21.15.42:0/1426535057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c3386af0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 -- 172.21.15.42:0/1426535057 >> 172.21.15.42:0/1426535057 conn(0x5643c33829a0 msgr2=0x5643c3380a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 -- 172.21.15.42:0/1426535057 shutdown_connections 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 -- 172.21.15.42:0/1426535057 wait complete. 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 Processor -- start 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.131+0000 7f8262016800 1 -- start start 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8262016800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c338d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8262016800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c338db00 con 0x5643c33866d0 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f825df62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c338d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f825df62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c338d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60290/0 (socket says 172.21.15.42:60290) 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 learned_addr learned my addr 172.21.15.42:0/118834332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c32646e0 con 0x5643c33866d0 2024-02-16T00:11:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f825df62640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c338d5c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f825804ae90 tx=0x7f825804bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8132ffd640 1 -- 172.21.15.42:0/118834332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8258032070 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8132ffd640 1 -- 172.21.15.42:0/118834332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258013ca0 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643c338dd00 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8132ffd640 1 -- 172.21.15.42:0/118834332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8258016440 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.132+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643c338e1c0 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f8132ffd640 1 -- 172.21.15.42:0/118834332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8258022740 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f8132ffd640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81280367e0 0x7f8128038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f8132ffd640 1 -- 172.21.15.42:0/118834332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8258037c50 con 0x5643c33866d0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f825d761640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81280367e0 0x7f8128038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c3399310 0x5643c339b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c339bf00 con 0x5643c3399310 2024-02-16T00:11:28.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.133+0000 7f825cf60640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c3399310 0x5643c339b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f825d761640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81280367e0 0x7f8128038ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5643c33688e0 tx=0x7f8250091000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f825cf60640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c3399310 0x5643c339b7b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 realm 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c3398880 con 0x5643c3399310 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c339c9d0 con 0x5643c3399310 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.134+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c339cee0 con 0x5643c3399310 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c339dc90 0x5643c33a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c339dc90 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f825df62640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c339dc90 0x5643c33a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f825df62640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c339dc90 0x5643c33a0080 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 20 searching for the correct realm 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5643c33a25e0 0x5643c33a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.135+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a5150 con 0x5643c33a25e0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.136+0000 7f825d761640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5643c33a25e0 0x5643c33a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.136+0000 7f825d761640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5643c33a25e0 0x5643c33a4a80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.136+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.136+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a5150 con 0x5643c339dc90 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.137+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.137+0000 7f825df62640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f82580133b0 0x7f825802c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.137+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.137+0000 7f825cf60640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f82580133b0 0x7f825802c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.137+0000 7f825cf60640 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f82580133b0 0x7f825802c800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.138+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c339dc90 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.139+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c339dc90 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.140+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.141+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c339dc90 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.142+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.143+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x5643c3399310 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.143+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.143+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.143+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.143+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.143+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254006070 con 0x7f82580133b0 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c339dc90 2024-02-16T00:11:28.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c33a25e0 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x7f82580133b0 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c3399310 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.144+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0600 con 0x5643c339dc90 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:28.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a0f00 con 0x5643c3399310 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a12b0 con 0x5643c3399310 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a1690 con 0x5643c3399310 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:28.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 zone default found 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 4 Realm: () 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 zonegroup default 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.145+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a5590 con 0x7f82580133b0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a7410 con 0x5643c33a25e0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.146+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a7770 con 0x5643c33a25e0 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.147+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.147+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.147+0000 7f8262016800 20 started sync module instance, tier type = 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.147+0000 7f8262016800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.147+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a68a0 con 0x5643c339dc90 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.148+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.148+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849038183776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a68a0 con 0x5643c339dc90 2024-02-16T00:11:28.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.148+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a81e0 con 0x5643c3399310 2024-02-16T00:11:28.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.149+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849038183776] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.149+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.149+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849038187712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a68a0 con 0x5643c3399310 2024-02-16T00:11:28.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.149+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a8c80 con 0x5643c33a25e0 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.150+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849038187712] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.150+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.150+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849038181376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a6820 con 0x5643c33a25e0 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.150+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a9ae0 con 0x5643c339dc90 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.151+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849038181376] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.151+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.151+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849038194240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33a9f00 con 0x5643c339dc90 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.151+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33aa870 con 0x5643c3399310 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.152+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.152+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849038197712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33aa830 con 0x5643c3399310 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.152+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ab7f0 con 0x7f82580133b0 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.152+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849038194240] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.153+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849038197712] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.153+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.153+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849038201616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33aaa10 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.153+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ac040 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.154+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849038201616] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.154+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.154+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849038195296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33abc90 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.154+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ac640 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849038195296] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849038202864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ac7e0 con 0x7f82580133b0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=0 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=1 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=2 2024-02-16T00:11:28.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=3 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=4 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=5 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.155+0000 7f8262016800 20 add_watcher() i=6 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.156+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849038202864] v27'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.156+0000 7f8262016800 20 add_watcher() i=7 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.156+0000 7f8262016800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.156+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33afba0 con 0x5643c3399310 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.156+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.156+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849038218656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ac840 con 0x5643c3399310 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.157+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849038218656] v27'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f81137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 5 note: GC not initialized 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f81127e4640 20 reqs_thread_entry: start 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 20 Filter name: none 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8083fff640 20 reqs_thread_entry: start 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.158+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33e1a20 con 0x5643c339dc90 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33e22a0 con 0x5643c3399310 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(63 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33e22e0 con 0x5643c339dc90 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.159+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33e3a10 con 0x5643c3399310 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:28.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 4.37 4:ee0f1f05:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33e3050 con 0x7f82580133b0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 4.15 4:abe4bfab:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33e8530 con 0x5643c33a25e0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 4.2b 4:d618bfba:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ead50 con 0x5643c3399310 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 4.15 4:aabdf911:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33ed5f0 con 0x5643c33a25e0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 4.c 4:31d7e51e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33f02f0 con 0x5643c3399310 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 4.6 4:62d3c06f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33f2de0 con 0x5643c33a25e0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:72 4.d 4:b3faa860:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33f5c20 con 0x5643c33a25e0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 4.38 4:1ed234cf:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33f89e0 con 0x5643c3399310 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:74 4.3d 4:bd5d1908:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33f02f0 con 0x5643c33a25e0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 4.21 4:85da9115:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33fd8d0 con 0x7f82580133b0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 4.34 4:2ee72343:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c3400310 con 0x5643c339dc90 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(66 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8254037040 con 0x5643c3399310 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.160+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8254037040 con 0x7f82580133b0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(71 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(76 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(69 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(72 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(74 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f8262016800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 6.d 6:b6a2947b:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33eec50 con 0x5643c3399310 2024-02-16T00:11:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(77 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f825404a040 con 0x5643c3399310 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.161+0000 7f8262016800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.162+0000 7f81137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.162+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849038218656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x5643c3399310 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.163+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94849038218656] v27'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f825404a040 con 0x5643c3399310 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.163+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849038183776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x5643c339dc90 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.164+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94849038183776] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.164+0000 7f8262016800 20 remove_watcher() i=0 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.164+0000 7f8262016800 2 removed watcher, disabling cache 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.164+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849038187712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x5643c3399310 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.165+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94849038187712] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825404a040 con 0x5643c3399310 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.165+0000 7f8262016800 20 remove_watcher() i=1 2024-02-16T00:11:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.165+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849038181376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x5643c33a25e0 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.166+0000 7f825d761640 1 -- 172.21.15.42:0/118834332 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94849038181376] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8250059040 con 0x5643c33a25e0 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.166+0000 7f8262016800 20 remove_watcher() i=2 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.166+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849038194240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x5643c339dc90 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.167+0000 7f825df62640 1 -- 172.21.15.42:0/118834332 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94849038194240] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825800a4a0 con 0x5643c339dc90 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.167+0000 7f8262016800 20 remove_watcher() i=3 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.167+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849038197712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x5643c3399310 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.168+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94849038197712] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825404a040 con 0x5643c3399310 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.168+0000 7f8262016800 20 remove_watcher() i=4 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.168+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849038201616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x7f82580133b0 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.169+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94849038201616] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825404a040 con 0x7f82580133b0 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.169+0000 7f8262016800 20 remove_watcher() i=5 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.169+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849038195296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x7f82580133b0 2024-02-16T00:11:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.170+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94849038195296] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825404a040 con 0x7f82580133b0 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.170+0000 7f8262016800 20 remove_watcher() i=6 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.170+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849038202864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5643c33cb800 con 0x7f82580133b0 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94849038202864] v27'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f825404a040 con 0x7f82580133b0 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 20 remove_watcher() i=7 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f82580133b0 msgr2=0x7f825802c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f82580133b0 0x7f825802c800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c3399310 msgr2=0x5643c339b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c3399310 0x5643c339b7b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c339dc90 msgr2=0x5643c33a0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c339dc90 0x5643c33a0080 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5643c33a25e0 msgr2=0x5643c33a4a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5643c33a25e0 0x5643c33a4a80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81280367e0 msgr2=0x7f8128038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81280367e0 0x7f8128038ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5643c33688e0 tx=0x7f8250091000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 msgr2=0x5643c338d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f825cf60640 1 -- 172.21.15.42:0/118834332 reap_dead start 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c338d5c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f825804ae90 tx=0x7f825804bf00 comp rx=0 tx=0).stop 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 shutdown_connections 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 --2- 172.21.15.42:0/118834332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c33866d0 0x5643c338d5c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 >> 172.21.15.42:0/118834332 conn(0x5643c33829a0 msgr2=0x5643c3380000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 shutdown_connections 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.171+0000 7f8262016800 1 -- 172.21.15.42:0/118834332 wait complete. 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8134036830 msgr2=0x7f8134038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8134036830 0x7f8134038cf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f825008c060 tx=0x7f8250052f60 comp rx=0 tx=0).stop 2024-02-16T00:11:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 msgr2=0x5643c3263af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 0x5643c3263af0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x5643c335d930 tx=0x7f8258018830 comp rx=0 tx=0).stop 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 shutdown_connections 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8134036830 0x7f8134038cf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/2261689513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c3265680 0x5643c3263af0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 >> 172.21.15.42:0/2261689513 conn(0x5643c336b2f0 msgr2=0x5643c336b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 shutdown_connections 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/2261689513 wait complete. 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c32680b0 msgr2=0x5643c3363230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c32680b0 0x5643c3363230 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c3365a40 msgr2=0x5643c3367e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c3365a40 0x5643c3367e30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81440367e0 msgr2=0x7f8144038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81440367e0 0x7f8144038ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8254000f60 tx=0x7f82540012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 msgr2=0x5643c335c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c335c530 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f825005f040 tx=0x7f8250002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 shutdown_connections 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5643c3365a40 0x5643c3367e30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5643c32680b0 0x5643c3363230 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f81440367e0 0x7f8144038ca0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 --2- 172.21.15.42:0/4193879237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643c31d8120 0x5643c335c530 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 >> 172.21.15.42:0/4193879237 conn(0x5643c325f4d0 msgr2=0x5643c3353960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 shutdown_connections 2024-02-16T00:11:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.172+0000 7f8262016800 1 -- 172.21.15.42:0/4193879237 wait complete. 2024-02-16T00:11:28.194 INFO:teuthology.orchestra.run.smithi042.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7d041155-908e-42d6-a32d-d2f504649d95","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","marker":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T00:11:27.687574Z","creation_time":"2024-02-16T00:11:24.745033Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T00:11:28.194 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7d041155-908e-42d6-a32d-d2f504649d95', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'marker': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T00:11:27.687574Z', 'creation_time': '2024-02-16T00:11:24.745033Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T00:11:28.195 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-02-16T00:11:28.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-02-16T00:11:28.195 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-02-16T00:11:28.274 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:28.274 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:28.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.272+0000 7fe37949d800 1 Processor -- start 2024-02-16T00:11:28.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.272+0000 7fe37949d800 1 -- start start 2024-02-16T00:11:28.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.272+0000 7fe37949d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55921d194330 0x55921d196720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.272+0000 7fe37949d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55921d0dbba0 con 0x55921d18fea0 2024-02-16T00:11:28.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.272+0000 7fe37949d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55921d093450 con 0x55921d194330 2024-02-16T00:11:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.273+0000 7fe3767a2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55921d194330 0x55921d196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.273+0000 7fe376fa3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55921d18fea0 0x55921d1902c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60552/0 (socket says 172.21.15.42:60552) 2024-02-16T00:11:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.273+0000 7fe3767a2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55921d194330 0x55921d196720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60296/0 (socket says 172.21.15.42:60296) 2024-02-16T00:11:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.273+0000 7fe376fa3640 1 -- 172.21.15.42:0/2350495205 learned_addr learned my addr 172.21.15.42:0/2350495205 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.273+0000 7fe3767a2640 1 -- 172.21.15.42:0/2350495205 >> v1:172.21.15.2:6789/0 conn(0x55921d18fea0 legacy=0x55921d1902c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.273+0000 7fe3767a2640 1 -- 172.21.15.42:0/2350495205 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921d197d50 con 0x55921d194330 2024-02-16T00:11:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.275+0000 7fe3767a2640 1 --2- 172.21.15.42:0/2350495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d194330 0x55921d196720 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00a470 tx=0x7fe36c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92af6b962ac53d5d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.275+0000 7fe375fa1640 1 -- 172.21.15.42:0/2350495205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe36c052570 con 0x55921d194330 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.275+0000 7fe375fa1640 1 -- 172.21.15.42:0/2350495205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c0526d0 con 0x55921d194330 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.275+0000 7fe375fa1640 1 -- 172.21.15.42:0/2350495205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe36c052990 con 0x55921d194330 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.275+0000 7fe37949d800 1 -- 172.21.15.42:0/2350495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d194330 msgr2=0x55921d196720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.275+0000 7fe37949d800 1 --2- 172.21.15.42:0/2350495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d194330 0x55921d196720 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00a470 tx=0x7fe36c01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.276+0000 7fe37949d800 1 -- 172.21.15.42:0/2350495205 shutdown_connections 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.276+0000 7fe37949d800 1 --2- 172.21.15.42:0/2350495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d194330 0x55921d196720 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.276+0000 7fe37949d800 1 -- 172.21.15.42:0/2350495205 >> 172.21.15.42:0/2350495205 conn(0x55921d18b460 msgr2=0x55921d18d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.276+0000 7fe37949d800 1 -- 172.21.15.42:0/2350495205 shutdown_connections 2024-02-16T00:11:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.276+0000 7fe37949d800 1 -- 172.21.15.42:0/2350495205 wait complete. 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.287+0000 7fe37949d800 1 Processor -- start 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.287+0000 7fe37949d800 1 -- start start 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.287+0000 7fe37949d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d27fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.287+0000 7fe37949d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921d090980 con 0x55921d18fea0 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe376fa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d27fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe376fa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d27fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60302/0 (socket says 172.21.15.42:60302) 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe376fa3640 1 -- 172.21.15.42:0/339890275 learned_addr learned my addr 172.21.15.42:0/339890275 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe376fa3640 1 -- 172.21.15.42:0/339890275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c005d20 con 0x55921d18fea0 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe376fa3640 1 --2- 172.21.15.42:0/339890275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d27fea0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe368001bf0 tx=0x7fe36800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56311383072d0be0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe264e09640 1 -- 172.21.15.42:0/339890275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe368010070 con 0x55921d18fea0 2024-02-16T00:11:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe264e09640 1 -- 172.21.15.42:0/339890275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800b110 con 0x55921d18fea0 2024-02-16T00:11:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.288+0000 7fe264e09640 1 -- 172.21.15.42:0/339890275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe368009460 con 0x55921d18fea0 2024-02-16T00:11:28.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- 172.21.15.42:0/339890275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 msgr2=0x55921d27fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 --2- 172.21.15.42:0/339890275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d27fea0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe368001bf0 tx=0x7fe36800b850 comp rx=0 tx=0).stop 2024-02-16T00:11:28.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- 172.21.15.42:0/339890275 shutdown_connections 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 --2- 172.21.15.42:0/339890275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d27fea0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- 172.21.15.42:0/339890275 >> 172.21.15.42:0/339890275 conn(0x55921d18b460 msgr2=0x55921d27b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- 172.21.15.42:0/339890275 shutdown_connections 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- 172.21.15.42:0/339890275 wait complete. 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 Processor -- start 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- start start 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d286470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.289+0000 7fe37949d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921d08c160 con 0x55921d18fea0 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe376fa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d286470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe376fa3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d286470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60306/0 (socket says 172.21.15.42:60306) 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe376fa3640 1 -- 172.21.15.42:0/2665290929 learned_addr learned my addr 172.21.15.42:0/2665290929 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe376fa3640 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921d0dbba0 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe376fa3640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d286470 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe368001bf0 tx=0x7fe368000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe263606640 1 -- 172.21.15.42:0/2665290929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe36801d040 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe263606640 1 -- 172.21.15.42:0/2665290929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368016640 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe263606640 1 -- 172.21.15.42:0/2665290929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3680168e0 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55921d2869b0 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.290+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55921d286e90 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.291+0000 7fe263606640 1 -- 172.21.15.42:0/2665290929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe368016a40 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.291+0000 7fe263606640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe25c036790 0x7fe25c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.291+0000 7fe263606640 1 -- 172.21.15.42:0/2665290929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe36804da10 con 0x55921d18fea0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.291+0000 7fe3767a2640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe25c036790 0x7fe25c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d194330 0x55921d28d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d28d730 con 0x55921d194330 2024-02-16T00:11:28.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe3777a4640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d194330 0x55921d28d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe3767a2640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe25c036790 0x7fe25c038c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe36c054000 tx=0x7fe36c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe3777a4640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d194330 0x55921d28d160 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe3777a4640 1 -- 172.21.15.42:0/2665290929 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe37000a4a0 con 0x55921d194330 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d28a830 con 0x55921d194330 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.292+0000 7fe3777a4640 1 -- 172.21.15.42:0/2665290929 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe37000a4a0 con 0x55921d194330 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d28f950 0x55921d291d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d292430 con 0x55921d28f950 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe376fa3640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d28f950 0x55921d291d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe376fa3640 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d28f950 0x55921d291d40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe376fa3640 1 -- 172.21.15.42:0/2665290929 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe368047db0 con 0x55921d28f950 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d28e8d0 con 0x55921d194330 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe3777a4640 1 -- 172.21.15.42:0/2665290929 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe37000a4a0 con 0x55921d194330 2024-02-16T00:11:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.293+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d28ecc0 con 0x55921d194330 2024-02-16T00:11:28.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe3777a4640 1 -- 172.21.15.42:0/2665290929 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe37000a4a0 con 0x55921d194330 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe37949d800 1 Processor -- start 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe37949d800 1 -- start start 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe37949d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 0x55921d2a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe37949d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921d02ee80 con 0x55921d2a1200 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe3777a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 0x55921d2a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe3777a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 0x55921d2a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60322/0 (socket says 172.21.15.42:60322) 2024-02-16T00:11:28.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.294+0000 7fe3777a4640 1 -- 172.21.15.42:0/1324809510 learned_addr learned my addr 172.21.15.42:0/1324809510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe3777a4640 1 -- 172.21.15.42:0/1324809510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921d2a1b60 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe3777a4640 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 0x55921d2a1620 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55921d287820 tx=0x7fe370018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe260e01640 1 -- 172.21.15.42:0/1324809510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe37001d070 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe260e01640 1 -- 172.21.15.42:0/1324809510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3700182e0 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55921d2a25d0 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe260e01640 1 -- 172.21.15.42:0/1324809510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3700145a0 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.295+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55921d2a2a90 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe260e01640 1 -- 172.21.15.42:0/1324809510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe370020020 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe260e01640 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe250036830 0x7fe250038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe260e01640 1 -- 172.21.15.42:0/1324809510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe37004dc40 con 0x55921d2a1200 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe376fa3640 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe250036830 0x7fe250038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe37949d800 1 Processor -- start 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe37949d800 1 -- start start 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.296+0000 7fe376fa3640 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe250036830 0x7fe250038cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55921d28db00 tx=0x7fe368022f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe37949d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe37949d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921d0045d0 con 0x55921d2b28f0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe3777a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe3777a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60336/0 (socket says 172.21.15.42:60336) 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe3777a4640 1 -- 172.21.15.42:0/1777525701 learned_addr learned my addr 172.21.15.42:0/1777525701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe3777a4640 1 -- 172.21.15.42:0/1777525701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921d2b32e0 con 0x55921d2b28f0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe3777a4640 1 --2- 172.21.15.42:0/1777525701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b2d10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe37004bfc0 tx=0x7fe370011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd4433893c2091d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe25a7fc640 1 -- 172.21.15.42:0/1777525701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe37002bc50 con 0x55921d2b28f0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.297+0000 7fe25a7fc640 1 -- 172.21.15.42:0/1777525701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37002bdb0 con 0x55921d2b28f0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe25a7fc640 1 -- 172.21.15.42:0/1777525701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3700133b0 con 0x55921d2b28f0 2024-02-16T00:11:28.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- 172.21.15.42:0/1777525701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 msgr2=0x55921d2b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 --2- 172.21.15.42:0/1777525701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b2d10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe37004bfc0 tx=0x7fe370011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- 172.21.15.42:0/1777525701 shutdown_connections 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 --2- 172.21.15.42:0/1777525701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b2d10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- 172.21.15.42:0/1777525701 >> 172.21.15.42:0/1777525701 conn(0x55921d2aa760 msgr2=0x55921d2a87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- 172.21.15.42:0/1777525701 shutdown_connections 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- 172.21.15.42:0/1777525701 wait complete. 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 Processor -- start 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- start start 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.298+0000 7fe37949d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921d2b9c30 con 0x55921d2b28f0 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe3777a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe3777a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60346/0 (socket says 172.21.15.42:60346) 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 learned_addr learned my addr 172.21.15.42:0/1079854974 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921d2a2a90 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe3777a4640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b96f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe37004aeb0 tx=0x7fe37004bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe258ff9640 1 -- 172.21.15.42:0/1079854974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe370032070 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe258ff9640 1 -- 172.21.15.42:0/1079854974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37002b350 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55921d2b9e30 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe258ff9640 1 -- 172.21.15.42:0/1079854974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe37002b5f0 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.299+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55921d2ba2f0 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe258ff9640 1 -- 172.21.15.42:0/1079854974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe37002b750 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe258ff9640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2400367e0 0x7fe240038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe258ff9640 1 -- 172.21.15.42:0/1079854974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe3700420c0 con 0x55921d2b28f0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe376fa3640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2400367e0 0x7fe240038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d2c5370 0x55921d2c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.300+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2c7f80 con 0x55921d2c5370 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe3767a2640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d2c5370 0x55921d2c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe376fa3640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2400367e0 0x7fe240038ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe368001250 tx=0x7fe368042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe3767a2640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d2c5370 0x55921d2c7830 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 20 realm 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2c8310 con 0x55921d2c5370 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2c8b90 con 0x55921d2c5370 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.301+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2c8ef0 con 0x55921d2c5370 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d2c9c00 0x55921d2cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cc530 con 0x55921d2c9c00 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe3777a4640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d2c9c00 0x55921d2cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe3777a4640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d2c9c00 0x55921d2cbff0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe37000a4a0 con 0x55921d2c9c00 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 20 searching for the correct realm 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55921d2ce2c0 0x55921d2d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.302+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d0ce0 con 0x55921d2ce2c0 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.303+0000 7fe376fa3640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55921d2ce2c0 0x55921d2d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.303+0000 7fe376fa3640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55921d2ce2c0 0x55921d2d06b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.303+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.303+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d0ce0 con 0x55921d2c9c00 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.304+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe37000a4a0 con 0x55921d2c9c00 2024-02-16T00:11:28.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.304+0000 7fe3777a4640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe370040030 0x7fe37002d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.304+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.304+0000 7fe3767a2640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe370040030 0x7fe37002d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.304+0000 7fe3767a2640 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe370040030 0x7fe37002d8e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.305+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.306+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.307+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.307+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.307+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.307+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.307+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.307+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.308+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.309+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.310+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.311+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.311+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.311+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.311+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.311+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.311+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.312+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2ccda0 con 0x55921d2c5370 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd150 con 0x55921d2c5370 2024-02-16T00:11:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd530 con 0x55921d2c5370 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 zone default found 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 4 Realm: () 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 zonegroup default 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.313+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d1120 con 0x7fe370040030 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d2fa0 con 0x55921d2ce2c0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe37949d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.314+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d3300 con 0x55921d2ce2c0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.315+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.315+0000 7fe37949d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.315+0000 7fe37949d800 20 started sync module instance, tier type = 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.315+0000 7fe37949d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.315+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d2570 con 0x55921d2c9c00 2024-02-16T00:11:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.316+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.316+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94086043085088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d2570 con 0x55921d2c9c00 2024-02-16T00:11:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.316+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d3d20 con 0x55921d2c5370 2024-02-16T00:11:28.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.317+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94086043085088] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.317+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.317+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94086043088928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d2570 con 0x55921d2c5370 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.317+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d47a0 con 0x55921d2ce2c0 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.318+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.318+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94086043091616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d5030 con 0x55921d2ce2c0 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.318+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d5ae0 con 0x55921d2c9c00 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.318+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94086043088928] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.319+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94086043091616] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.319+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.319+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94086043096544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d4b50 con 0x55921d2c9c00 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.319+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d64a0 con 0x55921d2c5370 2024-02-16T00:11:28.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.320+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.320+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94086043099136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d68c0 con 0x55921d2c5370 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.320+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d7340 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.320+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94086043096544] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.321+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.321+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94086043102784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d7300 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.321+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94086043099136] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.321+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d6460 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.322+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94086043102784] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.322+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.322+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94086043100256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d7890 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.322+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d8200 con 0x7fe370040030 2024-02-16T00:11:28.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94086043100256] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94086043082960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d8200 con 0x7fe370040030 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=0 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=1 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=2 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=3 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=4 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=5 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.323+0000 7fe37949d800 20 add_watcher() i=6 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.324+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94086043082960] v27'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.324+0000 7fe37949d800 20 add_watcher() i=7 2024-02-16T00:11:28.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.324+0000 7fe37949d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.324+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2dba60 con 0x55921d2c5370 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.324+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.324+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94086043108752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d8f20 con 0x55921d2c5370 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.325+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94086043108752] v27'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.325+0000 7fe22d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.325+0000 7fe37949d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.325+0000 7fe37949d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.325+0000 7fe37949d800 5 note: GC not initialized 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.326+0000 7fe1a7fff640 20 reqs_thread_entry: start 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.326+0000 7fe37949d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.326+0000 7fe37949d800 20 Filter name: none 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.326+0000 7fe1a5ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:28.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.326+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d30cc70 con 0x7fe370040030 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.327+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(62 [pgnls start_epoch 27 out=254b] v27'46 uv30 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.327+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd530 con 0x7fe370040030 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.327+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(63 [pgnls start_epoch 27 out=131b] v27'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.327+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd530 con 0x55921d2ce2c0 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.328+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 [pgnls start_epoch 27 out=295b] v27'35 uv27 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.328+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd530 con 0x7fe370040030 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.328+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(65 [pgnls start_epoch 27 out=172b] v27'23 uv15 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.328+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd530 con 0x55921d2c5370 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.328+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(66 [pgnls start_epoch 27 out=335b] v27'152 uv29 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.328+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2cd530 con 0x55921d2c9c00 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(67 [pgnls start_epoch 27 out=213b] v27'22 uv22 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(68 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(69 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(70 [pgnls start_epoch 27 out=213b] v27'16 uv16 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.329+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.330+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(71 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.330+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.330+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 [pgnls start_epoch 27 out=336b] v27'35 uv27 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.330+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.330+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=131b] v27'29 uv21 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.330+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=254b] v27'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(75 [pgnls start_epoch 27 out=90b] v27'29 uv21 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(76 [pgnls start_epoch 27 out=213b] v27'25 uv17 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=254b] v27'16 uv16 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.331+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.332+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(78 [pgnls start_epoch 27 out=254b] v27'20 uv20 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.332+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.332+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(79 [pgnls start_epoch 27 out=213b] v27'25 uv17 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.332+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.332+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(80 [pgnls start_epoch 27 out=172b] v27'40 uv24 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.332+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.333+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(81 [pgnls start_epoch 27 out=295b] v27'48 uv39 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.333+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.333+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(82 [pgnls start_epoch 27 out=276b] v27'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.333+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.333+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(83 [pgnls start_epoch 27 out=172b] v27'23 uv15 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.333+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.334+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(84 [pgnls start_epoch 27 out=295b] v27'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.334+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.334+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(85 [pgnls start_epoch 27 out=172b] v27'35 uv18 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.334+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.334+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(86 [pgnls start_epoch 27 out=213b] v27'49 uv25 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.334+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.335+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(87 [pgnls start_epoch 27 out=172b] v27'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.335+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.335+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(88 [pgnls start_epoch 27 out=172b] v27'23 uv15 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.335+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.335+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(89 [pgnls start_epoch 27 out=90b] v27'19 uv11 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.335+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2ce2c0 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.336+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(90 [pgnls start_epoch 27 out=90b] v27'43 uv19 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.336+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c5370 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.336+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(91 [pgnls start_epoch 27 out=131b] v27'12 uv12 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.336+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x55921d2c9c00 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.336+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(92 [pgnls start_epoch 27 out=295b] v27'24 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.336+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe370037030 con 0x7fe370040030 2024-02-16T00:11:28.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.337+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(93 [pgnls start_epoch 27 out=213b] v27'25 uv17 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.355 INFO:teuthology.orchestra.run.smithi042.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-02-16T00:11:28.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.338+0000 7fe22d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.338+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94086043108752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d30c300 con 0x55921d2c5370 2024-02-16T00:11:28.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.339+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94086043108752] v27'153 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.339+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94086043085088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d8590 con 0x55921d2c9c00 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.340+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94086043085088] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.340+0000 7fe37949d800 20 remove_watcher() i=0 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.340+0000 7fe37949d800 2 removed watcher, disabling cache 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.340+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94086043088928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d2920 con 0x55921d2c5370 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.341+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94086043088928] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.341+0000 7fe37949d800 20 remove_watcher() i=1 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.341+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94086043091616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d2920 con 0x55921d2ce2c0 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.342+0000 7fe376fa3640 1 -- 172.21.15.42:0/1079854974 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94086043091616] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe368047db0 con 0x55921d2ce2c0 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.342+0000 7fe37949d800 20 remove_watcher() i=2 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.342+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94086043096544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d3820 con 0x55921d2c9c00 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.343+0000 7fe3777a4640 1 -- 172.21.15.42:0/1079854974 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94086043096544] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe370062040 con 0x55921d2c9c00 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.343+0000 7fe37949d800 20 remove_watcher() i=3 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.343+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94086043099136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d3820 con 0x55921d2c5370 2024-02-16T00:11:28.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.344+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94086043099136] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x55921d2c5370 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.344+0000 7fe37949d800 20 remove_watcher() i=4 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.344+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94086043102784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d6000 con 0x7fe370040030 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.345+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94086043102784] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.345+0000 7fe37949d800 20 remove_watcher() i=5 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.345+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94086043100256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d3820 con 0x7fe370040030 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.346+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94086043100256] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.346+0000 7fe37949d800 20 remove_watcher() i=6 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.346+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94086043082960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55921d2d6e40 con 0x7fe370040030 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94086043082960] v27'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe36c059040 con 0x7fe370040030 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 20 remove_watcher() i=7 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe370040030 msgr2=0x7fe37002d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe370040030 0x7fe37002d8e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d2c5370 msgr2=0x55921d2c7830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d2c5370 0x55921d2c7830 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d2c9c00 msgr2=0x55921d2cbff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d2c9c00 0x55921d2cbff0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55921d2ce2c0 msgr2=0x55921d2d06b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55921d2ce2c0 0x55921d2d06b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2400367e0 msgr2=0x7fe240038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2400367e0 0x7fe240038ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe368001250 tx=0x7fe368042000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 msgr2=0x55921d2b96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b96f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe37004aeb0 tx=0x7fe37004bf20 comp rx=0 tx=0).stop 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe3767a2640 1 -- 172.21.15.42:0/1079854974 reap_dead start 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 shutdown_connections 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1079854974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2b28f0 0x55921d2b96f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 >> 172.21.15.42:0/1079854974 conn(0x55921d2aa760 msgr2=0x55921d2a7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 shutdown_connections 2024-02-16T00:11:28.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1079854974 wait complete. 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe250036830 msgr2=0x7fe250038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe250036830 0x7fe250038cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55921d28db00 tx=0x7fe368022f00 comp rx=0 tx=0).stop 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 msgr2=0x55921d2a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 0x55921d2a1620 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55921d287820 tx=0x7fe370018830 comp rx=0 tx=0).stop 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 shutdown_connections 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe250036830 0x7fe250038cf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 --2- 172.21.15.42:0/1324809510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d2a1200 0x55921d2a1620 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.348+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 >> 172.21.15.42:0/1324809510 conn(0x55921d2952a0 msgr2=0x55921d2956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 shutdown_connections 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/1324809510 wait complete. 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d194330 msgr2=0x55921d28d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d194330 0x55921d28d160 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d28f950 msgr2=0x55921d291d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d28f950 0x55921d291d40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe25c036790 msgr2=0x7fe25c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe25c036790 0x7fe25c038c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe36c054000 tx=0x7fe36c04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 msgr2=0x55921d286470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d286470 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe368001bf0 tx=0x7fe368000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 shutdown_connections 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55921d28f950 0x55921d291d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55921d194330 0x55921d28d160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe25c036790 0x7fe25c038c50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 --2- 172.21.15.42:0/2665290929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55921d18fea0 0x55921d286470 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 >> 172.21.15.42:0/2665290929 conn(0x55921d18b460 msgr2=0x55921d27e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 shutdown_connections 2024-02-16T00:11:28.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.349+0000 7fe37949d800 1 -- 172.21.15.42:0/2665290929 wait complete. 2024-02-16T00:11:28.366 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-02-16T00:11:28.366 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-16T00:11:28.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-16T00:11:28.366 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-16T00:11:28.442 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:28.442 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:28.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.440+0000 7f7e1b610800 1 Processor -- start 2024-02-16T00:11:28.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.440+0000 7f7e1b610800 1 -- start start 2024-02-16T00:11:28.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e1b610800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5648a2c865b0 0x5648a2c889a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e1b610800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5648a2bccbb0 con 0x5648a2c82aa0 2024-02-16T00:11:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e1b610800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5648a2b84450 con 0x5648a2c865b0 2024-02-16T00:11:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e165c4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5648a2c865b0 0x5648a2c889a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e16dc5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5648a2c82aa0 0x5648a2c84e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60558/0 (socket says 172.21.15.42:60558) 2024-02-16T00:11:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e16dc5640 1 -- 172.21.15.42:0/645846526 learned_addr learned my addr 172.21.15.42:0/645846526 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e165c4640 1 -- 172.21.15.42:0/645846526 >> v1:172.21.15.2:6789/0 conn(0x5648a2c82aa0 legacy=0x5648a2c84e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.441+0000 7f7e165c4640 1 -- 172.21.15.42:0/645846526 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a2c89ef0 con 0x5648a2c865b0 2024-02-16T00:11:28.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.443+0000 7f7e165c4640 1 --2- 172.21.15.42:0/645846526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c865b0 0x5648a2c889a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000a470 tx=0x7f7e0001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b5e78e9214382e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.443+0000 7f7e15dc3640 1 -- 172.21.15.42:0/645846526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e00052570 con 0x5648a2c865b0 2024-02-16T00:11:28.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.443+0000 7f7e15dc3640 1 -- 172.21.15.42:0/645846526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000526d0 con 0x5648a2c865b0 2024-02-16T00:11:28.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.443+0000 7f7e15dc3640 1 -- 172.21.15.42:0/645846526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e00052990 con 0x5648a2c865b0 2024-02-16T00:11:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 -- 172.21.15.42:0/645846526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c865b0 msgr2=0x5648a2c889a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 --2- 172.21.15.42:0/645846526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c865b0 0x5648a2c889a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000a470 tx=0x7f7e0001cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 -- 172.21.15.42:0/645846526 shutdown_connections 2024-02-16T00:11:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 --2- 172.21.15.42:0/645846526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c865b0 0x5648a2c889a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 -- 172.21.15.42:0/645846526 >> 172.21.15.42:0/645846526 conn(0x5648a2c7c4d0 msgr2=0x5648a2c7e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 -- 172.21.15.42:0/645846526 shutdown_connections 2024-02-16T00:11:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.444+0000 7f7e1b610800 1 -- 172.21.15.42:0/645846526 wait complete. 2024-02-16T00:11:28.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.455+0000 7f7e1b610800 1 Processor -- start 2024-02-16T00:11:28.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.455+0000 7f7e1b610800 1 -- start start 2024-02-16T00:11:28.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.455+0000 7f7e1b610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2d72010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.455+0000 7f7e1b610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a2b81980 con 0x5648a2c82aa0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7e16dc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2d72010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7e16dc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2d72010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60364/0 (socket says 172.21.15.42:60364) 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7e16dc5640 1 -- 172.21.15.42:0/3984789612 learned_addr learned my addr 172.21.15.42:0/3984789612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7e16dc5640 1 -- 172.21.15.42:0/3984789612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00005d20 con 0x5648a2c82aa0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/3984789612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2d72010 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e08001c50 tx=0x7f7e0800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cd5454df854b5e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7d04e09640 1 -- 172.21.15.42:0/3984789612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e0800e470 con 0x5648a2c82aa0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7d04e09640 1 -- 172.21.15.42:0/3984789612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0800e5d0 con 0x5648a2c82aa0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.456+0000 7f7d04e09640 1 -- 172.21.15.42:0/3984789612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e0800e8d0 con 0x5648a2c82aa0 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 -- 172.21.15.42:0/3984789612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 msgr2=0x5648a2d72010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 --2- 172.21.15.42:0/3984789612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2d72010 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e08001c50 tx=0x7f7e0800b6c0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 -- 172.21.15.42:0/3984789612 shutdown_connections 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 --2- 172.21.15.42:0/3984789612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2d72010 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 -- 172.21.15.42:0/3984789612 >> 172.21.15.42:0/3984789612 conn(0x5648a2c7c4d0 msgr2=0x5648a2d6d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 -- 172.21.15.42:0/3984789612 shutdown_connections 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.457+0000 7f7e1b610800 1 -- 172.21.15.42:0/3984789612 wait complete. 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e1b610800 1 Processor -- start 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e1b610800 1 -- start start 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e1b610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2c82390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e1b610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a2b7d160 con 0x5648a2c82aa0 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e16dc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2c82390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e16dc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2c82390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60368/0 (socket says 172.21.15.42:60368) 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e16dc5640 1 -- 172.21.15.42:0/832934767 learned_addr learned my addr 172.21.15.42:0/832934767 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e16dc5640 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a2bccbb0 con 0x5648a2c82aa0 2024-02-16T00:11:28.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2c82390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.458+0000 7f7d03606640 1 -- 172.21.15.42:0/832934767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e0801f070 con 0x5648a2c82aa0 2024-02-16T00:11:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.459+0000 7f7d03606640 1 -- 172.21.15.42:0/832934767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08018770 con 0x5648a2c82aa0 2024-02-16T00:11:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.459+0000 7f7d03606640 1 -- 172.21.15.42:0/832934767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e08018a30 con 0x5648a2c82aa0 2024-02-16T00:11:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.459+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648a2c828d0 con 0x5648a2c82aa0 2024-02-16T00:11:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.459+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648a2c80e20 con 0x5648a2c82aa0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.459+0000 7f7d03606640 1 -- 172.21.15.42:0/832934767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7e08018c20 con 0x5648a2c82aa0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.459+0000 7f7d03606640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cfc0367e0 0x7f7cfc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7d03606640 1 -- 172.21.15.42:0/832934767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7e0804c320 con 0x5648a2c82aa0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e165c4640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cfc0367e0 0x7f7cfc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2c865b0 0x5648a2d82a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2c81730 con 0x5648a2c865b0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e175c6640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2c865b0 0x5648a2d82a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e165c4640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cfc0367e0 0x7f7cfc038ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e00054000 tx=0x7f7e0004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e175c6640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2c865b0 0x5648a2d82a00 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e175c6640 1 -- 172.21.15.42:0/832934767 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2c865b0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.460+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2d82f80 con 0x5648a2c865b0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e175c6640 1 -- 172.21.15.42:0/832934767 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2c865b0 2024-02-16T00:11:28.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2d84d10 0x5648a2d87100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2d877d0 con 0x5648a2d84d10 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2d84d10 0x5648a2d87100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2d84d10 0x5648a2d87100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e16dc5640 1 -- 172.21.15.42:0/832934767 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2d84d10 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.461+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2d83c90 con 0x5648a2c865b0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e175c6640 1 -- 172.21.15.42:0/832934767 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2c865b0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2d84080 con 0x5648a2c865b0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e175c6640 1 -- 172.21.15.42:0/832934767 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2c865b0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e1b610800 1 Processor -- start 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e1b610800 1 -- start start 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e1b610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 0x5648a2d96a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.462+0000 7f7e1b610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a2b1fe80 con 0x5648a2d965e0 2024-02-16T00:11:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e175c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 0x5648a2d96a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e175c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 0x5648a2d96a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60372/0 (socket says 172.21.15.42:60372) 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e175c6640 1 -- 172.21.15.42:0/1020633031 learned_addr learned my addr 172.21.15.42:0/1020633031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e175c6640 1 -- 172.21.15.42:0/1020633031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a2d96f40 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e175c6640 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 0x5648a2d96a00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x5648a2c81a90 tx=0x7f7e10018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7d00e01640 1 -- 172.21.15.42:0/1020633031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e1001d070 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7d00e01640 1 -- 172.21.15.42:0/1020633031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e100182e0 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7d00e01640 1 -- 172.21.15.42:0/1020633031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e100145e0 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648a2d979b0 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.463+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648a2d97e70 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.464+0000 7f7d00e01640 1 -- 172.21.15.42:0/1020633031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7e10020020 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.464+0000 7f7d00e01640 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cf0036830 0x7f7cf0038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.464+0000 7f7d00e01640 1 -- 172.21.15.42:0/1020633031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7e1004dc50 con 0x5648a2d965e0 2024-02-16T00:11:28.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.464+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cf0036830 0x7f7cf0038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e1b610800 1 Processor -- start 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e1b610800 1 -- start start 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cf0036830 0x7f7cf0038cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5648a2c810a0 tx=0x7f7e0802c3a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e1b610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2da3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e1b610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a2af55d0 con 0x5648a2da38c0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e175c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2da3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e175c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2da3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60378/0 (socket says 172.21.15.42:60378) 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e175c6640 1 -- 172.21.15.42:0/3025330183 learned_addr learned my addr 172.21.15.42:0/3025330183 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e175c6640 1 -- 172.21.15.42:0/3025330183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a2da42b0 con 0x5648a2da38c0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.465+0000 7f7e175c6640 1 --2- 172.21.15.42:0/3025330183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2da3ce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e10013010 tx=0x7f7e10011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1348b6c3c8be7e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7cfa7fc640 1 -- 172.21.15.42:0/3025330183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e10016570 con 0x5648a2da38c0 2024-02-16T00:11:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7cfa7fc640 1 -- 172.21.15.42:0/3025330183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10014ac0 con 0x5648a2da38c0 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7cfa7fc640 1 -- 172.21.15.42:0/3025330183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e1002b350 con 0x5648a2da38c0 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 -- 172.21.15.42:0/3025330183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 msgr2=0x5648a2da3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 --2- 172.21.15.42:0/3025330183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2da3ce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e10013010 tx=0x7f7e10011460 comp rx=0 tx=0).stop 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 -- 172.21.15.42:0/3025330183 shutdown_connections 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 --2- 172.21.15.42:0/3025330183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2da3ce0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 -- 172.21.15.42:0/3025330183 >> 172.21.15.42:0/3025330183 conn(0x5648a2d9fb40 msgr2=0x5648a2d9dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 -- 172.21.15.42:0/3025330183 shutdown_connections 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 -- 172.21.15.42:0/3025330183 wait complete. 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 Processor -- start 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 -- start start 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.466+0000 7f7e1b610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2daa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e1b610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a2daad30 con 0x5648a2da38c0 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e175c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2daa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e175c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2daa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60394/0 (socket says 172.21.15.42:60394) 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 learned_addr learned my addr 172.21.15.42:0/2492934724 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a2d97e70 con 0x5648a2da38c0 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e175c6640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2daa7f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e1004aec0 tx=0x7f7e1004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7cf8ff9640 1 -- 172.21.15.42:0/2492934724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e10014c30 con 0x5648a2da38c0 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7cf8ff9640 1 -- 172.21.15.42:0/2492934724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e100133b0 con 0x5648a2da38c0 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648a2daaf30 con 0x5648a2da38c0 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7cf8ff9640 1 -- 172.21.15.42:0/2492934724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e10013690 con 0x5648a2da38c0 2024-02-16T00:11:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.467+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648a2dab3f0 con 0x5648a2da38c0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.468+0000 7f7cf8ff9640 1 -- 172.21.15.42:0/2492934724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7e10022740 con 0x5648a2da38c0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.468+0000 7f7cf8ff9640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ce0036790 0x7f7ce0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.468+0000 7f7cf8ff9640 1 -- 172.21.15.42:0/2492934724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7e10038c80 con 0x5648a2da38c0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.468+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ce0036790 0x7f7ce0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ce0036790 0x7f7ce0038c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e08016750 tx=0x7f7e08032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2db63c0 0x5648a2db8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2db8fd0 con 0x5648a2db63c0 2024-02-16T00:11:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e165c4640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2db63c0 0x5648a2db8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e165c4640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2db63c0 0x5648a2db8880 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.469+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e00059040 con 0x5648a2db63c0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 realm 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2db93c0 con 0x5648a2db63c0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e00059040 con 0x5648a2db63c0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2db9c40 con 0x5648a2db63c0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e00059040 con 0x5648a2db63c0 2024-02-16T00:11:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2db9fa0 con 0x5648a2db63c0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7e00059040 con 0x5648a2db63c0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2dbacb0 0x5648a2dbd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbacb0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.470+0000 7f7e175c6640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2dbacb0 0x5648a2dbd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e175c6640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2dbacb0 0x5648a2dbd0a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e1b610800 20 searching for the correct realm 2024-02-16T00:11:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648a2dbf980 0x5648a2dc1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc2510 con 0x5648a2dbf980 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648a2dbf980 0x5648a2dc1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.471+0000 7f7e16dc5640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648a2dbf980 0x5648a2dc1e40 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.472+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.472+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc2510 con 0x5648a2dbacb0 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.472+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.472+0000 7f7e175c6640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7e10014070 0x7f7e1002c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.472+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.472+0000 7f7e165c4640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7e10014070 0x7f7e1002c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7e10014070 0x7f7e1002c820 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.473+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbacb0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.474+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.475+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.475+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.475+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.475+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.475+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.475+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbacb0 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.476+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.477+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbacb0 2024-02-16T00:11:28.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.478+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbacb0 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.479+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x7f7e10014070 2024-02-16T00:11:28.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbacb0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.480+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbdd80 con 0x5648a2db63c0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbe130 con 0x5648a2db63c0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbe510 con 0x5648a2db63c0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 zone default found 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 4 Realm: () 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:28.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 zonegroup default 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.481+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc2950 con 0x7f7e10014070 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc47d0 con 0x5648a2dbf980 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc4b30 con 0x5648a2dbf980 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 started sync module instance, tier type = 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.482+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc3c10 con 0x5648a2dbacb0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.483+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.484+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94869969977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc3c10 con 0x5648a2dbacb0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.484+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc54e0 con 0x5648a2db63c0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.485+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94869969977600] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.485+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.485+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94869969981440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc3c10 con 0x5648a2db63c0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.485+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc5f50 con 0x5648a2dbf980 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.486+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94869969981440] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.486+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.486+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94869969975152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc3b90 con 0x5648a2dbf980 2024-02-16T00:11:28.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.486+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc6db0 con 0x5648a2dbacb0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.487+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94869969975152] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.487+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.487+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94869969987856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc71d0 con 0x5648a2dbacb0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.487+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc7b40 con 0x5648a2db63c0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.488+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94869969987856] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.488+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.488+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94869969991808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc71d0 con 0x5648a2db63c0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.488+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc8560 con 0x7f7e10014070 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.489+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94869969991808] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.489+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.489+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94869969993824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc8520 con 0x7f7e10014070 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.489+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc8fc0 con 0x7f7e10014070 2024-02-16T00:11:28.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.490+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94869969993824] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.490+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.490+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94869969996448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc8f80 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.490+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc9990 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94869969996448] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94869969988912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc9990 con 0x7f7e10014070 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=0 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=1 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=2 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=3 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=4 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=5 2024-02-16T00:11:28.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.491+0000 7f7e1b610800 20 add_watcher() i=6 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.492+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94869969988912] v27'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.492+0000 7f7e1b610800 20 add_watcher() i=7 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.492+0000 7f7e1b610800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.492+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dccf40 con 0x5648a2db63c0 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.492+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.492+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94869969998976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dca250 con 0x5648a2db63c0 2024-02-16T00:11:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.493+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94869969998976] v27'154 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.493+0000 7f7ccd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.493+0000 7f7e1b610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.493+0000 7f7e1b610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.493+0000 7f7e1b610800 5 note: GC not initialized 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7c47fff640 20 reqs_thread_entry: start 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 20 Filter name: none 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7c45ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dfee60 con 0x5648a2db63c0 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.494+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2e01380 con 0x5648a2dbacb0 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 20 disabling bucket name=myfoo 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dff800 con 0x5648a2dbacb0 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2e01fd0 con 0x5648a2db63c0 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.495+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2e09990 con 0x5648a2db63c0 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v27'9 uv9 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94869970232912 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2e07270 con 0x5648a2dbacb0 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== watch-notify(notify (1) cookie 94869969977600 notify 115964117017 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x5648a2daaf30 con 0x5648a2dbacb0 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7cfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117017 cookie 94869969977600 notifier 4586 bl.length()=725 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7cfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7cfa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7cfa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(67 notify.0 [notify cookie 94869970232912 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7cfa7fc640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f7cdc003e90 con 0x5648a2dbacb0 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== watch-notify(notify_complete (2) cookie 94869970232912 notify 115964117017 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7e1003b020 con 0x5648a2dbacb0 2024-02-16T00:11:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_sources= new_sources= 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential sources added=[] removed=[] 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_dests= new_dests= 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential dests added=[] removed=[] 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.497+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2e03ae0 con 0x5648a2db63c0 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v27'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e1b610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e1b610800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e1b610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94869970212080 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dfddb0 con 0x5648a2db63c0 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== watch-notify(notify (1) cookie 94869969991808 notify 115964117006 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f7e00084040 con 0x5648a2db63c0 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94869969991808 notifier 4586 bl.length()=534 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(70 notify.4 [notify cookie 94869970212080 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7cf9ffb640 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f7c4c003420 con 0x5648a2db63c0 2024-02-16T00:11:28.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== watch-notify(notify_complete (2) cookie 94869970212080 notify 115964117006 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7e00079040 con 0x5648a2db63c0 2024-02-16T00:11:28.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.499+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.519 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:28.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.500+0000 7f7ccd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.500+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94869969998976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2de8eb0 con 0x5648a2db63c0 2024-02-16T00:11:28.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.501+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94869969998976] v27'155 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.501+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94869969977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc9480 con 0x5648a2dbacb0 2024-02-16T00:11:28.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.502+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94869969977600] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.502+0000 7f7e1b610800 20 remove_watcher() i=0 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.502+0000 7f7e1b610800 2 removed watcher, disabling cache 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.502+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94869969981440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2db63c0 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.503+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94869969981440] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.503+0000 7f7e1b610800 20 remove_watcher() i=1 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.503+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94869969975152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dbd6b0 con 0x5648a2dbf980 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.504+0000 7f7e16dc5640 1 -- 172.21.15.42:0/2492934724 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94869969975152] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e08014070 con 0x5648a2dbf980 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.504+0000 7f7e1b610800 20 remove_watcher() i=2 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.504+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94869969987856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc5000 con 0x5648a2dbacb0 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.505+0000 7f7e175c6640 1 -- 172.21.15.42:0/2492934724 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94869969987856] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5648a2dbacb0 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.505+0000 7f7e1b610800 20 remove_watcher() i=3 2024-02-16T00:11:28.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.505+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94869969991808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc3770 con 0x5648a2db63c0 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.506+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94869969991808] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x5648a2db63c0 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.506+0000 7f7e1b610800 20 remove_watcher() i=4 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.506+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94869969993824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc6910 con 0x7f7e10014070 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.507+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94869969993824] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.507+0000 7f7e1b610800 20 remove_watcher() i=5 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.507+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94869969996448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc5000 con 0x7f7e10014070 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.508+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94869969996448] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.508+0000 7f7e1b610800 20 remove_watcher() i=6 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.508+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94869969988912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5648a2dc3770 con 0x7f7e10014070 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94869969988912] v27'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e00071040 con 0x7f7e10014070 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 20 remove_watcher() i=7 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7e10014070 msgr2=0x7f7e1002c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7e10014070 0x7f7e1002c820 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2db63c0 msgr2=0x5648a2db8880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2db63c0 0x5648a2db8880 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2dbacb0 msgr2=0x5648a2dbd0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2dbacb0 0x5648a2dbd0a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648a2dbf980 msgr2=0x5648a2dc1e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648a2dbf980 0x5648a2dc1e40 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ce0036790 msgr2=0x7f7ce0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7ce0036790 0x7f7ce0038c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e08016750 tx=0x7f7e08032000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 msgr2=0x5648a2daa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e165c4640 1 -- 172.21.15.42:0/2492934724 reap_dead start 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2daa7f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e1004aec0 tx=0x7f7e1004bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:28.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 shutdown_connections 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 --2- 172.21.15.42:0/2492934724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2da38c0 0x5648a2daa7f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.509+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 >> 172.21.15.42:0/2492934724 conn(0x5648a2d9fb40 msgr2=0x5648a2d9d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 shutdown_connections 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/2492934724 wait complete. 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cf0036830 msgr2=0x7f7cf0038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cf0036830 0x7f7cf0038cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5648a2c810a0 tx=0x7f7e0802c3a0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 msgr2=0x5648a2d96a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 0x5648a2d96a00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x5648a2c81a90 tx=0x7f7e10018830 comp rx=0 tx=0).stop 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 shutdown_connections 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cf0036830 0x7f7cf0038cf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/1020633031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2d965e0 0x5648a2d96a00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 >> 172.21.15.42:0/1020633031 conn(0x5648a2d8a680 msgr2=0x5648a2d8aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 shutdown_connections 2024-02-16T00:11:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/1020633031 wait complete. 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2c865b0 msgr2=0x5648a2d82a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2c865b0 0x5648a2d82a00 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2d84d10 msgr2=0x5648a2d87100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2d84d10 0x5648a2d87100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cfc0367e0 msgr2=0x7f7cfc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cfc0367e0 0x7f7cfc038ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e00054000 tx=0x7f7e0004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 msgr2=0x5648a2c82390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2c82390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e08000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 shutdown_connections 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648a2d84d10 0x5648a2d87100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648a2c865b0 0x5648a2d82a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7cfc0367e0 0x7f7cfc038ca0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 --2- 172.21.15.42:0/832934767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648a2c82aa0 0x5648a2c82390 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 >> 172.21.15.42:0/832934767 conn(0x5648a2c7c4d0 msgr2=0x5648a2d6c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 shutdown_connections 2024-02-16T00:11:28.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.510+0000 7f7e1b610800 1 -- 172.21.15.42:0/832934767 wait complete. 2024-02-16T00:11:28.531 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:28.533 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-16T00:11:28.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-16T00:11:28.533 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-16T00:11:28.607 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:28.607 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.605+0000 7f3cca722800 1 Processor -- start 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.605+0000 7f3cca722800 1 -- start start 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.605+0000 7f3cca722800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c369cfb890 0x55c369cfbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.605+0000 7f3cca722800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c369c47bb0 con 0x55c369cfc1f0 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.605+0000 7f3cca722800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c369bff450 con 0x55c369cfb890 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.606+0000 7f3cc64b7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c369cfb890 0x55c369cfbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.606+0000 7f3cc5cb6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c369cfc1f0 0x55c369cfc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:60572/0 (socket says 172.21.15.42:60572) 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.606+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/686760271 learned_addr learned my addr 172.21.15.42:0/686760271 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.606+0000 7f3cc64b7640 1 -- 172.21.15.42:0/686760271 >> v1:172.21.15.2:6789/0 conn(0x55c369cfc1f0 legacy=0x55c369cfc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.606+0000 7f3cc64b7640 1 -- 172.21.15.42:0/686760271 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369c70310 con 0x55c369cfb890 2024-02-16T00:11:28.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.608+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/686760271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369cfbcb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8005fd0 tx=0x7f3cb801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0a6684997a7d78 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.608+0000 7f3cc54b5640 1 -- 172.21.15.42:0/686760271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8052560 con 0x55c369cfb890 2024-02-16T00:11:28.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.608+0000 7f3cc54b5640 1 -- 172.21.15.42:0/686760271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb80526c0 con 0x55c369cfb890 2024-02-16T00:11:28.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.608+0000 7f3cc54b5640 1 -- 172.21.15.42:0/686760271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb80529e0 con 0x55c369cfb890 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.608+0000 7f3cca722800 1 -- 172.21.15.42:0/686760271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 msgr2=0x55c369cfbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.608+0000 7f3cca722800 1 --2- 172.21.15.42:0/686760271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369cfbcb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8005fd0 tx=0x7f3cb801cb90 comp rx=0 tx=0).stop 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.609+0000 7f3cca722800 1 -- 172.21.15.42:0/686760271 shutdown_connections 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.609+0000 7f3cca722800 1 --2- 172.21.15.42:0/686760271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369cfbcb0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.609+0000 7f3cca722800 1 -- 172.21.15.42:0/686760271 >> 172.21.15.42:0/686760271 conn(0x55c369cf74d0 msgr2=0x55c369cf98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.609+0000 7f3cca722800 1 -- 172.21.15.42:0/686760271 shutdown_connections 2024-02-16T00:11:28.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.609+0000 7f3cca722800 1 -- 172.21.15.42:0/686760271 wait complete. 2024-02-16T00:11:28.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cca722800 1 Processor -- start 2024-02-16T00:11:28.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cca722800 1 -- start start 2024-02-16T00:11:28.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cca722800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369def160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cca722800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369bfc980 con 0x55c369cfb890 2024-02-16T00:11:28.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cc64b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369def160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cc64b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369def160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60398/0 (socket says 172.21.15.42:60398) 2024-02-16T00:11:28.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.620+0000 7f3cc64b7640 1 -- 172.21.15.42:0/2279933416 learned_addr learned my addr 172.21.15.42:0/2279933416 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.621+0000 7f3cc64b7640 1 -- 172.21.15.42:0/2279933416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb800a100 con 0x55c369cfb890 2024-02-16T00:11:28.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.621+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/2279933416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369def160 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800a3f0 tx=0x7f3cb804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6301ebfc9c1d21 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.621+0000 7f3bb4608640 1 -- 172.21.15.42:0/2279933416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8052960 con 0x55c369cfb890 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.621+0000 7f3bb4608640 1 -- 172.21.15.42:0/2279933416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8052c10 con 0x55c369cfb890 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.621+0000 7f3bb4608640 1 -- 172.21.15.42:0/2279933416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb805c430 con 0x55c369cfb890 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- 172.21.15.42:0/2279933416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 msgr2=0x55c369def160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 --2- 172.21.15.42:0/2279933416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369def160 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800a3f0 tx=0x7f3cb804c000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- 172.21.15.42:0/2279933416 shutdown_connections 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 --2- 172.21.15.42:0/2279933416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369def160 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- 172.21.15.42:0/2279933416 >> 172.21.15.42:0/2279933416 conn(0x55c369cf74d0 msgr2=0x55c369deaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- 172.21.15.42:0/2279933416 shutdown_connections 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- 172.21.15.42:0/2279933416 wait complete. 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 Processor -- start 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- start start 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369df6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.622+0000 7f3cca722800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369bf8160 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cc64b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369df6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cc64b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369df6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60404/0 (socket says 172.21.15.42:60404) 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cc64b7640 1 -- 172.21.15.42:0/2245887562 learned_addr learned my addr 172.21.15.42:0/2245887562 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cc64b7640 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369c70310 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369df6650 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8000f80 tx=0x7f3cb8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3bb2e05640 1 -- 172.21.15.42:0/2245887562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb805c430 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3bb2e05640 1 -- 172.21.15.42:0/2245887562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8071440 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3bb2e05640 1 -- 172.21.15.42:0/2245887562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8071700 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c369df6b90 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.623+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c369df7070 con 0x55c369cfb890 2024-02-16T00:11:28.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.624+0000 7f3bb2e05640 1 -- 172.21.15.42:0/2245887562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3cb807a440 con 0x55c369cfb890 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.624+0000 7f3bb2e05640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3bac0367e0 0x7f3bac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.624+0000 7f3bb2e05640 1 -- 172.21.15.42:0/2245887562 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3cb808eaf0 con 0x55c369cfb890 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.624+0000 7f3cc5cb6640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3bac0367e0 0x7f3bac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369cfc1f0 0x55c369dfd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369dfd9a0 con 0x55c369cfc1f0 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369cfc1f0 0x55c369dfd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cc5cb6640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3bac0367e0 0x7f3bac038ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc000f60 tx=0x7f3cbc0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369cfc1f0 0x55c369dfd330 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/2245887562 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.625+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369dfaa20 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/2245887562 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369dffbe0 0x55c369e01fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e026c0 con 0x55c369dffbe0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369dffbe0 0x55c369e01fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369dffbe0 0x55c369e01fd0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cc64b7640 1 -- 172.21.15.42:0/2245887562 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369dffbe0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.626+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369dfeb60 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/2245887562 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369dfef50 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/2245887562 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369cfc1f0 2024-02-16T00:11:28.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cca722800 1 Processor -- start 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cca722800 1 -- start start 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cca722800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 0x55c369e118e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.627+0000 7f3cca722800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369b9ae80 con 0x55c369e114c0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cc6cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 0x55c369e118e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cc6cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 0x55c369e118e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60414/0 (socket says 172.21.15.42:60414) 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/784251868 learned_addr learned my addr 172.21.15.42:0/784251868 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/784251868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369e11e20 con 0x55c369e114c0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 0x55c369e118e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55c369df7870 tx=0x7f3cc000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3babfff640 1 -- 172.21.15.42:0/784251868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc000f040 con 0x55c369e114c0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3babfff640 1 -- 172.21.15.42:0/784251868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0007d00 con 0x55c369e114c0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c369e12890 con 0x55c369e114c0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3babfff640 1 -- 172.21.15.42:0/784251868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0019420 con 0x55c369e114c0 2024-02-16T00:11:28.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.628+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c369e12d50 con 0x55c369e114c0 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.629+0000 7f3babfff640 1 -- 172.21.15.42:0/784251868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3cc0019580 con 0x55c369e114c0 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3babfff640 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3ba0036830 0x7f3ba0038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3babfff640 1 -- 172.21.15.42:0/784251868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3cc004e390 con 0x55c369e114c0 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3ba0036830 0x7f3ba0038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cca722800 1 Processor -- start 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cca722800 1 -- start start 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3ba0036830 0x7f3ba0038cf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55c369dfdda0 tx=0x7f3cb80676a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cca722800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e1eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cca722800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369b705d0 con 0x55c369e1e770 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cc6cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e1eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cc6cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e1eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60424/0 (socket says 172.21.15.42:60424) 2024-02-16T00:11:28.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.630+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/1765276277 learned_addr learned my addr 172.21.15.42:0/1765276277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.631+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/1765276277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369e1f140 con 0x55c369e1e770 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.631+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/1765276277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e1eb70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3cc004c710 tx=0x7f3cc0017be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e1238da04979a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.631+0000 7f3ba9ffb640 1 -- 172.21.15.42:0/1765276277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0023790 con 0x55c369e1e770 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.631+0000 7f3ba9ffb640 1 -- 172.21.15.42:0/1765276277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0023910 con 0x55c369e1e770 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.631+0000 7f3ba9ffb640 1 -- 172.21.15.42:0/1765276277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0022e20 con 0x55c369e1e770 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- 172.21.15.42:0/1765276277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 msgr2=0x55c369e1eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 --2- 172.21.15.42:0/1765276277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e1eb70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3cc004c710 tx=0x7f3cc0017be0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- 172.21.15.42:0/1765276277 shutdown_connections 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 --2- 172.21.15.42:0/1765276277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e1eb70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- 172.21.15.42:0/1765276277 >> 172.21.15.42:0/1765276277 conn(0x55c369e1aa40 msgr2=0x55c369e18aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- 172.21.15.42:0/1765276277 shutdown_connections 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- 172.21.15.42:0/1765276277 wait complete. 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 Processor -- start 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- start start 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e256c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cca722800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369e25c00 con 0x55c369e1e770 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cc6cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cc6cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e256c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:60428/0 (socket says 172.21.15.42:60428) 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.632+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 learned_addr learned my addr 172.21.15.42:0/3295577972 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369e12d50 con 0x55c369e1e770 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e256c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0023fd0 tx=0x7f3cc004c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3b97fff640 1 -- 172.21.15.42:0/3295577972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0032070 con 0x55c369e1e770 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3b97fff640 1 -- 172.21.15.42:0/3295577972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0023790 con 0x55c369e1e770 2024-02-16T00:11:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3b97fff640 1 -- 172.21.15.42:0/3295577972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0015af0 con 0x55c369e1e770 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c369e25e00 con 0x55c369e1e770 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.633+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c369e262c0 con 0x55c369e1e770 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3b97fff640 1 -- 172.21.15.42:0/3295577972 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3cc0015c50 con 0x55c369e1e770 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3b97fff640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3b900367e0 0x7f3b90038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3b97fff640 1 -- 172.21.15.42:0/3295577972 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3cc0038c60 con 0x55c369e1e770 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3b900367e0 0x7f3b90038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369e311c0 0x55c369e33680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e33dd0 con 0x55c369e311c0 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3cc5cb6640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369e311c0 0x55c369e33680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.634+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3b900367e0 0x7f3b90038ca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3cb808d160 tx=0x7f3cb808a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cc5cb6640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369e311c0 0x55c369e33680 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 realm 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e30620 con 0x55c369e311c0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e34850 con 0x55c369e311c0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.635+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e350d0 con 0x55c369e311c0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369e35ab0 0x55c369e37ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e35ab0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369e35ab0 0x55c369e37ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369e35ab0 0x55c369e37ea0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 20 searching for the correct realm 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c369e3a860 0x55c369e3cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3d3f0 con 0x55c369e3a860 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.636+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c369e3a860 0x55c369e3cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.637+0000 7f3cc64b7640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c369e3a860 0x55c369e3cd20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.637+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.637+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3d3f0 con 0x55c369e35ab0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.637+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.637+0000 7f3cc6cb8640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3cc0019040 0x7f3cc004ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.637+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.638+0000 7f3cc5cb6640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3cc0019040 0x7f3cc004ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.638+0000 7f3cc5cb6640 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3cc0019040 0x7f3cc004ca40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.638+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.638+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.638+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e35ab0 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.639+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.640+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e35ab0 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.641+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.642+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e35ab0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.643+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x55c369e311c0 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc006070 con 0x7f3cc0019040 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.644+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e35ab0 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.645+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.645+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.645+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.645+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x7f3cc0019040 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.645+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.645+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e35ab0 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38c60 con 0x55c369e311c0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e39010 con 0x55c369e311c0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:28.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.646+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e393f0 con 0x55c369e311c0 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 zone default found 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 4 Realm: () 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 zonegroup default 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3d830 con 0x7f3cc0019040 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3f6b0 con 0x55c369e3a860 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3fa10 con 0x55c369e3a860 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.647+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.648+0000 7f3cca722800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.648+0000 7f3cca722800 20 started sync module instance, tier type = 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.648+0000 7f3cca722800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.648+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3ec80 con 0x55c369e35ab0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.648+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.648+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297783529840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3ec80 con 0x55c369e35ab0 2024-02-16T00:11:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.649+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e403e0 con 0x55c369e311c0 2024-02-16T00:11:28.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.650+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297783529840] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.650+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.650+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297783533280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3ec80 con 0x55c369e311c0 2024-02-16T00:11:28.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.650+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e40eb0 con 0x55c369e3a860 2024-02-16T00:11:28.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.651+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297783533280] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.651+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.651+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297783527392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e3ec00 con 0x55c369e3a860 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.651+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e41d40 con 0x55c369e35ab0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.652+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297783527392] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.652+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.652+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297783539872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e42160 con 0x55c369e35ab0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.652+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e42ad0 con 0x55c369e311c0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.653+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.653+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297783543344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e42ab0 con 0x55c369e311c0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.653+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e43a70 con 0x7f3cc0019040 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.653+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297783539872] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.654+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.654+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297783547248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e43a30 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.654+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e44470 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.654+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297783543344] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.655+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297783547248] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.655+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.655+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297783540928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e43f90 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.655+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e44900 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297783540928] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297783551072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e44d60 con 0x7f3cc0019040 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=0 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=1 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=2 2024-02-16T00:11:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=3 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=4 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=5 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.656+0000 7f3cca722800 20 add_watcher() i=6 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.657+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297783551072] v27'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.657+0000 7f3cca722800 20 add_watcher() i=7 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.657+0000 7f3cca722800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.657+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e481a0 con 0x55c369e311c0 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.658+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.658+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297783552128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e45610 con 0x55c369e311c0 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.658+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297783552128] v27'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3b7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 5 note: GC not initialized 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3af77fe640 20 reqs_thread_entry: start 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 20 Filter name: none 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3af57fa640 20 reqs_thread_entry: start 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.659+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e79dc0 con 0x55c369e311c0 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:28.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7c2e0 con 0x55c369e35ab0 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 20 enabling bucket name=myfoo 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7a760 con 0x55c369e35ab0 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 : miss 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 20 rados->read ofs=0 len=0 2024-02-16T00:11:28.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.660+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7cf10 con 0x55c369e311c0 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv9 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.661+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 8.c 8:3340c0f0:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e848d0 con 0x55c369e311c0 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v27'10 uv10 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cca722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cca722800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cca722800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cca722800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1, ofs0, ns] 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94297783784784 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7ef30 con 0x55c369e35ab0 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== watch-notify(notify (1) cookie 94297783529840 notify 115964117018 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55c369e25e00 con 0x55c369e35ab0 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3ba9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117018 cookie 94297783529840 notifier 4593 bl.length()=725 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3ba9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 info.flags=0x17 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3ba9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1 to cache LRU end 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3ba9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3ba9ffb640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3b8c003e90 con 0x55c369e35ab0 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.662+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(67 notify.0 [notify cookie 94297783784784 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== watch-notify(notify_complete (2) cookie 94297783784784 notify 115964117018 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3cc003b020 con 0x55c369e35ab0 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cca722800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_sources= new_sources= 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cca722800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential sources added=[] removed=[] 2024-02-16T00:11:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cca722800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): orig_dests= new_dests= 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cca722800 20 handle_bi_update(): bucket=:myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1]): potential dests added=[] removed=[] 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.663+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d9f0 con 0x55c369e311c0 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v27'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cca722800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cca722800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cca722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94297783784784 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d970 con 0x55c369e311c0 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== watch-notify(notify (1) cookie 94297783543344 notify 115964117007 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55c369c47bb0 con 0x55c369e311c0 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3ba97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 94297783543344 notifier 4593 bl.length()=534 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3ba97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3ba97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3ba97fa640 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f3afc003420 con 0x55c369e311c0 2024-02-16T00:11:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(70 notify.4 [notify cookie 94297783784784 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.664+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== watch-notify(notify_complete (2) cookie 94297783784784 notify 115964117007 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3cbc03d930 con 0x55c369e311c0 2024-02-16T00:11:28.682 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.665+0000 7f3b7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.665+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297783552128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e63df0 con 0x55c369e311c0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.666+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94297783552128] v27'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.666+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297783529840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d960 con 0x55c369e35ab0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.667+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94297783529840] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.667+0000 7f3cca722800 20 remove_watcher() i=0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.667+0000 7f3cca722800 2 removed watcher, disabling cache 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.667+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297783533280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e311c0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.668+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94297783533280] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.668+0000 7f3cca722800 20 remove_watcher() i=1 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.668+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297783527392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e38570 con 0x55c369e3a860 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.670+0000 7f3cc64b7640 1 -- 172.21.15.42:0/3295577972 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94297783527392] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cb807ac10 con 0x55c369e3a860 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.670+0000 7f3cca722800 20 remove_watcher() i=2 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.670+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297783539872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d960 con 0x55c369e35ab0 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.670+0000 7f3cc6cb8640 1 -- 172.21.15.42:0/3295577972 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94297783539872] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc00083e0 con 0x55c369e35ab0 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.670+0000 7f3cca722800 20 remove_watcher() i=3 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.670+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297783543344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d960 con 0x55c369e311c0 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.671+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94297783543344] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x55c369e311c0 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.672+0000 7f3cca722800 20 remove_watcher() i=4 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.672+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297783547248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d960 con 0x7f3cc0019040 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.673+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94297783547248] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.673+0000 7f3cca722800 20 remove_watcher() i=5 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.673+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297783540928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d960 con 0x7f3cc0019040 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.674+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94297783540928] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.674+0000 7f3cca722800 20 remove_watcher() i=6 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.674+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297783551072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55c369e7d960 con 0x7f3cc0019040 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94297783551072] v27'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cbc037040 con 0x7f3cc0019040 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 20 remove_watcher() i=7 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3cc0019040 msgr2=0x7f3cc004ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f3cc0019040 0x7f3cc004ca40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369e311c0 msgr2=0x55c369e33680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369e311c0 0x55c369e33680 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369e35ab0 msgr2=0x55c369e37ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369e35ab0 0x55c369e37ea0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c369e3a860 msgr2=0x55c369e3cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c369e3a860 0x55c369e3cd20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3b900367e0 msgr2=0x7f3b90038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3b900367e0 0x7f3b90038ca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3cb808d160 tx=0x7f3cb808a000 comp rx=0 tx=0).stop 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 msgr2=0x55c369e256c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cc5cb6640 1 -- 172.21.15.42:0/3295577972 reap_dead start 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e256c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0023fd0 tx=0x7f3cc004c670 comp rx=0 tx=0).stop 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 shutdown_connections 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/3295577972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e1e770 0x55c369e256c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 >> 172.21.15.42:0/3295577972 conn(0x55c369e1aa40 msgr2=0x55c369e180a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 shutdown_connections 2024-02-16T00:11:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/3295577972 wait complete. 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3ba0036830 msgr2=0x7f3ba0038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3ba0036830 0x7f3ba0038cf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55c369dfdda0 tx=0x7f3cb80676a0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 msgr2=0x55c369e118e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.675+0000 7f3cca722800 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 0x55c369e118e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55c369df7870 tx=0x7f3cc000aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 shutdown_connections 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3ba0036830 0x7f3ba0038cf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/784251868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369e114c0 0x55c369e118e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 >> 172.21.15.42:0/784251868 conn(0x55c369e05560 msgr2=0x55c369e05960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 shutdown_connections 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/784251868 wait complete. 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369cfc1f0 msgr2=0x55c369dfd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369cfc1f0 0x55c369dfd330 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369dffbe0 msgr2=0x55c369e01fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369dffbe0 0x55c369e01fd0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3bac0367e0 msgr2=0x7f3bac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3bac0367e0 0x7f3bac038ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc000f60 tx=0x7f3cbc0012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 msgr2=0x55c369df6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369df6650 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8000f80 tx=0x7f3cb8003330 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 shutdown_connections 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c369dffbe0 0x55c369e01fd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c369cfc1f0 0x55c369dfd330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3bac0367e0 0x7f3bac038ca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 --2- 172.21.15.42:0/2245887562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c369cfb890 0x55c369df6650 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 >> 172.21.15.42:0/2245887562 conn(0x55c369cf74d0 msgr2=0x55c369de9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 shutdown_connections 2024-02-16T00:11:28.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:28.676+0000 7f3cca722800 1 -- 172.21.15.42:0/2245887562 wait complete. 2024-02-16T00:11:28.696 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:28.702 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T00:11:28.943 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-02-16T00:11:28.949 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:43.949 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-16T00:11:43.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-16T00:11:43.950 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-16T00:11:43.999 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:43.999 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.997+0000 7f03b252f800 1 Processor -- start 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.997+0000 7f03b252f800 1 -- start start 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.997+0000 7f03b252f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56542fe4e3f0 0x56542fe56ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.997+0000 7f03b252f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56542fd98bb0 con 0x56542fe4c8b0 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.997+0000 7f03b252f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x56542fd50450 con 0x56542fe4e3f0 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.998+0000 7f03ad9b2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56542fe4e3f0 0x56542fe56ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.998+0000 7f03ad9b2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56542fe4e3f0 0x56542fe56ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54474/0 (socket says 172.21.15.42:54474) 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.998+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2432551227 learned_addr learned my addr 172.21.15.42:0/2432551227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.998+0000 7f03ae1b3640 1 --1- 172.21.15.42:0/2432551227 >> v1:172.21.15.2:6789/0 conn(0x56542fe4c8b0 0x56542fe4ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51480/0 (socket says 172.21.15.42:51480) 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.998+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2432551227 >> v1:172.21.15.2:6789/0 conn(0x56542fe4c8b0 legacy=0x56542fe4ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:43.998+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2432551227 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56542fdc1160 con 0x56542fe4e3f0 2024-02-16T00:11:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.000+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/2432551227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4e3f0 0x56542fe56ef0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f03a400a520 tx=0x7f03a401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca03b00e48448f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.000+0000 7f03ad1b1640 1 -- 172.21.15.42:0/2432551227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a4052570 con 0x56542fe4e3f0 2024-02-16T00:11:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.000+0000 7f03ad1b1640 1 -- 172.21.15.42:0/2432551227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a40526d0 con 0x56542fe4e3f0 2024-02-16T00:11:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.000+0000 7f03ad1b1640 1 -- 172.21.15.42:0/2432551227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a4052990 con 0x56542fe4e3f0 2024-02-16T00:11:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 -- 172.21.15.42:0/2432551227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4e3f0 msgr2=0x56542fe56ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 --2- 172.21.15.42:0/2432551227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4e3f0 0x56542fe56ef0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f03a400a520 tx=0x7f03a401cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 -- 172.21.15.42:0/2432551227 shutdown_connections 2024-02-16T00:11:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 --2- 172.21.15.42:0/2432551227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4e3f0 0x56542fe56ef0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 -- 172.21.15.42:0/2432551227 >> 172.21.15.42:0/2432551227 conn(0x56542fe484d0 msgr2=0x56542fe4a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 -- 172.21.15.42:0/2432551227 shutdown_connections 2024-02-16T00:11:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.001+0000 7f03b252f800 1 -- 172.21.15.42:0/2432551227 wait complete. 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03b252f800 1 Processor -- start 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03b252f800 1 -- start start 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03b252f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03b252f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542fd4d980 con 0x56542fe4c8b0 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03ae1b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03ae1b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54484/0 (socket says 172.21.15.42:54484) 2024-02-16T00:11:44.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2934412805 learned_addr learned my addr 172.21.15.42:0/2934412805 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.015+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2934412805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4005de0 con 0x56542fe4c8b0 2024-02-16T00:11:44.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.016+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/2934412805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff402f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001d00 tx=0x7f03a000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceed69fbcddffb97 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.016+0000 7f029c608640 1 -- 172.21.15.42:0/2934412805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a0014070 con 0x56542fe4c8b0 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.016+0000 7f029c608640 1 -- 172.21.15.42:0/2934412805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000f450 con 0x56542fe4c8b0 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.016+0000 7f029c608640 1 -- 172.21.15.42:0/2934412805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a000f730 con 0x56542fe4c8b0 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- 172.21.15.42:0/2934412805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 msgr2=0x56542ff402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 --2- 172.21.15.42:0/2934412805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff402f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001d00 tx=0x7f03a000b600 comp rx=0 tx=0).stop 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- 172.21.15.42:0/2934412805 shutdown_connections 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 --2- 172.21.15.42:0/2934412805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff402f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- 172.21.15.42:0/2934412805 >> 172.21.15.42:0/2934412805 conn(0x56542fe484d0 msgr2=0x56542ff3bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- 172.21.15.42:0/2934412805 shutdown_connections 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- 172.21.15.42:0/2934412805 wait complete. 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 Processor -- start 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- start start 2024-02-16T00:11:44.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03b252f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542fd49160 con 0x56542fe4c8b0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.017+0000 7f03ae1b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f03ae1b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54496/0 (socket says 172.21.15.42:54496) 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f03ae1b3640 1 -- 172.21.15.42:0/3520890252 learned_addr learned my addr 172.21.15.42:0/3520890252 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f03ae1b3640 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56542fd98bb0 con 0x56542fe4c8b0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff479a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x56542ff41080 tx=0x7f03a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f029ae05640 1 -- 172.21.15.42:0/3520890252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a0014050 con 0x56542fe4c8b0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f029ae05640 1 -- 172.21.15.42:0/3520890252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a001ba30 con 0x56542fe4c8b0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56542ff47ee0 con 0x56542fe4c8b0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f029ae05640 1 -- 172.21.15.42:0/3520890252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a001bcd0 con 0x56542fe4c8b0 2024-02-16T00:11:44.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.018+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56542ff483c0 con 0x56542fe4c8b0 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.019+0000 7f029ae05640 1 -- 172.21.15.42:0/3520890252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f03a0022020 con 0x56542fe4c8b0 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.019+0000 7f029ae05640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02940367e0 0x7f0294038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.019+0000 7f029ae05640 1 -- 172.21.15.42:0/3520890252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f03a0008030 con 0x56542fe4c8b0 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02940367e0 0x7f0294038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542fe4e3f0 0x56542ff4e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff4ed00 con 0x56542fe4e3f0 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542fe4e3f0 0x56542ff4e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02940367e0 0x7f0294038ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f03a4054000 tx=0x7f03a404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542fe4e3f0 0x56542ff4e730 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.020+0000 7f03ae9b4640 1 -- 172.21.15.42:0/3520890252 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542fe4e3f0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.021+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff4bd90 con 0x56542fe4e3f0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.021+0000 7f03ae9b4640 1 -- 172.21.15.42:0/3520890252 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542fe4e3f0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.021+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff50f40 0x56542ff53330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.021+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff53a00 con 0x56542ff50f40 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.021+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff50f40 0x56542ff53330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.021+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff50f40 0x56542ff53330 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.022+0000 7f03ae1b3640 1 -- 172.21.15.42:0/3520890252 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff50f40 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.022+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff4fec0 con 0x56542fe4e3f0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.022+0000 7f03ae9b4640 1 -- 172.21.15.42:0/3520890252 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542fe4e3f0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.022+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff502d0 con 0x56542fe4e3f0 2024-02-16T00:11:44.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.022+0000 7f03ae9b4640 1 -- 172.21.15.42:0/3520890252 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542fe4e3f0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03b252f800 1 Processor -- start 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03b252f800 1 -- start start 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03b252f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 0x56542ff62c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03b252f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542fcebe80 con 0x56542ff627f0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03ae9b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 0x56542ff62c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03ae9b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 0x56542ff62c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54506/0 (socket says 172.21.15.42:54506) 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.023+0000 7f03ae9b4640 1 -- 172.21.15.42:0/1641968336 learned_addr learned my addr 172.21.15.42:0/1641968336 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f03ae9b4640 1 -- 172.21.15.42:0/1641968336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56542ff63150 con 0x56542ff627f0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 0x56542ff62c10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x56542ff4f060 tx=0x7f03a8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f0293fff640 1 -- 172.21.15.42:0/1641968336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a801d070 con 0x56542ff627f0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f0293fff640 1 -- 172.21.15.42:0/1641968336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a80182e0 con 0x56542ff627f0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f0293fff640 1 -- 172.21.15.42:0/1641968336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a80145e0 con 0x56542ff627f0 2024-02-16T00:11:44.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56542ff63bc0 con 0x56542ff627f0 2024-02-16T00:11:44.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.024+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56542ff64080 con 0x56542ff627f0 2024-02-16T00:11:44.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f0293fff640 1 -- 172.21.15.42:0/1641968336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f03a8020020 con 0x56542ff627f0 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f0293fff640 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02880367e0 0x7f0288038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f0293fff640 1 -- 172.21.15.42:0/1641968336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f03a804dca0 con 0x56542ff627f0 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02880367e0 0x7f0288038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f03b252f800 1 Processor -- start 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f03b252f800 1 -- start start 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02880367e0 0x7f0288038ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56542ff4f0d0 tx=0x7f03a0040040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.025+0000 7f03b252f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff6fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.026+0000 7f03b252f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542fcc15d0 con 0x56542ff6fac0 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.026+0000 7f03ae9b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff6fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.026+0000 7f03ae9b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff6fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54514/0 (socket says 172.21.15.42:54514) 2024-02-16T00:11:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.026+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2771341841 learned_addr learned my addr 172.21.15.42:0/2771341841 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.026+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2771341841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56542ff70490 con 0x56542ff6fac0 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.026+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/2771341841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff6fec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f03a804c020 tx=0x7f03a8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd11fd1f9bbdfe81 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f0291ffb640 1 -- 172.21.15.42:0/2771341841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a804d070 con 0x56542ff6fac0 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f0291ffb640 1 -- 172.21.15.42:0/2771341841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8016440 con 0x56542ff6fac0 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f0291ffb640 1 -- 172.21.15.42:0/2771341841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a8014b10 con 0x56542ff6fac0 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 -- 172.21.15.42:0/2771341841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 msgr2=0x56542ff6fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 --2- 172.21.15.42:0/2771341841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff6fec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f03a804c020 tx=0x7f03a8011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 -- 172.21.15.42:0/2771341841 shutdown_connections 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 --2- 172.21.15.42:0/2771341841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff6fec0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 -- 172.21.15.42:0/2771341841 >> 172.21.15.42:0/2771341841 conn(0x56542ff6bd90 msgr2=0x56542ff69df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 -- 172.21.15.42:0/2771341841 shutdown_connections 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 -- 172.21.15.42:0/2771341841 wait complete. 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 Processor -- start 2024-02-16T00:11:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.027+0000 7f03b252f800 1 -- start start 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03b252f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03b252f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542ff76f00 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03ae9b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03ae9b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff769c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54530/0 (socket says 172.21.15.42:54530) 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 learned_addr learned my addr 172.21.15.42:0/2512922884 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56542ff64080 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff769c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f03a804bf50 tx=0x7f03a804bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.028+0000 7f027ffff640 1 -- 172.21.15.42:0/2512922884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a8032070 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.029+0000 7f027ffff640 1 -- 172.21.15.42:0/2512922884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a80116f0 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.029+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56542ff77100 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.029+0000 7f027ffff640 1 -- 172.21.15.42:0/2512922884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a80133b0 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.029+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56542ff77560 con 0x56542ff6fac0 2024-02-16T00:11:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f027ffff640 1 -- 172.21.15.42:0/2512922884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f03a8013510 con 0x56542ff6fac0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f027ffff640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0278036790 0x7f0278038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f027ffff640 1 -- 172.21.15.42:0/2512922884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f03a8037c50 con 0x56542ff6fac0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0278036790 0x7f0278038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542ff826e0 0x56542ff84b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff852d0 con 0x56542ff826e0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542ff826e0 0x56542ff84b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.030+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0278036790 0x7f0278038c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03a0018500 tx=0x7f03a0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542ff826e0 0x56542ff84b80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 realm 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff85660 con 0x56542ff826e0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff85e60 con 0x56542ff826e0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.031+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff861c0 con 0x56542ff826e0 2024-02-16T00:11:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03b252f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff86c70 0x56542ff89060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff86c70 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff86c70 0x56542ff89060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff86c70 0x56542ff89060 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.032+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.033+0000 7f03b252f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.033+0000 7f03b252f800 20 searching for the correct realm 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.033+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56542ff8b780 0x56542ff8dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.033+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8e2f0 con 0x56542ff8b780 2024-02-16T00:11:44.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.033+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56542ff8b780 0x56542ff8dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.033+0000 7f03ae1b3640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56542ff8b780 0x56542ff8dc20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.034+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.034+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8e2f0 con 0x56542ff86c70 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.034+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.034+0000 7f03ae9b4640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03a8014070 0x7f03a8026640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.034+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.034+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03a8014070 0x7f03a8026640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.035+0000 7f03ad9b2640 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03a8014070 0x7f03a8026640 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.035+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.035+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.035+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.035+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.036+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.036+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.036+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.036+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.036+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.036+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff86c70 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.037+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.037+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.037+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.037+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.037+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.037+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff86c70 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.038+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.039+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.040+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff86c70 2024-02-16T00:11:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.041+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.042+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.042+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.042+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.042+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.042+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.042+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff86c70 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.043+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.043+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff8b780 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.043+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.043+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x7f03a8014070 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.043+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.043+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff826e0 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff897a0 con 0x56542ff86c70 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8a0a0 con 0x56542ff826e0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8a450 con 0x56542ff826e0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.044+0000 7f03b252f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8a830 con 0x56542ff826e0 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 zone default found 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 4 Realm: () 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 zonegroup default 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8e730 con 0x7f03a8014070 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.045+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff905b0 con 0x56542ff8b780 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff90910 con 0x56542ff8b780 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 20 started sync module instance, tier type = 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.046+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8fa40 con 0x56542ff86c70 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.047+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.047+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919582088960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8fa40 con 0x56542ff86c70 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.047+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff91380 con 0x56542ff826e0 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.048+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919582088960] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.049+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.049+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919582092896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8fa40 con 0x56542ff826e0 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.049+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff91d80 con 0x56542ff8b780 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.050+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919582092896] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.050+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.050+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919582086560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff8f9c0 con 0x56542ff8b780 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.050+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff92be0 con 0x56542ff86c70 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.051+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.051+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919582099744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff933e0 con 0x56542ff86c70 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.051+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919582086560] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.051+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff93eb0 con 0x56542ff826e0 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.052+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919582099744] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.052+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.052+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919582103952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff93e70 con 0x56542ff826e0 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.052+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff92fb0 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.053+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919582103952] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.053+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.053+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919582097712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff94750 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.054+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff950c0 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.055+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919582097712] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.055+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.055+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919582106128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff950c0 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.055+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff95a80 con 0x7f03a8014070 2024-02-16T00:11:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919582111200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff95ee0 con 0x7f03a8014070 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919582106128] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=0 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=1 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=2 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=3 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=4 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=5 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.056+0000 7f03b252f800 20 add_watcher() i=6 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.057+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919582111200] v27'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.057+0000 7f03b252f800 20 add_watcher() i=7 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.057+0000 7f03b252f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.057+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff992f0 con 0x56542ff826e0 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.057+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.057+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919582112256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff96760 con 0x56542ff826e0 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.058+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919582112256] v27'158 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.058+0000 7f0264fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.058+0000 7f03b252f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.058+0000 7f03b252f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.059+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa1650 con 0x56542ff826e0 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.060+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'49 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.060+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa1c20 con 0x7f03a8014070 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.061+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.061+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa2150 con 0x56542ff8b780 2024-02-16T00:11:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.062+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'24 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.062+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa2680 con 0x56542ff826e0 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.063+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'159 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.063+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa2bb0 con 0x56542ff86c70 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.064+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'50 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.064+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa30e0 con 0x56542ff8b780 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.065+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'41 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.065+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa3610 con 0x56542ff826e0 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.066+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.066+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa3ab0 con 0x7f03a8014070 2024-02-16T00:11:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.067+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'36 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.067+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa30e0 con 0x56542ff86c70 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.068+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.068+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa3c80 con 0x56542ff8b780 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.069+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.069+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa41b0 con 0x56542ff86c70 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.070+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'51 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.070+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa4650 con 0x7f03a8014070 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.071+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.071+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa4650 con 0x56542ff86c70 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.072+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.072+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa3c80 con 0x7f03a8014070 2024-02-16T00:11:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.073+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'47 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.073+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa3c80 con 0x56542ff826e0 2024-02-16T00:11:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.074+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'160 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.074+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa3c80 con 0x56542ff8b780 2024-02-16T00:11:44.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.076+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'44 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.076+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f800 con 0x56542ff86c70 2024-02-16T00:11:44.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.076+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'52 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.076+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.077+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.077+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff826e0 2024-02-16T00:11:44.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.079+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'26 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.079+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff826e0 2024-02-16T00:11:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.080+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'161 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.080+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.081+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'45 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.081+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff86c70 2024-02-16T00:11:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.082+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'36 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.082+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.083+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.083+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.084+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'36 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.084+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.085+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.085+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.086+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'42 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.086+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x7f03a8014070 2024-02-16T00:11:44.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.087+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'26 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.087+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.088+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'30 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.088+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x7f03a8014070 2024-02-16T00:11:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.089+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'37 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.089+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff8b780 2024-02-16T00:11:44.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.091+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'46 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.091+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x7f03a8014070 2024-02-16T00:11:44.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.092+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'48 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.092+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9fdd0 con 0x56542ff86c70 2024-02-16T00:11:44.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.093+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.093+0000 7f01df7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.093+0000 7f03b252f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.093+0000 7f03b252f800 20 Filter name: none 2024-02-16T00:11:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.094+0000 7f01dd7fa640 20 reqs_thread_entry: start 2024-02-16T00:11:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.094+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f020 con 0x56542ff826e0 2024-02-16T00:11:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.094+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.094+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f020 con 0x56542ff826e0 2024-02-16T00:11:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.094+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.094+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f020 con 0x56542ff826e0 2024-02-16T00:11:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.095+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.095+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f020 con 0x7f03a8014070 2024-02-16T00:11:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.095+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.095+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f020 con 0x7f03a8014070 2024-02-16T00:11:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.096+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.096+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9f020 con 0x7f03a8014070 2024-02-16T00:11:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.096+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(99 gc.1 [call out=1702b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.096+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv10 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.097+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff826e0 2024-02-16T00:11:44.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.098+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.099+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.100+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.100+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.100+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.100+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff826e0 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.100+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.100+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.101+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.101+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.101+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv14 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.101+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x7f03a8014070 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv14 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv14 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.102+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.103+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.103+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.103+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.103+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.103+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.103+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.104+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.105+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.105+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x7f03a8014070 2024-02-16T00:11:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.105+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.105+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.106+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.106+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.106+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.106+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.106+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.106+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.107+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.107+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.107+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.107+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x7f03a8014070 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.107+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.107+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.108+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.108+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.108+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.108+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff826e0 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.108+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.108+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.109+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.109+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.109+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.109+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.109+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.110+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.111+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff826e0 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.112+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff826e0 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff826e0 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.113+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.114+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.114+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.114+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.114+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.114+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.114+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.115+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.116+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.117+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.117+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.117+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.117+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.117+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.117+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.118+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.118+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.118+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.118+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.118+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.118+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.119+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.119+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x7f03a8014070 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.119+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.119+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.119+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.119+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.120+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x7f03a8014070 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.121+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.121+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.121+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.121+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.121+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.121+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff8b780 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.122+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.122+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff8b780 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.122+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.122+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.122+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.122+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x7f03a8014070 2024-02-16T00:11:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.123+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.123+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x7f03a8014070 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.123+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.123+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.124+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.124+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffce5a0 con 0x56542ff86c70 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.124+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.124+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffcf5b0 con 0x56542ff86c70 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.124+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.125+0000 7f0264fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.125+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919582112256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ffa0370 con 0x56542ff826e0 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.126+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94919582112256] v27'162 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.126+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919582088960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x56542ff86c70 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.127+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94919582088960] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.127+0000 7f03b252f800 20 remove_watcher() i=0 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.127+0000 7f03b252f800 2 removed watcher, disabling cache 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.127+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919582092896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x56542ff826e0 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.128+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94919582092896] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.128+0000 7f03b252f800 20 remove_watcher() i=1 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.128+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919582086560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x56542ff8b780 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.129+0000 7f03ae1b3640 1 -- 172.21.15.42:0/2512922884 <== osd.3 v2:172.21.15.42:6810/474355007 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94919582086560] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a0016070 con 0x56542ff8b780 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.129+0000 7f03b252f800 20 remove_watcher() i=2 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.129+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919582099744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x56542ff86c70 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.130+0000 7f03ae9b4640 1 -- 172.21.15.42:0/2512922884 <== osd.2 v2:172.21.15.42:6808/1288904824 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94919582099744] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56542ff86c70 2024-02-16T00:11:44.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.130+0000 7f03b252f800 20 remove_watcher() i=3 2024-02-16T00:11:44.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.130+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919582103952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x56542ff826e0 2024-02-16T00:11:44.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.132+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.1 v2:172.21.15.42:6800/2950936693 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94919582103952] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x56542ff826e0 2024-02-16T00:11:44.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.132+0000 7f03b252f800 20 remove_watcher() i=4 2024-02-16T00:11:44.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.132+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919582097712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x7f03a8014070 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.133+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94919582097712] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.133+0000 7f03b252f800 20 remove_watcher() i=5 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.133+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919582106128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x7f03a8014070 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.134+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94919582106128] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.134+0000 7f03b252f800 20 remove_watcher() i=6 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.134+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919582111200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56542ff9ec50 con 0x7f03a8014070 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 <== osd.0 v2:172.21.15.2:6800/1783370926 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94919582111200] v27'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03a4052aa0 con 0x7f03a8014070 2024-02-16T00:11:44.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 20 remove_watcher() i=7 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03a8014070 msgr2=0x7f03a8026640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03a8014070 0x7f03a8026640 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542ff826e0 msgr2=0x56542ff84b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542ff826e0 0x56542ff84b80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff86c70 msgr2=0x56542ff89060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff86c70 0x56542ff89060 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56542ff8b780 msgr2=0x56542ff8dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56542ff8b780 0x56542ff8dc20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0278036790 msgr2=0x7f0278038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0278036790 0x7f0278038c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03a0018500 tx=0x7f03a0032000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 msgr2=0x56542ff769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff769c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f03a804bf50 tx=0x7f03a804bf80 comp rx=0 tx=0).stop 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03ad9b2640 1 -- 172.21.15.42:0/2512922884 reap_dead start 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 shutdown_connections 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/2512922884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff6fac0 0x56542ff769c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 >> 172.21.15.42:0/2512922884 conn(0x56542ff6bd90 msgr2=0x56542ff693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 shutdown_connections 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/2512922884 wait complete. 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02880367e0 msgr2=0x7f0288038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02880367e0 0x7f0288038ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56542ff4f0d0 tx=0x7f03a0040040 comp rx=0 tx=0).stop 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 msgr2=0x56542ff62c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.135+0000 7f03b252f800 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 0x56542ff62c10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x56542ff4f060 tx=0x7f03a8018830 comp rx=0 tx=0).stop 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 shutdown_connections 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02880367e0 0x7f0288038ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/1641968336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542ff627f0 0x56542ff62c10 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 >> 172.21.15.42:0/1641968336 conn(0x56542ff56890 msgr2=0x56542ff56c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 shutdown_connections 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/1641968336 wait complete. 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542fe4e3f0 msgr2=0x56542ff4e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542fe4e3f0 0x56542ff4e730 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff50f40 msgr2=0x56542ff53330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff50f40 0x56542ff53330 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02940367e0 msgr2=0x7f0294038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02940367e0 0x7f0294038ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f03a4054000 tx=0x7f03a404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 msgr2=0x56542ff479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff479a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x56542ff41080 tx=0x7f03a0000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 shutdown_connections 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56542ff50f40 0x56542ff53330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56542fe4e3f0 0x56542ff4e730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02940367e0 0x7f0294038ca0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 --2- 172.21.15.42:0/3520890252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56542fe4c8b0 0x56542ff479a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 >> 172.21.15.42:0/3520890252 conn(0x56542fe484d0 msgr2=0x56542ff3a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 shutdown_connections 2024-02-16T00:11:44.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.136+0000 7f03b252f800 1 -- 172.21.15.42:0/3520890252 wait complete. 2024-02-16T00:11:44.150 INFO:teuthology.orchestra.run.smithi042.stdout:[{"tag":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10068340188151715470\u0000","time":"2024-02-16T00:11:43.946778+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_7","key":"","instance":""}]}] 2024-02-16T00:11:44.150 DEBUG:tasks.util.rgw: json result: [{'tag': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10068340188151715470\x00', 'time': '2024-02-16T00:11:43.946778+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_7', 'key': '', 'instance': ''}]}] 2024-02-16T00:11:44.150 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-02-16T00:11:44.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-02-16T00:11:44.150 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-02-16T00:11:44.190 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:44.191 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.188+0000 7f8c4cd1f800 1 Processor -- start 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c4cd1f800 1 -- start start 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c4cd1f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5621fa5a53e0 0x5621fa5adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c4cd1f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5621fa4efba0 con 0x5621fa5a38a0 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c4cd1f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5621fa4a7450 con 0x5621fa5a53e0 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c481eb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5621fa5a53e0 0x5621fa5adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c481eb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5621fa5a53e0 0x5621fa5adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54538/0 (socket says 172.21.15.42:54538) 2024-02-16T00:11:44.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c481eb640 1 -- 172.21.15.42:0/748691490 learned_addr learned my addr 172.21.15.42:0/748691490 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c489ec640 1 --1- 172.21.15.42:0/748691490 >> v1:172.21.15.2:6789/0 conn(0x5621fa5a38a0 0x5621fa5a3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51490/0 (socket says 172.21.15.42:51490) 2024-02-16T00:11:44.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c481eb640 1 -- 172.21.15.42:0/748691490 >> v1:172.21.15.2:6789/0 conn(0x5621fa5a38a0 legacy=0x5621fa5a3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.189+0000 7f8c481eb640 1 -- 172.21.15.42:0/748691490 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fa518150 con 0x5621fa5a53e0 2024-02-16T00:11:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.191+0000 7f8c481eb640 1 --2- 172.21.15.42:0/748691490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a53e0 0x5621fa5adee0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000a520 tx=0x7f8c3001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f6482a78215f85 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.191+0000 7f8c479ea640 1 -- 172.21.15.42:0/748691490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c30052570 con 0x5621fa5a53e0 2024-02-16T00:11:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.191+0000 7f8c479ea640 1 -- 172.21.15.42:0/748691490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c300526d0 con 0x5621fa5a53e0 2024-02-16T00:11:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.191+0000 7f8c479ea640 1 -- 172.21.15.42:0/748691490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c30052990 con 0x5621fa5a53e0 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/748691490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a53e0 msgr2=0x5621fa5adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/748691490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a53e0 0x5621fa5adee0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000a520 tx=0x7f8c3001cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/748691490 shutdown_connections 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/748691490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a53e0 0x5621fa5adee0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/748691490 >> 172.21.15.42:0/748691490 conn(0x5621fa59f4c0 msgr2=0x5621fa5a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/748691490 shutdown_connections 2024-02-16T00:11:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.192+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/748691490 wait complete. 2024-02-16T00:11:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.203+0000 7f8c4cd1f800 1 Processor -- start 2024-02-16T00:11:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.203+0000 7f8c4cd1f800 1 -- start start 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.203+0000 7f8c4cd1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa697280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.203+0000 7f8c4cd1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fa4a4980 con 0x5621fa5a38a0 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8c489ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa697280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8c489ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa697280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54548/0 (socket says 172.21.15.42:54548) 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8c489ec640 1 -- 172.21.15.42:0/2020483850 learned_addr learned my addr 172.21.15.42:0/2020483850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8c489ec640 1 -- 172.21.15.42:0/2020483850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30005de0 con 0x5621fa5a38a0 2024-02-16T00:11:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8c489ec640 1 --2- 172.21.15.42:0/2020483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa697280 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8c38006f70 tx=0x7f8c38001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1f3dd7b1b0dcc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8b36e0d640 1 -- 172.21.15.42:0/2020483850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c38006320 con 0x5621fa5a38a0 2024-02-16T00:11:44.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8b36e0d640 1 -- 172.21.15.42:0/2020483850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38013420 con 0x5621fa5a38a0 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.204+0000 7f8b36e0d640 1 -- 172.21.15.42:0/2020483850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c38013740 con 0x5621fa5a38a0 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/2020483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 msgr2=0x5621fa697280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/2020483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa697280 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8c38006f70 tx=0x7f8c38001930 comp rx=0 tx=0).stop 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/2020483850 shutdown_connections 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/2020483850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa697280 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/2020483850 >> 172.21.15.42:0/2020483850 conn(0x5621fa59f4c0 msgr2=0x5621fa692ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/2020483850 shutdown_connections 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/2020483850 wait complete. 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 Processor -- start 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- start start 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa69e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.205+0000 7f8c4cd1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fa4a0160 con 0x5621fa5a38a0 2024-02-16T00:11:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8c489ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa69e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8c489ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa69e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54552/0 (socket says 172.21.15.42:54552) 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8c489ec640 1 -- 172.21.15.42:0/1960777060 learned_addr learned my addr 172.21.15.42:0/1960777060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8c489ec640 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fa4efba0 con 0x5621fa5a38a0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa69e960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x5621fa698010 tx=0x7f8c38000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8b3560a640 1 -- 172.21.15.42:0/1960777060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c38023030 con 0x5621fa5a38a0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8b3560a640 1 -- 172.21.15.42:0/1960777060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38003790 con 0x5621fa5a38a0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621fa69eea0 con 0x5621fa5a38a0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.206+0000 7f8b3560a640 1 -- 172.21.15.42:0/1960777060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c38003a30 con 0x5621fa5a38a0 2024-02-16T00:11:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.207+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fa69f380 con 0x5621fa5a38a0 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.207+0000 7f8b3560a640 1 -- 172.21.15.42:0/1960777060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c38026070 con 0x5621fa5a38a0 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.207+0000 7f8b3560a640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b300367e0 0x7f8b30038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8b3560a640 1 -- 172.21.15.42:0/1960777060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8c38024070 con 0x5621fa5a38a0 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c481eb640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b300367e0 0x7f8b30038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa5a53e0 0x5621fa6a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6a5c90 con 0x5621fa5a53e0 2024-02-16T00:11:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c491ed640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa5a53e0 0x5621fa6a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c481eb640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b300367e0 0x7f8b30038ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c30054000 tx=0x7f8c3004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c491ed640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa5a53e0 0x5621fa6a5670 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c491ed640 1 -- 172.21.15.42:0/1960777060 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c400083e0 con 0x5621fa5a53e0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.208+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6a2ce0 con 0x5621fa5a53e0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c491ed640 1 -- 172.21.15.42:0/1960777060 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8c400083e0 con 0x5621fa5a53e0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6a7ed0 0x5621fa6aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6aa9b0 con 0x5621fa6a7ed0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6a7ed0 0x5621fa6aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6a7ed0 0x5621fa6aa2c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c489ec640 1 -- 172.21.15.42:0/1960777060 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6a7ed0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.209+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6a6e50 con 0x5621fa5a53e0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c491ed640 1 -- 172.21.15.42:0/1960777060 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8c400083e0 con 0x5621fa5a53e0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6a7240 con 0x5621fa5a53e0 2024-02-16T00:11:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c491ed640 1 -- 172.21.15.42:0/1960777060 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8c400083e0 con 0x5621fa5a53e0 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c4cd1f800 1 Processor -- start 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c4cd1f800 1 -- start start 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c4cd1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 0x5621fa6b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.210+0000 7f8c4cd1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fa442e80 con 0x5621fa6b9790 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c491ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 0x5621fa6b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c491ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 0x5621fa6b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54566/0 (socket says 172.21.15.42:54566) 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c491ed640 1 -- 172.21.15.42:0/3426214580 learned_addr learned my addr 172.21.15.42:0/3426214580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c491ed640 1 -- 172.21.15.42:0/3426214580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fa6ba0f0 con 0x5621fa6b9790 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c491ed640 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 0x5621fa6b9bb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x5621fa69fd10 tx=0x7f8c4000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8b2e7fc640 1 -- 172.21.15.42:0/3426214580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c4000f040 con 0x5621fa6b9790 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8b2e7fc640 1 -- 172.21.15.42:0/3426214580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40007d00 con 0x5621fa6b9790 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621fa6bab60 con 0x5621fa6b9790 2024-02-16T00:11:44.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8b2e7fc640 1 -- 172.21.15.42:0/3426214580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c40019420 con 0x5621fa6b9790 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.211+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fa6bb020 con 0x5621fa6b9790 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.212+0000 7f8b2e7fc640 1 -- 172.21.15.42:0/3426214580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c400195d0 con 0x5621fa6b9790 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.212+0000 7f8b2e7fc640 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b200367e0 0x7f8b20038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.212+0000 7f8b2e7fc640 1 -- 172.21.15.42:0/3426214580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8c4004e0a0 con 0x5621fa6b9790 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.212+0000 7f8c489ec640 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b200367e0 0x7f8b20038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.212+0000 7f8c4cd1f800 1 Processor -- start 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c4cd1f800 1 -- start start 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c489ec640 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b200367e0 0x7f8b20038ca0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x5621fa6a6090 tx=0x7f8c38028ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c4cd1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c4cd1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fa4185d0 con 0x5621fa6c6b30 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c491ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c491ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54578/0 (socket says 172.21.15.42:54578) 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c491ed640 1 -- 172.21.15.42:0/3356423705 learned_addr learned my addr 172.21.15.42:0/3356423705 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c491ed640 1 -- 172.21.15.42:0/3356423705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fa6c7520 con 0x5621fa6c6b30 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8c491ed640 1 --2- 172.21.15.42:0/3356423705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6c6f50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8c4004c3f0 tx=0x7f8c40014f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b5a3113af62e20 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8b1ffff640 1 -- 172.21.15.42:0/3356423705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c400184e0 con 0x5621fa6c6b30 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8b1ffff640 1 -- 172.21.15.42:0/3356423705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4004a070 con 0x5621fa6c6b30 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.213+0000 7f8b1ffff640 1 -- 172.21.15.42:0/3356423705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c40019da0 con 0x5621fa6c6b30 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3356423705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 msgr2=0x5621fa6c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/3356423705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6c6f50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8c4004c3f0 tx=0x7f8c40014f10 comp rx=0 tx=0).stop 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3356423705 shutdown_connections 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/3356423705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6c6f50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3356423705 >> 172.21.15.42:0/3356423705 conn(0x5621fa6c2db0 msgr2=0x5621fa6c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3356423705 shutdown_connections 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3356423705 wait complete. 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 Processor -- start 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- start start 2024-02-16T00:11:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.214+0000 7f8c4cd1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fa6cdfd0 con 0x5621fa6c6b30 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c491ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c491ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54586/0 (socket says 172.21.15.42:54586) 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 learned_addr learned my addr 172.21.15.42:0/1364574964 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fa6bb020 con 0x5621fa6c6b30 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c491ed640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6cda90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c40014ad0 tx=0x7f8c4004c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8b1e7fc640 1 -- 172.21.15.42:0/1364574964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c400176f0 con 0x5621fa6c6b30 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8b1e7fc640 1 -- 172.21.15.42:0/1364574964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40017850 con 0x5621fa6c6b30 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8b1e7fc640 1 -- 172.21.15.42:0/1364574964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c40022730 con 0x5621fa6c6b30 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621fa6ce1d0 con 0x5621fa6c6b30 2024-02-16T00:11:44.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.215+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fa6ce630 con 0x5621fa6c6b30 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.216+0000 7f8b1e7fc640 1 -- 172.21.15.42:0/1364574964 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c4003b2b0 con 0x5621fa6c6b30 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.216+0000 7f8b1e7fc640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b14036790 0x7f8b14038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.216+0000 7f8b1e7fc640 1 -- 172.21.15.42:0/1364574964 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8c40036c40 con 0x5621fa6c6b30 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.216+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b14036790 0x7f8b14038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b14036790 0x7f8b14038c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c38029ca0 tx=0x7f8c38031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa6d9850 0x5621fa6dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6dc460 con 0x5621fa6d9850 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c481eb640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa6d9850 0x5621fa6dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c481eb640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa6d9850 0x5621fa6dbd10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 20 realm 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.217+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6dc7f0 con 0x5621fa6d9850 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6dcff0 con 0x5621fa6d9850 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6dd350 con 0x5621fa6d9850 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6de060 0x5621fa6e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6de060 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.218+0000 7f8c491ed640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6de060 0x5621fa6e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c491ed640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6de060 0x5621fa6e0450 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c4cd1f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c4cd1f800 20 searching for the correct realm 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5621fa6e2d30 0x5621fa6e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e58c0 con 0x5621fa6e2d30 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5621fa6e2d30 0x5621fa6e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.219+0000 7f8c489ec640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5621fa6e2d30 0x5621fa6e51f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.220+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.220+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e58c0 con 0x5621fa6de060 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.220+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.220+0000 7f8c491ed640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8c40035020 0x7f8c4002c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.220+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.220+0000 7f8c481eb640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8c40035020 0x7f8c4002c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.221+0000 7f8c481eb640 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8c40035020 0x7f8c4002c430 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.221+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.221+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.221+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.221+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6de060 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.222+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.223+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6de060 2024-02-16T00:11:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.224+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.224+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.224+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.224+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.224+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.224+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.225+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6de060 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.226+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6de060 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.227+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6e2d30 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x7f8c40035020 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6d9850 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.228+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e0a60 con 0x5621fa6de060 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e1130 con 0x5621fa6d9850 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e14e0 con 0x5621fa6d9850 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e18c0 con 0x5621fa6d9850 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 zone default found 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 4 Realm: () 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 zonegroup default 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.229+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e5d00 con 0x7f8c40035020 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7b80 con 0x5621fa6e2d30 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7ee0 con 0x5621fa6e2d30 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 started sync module instance, tier type = 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.230+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7150 con 0x5621fa6de060 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.231+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.231+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94703935452416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7150 con 0x5621fa6de060 2024-02-16T00:11:44.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.231+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e88b0 con 0x5621fa6d9850 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.232+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94703935452416] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.232+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.232+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94703935456176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7150 con 0x5621fa6d9850 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.232+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e92f0 con 0x5621fa6e2d30 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.234+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.234+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94703935458768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e9b80 con 0x5621fa6e2d30 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.234+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6ea630 con 0x5621fa6de060 2024-02-16T00:11:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.234+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94703935456176] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.235+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94703935458768] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.235+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.235+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94703935463728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e96a0 con 0x5621fa6de060 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.235+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6eaff0 con 0x5621fa6d9850 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.236+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94703935463728] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.236+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.236+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94703935450288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6eaff0 con 0x5621fa6d9850 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.236+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6eb960 con 0x7f8c40035020 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.237+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.237+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94703935468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6eb8e0 con 0x7f8c40035020 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.237+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6ec880 con 0x7f8c40035020 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.237+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94703935450288] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.238+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94703935468736] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.238+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.238+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94703935472512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6ebcc0 con 0x7f8c40035020 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.238+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6ece50 con 0x7f8c40035020 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94703935472512] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94703935474096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6ed270 con 0x7f8c40035020 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=0 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=1 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=2 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=3 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=4 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=5 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.239+0000 7f8c4cd1f800 20 add_watcher() i=6 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.240+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94703935474096] v27'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.240+0000 7f8c4cd1f800 20 add_watcher() i=7 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.240+0000 7f8c4cd1f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.240+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f0630 con 0x5621fa6d9850 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.240+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.240+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94703935475152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6edad0 con 0x5621fa6d9850 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.241+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94703935475152] v27'163 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.241+0000 7f8afefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.242+0000 7f8c4cd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.242+0000 7f8c4cd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.242+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f8b50 con 0x5621fa6d9850 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.243+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'50 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.243+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f9160 con 0x7f8c40035020 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.244+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.244+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f9690 con 0x5621fa6e2d30 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.245+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'25 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.245+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fa060 con 0x5621fa6d9850 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.246+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'164 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.246+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f4a20 con 0x5621fa6de060 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.247+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'53 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.247+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f4a20 con 0x5621fa6e2d30 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.248+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'43 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.248+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fb240 con 0x5621fa6d9850 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.249+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.249+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fb240 con 0x7f8c40035020 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.250+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'38 uv14 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.251+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fb2d0 con 0x5621fa6de060 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.252+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.252+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fb800 con 0x5621fa6e2d30 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.253+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.253+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fbd30 con 0x5621fa6de060 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.254+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'54 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.254+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc1d0 con 0x7f8c40035020 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.255+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.255+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc1d0 con 0x5621fa6de060 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.255+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.256+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc1d0 con 0x7f8c40035020 2024-02-16T00:11:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.257+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'49 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.257+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc1d0 con 0x5621fa6d9850 2024-02-16T00:11:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.258+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'165 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.258+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc1d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.259+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'47 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.259+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6de060 2024-02-16T00:11:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.259+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'55 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.260+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6e2d30 2024-02-16T00:11:44.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.260+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.260+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6d9850 2024-02-16T00:11:44.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.262+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'27 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.262+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6d9850 2024-02-16T00:11:44.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.263+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'166 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.263+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6e2d30 2024-02-16T00:11:44.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.264+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'48 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.264+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6de060 2024-02-16T00:11:44.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.265+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'37 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.265+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6e2d30 2024-02-16T00:11:44.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.265+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.266+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc090 con 0x5621fa6e2d30 2024-02-16T00:11:44.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.267+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.267+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x5621fa6e2d30 2024-02-16T00:11:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.267+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.267+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x5621fa6e2d30 2024-02-16T00:11:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.268+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'44 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.268+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x7f8c40035020 2024-02-16T00:11:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.269+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'27 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.270+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x5621fa6e2d30 2024-02-16T00:11:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.271+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'31 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.271+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x7f8c40035020 2024-02-16T00:11:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.272+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'39 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.272+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x5621fa6e2d30 2024-02-16T00:11:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.273+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'49 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.273+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x7f8c40035020 2024-02-16T00:11:44.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.274+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'50 uv16 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.274+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6fc110 con 0x5621fa6de060 2024-02-16T00:11:44.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.275+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.276+0000 7f8afdfe3640 20 reqs_thread_entry: start 2024-02-16T00:11:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.276+0000 7f8c4cd1f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.276+0000 7f8c4cd1f800 20 Filter name: none 2024-02-16T00:11:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.276+0000 7f8a6f7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.276+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-02-16T00:11:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.276+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.277+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 gc.14 [call] v27'167 uv167 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.277+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.277+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(95 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.277+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.277+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(96 gc.14 [call out=24b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(97 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(98 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.278+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.279+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(99 gc.14 [call] v27'168 uv168 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.279+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-02-16T00:11:44.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.279+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:100 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.280+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(100 gc.15 [call] v27'50 uv50 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.280+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:101 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.280+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(101 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.280+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:102 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(102 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:103 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(103 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:104 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(104 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.281+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:105 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.282+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(105 gc.15 [call] v27'51 uv51 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.282+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-02-16T00:11:44.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.282+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.283+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(106 gc.16 [call] v27'56 uv56 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.283+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:107 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(107 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:108 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(108 gc.16 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:109 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(109 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.284+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:110 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.285+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(110 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.285+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.285+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:111 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.286+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(111 gc.16 [call] v27'57 uv57 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.286+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-02-16T00:11:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.286+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:112 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(112 gc.17 [call] v27'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:113 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(113 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:114 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(114 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:115 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(115 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.287+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:116 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.288+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(116 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.288+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.288+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:117 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.289+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(117 gc.17 [call] v27'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.289+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-02-16T00:11:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.289+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:118 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(118 gc.18 [call] v27'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:119 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(119 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:120 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(120 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.290+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:121 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.291+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(121 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.291+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.291+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:122 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.291+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(122 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.291+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.291+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:123 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.292+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(123 gc.18 [call] v27'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.292+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-02-16T00:11:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.292+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:124 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.293+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(124 gc.19 [call] v27'169 uv169 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.293+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:125 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.293+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 41 ==== osd_op_reply(125 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.293+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.293+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:126 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 42 ==== osd_op_reply(126 gc.19 [call out=24b] v0'0 uv169 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:127 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 43 ==== osd_op_reply(127 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:128 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 44 ==== osd_op_reply(128 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.294+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:129 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.295+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 45 ==== osd_op_reply(129 gc.19 [call] v27'170 uv170 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.295+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.295+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:130 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.296+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(130 gc.20 [call] v27'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.296+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:131 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.296+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(131 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:132 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(132 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:133 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 41 ==== osd_op_reply(133 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:134 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 42 ==== osd_op_reply(134 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.297+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:135 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.298+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 43 ==== osd_op_reply(135 gc.20 [call] v27'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.298+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-02-16T00:11:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.298+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:136 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.299+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(136 gc.21 [call] v27'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.299+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:137 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== osd_op_reply(137 gc.21 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:138 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(138 gc.21 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:139 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(139 gc.21 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:140 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(140 gc.21 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.300+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:141 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.301+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(141 gc.21 [call] v27'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.301+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.301+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:142 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.302+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 44 ==== osd_op_reply(142 gc.22 [call] v27'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.302+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:143 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.302+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 45 ==== osd_op_reply(143 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.302+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.302+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:144 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 46 ==== osd_op_reply(144 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:145 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 47 ==== osd_op_reply(145 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:146 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 48 ==== osd_op_reply(146 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.303+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.304+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 49 ==== osd_op_reply(147 gc.22 [call] v27'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.304+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-02-16T00:11:44.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.304+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:148 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.305+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 50 ==== osd_op_reply(148 gc.23 [call] v27'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.305+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:149 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.305+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 51 ==== osd_op_reply(149 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.305+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.305+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:150 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 52 ==== osd_op_reply(150 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:151 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 53 ==== osd_op_reply(151 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:152 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 54 ==== osd_op_reply(152 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.306+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:153 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.307+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 55 ==== osd_op_reply(153 gc.23 [call] v27'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.307+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.307+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:154 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 56 ==== osd_op_reply(154 gc.24 [call] v27'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:155 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 57 ==== osd_op_reply(155 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:156 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 58 ==== osd_op_reply(156 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.308+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:157 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.309+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 59 ==== osd_op_reply(157 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.309+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.309+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:158 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.309+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 60 ==== osd_op_reply(158 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.309+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.309+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:159 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.310+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 61 ==== osd_op_reply(159 gc.24 [call] v27'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.310+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.310+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:160 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 62 ==== osd_op_reply(160 gc.25 [call] v27'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:161 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 63 ==== osd_op_reply(161 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:162 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 64 ==== osd_op_reply(162 gc.25 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.311+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:163 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.312+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 65 ==== osd_op_reply(163 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.312+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.312+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:164 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.312+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 66 ==== osd_op_reply(164 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.312+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.312+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:165 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.313+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 67 ==== osd_op_reply(165 gc.25 [call] v27'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.313+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-02-16T00:11:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.313+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:166 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.314+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(166 gc.26 [call] v27'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.314+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:167 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(167 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:168 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(168 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:169 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(169 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:170 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(170 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.315+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:171 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.317+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(171 gc.26 [call] v27'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.317+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-02-16T00:11:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.317+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:172 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 68 ==== osd_op_reply(172 gc.27 [call] v27'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:173 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 69 ==== osd_op_reply(173 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:174 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 70 ==== osd_op_reply(174 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.318+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.319+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 71 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.319+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.319+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.319+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 72 ==== osd_op_reply(176 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.319+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.319+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.320+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 73 ==== osd_op_reply(177 gc.27 [call] v27'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.320+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-02-16T00:11:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.320+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(178 gc.28 [call] v27'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(179 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(180 gc.28 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.321+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:181 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.322+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(181 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.322+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.322+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:182 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.322+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(182 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.322+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.322+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:183 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.323+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(183 gc.28 [call] v27'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.323+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.323+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:184 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.324+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 74 ==== osd_op_reply(184 gc.29 [call] v27'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.324+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:185 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.324+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 75 ==== osd_op_reply(185 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.324+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.324+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:186 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 76 ==== osd_op_reply(186 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:187 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 77 ==== osd_op_reply(187 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:188 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 78 ==== osd_op_reply(188 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.325+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:189 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6e2d30 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.326+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 79 ==== osd_op_reply(189 gc.29 [call] v27'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.326+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-02-16T00:11:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.326+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:190 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.328+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(190 gc.30 [call] v27'51 uv51 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.328+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:191 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.328+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(191 gc.30 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.328+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.328+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:192 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.329+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(192 gc.30 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.329+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:193 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.329+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(193 gc.30 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.329+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.329+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:194 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.330+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== osd_op_reply(194 gc.30 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.330+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.330+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:195 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.331+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== osd_op_reply(195 gc.30 [call] v27'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.331+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-02-16T00:11:44.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.331+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:196 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 31 ==== osd_op_reply(196 gc.31 [call] v27'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:197 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 32 ==== osd_op_reply(197 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:198 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 33 ==== osd_op_reply(198 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.332+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:199 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.333+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 34 ==== osd_op_reply(199 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.333+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.333+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:200 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.333+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 35 ==== osd_op_reply(200 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.333+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.333+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:201 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6de060 2024-02-16T00:11:44.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.334+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 36 ==== osd_op_reply(201 gc.31 [call] v27'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.334+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-02-16T00:11:44.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.334+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:202 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 46 ==== osd_op_reply(202 gc.0 [call] v27'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:203 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 47 ==== osd_op_reply(203 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:204 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 48 ==== osd_op_reply(204 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.335+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.336+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 49 ==== osd_op_reply(205 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.336+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.336+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:206 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.336+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 50 ==== osd_op_reply(206 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.336+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.336+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:207 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x5621fa6d9850 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.337+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 51 ==== osd_op_reply(207 gc.0 [call] v27'52 uv52 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.337+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.337+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:208 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.338+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(208 gc.1 [call] v27'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.338+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:209 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.338+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== osd_op_reply(209 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.338+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.338+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:210 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.339+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== osd_op_reply(210 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.339+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:211 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.339+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== osd_op_reply(211 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.339+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.339+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:212 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f35d0 con 0x7f8c40035020 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 46 ==== osd_op_reply(212 gc.1 [call out=1702b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process iterating over entry tag='5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10068340188151715470', time=2024-02-16T00:11:43.946778+0000, chain.objs.size()=7 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_1 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:213 3.38s0 3:1cfcc49b:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3e20 con 0x7f8c40035020 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_2 2024-02-16T00:11:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:214 3.20s0 3:073f164c:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa72a1f0 con 0x5621fa6de060 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_3 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:215 3.17s0 3:e8283b6f:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa72cab0 con 0x5621fa6d9850 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_4 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:216 3.9s0 3:90c3df3a:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa72cab0 con 0x5621fa6e2d30 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_5 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:217 3.es0 3:73412d12:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa731910 con 0x5621fa6de060 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_6 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:218 3.32s0 3:4e06a589:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa7341f0 con 0x5621fa6e2d30 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_7 2024-02-16T00:11:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.340+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:219 3.6s0 3:62ec8d55:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa7366b0 con 0x5621fa6d9850 2024-02-16T00:11:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.342+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 37 ==== osd_op_reply(214 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_2 [call] v27'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.343+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 38 ==== osd_op_reply(217 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_5 [call] v27'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.343+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 47 ==== osd_op_reply(213 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_1 [call] v27'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.343+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 52 ==== osd_op_reply(219 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_7 [call] v27'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.344+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 53 ==== osd_op_reply(215 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_3 [call] v27'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.344+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 80 ==== osd_op_reply(216 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_4 [call] v27'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.344+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 81 ==== osd_op_reply(218 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1__shadow_.0UCV3RN4BEJl1zz5XqjbKckYciU6Kzq_6 [call] v27'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.344+0000 7f8c4cd1f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-16T00:11:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.344+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:220 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x7f8c40035020 2024-02-16T00:11:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.346+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 48 ==== osd_op_reply(220 gc.1 [call] v27'28 uv28 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.346+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:221 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x7f8c40035020 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.347+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 49 ==== osd_op_reply(221 gc.1 [call] v27'29 uv29 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.347+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.347+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:222 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6e2d30 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 82 ==== osd_op_reply(222 gc.2 [call] v27'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:223 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6e2d30 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 83 ==== osd_op_reply(223 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:224 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa730400 con 0x5621fa6e2d30 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 84 ==== osd_op_reply(224 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:225 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6e2d30 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 85 ==== osd_op_reply(225 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.348+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:226 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6e2d30 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.349+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 86 ==== osd_op_reply(226 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.349+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.349+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:227 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6e2d30 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.349+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 87 ==== osd_op_reply(227 gc.2 [call] v27'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.349+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-02-16T00:11:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.350+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:228 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 54 ==== osd_op_reply(228 gc.3 [call] v27'171 uv171 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:229 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 55 ==== osd_op_reply(229 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:230 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa72b5c0 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 56 ==== osd_op_reply(230 gc.3 [call out=24b] v0'0 uv171 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:231 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6d9850 2024-02-16T00:11:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 57 ==== osd_op_reply(231 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.351+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:232 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6d9850 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.352+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 58 ==== osd_op_reply(232 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.352+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.352+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:233 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6d9850 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.352+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 59 ==== osd_op_reply(233 gc.3 [call] v27'172 uv172 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.352+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.352+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:234 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6de060 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.353+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 39 ==== osd_op_reply(234 gc.4 [call] v27'58 uv58 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.353+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:235 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6de060 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.353+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 40 ==== osd_op_reply(235 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.353+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:236 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 41 ==== osd_op_reply(236 gc.4 [call out=24b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:237 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 42 ==== osd_op_reply(237 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:238 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3980 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 43 ==== osd_op_reply(238 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.354+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:239 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa72c520 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.355+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 44 ==== osd_op_reply(239 gc.4 [call] v27'59 uv59 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.355+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.355+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:240 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa72c520 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.356+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 88 ==== osd_op_reply(240 gc.5 [call] v27'47 uv47 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.356+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:241 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.356+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 89 ==== osd_op_reply(241 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.356+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.356+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:242 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 90 ==== osd_op_reply(242 gc.5 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:243 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 91 ==== osd_op_reply(243 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:244 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 92 ==== osd_op_reply(244 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.357+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:245 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.358+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 93 ==== osd_op_reply(245 gc.5 [call] v27'48 uv48 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.358+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-02-16T00:11:44.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.358+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:246 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.359+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 60 ==== osd_op_reply(246 gc.6 [call] v27'28 uv28 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.359+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:247 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.359+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 61 ==== osd_op_reply(247 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.359+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.359+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:248 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 62 ==== osd_op_reply(248 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:249 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 63 ==== osd_op_reply(249 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:250 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 64 ==== osd_op_reply(250 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.360+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:251 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6d9850 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.361+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 65 ==== osd_op_reply(251 gc.6 [call] v27'29 uv29 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.361+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.361+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:252 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.362+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 50 ==== osd_op_reply(252 gc.7 [call] v27'42 uv42 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.362+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:253 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 51 ==== osd_op_reply(253 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:254 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 52 ==== osd_op_reply(254 gc.7 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:255 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 53 ==== osd_op_reply(255 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:256 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 54 ==== osd_op_reply(256 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.363+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:257 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x7f8c40035020 2024-02-16T00:11:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.364+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 55 ==== osd_op_reply(257 gc.7 [call] v27'43 uv43 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.364+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-02-16T00:11:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.364+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:258 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.365+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 45 ==== osd_op_reply(258 gc.8 [call] v27'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.365+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:259 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 46 ==== osd_op_reply(259 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:260 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 47 ==== osd_op_reply(260 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:261 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 48 ==== osd_op_reply(261 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:262 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 49 ==== osd_op_reply(262 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.366+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:263 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.367+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 50 ==== osd_op_reply(263 gc.8 [call] v27'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.367+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.367+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:264 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.368+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 94 ==== osd_op_reply(264 gc.9 [call] v27'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.368+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:265 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6e2d30 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 95 ==== osd_op_reply(265 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:266 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 96 ==== osd_op_reply(266 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:267 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 97 ==== osd_op_reply(267 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:268 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 98 ==== osd_op_reply(268 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.369+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:269 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.370+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 99 ==== osd_op_reply(269 gc.9 [call] v27'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.370+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.370+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:270 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.371+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 51 ==== osd_op_reply(270 gc.10 [call] v27'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.371+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:271 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.371+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 52 ==== osd_op_reply(271 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.371+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.371+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:272 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 53 ==== osd_op_reply(272 gc.10 [call out=24b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:273 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 54 ==== osd_op_reply(273 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:274 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 55 ==== osd_op_reply(274 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.372+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:275 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.373+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 56 ==== osd_op_reply(275 gc.10 [call] v27'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.373+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-02-16T00:11:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.373+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:276 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.374+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 56 ==== osd_op_reply(276 gc.11 [call] v27'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.374+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:277 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.374+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 57 ==== osd_op_reply(277 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.374+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.374+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:278 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 58 ==== osd_op_reply(278 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:279 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 59 ==== osd_op_reply(279 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:280 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 60 ==== osd_op_reply(280 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.375+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:281 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.377+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 61 ==== osd_op_reply(281 gc.11 [call] v27'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.377+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.377+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:282 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 57 ==== osd_op_reply(282 gc.12 [call] v27'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:283 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 58 ==== osd_op_reply(283 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:284 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 59 ==== osd_op_reply(284 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:285 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 60 ==== osd_op_reply(285 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.378+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:286 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.379+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 61 ==== osd_op_reply(286 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.379+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.379+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:287 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x5621fa6de060 2024-02-16T00:11:44.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.379+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 62 ==== osd_op_reply(287 gc.12 [call] v27'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.379+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.379+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:288 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 62 ==== osd_op_reply(288 gc.13 [call] v27'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:289 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 63 ==== osd_op_reply(289 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:290 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 64 ==== osd_op_reply(290 gc.13 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:291 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 65 ==== osd_op_reply(291 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:11:44.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.381+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:292 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x7f8c40035020 2024-02-16T00:11:44.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.382+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 66 ==== osd_op_reply(292 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.382+0000 7f8c4cd1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:11:44.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.382+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:293 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3c20 con 0x7f8c40035020 2024-02-16T00:11:44.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.382+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 67 ==== osd_op_reply(293 gc.13 [call] v27'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.383+0000 7f8afefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.383+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94703935475152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6f3870 con 0x5621fa6d9850 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.384+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94703935475152] v27'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.384+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94703935452416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6ecdd0 con 0x5621fa6de060 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.385+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94703935452416] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.385+0000 7f8c4cd1f800 20 remove_watcher() i=0 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.385+0000 7f8c4cd1f800 2 removed watcher, disabling cache 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.385+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94703935456176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7500 con 0x5621fa6d9850 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.386+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94703935456176] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.387+0000 7f8c4cd1f800 20 remove_watcher() i=1 2024-02-16T00:11:44.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.387+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94703935458768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7500 con 0x5621fa6e2d30 2024-02-16T00:11:44.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.388+0000 7f8c489ec640 1 -- 172.21.15.42:0/1364574964 <== osd.3 v2:172.21.15.42:6810/474355007 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94703935458768] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c38029990 con 0x5621fa6e2d30 2024-02-16T00:11:44.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.388+0000 7f8c4cd1f800 20 remove_watcher() i=2 2024-02-16T00:11:44.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.388+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94703935463728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7500 con 0x5621fa6de060 2024-02-16T00:11:44.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.389+0000 7f8c491ed640 1 -- 172.21.15.42:0/1364574964 <== osd.2 v2:172.21.15.42:6808/1288904824 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94703935463728] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c40032070 con 0x5621fa6de060 2024-02-16T00:11:44.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.389+0000 7f8c4cd1f800 20 remove_watcher() i=3 2024-02-16T00:11:44.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.389+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94703935450288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7500 con 0x5621fa6d9850 2024-02-16T00:11:44.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.390+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.1 v2:172.21.15.42:6800/2950936693 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94703935450288] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x5621fa6d9850 2024-02-16T00:11:44.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.390+0000 7f8c4cd1f800 20 remove_watcher() i=4 2024-02-16T00:11:44.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.390+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94703935468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e6cb0 con 0x7f8c40035020 2024-02-16T00:11:44.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.391+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94703935468736] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.391+0000 7f8c4cd1f800 20 remove_watcher() i=5 2024-02-16T00:11:44.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.391+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94703935472512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6e7500 con 0x7f8c40035020 2024-02-16T00:11:44.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.392+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94703935472512] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.392+0000 7f8c4cd1f800 20 remove_watcher() i=6 2024-02-16T00:11:44.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.392+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94703935474096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5621fa6eb4c0 con 0x7f8c40035020 2024-02-16T00:11:44.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 <== osd.0 v2:172.21.15.2:6800/1783370926 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94703935474096] v27'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c30052b00 con 0x7f8c40035020 2024-02-16T00:11:44.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 20 remove_watcher() i=7 2024-02-16T00:11:44.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8c40035020 msgr2=0x7f8c4002c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8c40035020 0x7f8c4002c430 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa6d9850 msgr2=0x5621fa6dbd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa6d9850 0x5621fa6dbd10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6de060 msgr2=0x5621fa6e0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6de060 0x5621fa6e0450 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5621fa6e2d30 msgr2=0x5621fa6e51f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5621fa6e2d30 0x5621fa6e51f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b14036790 msgr2=0x7f8b14038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b14036790 0x7f8b14038c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c38029ca0 tx=0x7f8c38031000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 msgr2=0x5621fa6cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6cda90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c40014ad0 tx=0x7f8c4004c380 comp rx=0 tx=0).stop 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c481eb640 1 -- 172.21.15.42:0/1364574964 reap_dead start 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 shutdown_connections 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1364574964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6c6b30 0x5621fa6cda90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 >> 172.21.15.42:0/1364574964 conn(0x5621fa6c2db0 msgr2=0x5621fa6c0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 shutdown_connections 2024-02-16T00:11:44.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1364574964 wait complete. 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b200367e0 msgr2=0x7f8b20038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b200367e0 0x7f8b20038ca0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x5621fa6a6090 tx=0x7f8c38028ef0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 msgr2=0x5621fa6b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.393+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 0x5621fa6b9bb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x5621fa69fd10 tx=0x7f8c4000aec0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 shutdown_connections 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b200367e0 0x7f8b20038ca0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/3426214580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa6b9790 0x5621fa6b9bb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 >> 172.21.15.42:0/3426214580 conn(0x5621fa6ad830 msgr2=0x5621fa6adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 shutdown_connections 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/3426214580 wait complete. 2024-02-16T00:11:44.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa5a53e0 msgr2=0x5621fa6a5670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa5a53e0 0x5621fa6a5670 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6a7ed0 msgr2=0x5621fa6aa2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6a7ed0 0x5621fa6aa2c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b300367e0 msgr2=0x7f8b30038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b300367e0 0x7f8b30038ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c30054000 tx=0x7f8c3004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 msgr2=0x5621fa69e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa69e960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x5621fa698010 tx=0x7f8c38000f40 comp rx=0 tx=0).stop 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 shutdown_connections 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5621fa6a7ed0 0x5621fa6aa2c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5621fa5a53e0 0x5621fa6a5670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8b300367e0 0x7f8b30038ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 --2- 172.21.15.42:0/1960777060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5621fa5a38a0 0x5621fa69e960 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 >> 172.21.15.42:0/1960777060 conn(0x5621fa59f4c0 msgr2=0x5621fa691400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 shutdown_connections 2024-02-16T00:11:44.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.394+0000 7f8c4cd1f800 1 -- 172.21.15.42:0/1960777060 wait complete. 2024-02-16T00:11:44.405 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-16T00:11:44.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-16T00:11:44.405 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-16T00:11:44.487 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:44.487 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:44.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3ed89d800 1 Processor -- start 2024-02-16T00:11:44.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3ed89d800 1 -- start start 2024-02-16T00:11:44.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3ed89d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ddc0403020 0x55ddc0403440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3ed89d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ddc034dbb0 con 0x55ddc0404280 2024-02-16T00:11:44.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3ed89d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ddc0305450 con 0x55ddc0403020 2024-02-16T00:11:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3eb3a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ddc0403020 0x55ddc0403440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3eb3a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ddc0403020 0x55ddc0403440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54598/0 (socket says 172.21.15.42:54598) 2024-02-16T00:11:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/3786538424 learned_addr learned my addr 172.21.15.42:0/3786538424 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3eaba2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55ddc0404280 0x55ddc0404700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51496/0 (socket says 172.21.15.42:51496) 2024-02-16T00:11:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.485+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/3786538424 >> v1:172.21.15.2:6789/0 conn(0x55ddc0404280 legacy=0x55ddc0404700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.486+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/3786538424 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc0403b10 con 0x55ddc0403020 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.487+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/3786538424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc0403440 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc005fd0 tx=0x7fe3dc01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ff554d52760676 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.487+0000 7fe3ea3a1640 1 -- 172.21.15.42:0/3786538424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc052540 con 0x55ddc0403020 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.487+0000 7fe3ea3a1640 1 -- 172.21.15.42:0/3786538424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0526a0 con 0x55ddc0403020 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.487+0000 7fe3ea3a1640 1 -- 172.21.15.42:0/3786538424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0529c0 con 0x55ddc0403020 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3786538424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 msgr2=0x55ddc0403440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3786538424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc0403440 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc005fd0 tx=0x7fe3dc01cc50 comp rx=0 tx=0).stop 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3786538424 shutdown_connections 2024-02-16T00:11:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3786538424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc0403440 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3786538424 >> 172.21.15.42:0/3786538424 conn(0x55ddc03fe5c0 msgr2=0x55ddc04009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3786538424 shutdown_connections 2024-02-16T00:11:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.488+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3786538424 wait complete. 2024-02-16T00:11:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.499+0000 7fe3ed89d800 1 Processor -- start 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.499+0000 7fe3ed89d800 1 -- start start 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.499+0000 7fe3ed89d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04f3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.499+0000 7fe3ed89d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc0302980 con 0x55ddc0403020 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe3eb3a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe3eb3a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54612/0 (socket says 172.21.15.42:54612) 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/3299208141 learned_addr learned my addr 172.21.15.42:0/3299208141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/3299208141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc00a1c0 con 0x55ddc0403020 2024-02-16T00:11:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/3299208141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04f3360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc007000 tx=0x7fe3dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb80cb011b51c54 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe2d960a640 1 -- 172.21.15.42:0/3299208141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc052a00 con 0x55ddc0403020 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe2d960a640 1 -- 172.21.15.42:0/3299208141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc05d420 con 0x55ddc0403020 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.500+0000 7fe2d960a640 1 -- 172.21.15.42:0/3299208141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc05d700 con 0x55ddc0403020 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3299208141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 msgr2=0x55ddc04f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3299208141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04f3360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc007000 tx=0x7fe3dc04c000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3299208141 shutdown_connections 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3299208141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04f3360 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3299208141 >> 172.21.15.42:0/3299208141 conn(0x55ddc03fe5c0 msgr2=0x55ddc04eec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3299208141 shutdown_connections 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3299208141 wait complete. 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 Processor -- start 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.501+0000 7fe3ed89d800 1 -- start start 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3ed89d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04fa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3ed89d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc02fe160 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3eb3a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04fa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3eb3a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04fa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54622/0 (socket says 172.21.15.42:54622) 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/2360909135 learned_addr learned my addr 172.21.15.42:0/2360909135 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc04fae00 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04fa8c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc007000 tx=0x7fe3dc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe2d7e07640 1 -- 172.21.15.42:0/2360909135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc05dac0 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe2d7e07640 1 -- 172.21.15.42:0/2360909135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc05dc20 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ddc04fb050 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe2d7e07640 1 -- 172.21.15.42:0/2360909135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc071440 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.502+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddc04fdd40 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.503+0000 7fe2d7e07640 1 -- 172.21.15.42:0/2360909135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe3dc07a440 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.503+0000 7fe2d7e07640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2d0036790 0x7fe2d0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.503+0000 7fe2d7e07640 1 -- 172.21.15.42:0/2360909135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe3dc08e6d0 con 0x55ddc0403020 2024-02-16T00:11:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.503+0000 7fe3eaba2640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2d0036790 0x7fe2d0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.503+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0404280 0x55ddc0501710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.503+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0501c50 con 0x55ddc0404280 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0404280 0x55ddc0501710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3eaba2640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2d0036790 0x7fe2d0038c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000f60 tx=0x7fe3e0001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0404280 0x55ddc0501710 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3ebba4640 1 -- 172.21.15.42:0/2360909135 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc0404280 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc04fede0 con 0x55ddc0404280 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3ebba4640 1 -- 172.21.15.42:0/2360909135 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc0404280 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.504+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc0503d00 0x55ddc05061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.505+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0506950 con 0x55ddc0503d00 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.505+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc0503d00 0x55ddc05061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.505+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc0503d00 0x55ddc05061c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.505+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/2360909135 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0503d00 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.505+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc05024d0 con 0x55ddc0404280 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.505+0000 7fe3ebba4640 1 -- 172.21.15.42:0/2360909135 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc0404280 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.506+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc05028c0 con 0x55ddc0404280 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.506+0000 7fe3ebba4640 1 -- 172.21.15.42:0/2360909135 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc0404280 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.506+0000 7fe3ed89d800 1 Processor -- start 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.506+0000 7fe3ed89d800 1 -- start start 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.506+0000 7fe3ed89d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 0x55ddc0515b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.506+0000 7fe3ed89d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc02a0e80 con 0x55ddc05156f0 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ebba4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 0x55ddc0515b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ebba4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 0x55ddc0515b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54636/0 (socket says 172.21.15.42:54636) 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ebba4640 1 -- 172.21.15.42:0/3441237130 learned_addr learned my addr 172.21.15.42:0/3441237130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ebba4640 1 -- 172.21.15.42:0/3441237130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc0516050 con 0x55ddc05156f0 2024-02-16T00:11:44.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 0x55ddc0515b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55ddc04fb790 tx=0x7fe3e400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe2d5602640 1 -- 172.21.15.42:0/3441237130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e400f040 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe2d5602640 1 -- 172.21.15.42:0/3441237130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e4007ca0 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ddc0516ac0 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe2d5602640 1 -- 172.21.15.42:0/3441237130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e4019420 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.507+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddc0516f80 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.508+0000 7fe2d5602640 1 -- 172.21.15.42:0/3441237130 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe3e40195d0 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.508+0000 7fe2d5602640 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2c40367e0 0x7fe2c4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.508+0000 7fe2d5602640 1 -- 172.21.15.42:0/3441237130 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe3e404e040 con 0x55ddc05156f0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.508+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2c40367e0 0x7fe2c4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.508+0000 7fe3ed89d800 1 Processor -- start 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ed89d800 1 -- start start 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2c40367e0 0x7fe2c4038ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc065b30 tx=0x7fe3dc08c9f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ed89d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc0376500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ed89d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc02765d0 con 0x55ddc0377dd0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ebba4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc0376500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ebba4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc0376500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54638/0 (socket says 172.21.15.42:54638) 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ebba4640 1 -- 172.21.15.42:0/3797060204 learned_addr learned my addr 172.21.15.42:0/3797060204 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ebba4640 1 -- 172.21.15.42:0/3797060204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc0378280 con 0x55ddc0377dd0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/3797060204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc0376500 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe3e404c3c0 tx=0x7fe3e4019af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49084bb85b265cb2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe2ceffd640 1 -- 172.21.15.42:0/3797060204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e40173b0 con 0x55ddc0377dd0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe2ceffd640 1 -- 172.21.15.42:0/3797060204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e4017510 con 0x55ddc0377dd0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.509+0000 7fe2ceffd640 1 -- 172.21.15.42:0/3797060204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e4017df0 con 0x55ddc0377dd0 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3797060204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 msgr2=0x55ddc0376500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3797060204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc0376500 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe3e404c3c0 tx=0x7fe3e4019af0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3797060204 shutdown_connections 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3797060204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc0376500 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3797060204 >> 172.21.15.42:0/3797060204 conn(0x55ddc051ec50 msgr2=0x55ddc051ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3797060204 shutdown_connections 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3797060204 wait complete. 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 Processor -- start 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- start start 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc052bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.510+0000 7fe3ed89d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc052c050 con 0x55ddc0377dd0 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ebba4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc052bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ebba4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc052bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54644/0 (socket says 172.21.15.42:54644) 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 learned_addr learned my addr 172.21.15.42:0/1080782911 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc0516f80 con 0x55ddc0377dd0 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc052bb10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4014fd0 tx=0x7fe3e404c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe2cd7fa640 1 -- 172.21.15.42:0/1080782911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e4040040 con 0x55ddc0377dd0 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe2cd7fa640 1 -- 172.21.15.42:0/1080782911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e4017a40 con 0x55ddc0377dd0 2024-02-16T00:11:44.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ddc052c250 con 0x55ddc0377dd0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe2cd7fa640 1 -- 172.21.15.42:0/1080782911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e4015db0 con 0x55ddc0377dd0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.511+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddc052c6b0 con 0x55ddc0377dd0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe2cd7fa640 1 -- 172.21.15.42:0/1080782911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe3e4032020 con 0x55ddc0377dd0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe2cd7fa640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2b40367e0 0x7fe2b4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe2cd7fa640 1 -- 172.21.15.42:0/1080782911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe3e4036c60 con 0x55ddc0377dd0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2b40367e0 0x7fe2b4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0537810 0x55ddc0539cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.512+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053a420 con 0x55ddc0537810 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3eaba2640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0537810 0x55ddc0539cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2b40367e0 0x7fe2b4038ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc08e010 tx=0x7fe3dc085000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3eaba2640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0537810 0x55ddc0539cd0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 20 realm 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0536cf0 con 0x55ddc0537810 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.513+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053aea0 con 0x55ddc0537810 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053b3b0 con 0x55ddc0537810 2024-02-16T00:11:44.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc053c160 0x55ddc053e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053ead0 con 0x55ddc053c160 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc053c160 0x55ddc053e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc053c160 0x55ddc053e550 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.514+0000 7fe3ed89d800 20 searching for the correct realm 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.515+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ddc0540860 0x55ddc0542c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.515+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0543300 con 0x55ddc0540860 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.515+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ddc0540860 0x55ddc0542c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.515+0000 7fe3eb3a3640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ddc0540860 0x55ddc0542c50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.515+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.515+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0543300 con 0x55ddc053c160 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.516+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.516+0000 7fe3ebba4640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe3e4019040 0x7fe3e40228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.516+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.516+0000 7fe3eaba2640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe3e4019040 0x7fe3e40228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.516+0000 7fe3eaba2640 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe3e4019040 0x7fe3e40228a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.517+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc053c160 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.518+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.519+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.519+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.519+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.519+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc053c160 2024-02-16T00:11:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.520+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.521+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc053c160 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.522+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc053c160 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.523+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0540860 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x7fe3e4019040 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc0537810 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fe3e4050070 con 0x55ddc053c160 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.524+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053f340 con 0x55ddc0537810 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053f6f0 con 0x55ddc0537810 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053fad0 con 0x55ddc0537810 2024-02-16T00:11:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 zone default found 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 4 Realm: () 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 zonegroup default 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc053fec0 con 0x7fe3e4019040 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.525+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0545100 con 0x55ddc0540860 2024-02-16T00:11:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0545460 con 0x55ddc0540860 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 20 started sync module instance, tier type = 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.526+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc05449e0 con 0x55ddc053c160 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.527+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.527+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410902881600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0544d90 con 0x55ddc053c160 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.527+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0546150 con 0x55ddc0537810 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.528+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94410902881600] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.528+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.528+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410902886688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0546320 con 0x55ddc0537810 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.528+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0546d90 con 0x55ddc0540860 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.529+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94410902886688] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.530+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.530+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94410902890608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0547140 con 0x55ddc0540860 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.530+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0547b90 con 0x55ddc053c160 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.531+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94410902890608] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.531+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.531+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94410902894192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0547f40 con 0x55ddc053c160 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.531+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0548970 con 0x55ddc0537810 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.532+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94410902894192] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.532+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.532+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410902897776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0548930 con 0x55ddc0537810 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.532+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc05493d0 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.533+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.533+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94410902900464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc05493d0 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.533+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054a2d0 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.533+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94410902897776] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.534+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94410902900464] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.534+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.534+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94410902887808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0549df0 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.534+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054a7a0 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94410902887808] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94410902902624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054a760 con 0x7fe3e4019040 2024-02-16T00:11:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=0 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=1 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=2 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=3 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=4 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=5 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.535+0000 7fe3ed89d800 20 add_watcher() i=6 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.536+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94410902902624] v27'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.536+0000 7fe3ed89d800 20 add_watcher() i=7 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.536+0000 7fe3ed89d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.536+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054a740 con 0x55ddc0537810 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.536+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.536+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94410902907776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054b440 con 0x55ddc0537810 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.537+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94410902907776] v27'174 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.537+0000 7fe2a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.537+0000 7fe3ed89d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.537+0000 7fe3ed89d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.537+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054d570 con 0x55ddc0537810 2024-02-16T00:11:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.538+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'53 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.538+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054d570 con 0x7fe3e4019040 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.539+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.539+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0556eb0 con 0x55ddc0540860 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.540+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.540+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0557880 con 0x55ddc0537810 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.541+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'175 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.541+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0557880 con 0x55ddc053c160 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.542+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'62 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.542+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0557db0 con 0x55ddc0540860 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.543+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'49 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.543+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0558780 con 0x55ddc0537810 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.544+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.544+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0558780 con 0x7fe3e4019040 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.545+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'44 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.545+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0558780 con 0x55ddc053c160 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.546+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.546+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0558cd0 con 0x55ddc0540860 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.547+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.547+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559200 con 0x55ddc053c160 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.548+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'63 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.548+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559200 con 0x7fe3e4019040 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.549+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.549+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559200 con 0x55ddc053c160 2024-02-16T00:11:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.550+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.550+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559200 con 0x7fe3e4019040 2024-02-16T00:11:44.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.551+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'55 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.551+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559200 con 0x55ddc0537810 2024-02-16T00:11:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.552+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'176 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.552+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559200 con 0x55ddc0540860 2024-02-16T00:11:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.553+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.553+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc053c160 2024-02-16T00:11:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.554+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'64 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.554+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.555+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'34 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.555+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0537810 2024-02-16T00:11:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.556+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.556+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0537810 2024-02-16T00:11:44.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.556+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'177 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.557+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.557+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.557+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc053c160 2024-02-16T00:11:44.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.558+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'40 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.558+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.559+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.559+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.560+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'40 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.560+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.561+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.561+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.562+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'50 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.562+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x7fe3e4019040 2024-02-16T00:11:44.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.563+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.563+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.564+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'34 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.564+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x7fe3e4019040 2024-02-16T00:11:44.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.565+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'45 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.565+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc0540860 2024-02-16T00:11:44.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.566+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.566+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x7fe3e4019040 2024-02-16T00:11:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.567+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'56 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.567+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0559830 con 0x55ddc053c160 2024-02-16T00:11:44.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.568+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'29 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe2a0fe1640 20 reqs_thread_entry: start 2024-02-16T00:11:44.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3ed89d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:44.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3ed89d800 20 Filter name: none 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe21a7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0537810 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.569+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.570+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.570+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.570+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.570+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.570+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.570+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.571+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0537810 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv172 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.572+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.573+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0537810 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.574+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.575+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.575+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.575+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.575+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.576+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.577+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.578+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.578+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.578+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.578+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.579+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.580+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0537810 2024-02-16T00:11:44.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv168 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.581+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.582+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.583+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0537810 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.584+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv170 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.585+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.586+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.587+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.588+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.589+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.590+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.590+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.590+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.590+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.590+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.590+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.591+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.592+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.592+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.592+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.592+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.592+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.592+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.593+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.593+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.593+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.593+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc0540860 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.593+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.593+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc0540860 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.594+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.594+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.594+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.594+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x7fe3e4019040 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.594+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.594+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x7fe3e4019040 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0582c40 con 0x55ddc053c160 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0583c50 con 0x55ddc053c160 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.595+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.596+0000 7fe2a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.596+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94410902907776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc05311b0 con 0x55ddc0537810 2024-02-16T00:11:44.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.597+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94410902907776] v27'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.597+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94410902881600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054ab80 con 0x55ddc053c160 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.598+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94410902881600] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.598+0000 7fe3ed89d800 20 remove_watcher() i=0 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.598+0000 7fe3ed89d800 2 removed watcher, disabling cache 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.598+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94410902886688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054ab80 con 0x55ddc0537810 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.599+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94410902886688] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.599+0000 7fe3ed89d800 20 remove_watcher() i=1 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.599+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94410902890608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0545920 con 0x55ddc0540860 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.600+0000 7fe3eb3a3640 1 -- 172.21.15.42:0/1080782911 <== osd.3 v2:172.21.15.42:6810/474355007 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94410902890608] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc063020 con 0x55ddc0540860 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.600+0000 7fe3ed89d800 20 remove_watcher() i=2 2024-02-16T00:11:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.600+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94410902894192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054ab80 con 0x55ddc053c160 2024-02-16T00:11:44.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.601+0000 7fe3ebba4640 1 -- 172.21.15.42:0/1080782911 <== osd.2 v2:172.21.15.42:6808/1288904824 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94410902894192] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e40083e0 con 0x55ddc053c160 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.601+0000 7fe3ed89d800 20 remove_watcher() i=3 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.601+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94410902897776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0546870 con 0x55ddc0537810 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.602+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.1 v2:172.21.15.42:6800/2950936693 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94410902897776] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x55ddc0537810 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.602+0000 7fe3ed89d800 20 remove_watcher() i=4 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.602+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94410902900464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0547670 con 0x7fe3e4019040 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.603+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94410902900464] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.603+0000 7fe3ed89d800 20 remove_watcher() i=5 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.603+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94410902887808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc054ab80 con 0x7fe3e4019040 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.604+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94410902887808] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.604+0000 7fe3ed89d800 20 remove_watcher() i=6 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.604+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94410902902624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x55ddc0548470 con 0x7fe3e4019040 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 <== osd.0 v2:172.21.15.2:6800/1783370926 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94410902902624] v27'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e000f610 con 0x7fe3e4019040 2024-02-16T00:11:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 20 remove_watcher() i=7 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe3e4019040 msgr2=0x7fe3e40228a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe3e4019040 0x7fe3e40228a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0537810 msgr2=0x55ddc0539cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0537810 0x55ddc0539cd0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc053c160 msgr2=0x55ddc053e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc053c160 0x55ddc053e550 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ddc0540860 msgr2=0x55ddc0542c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55ddc0540860 0x55ddc0542c50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2b40367e0 msgr2=0x7fe2b4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2b40367e0 0x7fe2b4038ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc08e010 tx=0x7fe3dc085000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 msgr2=0x55ddc052bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/1080782911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0377dd0 0x55ddc052bb10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4014fd0 tx=0x7fe3e404c320 comp rx=0 tx=0).stop 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 reap_dead start 2024-02-16T00:11:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.605+0000 7fe3eaba2640 1 -- 172.21.15.42:0/1080782911 reap_dead start 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 shutdown_connections 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 >> 172.21.15.42:0/1080782911 conn(0x55ddc051ec50 msgr2=0x55ddc051c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 shutdown_connections 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/1080782911 wait complete. 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2c40367e0 msgr2=0x7fe2c4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2c40367e0 0x7fe2c4038ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc065b30 tx=0x7fe3dc08c9f0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 msgr2=0x55ddc0515b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 0x55ddc0515b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55ddc04fb790 tx=0x7fe3e400aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 shutdown_connections 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2c40367e0 0x7fe2c4038ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/3441237130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc05156f0 0x55ddc0515b10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 >> 172.21.15.42:0/3441237130 conn(0x55ddc0509790 msgr2=0x55ddc0509b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 shutdown_connections 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/3441237130 wait complete. 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0404280 msgr2=0x55ddc0501710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0404280 0x55ddc0501710 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc0503d00 msgr2=0x55ddc05061c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc0503d00 0x55ddc05061c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2d0036790 msgr2=0x7fe2d0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2d0036790 0x7fe2d0038c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000f60 tx=0x7fe3e0001370 comp rx=0 tx=0).stop 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 msgr2=0x55ddc04fa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04fa8c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc007000 tx=0x7fe3dc003330 comp rx=0 tx=0).stop 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 shutdown_connections 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55ddc0503d00 0x55ddc05061c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ddc0404280 0x55ddc0501710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe2d0036790 0x7fe2d0038c50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 --2- 172.21.15.42:0/2360909135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ddc0403020 0x55ddc04fa8c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.606+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 >> 172.21.15.42:0/2360909135 conn(0x55ddc03fe5c0 msgr2=0x55ddc04f1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.607+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 shutdown_connections 2024-02-16T00:11:44.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.607+0000 7fe3ed89d800 1 -- 172.21.15.42:0/2360909135 wait complete. 2024-02-16T00:11:44.619 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-02-16T00:11:44.619 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T00:11:44.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T00:11:44.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T00:11:44.620 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T00:11:44.702 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:44.702 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.700+0000 7ff47972d800 1 Processor -- start 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.700+0000 7ff47972d800 1 -- start start 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.700+0000 7ff47972d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560f63e4b300 0x560f63e4d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.700+0000 7ff47972d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560f63d92bb0 con 0x560f63e46e70 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.700+0000 7ff47972d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x560f63d4a450 con 0x560f63e4b300 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.701+0000 7ff474b7c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560f63e4b300 0x560f63e4d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.701+0000 7ff474b7c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x560f63e4b300 0x560f63e4d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54658/0 (socket says 172.21.15.42:54658) 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.701+0000 7ff474b7c640 1 -- 172.21.15.42:0/3153554590 learned_addr learned my addr 172.21.15.42:0/3153554590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.701+0000 7ff47537d640 1 --1- 172.21.15.42:0/3153554590 >> v1:172.21.15.2:6789/0 conn(0x560f63e46e70 0x560f63e47290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51506/0 (socket says 172.21.15.42:51506) 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.701+0000 7ff474b7c640 1 -- 172.21.15.42:0/3153554590 >> v1:172.21.15.2:6789/0 conn(0x560f63e46e70 legacy=0x560f63e47290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.701+0000 7ff474b7c640 1 -- 172.21.15.42:0/3153554590 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f63e4ed20 con 0x560f63e4b300 2024-02-16T00:11:44.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.703+0000 7ff474b7c640 1 --2- 172.21.15.42:0/3153554590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e4b300 0x560f63e4d6f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff46000a520 tx=0x7ff46001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de3366ea88a5276 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.703+0000 7ff46ffff640 1 -- 172.21.15.42:0/3153554590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff460052570 con 0x560f63e4b300 2024-02-16T00:11:44.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.703+0000 7ff46ffff640 1 -- 172.21.15.42:0/3153554590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4600526d0 con 0x560f63e4b300 2024-02-16T00:11:44.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.703+0000 7ff46ffff640 1 -- 172.21.15.42:0/3153554590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff460052990 con 0x560f63e4b300 2024-02-16T00:11:44.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.703+0000 7ff47972d800 1 -- 172.21.15.42:0/3153554590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e4b300 msgr2=0x560f63e4d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.703+0000 7ff47972d800 1 --2- 172.21.15.42:0/3153554590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e4b300 0x560f63e4d6f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff46000a520 tx=0x7ff46001cee0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.704+0000 7ff47972d800 1 -- 172.21.15.42:0/3153554590 shutdown_connections 2024-02-16T00:11:44.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.704+0000 7ff47972d800 1 --2- 172.21.15.42:0/3153554590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e4b300 0x560f63e4d6f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.704+0000 7ff47972d800 1 -- 172.21.15.42:0/3153554590 >> 172.21.15.42:0/3153554590 conn(0x560f63e424d0 msgr2=0x560f63e448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.704+0000 7ff47972d800 1 -- 172.21.15.42:0/3153554590 shutdown_connections 2024-02-16T00:11:44.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.704+0000 7ff47972d800 1 -- 172.21.15.42:0/3153554590 wait complete. 2024-02-16T00:11:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47972d800 1 Processor -- start 2024-02-16T00:11:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47972d800 1 -- start start 2024-02-16T00:11:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47972d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f35d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47972d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f63d47980 con 0x560f63e46e70 2024-02-16T00:11:44.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47537d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f35d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47537d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f35d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54660/0 (socket says 172.21.15.42:54660) 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.715+0000 7ff47537d640 1 -- 172.21.15.42:0/3752381186 learned_addr learned my addr 172.21.15.42:0/3752381186 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.716+0000 7ff47537d640 1 -- 172.21.15.42:0/3752381186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460005de0 con 0x560f63e46e70 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.716+0000 7ff47537d640 1 --2- 172.21.15.42:0/3752381186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f35d70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff470008ec0 tx=0x7ff47000d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7103a5cd08e7906d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.716+0000 7ff363606640 1 -- 172.21.15.42:0/3752381186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff47000b7c0 con 0x560f63e46e70 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.716+0000 7ff363606640 1 -- 172.21.15.42:0/3752381186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47000b940 con 0x560f63e46e70 2024-02-16T00:11:44.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.716+0000 7ff363606640 1 -- 172.21.15.42:0/3752381186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff47000bc60 con 0x560f63e46e70 2024-02-16T00:11:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- 172.21.15.42:0/3752381186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 msgr2=0x560f63f35d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 --2- 172.21.15.42:0/3752381186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f35d70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff470008ec0 tx=0x7ff47000d810 comp rx=0 tx=0).stop 2024-02-16T00:11:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- 172.21.15.42:0/3752381186 shutdown_connections 2024-02-16T00:11:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 --2- 172.21.15.42:0/3752381186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f35d70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- 172.21.15.42:0/3752381186 >> 172.21.15.42:0/3752381186 conn(0x560f63e424d0 msgr2=0x560f63f31690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- 172.21.15.42:0/3752381186 shutdown_connections 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- 172.21.15.42:0/3752381186 wait complete. 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 Processor -- start 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- start start 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f3d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.717+0000 7ff47972d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f63d43160 con 0x560f63e46e70 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47537d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f3d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47537d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f3d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54662/0 (socket says 172.21.15.42:54662) 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47537d640 1 -- 172.21.15.42:0/3296173211 learned_addr learned my addr 172.21.15.42:0/3296173211 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47537d640 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f63d92bb0 con 0x560f63e46e70 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47537d640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f3d430 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff470006000 tx=0x7ff470000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff361e03640 1 -- 172.21.15.42:0/3296173211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4700158c0 con 0x560f63e46e70 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff361e03640 1 -- 172.21.15.42:0/3296173211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470015a20 con 0x560f63e46e70 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff361e03640 1 -- 172.21.15.42:0/3296173211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff470015cc0 con 0x560f63e46e70 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f63f3d970 con 0x560f63e46e70 2024-02-16T00:11:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.718+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f63f3de50 con 0x560f63e46e70 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.719+0000 7ff361e03640 1 -- 172.21.15.42:0/3296173211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff470022480 con 0x560f63e46e70 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.719+0000 7ff361e03640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff35c036790 0x7ff35c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.719+0000 7ff361e03640 1 -- 172.21.15.42:0/3296173211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff47004eea0 con 0x560f63e46e70 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.719+0000 7ff474b7c640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff35c036790 0x7ff35c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.719+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63e4b300 0x560f63f44130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.720+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f44700 con 0x560f63e4b300 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.720+0000 7ff475b7e640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63e4b300 0x560f63f44130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.720+0000 7ff474b7c640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff35c036790 0x7ff35c038c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff460054000 tx=0x7ff46004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.720+0000 7ff475b7e640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63e4b300 0x560f63f44130 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.720+0000 7ff475b7e640 1 -- 172.21.15.42:0/3296173211 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63e4b300 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.720+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f41840 con 0x560f63e4b300 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff475b7e640 1 -- 172.21.15.42:0/3296173211 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63e4b300 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f46970 0x560f63f48d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f49450 con 0x560f63f46970 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff47537d640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f46970 0x560f63f48d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff47537d640 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f46970 0x560f63f48d60 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff47537d640 1 -- 172.21.15.42:0/3296173211 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff470028020 con 0x560f63f46970 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.721+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f458f0 con 0x560f63e4b300 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.722+0000 7ff475b7e640 1 -- 172.21.15.42:0/3296173211 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63e4b300 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.722+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f45ce0 con 0x560f63e4b300 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.722+0000 7ff475b7e640 1 -- 172.21.15.42:0/3296173211 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63e4b300 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.722+0000 7ff47972d800 1 Processor -- start 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.722+0000 7ff47972d800 1 -- start start 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff47972d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 0x560f63f58640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff47972d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f63ce5e80 con 0x560f63f58220 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff475b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 0x560f63f58640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff475b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 0x560f63f58640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54678/0 (socket says 172.21.15.42:54678) 2024-02-16T00:11:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff475b7e640 1 -- 172.21.15.42:0/1807056545 learned_addr learned my addr 172.21.15.42:0/1807056545 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff475b7e640 1 -- 172.21.15.42:0/1807056545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f63f58b80 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff475b7e640 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 0x560f63f58640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x560f63f3e830 tx=0x7ff468018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff35affd640 1 -- 172.21.15.42:0/1807056545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46801d070 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff35affd640 1 -- 172.21.15.42:0/1807056545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4680182e0 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f63f595f0 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff35affd640 1 -- 172.21.15.42:0/1807056545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4680145a0 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.723+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f63f59ab0 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.724+0000 7ff35affd640 1 -- 172.21.15.42:0/1807056545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff468020020 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.724+0000 7ff35affd640 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff3500367e0 0x7ff350038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.724+0000 7ff35affd640 1 -- 172.21.15.42:0/1807056545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff46804dc50 con 0x560f63f58220 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.724+0000 7ff47537d640 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff3500367e0 0x7ff350038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff47972d800 1 Processor -- start 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff47972d800 1 -- start start 2024-02-16T00:11:44.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff47537d640 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff3500367e0 0x7ff350038ca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x560f63f44ad0 tx=0x7ff470015f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff47972d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f65880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff47972d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f63cbb5d0 con 0x560f63f65460 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff475b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f65880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff475b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f65880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54684/0 (socket says 172.21.15.42:54684) 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff475b7e640 1 -- 172.21.15.42:0/1283891553 learned_addr learned my addr 172.21.15.42:0/1283891553 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff475b7e640 1 -- 172.21.15.42:0/1283891553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f63f65e50 con 0x560f63f65460 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff475b7e640 1 --2- 172.21.15.42:0/1283891553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f65880 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff468013010 tx=0x7ff46804c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bb32f0212fe960 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.725+0000 7ff358ff9640 1 -- 172.21.15.42:0/1283891553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff468016440 con 0x560f63f65460 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff358ff9640 1 -- 172.21.15.42:0/1283891553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4680165a0 con 0x560f63f65460 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff358ff9640 1 -- 172.21.15.42:0/1283891553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46802b4a0 con 0x560f63f65460 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 -- 172.21.15.42:0/1283891553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 msgr2=0x560f63f65880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 --2- 172.21.15.42:0/1283891553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f65880 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff468013010 tx=0x7ff46804c260 comp rx=0 tx=0).stop 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 -- 172.21.15.42:0/1283891553 shutdown_connections 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 --2- 172.21.15.42:0/1283891553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f65880 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 -- 172.21.15.42:0/1283891553 >> 172.21.15.42:0/1283891553 conn(0x560f63f61780 msgr2=0x560f63f5f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 -- 172.21.15.42:0/1283891553 shutdown_connections 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 -- 172.21.15.42:0/1283891553 wait complete. 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 Processor -- start 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.726+0000 7ff47972d800 1 -- start start 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff47972d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f6c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff47972d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f63f6c960 con 0x560f63f65460 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff475b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff475b7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f6c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54700/0 (socket says 172.21.15.42:54700) 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 learned_addr learned my addr 172.21.15.42:0/2221388542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f63f59ab0 con 0x560f63f65460 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff475b7e640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f6c420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff46804aec0 tx=0x7ff46804bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff346ffd640 1 -- 172.21.15.42:0/2221388542 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff468032070 con 0x560f63f65460 2024-02-16T00:11:44.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff346ffd640 1 -- 172.21.15.42:0/2221388542 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4680116f0 con 0x560f63f65460 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f63f6cb60 con 0x560f63f65460 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff346ffd640 1 -- 172.21.15.42:0/2221388542 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff468013ca0 con 0x560f63f65460 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.727+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f63f6d020 con 0x560f63f65460 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.728+0000 7ff346ffd640 1 -- 172.21.15.42:0/2221388542 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff46804d450 con 0x560f63f65460 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.728+0000 7ff346ffd640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff340036790 0x7ff340038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.728+0000 7ff346ffd640 1 -- 172.21.15.42:0/2221388542 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff46803d030 con 0x560f63f65460 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.728+0000 7ff47537d640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff340036790 0x7ff340038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47537d640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff340036790 0x7ff340038c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff470014fd0 tx=0x7ff470039000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63f78140 0x560f63f7a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7ad50 con 0x560f63f78140 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff474b7c640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63f78140 0x560f63f7a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff474b7c640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63f78140 0x560f63f7a600 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 20 realm 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.729+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7b0e0 con 0x560f63f78140 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7b8e0 con 0x560f63f78140 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7bc40 con 0x560f63f78140 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f7c950 0x560f63f7ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f7c950 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.730+0000 7ff475b7e640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f7c950 0x560f63f7ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff475b7e640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f7c950 0x560f63f7ed40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff47972d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff47972d800 20 searching for the correct realm 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x560f63f81620 0x560f63f83ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f841b0 con 0x560f63f81620 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff47537d640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x560f63f81620 0x560f63f83ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.731+0000 7ff47537d640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x560f63f81620 0x560f63f83ae0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.732+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.732+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f841b0 con 0x560f63f7c950 2024-02-16T00:11:44.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.732+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.732+0000 7ff475b7e640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff4680133b0 0x7ff46802d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.732+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.732+0000 7ff474b7c640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff4680133b0 0x7ff46802d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.733+0000 7ff474b7c640 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff4680133b0 0x7ff46802d460 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.733+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.733+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.733+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.733+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f7c950 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.734+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.735+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f7c950 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.736+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.737+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f7c950 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.738+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f7c950 2024-02-16T00:11:44.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.739+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f81620 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x7ff4680133b0 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f78140 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7f350 con 0x560f63f7c950 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:44.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.740+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7fa20 con 0x560f63f78140 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f7fdd0 con 0x560f63f78140 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f801b0 con 0x560f63f78140 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 zone default found 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 4 Realm: () 2024-02-16T00:11:44.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 zonegroup default 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.741+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f845f0 con 0x7ff4680133b0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f80b70 con 0x560f63f81620 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f86570 con 0x560f63f81620 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 started sync module instance, tier type = 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.742+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f85a40 con 0x560f63f7c950 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.743+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.743+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94624101719840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f85a40 con 0x560f63f7c950 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.743+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f870e0 con 0x560f63f78140 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.744+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94624101719840] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.745+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.745+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94624101723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f85a40 con 0x560f63f78140 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.745+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f87b30 con 0x560f63f81620 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.746+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94624101723104] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.746+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.746+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94624101717408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f859c0 con 0x560f63f81620 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.746+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f889c0 con 0x560f63f7c950 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.747+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94624101717408] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.747+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.747+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94624101729568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f88de0 con 0x560f63f7c950 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.747+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f89790 con 0x560f63f78140 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.748+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.748+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94624101733040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f89750 con 0x560f63f78140 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.748+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8a6e0 con 0x7ff4680133b0 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.748+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94624101729568] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.749+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94624101733040] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.749+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.749+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94624101730624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f89930 con 0x7ff4680133b0 2024-02-16T00:11:44.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.749+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8af30 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.750+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94624101730624] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.750+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.750+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94624101736912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8ab80 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.750+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b530 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94624101736912] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94624101740624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b710 con 0x7ff4680133b0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=0 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=1 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=2 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=3 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=4 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=5 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.751+0000 7ff47972d800 20 add_watcher() i=6 2024-02-16T00:11:44.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.752+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94624101740624] v27'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.752+0000 7ff47972d800 20 add_watcher() i=7 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.752+0000 7ff47972d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.752+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8ead0 con 0x560f63f78140 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.752+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.753+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94624101742080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8bf60 con 0x560f63f78140 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.754+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94624101742080] v27'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.754+0000 7ff32b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.754+0000 7ff47972d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.754+0000 7ff47972d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:44.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.754+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8e5d0 con 0x560f63f78140 2024-02-16T00:11:44.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.755+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'54 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.755+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8e590 con 0x7ff4680133b0 2024-02-16T00:11:44.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.756+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.756+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f97e50 con 0x560f63f81620 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.757+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.757+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f98380 con 0x560f63f78140 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.758+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'180 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.758+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f988b0 con 0x560f63f7c950 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.759+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'65 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.759+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f98de0 con 0x560f63f81620 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.760+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'51 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.760+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f99310 con 0x560f63f78140 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.761+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.761+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f997b0 con 0x7ff4680133b0 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.762+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'46 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.762+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f997b0 con 0x560f63f7c950 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.763+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.763+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f972e0 con 0x560f63f81620 2024-02-16T00:11:44.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.764+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.764+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f972e0 con 0x560f63f7c950 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.765+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'66 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.765+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a4f0 con 0x7ff4680133b0 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.766+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.766+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a4f0 con 0x560f63f7c950 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.767+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.767+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x7ff4680133b0 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.768+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'57 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.768+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f78140 2024-02-16T00:11:44.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.768+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'181 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.768+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.770+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.770+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f7c950 2024-02-16T00:11:44.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.770+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'67 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.770+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.771+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'35 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.771+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f78140 2024-02-16T00:11:44.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.773+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.773+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f78140 2024-02-16T00:11:44.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.774+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'182 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.774+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.774+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.774+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f7c950 2024-02-16T00:11:44.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.775+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'41 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.775+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.776+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.776+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.777+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'41 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.777+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.778+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.778+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.779+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'52 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.779+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x7ff4680133b0 2024-02-16T00:11:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.780+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.780+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.781+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'35 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.781+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x7ff4680133b0 2024-02-16T00:11:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.782+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'47 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.782+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f81620 2024-02-16T00:11:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.783+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.783+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x7ff4680133b0 2024-02-16T00:11:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.784+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'58 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.784+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f9a7c0 con 0x560f63f7c950 2024-02-16T00:11:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'30 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff32a7e4640 20 reqs_thread_entry: start 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff47972d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff47972d800 20 Filter name: none 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff29bfff640 20 reqs_thread_entry: start 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff47972d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff47972d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.785+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63fc41f0 con 0x560f63f78140 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff47972d800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff47972d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff47972d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff47972d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:44.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63fc66f0 con 0x560f63f7c950 2024-02-16T00:11:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.786+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T00:11:44.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.787+0000 7ff32b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:44.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.787+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94624101742080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f742c0 con 0x560f63f78140 2024-02-16T00:11:44.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.788+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94624101742080] v27'183 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.788+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94624101719840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b600 con 0x560f63f7c950 2024-02-16T00:11:44.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.789+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94624101719840] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.789+0000 7ff47972d800 20 remove_watcher() i=0 2024-02-16T00:11:44.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.789+0000 7ff47972d800 2 removed watcher, disabling cache 2024-02-16T00:11:44.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.789+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94624101723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b600 con 0x560f63f78140 2024-02-16T00:11:44.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.790+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94624101723104] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.790+0000 7ff47972d800 20 remove_watcher() i=1 2024-02-16T00:11:44.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.790+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94624101717408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b600 con 0x560f63f81620 2024-02-16T00:11:44.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.791+0000 7ff47537d640 1 -- 172.21.15.42:0/2221388542 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94624101717408] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff470028020 con 0x560f63f81620 2024-02-16T00:11:44.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.791+0000 7ff47972d800 20 remove_watcher() i=2 2024-02-16T00:11:44.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.791+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94624101729568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b600 con 0x560f63f7c950 2024-02-16T00:11:44.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.792+0000 7ff475b7e640 1 -- 172.21.15.42:0/2221388542 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94624101729568] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a4a0 con 0x560f63f7c950 2024-02-16T00:11:44.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.792+0000 7ff47972d800 20 remove_watcher() i=3 2024-02-16T00:11:44.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.792+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94624101733040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f88520 con 0x560f63f78140 2024-02-16T00:11:44.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.793+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94624101733040] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x560f63f78140 2024-02-16T00:11:44.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.793+0000 7ff47972d800 20 remove_watcher() i=4 2024-02-16T00:11:44.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.793+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94624101730624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f8b600 con 0x7ff4680133b0 2024-02-16T00:11:44.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.794+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94624101730624] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.794+0000 7ff47972d800 20 remove_watcher() i=5 2024-02-16T00:11:44.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.794+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94624101736912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f889c0 con 0x7ff4680133b0 2024-02-16T00:11:44.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.795+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94624101736912] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.795+0000 7ff47972d800 20 remove_watcher() i=6 2024-02-16T00:11:44.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.795+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94624101740624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x560f63f889c0 con 0x7ff4680133b0 2024-02-16T00:11:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94624101740624] v27'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460052b00 con 0x7ff4680133b0 2024-02-16T00:11:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 20 remove_watcher() i=7 2024-02-16T00:11:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff4680133b0 msgr2=0x7ff46802d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7ff4680133b0 0x7ff46802d460 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63f78140 msgr2=0x560f63f7a600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63f78140 0x560f63f7a600 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f7c950 msgr2=0x560f63f7ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f7c950 0x560f63f7ed40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x560f63f81620 msgr2=0x560f63f83ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x560f63f81620 0x560f63f83ae0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff340036790 msgr2=0x7ff340038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff340036790 0x7ff340038c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff470014fd0 tx=0x7ff470039000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 msgr2=0x560f63f6c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 --2- 172.21.15.42:0/2221388542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f65460 0x560f63f6c420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff46804aec0 tx=0x7ff46804bf30 comp rx=0 tx=0).stop 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff474b7c640 1 -- 172.21.15.42:0/2221388542 reap_dead start 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 shutdown_connections 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 >> 172.21.15.42:0/2221388542 conn(0x560f63f61780 msgr2=0x560f63f5ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 shutdown_connections 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.796+0000 7ff47972d800 1 -- 172.21.15.42:0/2221388542 wait complete. 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff3500367e0 msgr2=0x7ff350038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff3500367e0 0x7ff350038ca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x560f63f44ad0 tx=0x7ff470015f30 comp rx=0 tx=0).stop 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 msgr2=0x560f63f58640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 0x560f63f58640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x560f63f3e830 tx=0x7ff468018830 comp rx=0 tx=0).stop 2024-02-16T00:11:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 shutdown_connections 2024-02-16T00:11:44.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff3500367e0 0x7ff350038ca0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/1807056545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63f58220 0x560f63f58640 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 >> 172.21.15.42:0/1807056545 conn(0x560f63f4c2c0 msgr2=0x560f63f4c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 shutdown_connections 2024-02-16T00:11:44.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/1807056545 wait complete. 2024-02-16T00:11:44.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63e4b300 msgr2=0x560f63f44130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63e4b300 0x560f63f44130 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f46970 msgr2=0x560f63f48d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f46970 0x560f63f48d60 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff35c036790 msgr2=0x7ff35c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff35c036790 0x7ff35c038c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff460054000 tx=0x7ff46004e000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 msgr2=0x560f63f3d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f3d430 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff470006000 tx=0x7ff470000bc0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 shutdown_connections 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x560f63f46970 0x560f63f48d60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x560f63e4b300 0x560f63f44130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7ff35c036790 0x7ff35c038c50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 --2- 172.21.15.42:0/3296173211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f63e46e70 0x560f63f3d430 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.797+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 >> 172.21.15.42:0/3296173211 conn(0x560f63e424d0 msgr2=0x560f63f2ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.798+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 shutdown_connections 2024-02-16T00:11:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.798+0000 7ff47972d800 1 -- 172.21.15.42:0/3296173211 wait complete. 2024-02-16T00:11:44.809 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T00:11:44.818 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-02-16T00:11:44.822 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:44.849 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:44.858 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:44.900 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-16T00:11:44.904 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:44.905 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T00:11:44.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T00:11:44.905 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-16T00:11:44.948 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:44.948 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f1670d800 1 Processor -- start 2024-02-16T00:11:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f1670d800 1 -- start start 2024-02-16T00:11:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f1670d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558b707b1a20 0x558b707b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f1670d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558b706fbba0 con 0x558b707b4350 2024-02-16T00:11:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f1670d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x558b706b3450 con 0x558b707b1a20 2024-02-16T00:11:44.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f1420c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x558b707b1a20 0x558b707b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f13a0b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x558b707b4350 0x558b707b6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51520/0 (socket says 172.21.15.42:51520) 2024-02-16T00:11:44.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.946+0000 7f8f13a0b640 1 -- 172.21.15.42:0/2819590456 learned_addr learned my addr 172.21.15.42:0/2819590456 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:44.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.947+0000 7f8f1420c640 1 -- 172.21.15.42:0/2819590456 >> v1:172.21.15.2:6789/0 conn(0x558b707b4350 legacy=0x558b707b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.947+0000 7f8f1420c640 1 -- 172.21.15.42:0/2819590456 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b707b8e70 con 0x558b707b1a20 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.948+0000 7f8f1420c640 1 --2- 172.21.15.42:0/2819590456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b707b3e10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005fd0 tx=0x7f8f0401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b72bcb365c35b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1320a640 1 -- 172.21.15.42:0/2819590456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f04052560 con 0x558b707b1a20 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1320a640 1 -- 172.21.15.42:0/2819590456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040526c0 con 0x558b707b1a20 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1320a640 1 -- 172.21.15.42:0/2819590456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f040529e0 con 0x558b707b1a20 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 -- 172.21.15.42:0/2819590456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 msgr2=0x558b707b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 --2- 172.21.15.42:0/2819590456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b707b3e10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005fd0 tx=0x7f8f0401cb90 comp rx=0 tx=0).stop 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 -- 172.21.15.42:0/2819590456 shutdown_connections 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 --2- 172.21.15.42:0/2819590456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b707b3e10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 -- 172.21.15.42:0/2819590456 >> 172.21.15.42:0/2819590456 conn(0x558b707ab4f0 msgr2=0x558b707ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 -- 172.21.15.42:0/2819590456 shutdown_connections 2024-02-16T00:11:44.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.949+0000 7f8f1670d800 1 -- 172.21.15.42:0/2819590456 wait complete. 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.960+0000 7f8f1670d800 1 Processor -- start 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1670d800 1 -- start start 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1670d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1670d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b706b0980 con 0x558b707b1a20 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1420c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1420c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54722/0 (socket says 172.21.15.42:54722) 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1420c640 1 -- 172.21.15.42:0/3119671000 learned_addr learned my addr 172.21.15.42:0/3119671000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.961+0000 7f8f1420c640 1 -- 172.21.15.42:0/3119671000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0400a100 con 0x558b707b1a20 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3119671000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a0fe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8f04054040 tx=0x7f8f0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e0216b7be4519f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8e0260c640 1 -- 172.21.15.42:0/3119671000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f04052960 con 0x558b707b1a20 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8e0260c640 1 -- 172.21.15.42:0/3119671000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04052ac0 con 0x558b707b1a20 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8e0260c640 1 -- 172.21.15.42:0/3119671000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f04052d80 con 0x558b707b1a20 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 -- 172.21.15.42:0/3119671000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 msgr2=0x558b708a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3119671000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a0fe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8f04054040 tx=0x7f8f0404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 -- 172.21.15.42:0/3119671000 shutdown_connections 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3119671000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a0fe0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 -- 172.21.15.42:0/3119671000 >> 172.21.15.42:0/3119671000 conn(0x558b707ab4f0 msgr2=0x558b7089c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 -- 172.21.15.42:0/3119671000 shutdown_connections 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.962+0000 7f8f1670d800 1 -- 172.21.15.42:0/3119671000 wait complete. 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1670d800 1 Processor -- start 2024-02-16T00:11:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1670d800 1 -- start start 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1670d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1670d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b706ac160 con 0x558b707b1a20 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1420c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1420c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54736/0 (socket says 172.21.15.42:54736) 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1420c640 1 -- 172.21.15.42:0/3406533692 learned_addr learned my addr 172.21.15.42:0/3406533692 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.963+0000 7f8f1420c640 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b707b8e70 con 0x558b707b1a20 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a8630 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8f0401d2c0 tx=0x7f8f04003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8e00e09640 1 -- 172.21.15.42:0/3406533692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f04066410 con 0x558b707b1a20 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8e00e09640 1 -- 172.21.15.42:0/3406533692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04066570 con 0x558b707b1a20 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b708a8b70 con 0x558b707b1a20 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8e00e09640 1 -- 172.21.15.42:0/3406533692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f04066850 con 0x558b707b1a20 2024-02-16T00:11:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b708a9050 con 0x558b707b1a20 2024-02-16T00:11:44.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.964+0000 7f8e00e09640 1 -- 172.21.15.42:0/3406533692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8f040669b0 con 0x558b707b1a20 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8e00e09640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dfc0367e0 0x7f8dfc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8e00e09640 1 -- 172.21.15.42:0/3406533692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8f0408e550 con 0x558b707b1a20 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f13a0b640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dfc0367e0 0x7f8dfc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b707b4350 0x558b708af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708afa30 con 0x558b707b4350 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b707b4350 0x558b708af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f13a0b640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dfc0367e0 0x7f8dfc038ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8efc000f60 tx=0x7f8efc0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b707b4350 0x558b708af460 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.965+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3406533692 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8f0c0083e0 con 0x558b707b4350 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708aca00 con 0x558b707b4350 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3406533692 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8f0c0083e0 con 0x558b707b4350 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708b1c70 0x558b708b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708b4730 con 0x558b708b1c70 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708b1c70 0x558b708b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708b1c70 0x558b708b4060 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.966+0000 7f8f1420c640 1 -- 172.21.15.42:0/3406533692 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8f04077070 con 0x558b708b1c70 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.967+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708b0bc0 con 0x558b707b4350 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.967+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3406533692 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8f0c0083e0 con 0x558b707b4350 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.967+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708b0fd0 con 0x558b707b4350 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.967+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3406533692 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8f0c0083e0 con 0x558b707b4350 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.967+0000 7f8f1670d800 1 Processor -- start 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.967+0000 7f8f1670d800 1 -- start start 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f1670d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 0x558b708c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f1670d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7064ee80 con 0x558b708c3420 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f14a0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 0x558b708c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f14a0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 0x558b708c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54746/0 (socket says 172.21.15.42:54746) 2024-02-16T00:11:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f14a0d640 1 -- 172.21.15.42:0/716017382 learned_addr learned my addr 172.21.15.42:0/716017382 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f14a0d640 1 -- 172.21.15.42:0/716017382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b708c3d80 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.968+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 0x558b708c3840 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x558b708a96e0 tx=0x7f8f0c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.969+0000 7f8df9ffb640 1 -- 172.21.15.42:0/716017382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f0c00f040 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.969+0000 7f8df9ffb640 1 -- 172.21.15.42:0/716017382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c007d00 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.969+0000 7f8df9ffb640 1 -- 172.21.15.42:0/716017382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f0c01a430 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.969+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b708c47f0 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.969+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b708c4cb0 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.969+0000 7f8df9ffb640 1 -- 172.21.15.42:0/716017382 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8f0c01a5b0 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8df9ffb640 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dec0367e0 0x7f8dec038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8df9ffb640 1 -- 172.21.15.42:0/716017382 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8f0c04e240 con 0x558b708c3420 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f1420c640 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dec0367e0 0x7f8dec038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f1670d800 1 Processor -- start 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f1670d800 1 -- start start 2024-02-16T00:11:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f1420c640 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dec0367e0 0x7f8dec038ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f0408ca60 tx=0x7f8f04081040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f1670d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f1670d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b706245d0 con 0x558b708d0730 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f14a0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f14a0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54762/0 (socket says 172.21.15.42:54762) 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.970+0000 7f8f14a0d640 1 -- 172.21.15.42:0/2864994293 learned_addr learned my addr 172.21.15.42:0/2864994293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f14a0d640 1 -- 172.21.15.42:0/2864994293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b708d1120 con 0x558b708d0730 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/2864994293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d0b50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c04c680 tx=0x7f8f0c0239c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc0f04840baec94 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8deb7fe640 1 -- 172.21.15.42:0/2864994293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f0c04a030 con 0x558b708d0730 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8deb7fe640 1 -- 172.21.15.42:0/2864994293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c04b230 con 0x558b708d0730 2024-02-16T00:11:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8deb7fe640 1 -- 172.21.15.42:0/2864994293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f0c01ada0 con 0x558b708d0730 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f1670d800 1 -- 172.21.15.42:0/2864994293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 msgr2=0x558b708d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f1670d800 1 --2- 172.21.15.42:0/2864994293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d0b50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c04c680 tx=0x7f8f0c0239c0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f1670d800 1 -- 172.21.15.42:0/2864994293 shutdown_connections 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f1670d800 1 --2- 172.21.15.42:0/2864994293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d0b50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.971+0000 7f8f1670d800 1 -- 172.21.15.42:0/2864994293 >> 172.21.15.42:0/2864994293 conn(0x558b708cca00 msgr2=0x558b708caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f1670d800 1 -- 172.21.15.42:0/2864994293 shutdown_connections 2024-02-16T00:11:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f1670d800 1 -- 172.21.15.42:0/2864994293 wait complete. 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f1670d800 1 Processor -- start 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f1670d800 1 -- start start 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f1670d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f1670d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b708d7c20 con 0x558b708d0730 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f14a0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f14a0d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54770/0 (socket says 172.21.15.42:54770) 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.972+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 learned_addr learned my addr 172.21.15.42:0/3828318142 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b708c4cb0 con 0x558b708d0730 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d76e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c04e1b0 tx=0x7f8f0c04c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8de9ffb640 1 -- 172.21.15.42:0/3828318142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f0c018720 con 0x558b708d0730 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8de9ffb640 1 -- 172.21.15.42:0/3828318142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c018880 con 0x558b708d0730 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8de9ffb640 1 -- 172.21.15.42:0/3828318142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f0c023a80 con 0x558b708d0730 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b708d7e20 con 0x558b708d0730 2024-02-16T00:11:44.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.973+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b708d8280 con 0x558b708d0730 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8de9ffb640 1 -- 172.21.15.42:0/3828318142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8f0c023be0 con 0x558b708d0730 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8de9ffb640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ddc0367e0 0x7f8ddc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8de9ffb640 1 -- 172.21.15.42:0/3828318142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8f0c04b070 con 0x558b708d0730 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ddc0367e0 0x7f8ddc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b708e3440 0x558b708e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708e6050 con 0x558b708e3440 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ddc0367e0 0x7f8ddc038ca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f04052450 tx=0x7f8f04089000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.974+0000 7f8f13a0b640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b708e3440 0x558b708e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f13a0b640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b708e3440 0x558b708e5900 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 realm 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708e28a0 con 0x558b708e3440 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708e6ad0 con 0x558b708e3440 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.975+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708e7350 con 0x558b708e3440 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708e7d30 0x558b708ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ea7f0 con 0x558b708e7d30 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708e7d30 0x558b708ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708e7d30 0x558b708ea120 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 20 searching for the correct realm 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558b708ecac0 0x558b708eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.976+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558b708ecac0 0x558b708eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.977+0000 7f8f1420c640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558b708ecac0 0x558b708eef80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.977+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.977+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e7d30 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.978+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.978+0000 7f8f14a0d640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8f0c0233c0 0x7f8f0c02d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.978+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.978+0000 7f8f13a0b640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8f0c0233c0 0x7f8f0c02d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.978+0000 7f8f13a0b640 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8f0c0233c0 0x7f8f0c02d660 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.979+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e7d30 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:44.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.980+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e7d30 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.981+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.982+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e7d30 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.983+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x558b708e3440 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.984+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc006070 con 0x7f8f0c0233c0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e7d30 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708ecac0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:44.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x7f8f0c0233c0 2024-02-16T00:11:44.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:44.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.985+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e3440 2024-02-16T00:11:44.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:44.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ef650 con 0x558b708e7d30 2024-02-16T00:11:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708ec020 con 0x558b708e3440 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708eafd0 con 0x558b708e3440 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.986+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708eb8c0 con 0x558b708e3440 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 zone default found 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 4 Realm: () 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 zonegroup default 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708eff30 con 0x7f8f0c0233c0 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f1940 con 0x558b708ecac0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.987+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f1dd0 con 0x558b708ecac0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.988+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.988+0000 7f8f1670d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.988+0000 7f8f1670d800 20 started sync module instance, tier type = 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.988+0000 7f8f1670d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.988+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f0ee0 con 0x558b708e7d30 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.989+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.989+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057377239696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f0b50 con 0x558b708e7d30 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.989+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f2ca0 con 0x558b708e3440 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.990+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057377239696] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.990+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.990+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057377243632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f2ca0 con 0x558b708e3440 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.990+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f3750 con 0x558b708ecac0 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.991+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057377243632] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.991+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.991+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057377245184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f2c20 con 0x558b708ecac0 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.991+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f45b0 con 0x558b708e7d30 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.992+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057377245184] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.992+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.992+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057377251600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f49d0 con 0x558b708e7d30 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.992+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f5340 con 0x558b708e3440 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.993+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057377251600] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.993+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.993+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057377255552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f49d0 con 0x558b708e3440 2024-02-16T00:11:45.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.993+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f5d80 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.994+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057377255552] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.994+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.994+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057377257568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f49d0 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.994+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f6780 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.995+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057377257568] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.995+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.995+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057377260192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f49d0 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.995+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f7140 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057377260192] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057377253136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f7140 con 0x7f8f0c0233c0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=0 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=1 2024-02-16T00:11:45.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=2 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=3 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=4 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=5 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.996+0000 7f8f1670d800 20 add_watcher() i=6 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.997+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057377253136] v27'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.997+0000 7f8f1670d800 20 add_watcher() i=7 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.997+0000 7f8f1670d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.997+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f7120 con 0x558b708e3440 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.997+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.998+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057377264944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f7df0 con 0x558b708e3440 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057377264944] v27'184 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8dcafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:45.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 5 note: GC not initialized 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8dc9fdb640 20 reqs_thread_entry: start 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 20 Filter name: none 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8d3b7fe640 20 reqs_thread_entry: start 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:44.999+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b7092ca70 con 0x558b708e7d30 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 : miss 2024-02-16T00:11:45.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.2 8:42d2f82b:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b7092e530 con 0x558b708e7d30 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(63 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 info.flags=0x17 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 to cache LRU end 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 20 get_obj_state: octx=0x7f8f0c02df10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558b70930b88 s->prefetch_data=0 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.000+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 3.17s0 3:ea916f1c:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b70931b10 con 0x558b708e3440 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.001+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 262+0+864 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.001+0000 7f8f1670d800 10 manifest: total_size = 5 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.001+0000 7f8f1670d800 20 get_obj_state: setting s->obj_tag to _-B_nz9B1wJwDVlwdu_hWSxhljU0dVrm 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.001+0000 7f8dcafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.001+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057377264944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b70931b10 con 0x558b708e3440 2024-02-16T00:11:45.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.002+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94057377264944] v27'185 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.002+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057377239696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b70931b10 con 0x558b708e7d30 2024-02-16T00:11:45.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.003+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94057377239696] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.003+0000 7f8f1670d800 20 remove_watcher() i=0 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.003+0000 7f8f1670d800 2 removed watcher, disabling cache 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.003+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057377243632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b70931b10 con 0x558b708e3440 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.004+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94057377243632] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.004+0000 7f8f1670d800 20 remove_watcher() i=1 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.004+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057377245184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b70931b10 con 0x558b708ecac0 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.005+0000 7f8f1420c640 1 -- 172.21.15.42:0/3828318142 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94057377245184] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f04077070 con 0x558b708ecac0 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.005+0000 7f8f1670d800 20 remove_watcher() i=2 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.005+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057377251600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b70916660 con 0x558b708e7d30 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.006+0000 7f8f14a0d640 1 -- 172.21.15.42:0/3828318142 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94057377251600] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f0c012070 con 0x558b708e7d30 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.006+0000 7f8f1670d800 20 remove_watcher() i=3 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.006+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057377255552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f1290 con 0x558b708e3440 2024-02-16T00:11:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.007+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94057377255552] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x558b708e3440 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.007+0000 7f8f1670d800 20 remove_watcher() i=4 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.007+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057377257568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f21f0 con 0x7f8f0c0233c0 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.008+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94057377257568] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.008+0000 7f8f1670d800 20 remove_watcher() i=5 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.008+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057377260192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f2800 con 0x7f8f0c0233c0 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.009+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94057377260192] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.009+0000 7f8f1670d800 20 remove_watcher() i=6 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.009+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057377253136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x558b708f4110 con 0x7f8f0c0233c0 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.010+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94057377253136] v27'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8efc037040 con 0x7f8f0c0233c0 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.010+0000 7f8f1670d800 20 remove_watcher() i=7 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8f0c0233c0 msgr2=0x7f8f0c02d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f8f0c0233c0 0x7f8f0c02d660 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b708e3440 msgr2=0x558b708e5900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b708e3440 0x558b708e5900 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708e7d30 msgr2=0x558b708ea120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708e7d30 0x558b708ea120 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558b708ecac0 msgr2=0x558b708eef80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x558b708ecac0 0x558b708eef80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ddc0367e0 msgr2=0x7f8ddc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8ddc0367e0 0x7f8ddc038ca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f04052450 tx=0x7f8f04089000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 msgr2=0x558b708d76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3828318142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708d0730 0x558b708d76e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c04e1b0 tx=0x7f8f0c04c5e0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 reap_dead start 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f13a0b640 1 -- 172.21.15.42:0/3828318142 reap_dead start 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 shutdown_connections 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 >> 172.21.15.42:0/3828318142 conn(0x558b708cca00 msgr2=0x558b708ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 shutdown_connections 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/3828318142 wait complete. 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dec0367e0 msgr2=0x7f8dec038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dec0367e0 0x7f8dec038ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f0408ca60 tx=0x7f8f04081040 comp rx=0 tx=0).stop 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 msgr2=0x558b708c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 0x558b708c3840 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x558b708a96e0 tx=0x7f8f0c00aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 shutdown_connections 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dec0367e0 0x7f8dec038ca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 --2- 172.21.15.42:0/716017382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b708c3420 0x558b708c3840 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 >> 172.21.15.42:0/716017382 conn(0x558b708b74c0 msgr2=0x558b708b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 shutdown_connections 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.011+0000 7f8f1670d800 1 -- 172.21.15.42:0/716017382 wait complete. 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b707b4350 msgr2=0x558b708af460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b707b4350 0x558b708af460 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708b1c70 msgr2=0x558b708b4060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708b1c70 0x558b708b4060 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dfc0367e0 msgr2=0x7f8dfc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dfc0367e0 0x7f8dfc038ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8efc000f60 tx=0x7f8efc0012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 msgr2=0x558b708a8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a8630 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8f0401d2c0 tx=0x7f8f04003330 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 shutdown_connections 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x558b708b1c70 0x558b708b4060 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x558b707b4350 0x558b708af460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8dfc0367e0 0x7f8dfc038ca0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 --2- 172.21.15.42:0/3406533692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b707b1a20 0x558b708a8630 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 >> 172.21.15.42:0/3406533692 conn(0x558b707ab4f0 msgr2=0x558b7089b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 shutdown_connections 2024-02-16T00:11:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.012+0000 7f8f1670d800 1 -- 172.21.15.42:0/3406533692 wait complete. 2024-02-16T00:11:45.024 INFO:teuthology.orchestra.run.smithi042.stdout:fooFoofooFooFULL_CONTROL 2024-02-16T00:11:45.025 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-02-16T00:11:45.027 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-02-16T00:11:45.031 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:45.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T00:11:45.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T00:11:45.032 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-16T00:11:45.108 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:45.108 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:45.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff1c044800 1 Processor -- start 2024-02-16T00:11:45.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff1c044800 1 -- start start 2024-02-16T00:11:45.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff1c044800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5645268e4e90 0x5645268e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff1c044800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564526830ba0 con 0x5645268e60f0 2024-02-16T00:11:45.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff1c044800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5645267e8450 con 0x5645268e4e90 2024-02-16T00:11:45.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff19b43640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5645268e4e90 0x5645268e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff19342640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5645268e60f0 0x5645268e6570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51528/0 (socket says 172.21.15.42:51528) 2024-02-16T00:11:45.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff19342640 1 -- 172.21.15.42:0/1851504115 learned_addr learned my addr 172.21.15.42:0/1851504115 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:45.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff19b43640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5645268e4e90 0x5645268e52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54774/0 (socket says 172.21.15.42:54774) 2024-02-16T00:11:45.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.106+0000 7eff19b43640 1 -- 172.21.15.42:0/1851504115 >> v1:172.21.15.2:6789/0 conn(0x5645268e60f0 legacy=0x5645268e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.107+0000 7eff19b43640 1 -- 172.21.15.42:0/1851504115 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645268e5980 con 0x5645268e4e90 2024-02-16T00:11:45.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.108+0000 7eff19b43640 1 --2- 172.21.15.42:0/1851504115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645268e52b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00a470 tx=0x7eff0c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22229e61150e115a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.108+0000 7eff18b41640 1 -- 172.21.15.42:0/1851504115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c052570 con 0x5645268e4e90 2024-02-16T00:11:45.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.108+0000 7eff18b41640 1 -- 172.21.15.42:0/1851504115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0526d0 con 0x5645268e4e90 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.108+0000 7eff18b41640 1 -- 172.21.15.42:0/1851504115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c052990 con 0x5645268e4e90 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 -- 172.21.15.42:0/1851504115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 msgr2=0x5645268e52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 --2- 172.21.15.42:0/1851504115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645268e52b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00a470 tx=0x7eff0c01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 -- 172.21.15.42:0/1851504115 shutdown_connections 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 --2- 172.21.15.42:0/1851504115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645268e52b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 -- 172.21.15.42:0/1851504115 >> 172.21.15.42:0/1851504115 conn(0x5645268e04f0 msgr2=0x5645268e2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 -- 172.21.15.42:0/1851504115 shutdown_connections 2024-02-16T00:11:45.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.109+0000 7eff1c044800 1 -- 172.21.15.42:0/1851504115 wait complete. 2024-02-16T00:11:45.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.120+0000 7eff1c044800 1 Processor -- start 2024-02-16T00:11:45.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.120+0000 7eff1c044800 1 -- start start 2024-02-16T00:11:45.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.120+0000 7eff1c044800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x564526858f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.120+0000 7eff1c044800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645267e5980 con 0x5645268e4e90 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.121+0000 7eff19b43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x564526858f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.121+0000 7eff19b43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x564526858f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54788/0 (socket says 172.21.15.42:54788) 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.121+0000 7eff19b43640 1 -- 172.21.15.42:0/103822912 learned_addr learned my addr 172.21.15.42:0/103822912 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.121+0000 7eff19b43640 1 -- 172.21.15.42:0/103822912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c005d20 con 0x5645268e4e90 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.121+0000 7eff19b43640 1 --2- 172.21.15.42:0/103822912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x564526858f50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7eff0c055040 tx=0x7eff0c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c0ee392daf63d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7efe07e07640 1 -- 172.21.15.42:0/103822912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c00a180 con 0x5645268e4e90 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7efe07e07640 1 -- 172.21.15.42:0/103822912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00a2e0 con 0x5645268e4e90 2024-02-16T00:11:45.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7efe07e07640 1 -- 172.21.15.42:0/103822912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c0529b0 con 0x5645268e4e90 2024-02-16T00:11:45.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 -- 172.21.15.42:0/103822912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 msgr2=0x564526858f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 --2- 172.21.15.42:0/103822912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x564526858f50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7eff0c055040 tx=0x7eff0c04c000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 -- 172.21.15.42:0/103822912 shutdown_connections 2024-02-16T00:11:45.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 --2- 172.21.15.42:0/103822912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x564526858f50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 -- 172.21.15.42:0/103822912 >> 172.21.15.42:0/103822912 conn(0x5645268e04f0 msgr2=0x5645269d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 -- 172.21.15.42:0/103822912 shutdown_connections 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.122+0000 7eff1c044800 1 -- 172.21.15.42:0/103822912 wait complete. 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff1c044800 1 Processor -- start 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff1c044800 1 -- start start 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff1c044800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645269dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff1c044800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645267e1160 con 0x5645268e4e90 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff19b43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645269dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff19b43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645269dfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54792/0 (socket says 172.21.15.42:54792) 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff19b43640 1 -- 172.21.15.42:0/2882976538 learned_addr learned my addr 172.21.15.42:0/2882976538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff19b43640 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c04e070 con 0x5645268e4e90 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.123+0000 7eff19b43640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645269dfb50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7eff0c005870 tx=0x7eff0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7efe06604640 1 -- 172.21.15.42:0/2882976538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c06a070 con 0x5645268e4e90 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7efe06604640 1 -- 172.21.15.42:0/2882976538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c052e10 con 0x5645268e4e90 2024-02-16T00:11:45.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645269e0090 con 0x5645268e4e90 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7efe06604640 1 -- 172.21.15.42:0/2882976538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c05d550 con 0x5645268e4e90 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645269e0570 con 0x5645268e4e90 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7efe06604640 1 -- 172.21.15.42:0/2882976538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7eff0c05d6b0 con 0x5645268e4e90 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.124+0000 7efe06604640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efe000367e0 0x7efe00038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7efe06604640 1 -- 172.21.15.42:0/2882976538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7eff0c08d820 con 0x5645268e4e90 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff19342640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efe000367e0 0x7efe00038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5645268e60f0 0x5645269e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645269e6d50 con 0x5645268e60f0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff1a344640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5645268e60f0 0x5645269e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff19342640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efe000367e0 0x7efe00038ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff10000f60 tx=0x7eff100012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff1a344640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5645268e60f0 0x5645269e6810 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff1a344640 1 -- 172.21.15.42:0/2882976538 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff1400a4a0 con 0x5645268e60f0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.125+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645269e70f0 con 0x5645268e60f0 2024-02-16T00:11:45.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff1a344640 1 -- 172.21.15.42:0/2882976538 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff1400a4a0 con 0x5645268e60f0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5645269e8e80 0x5645269eb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645269eb9b0 con 0x5645269e8e80 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff19b43640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5645269e8e80 0x5645269eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff19b43640 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5645269e8e80 0x5645269eb270 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff19b43640 1 -- 172.21.15.42:0/2882976538 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7eff0c059040 con 0x5645269e8e80 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.126+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645269e7e00 con 0x5645268e60f0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1a344640 1 -- 172.21.15.42:0/2882976538 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff1400a4a0 con 0x5645268e60f0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645269e8210 con 0x5645268e60f0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1a344640 1 -- 172.21.15.42:0/2882976538 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7eff1400a4a0 con 0x5645268e60f0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1c044800 1 Processor -- start 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1c044800 1 -- start start 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1c044800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 0x5645269fab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.127+0000 7eff1c044800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564526783e80 con 0x5645269fa760 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1a344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 0x5645269fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1a344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 0x5645269fab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54808/0 (socket says 172.21.15.42:54808) 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1a344640 1 -- 172.21.15.42:0/2931316924 learned_addr learned my addr 172.21.15.42:0/2931316924 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1a344640 1 -- 172.21.15.42:0/2931316924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645269fb0c0 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1a344640 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 0x5645269fab80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5645269e0a70 tx=0x7eff14018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7efdff7fe640 1 -- 172.21.15.42:0/2931316924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1401d070 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7efdff7fe640 1 -- 172.21.15.42:0/2931316924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140182e0 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7efdff7fe640 1 -- 172.21.15.42:0/2931316924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff140145a0 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645269fbb30 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.128+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645269fbff0 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.129+0000 7efdff7fe640 1 -- 172.21.15.42:0/2931316924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7eff14020020 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.129+0000 7efdff7fe640 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efdf40367e0 0x7efdf4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.129+0000 7efdff7fe640 1 -- 172.21.15.42:0/2931316924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7eff1404dc40 con 0x5645269fa760 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.129+0000 7eff19b43640 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efdf40367e0 0x7efdf4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.129+0000 7eff1c044800 1 Processor -- start 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1c044800 1 -- start start 2024-02-16T00:11:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff19b43640 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efdf40367e0 0x7efdf4038ca0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5645269e3ec0 tx=0x7eff0c065f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1c044800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a07e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1c044800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645267595d0 con 0x564526a07a40 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1a344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a07e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1a344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a07e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54812/0 (socket says 172.21.15.42:54812) 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1a344640 1 -- 172.21.15.42:0/3276064638 learned_addr learned my addr 172.21.15.42:0/3276064638 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1a344640 1 -- 172.21.15.42:0/3276064638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564526a08430 con 0x564526a07a40 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7eff1a344640 1 --2- 172.21.15.42:0/3276064638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a07e60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff1404bf90 tx=0x7eff14011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0390afe212a2b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7efdfd7fa640 1 -- 172.21.15.42:0/3276064638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff14040410 con 0x564526a07a40 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7efdfd7fa640 1 -- 172.21.15.42:0/3276064638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1402bc50 con 0x564526a07a40 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.130+0000 7efdfd7fa640 1 -- 172.21.15.42:0/3276064638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff140133b0 con 0x564526a07a40 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 -- 172.21.15.42:0/3276064638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 msgr2=0x564526a07e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 --2- 172.21.15.42:0/3276064638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a07e60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff1404bf90 tx=0x7eff14011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 -- 172.21.15.42:0/3276064638 shutdown_connections 2024-02-16T00:11:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 --2- 172.21.15.42:0/3276064638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a07e60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 -- 172.21.15.42:0/3276064638 >> 172.21.15.42:0/3276064638 conn(0x564526a03cc0 msgr2=0x564526a01d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 -- 172.21.15.42:0/3276064638 shutdown_connections 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 -- 172.21.15.42:0/3276064638 wait complete. 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 Processor -- start 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.131+0000 7eff1c044800 1 -- start start 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1c044800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a0e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1c044800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564526a0ee30 con 0x564526a07a40 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1a344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a0e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1a344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a0e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54822/0 (socket says 172.21.15.42:54822) 2024-02-16T00:11:45.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 learned_addr learned my addr 172.21.15.42:0/4102807460 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645269fbff0 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1a344640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a0e8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7eff14013fd0 tx=0x7eff1404bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7efdeb7fe640 1 -- 172.21.15.42:0/4102807460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff14032070 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7efdeb7fe640 1 -- 172.21.15.42:0/4102807460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14014b00 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564526a0f030 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7efdeb7fe640 1 -- 172.21.15.42:0/4102807460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1404d440 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.132+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564526a0f4f0 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.133+0000 7efdeb7fe640 1 -- 172.21.15.42:0/4102807460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7eff1404d5c0 con 0x564526a07a40 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.133+0000 7efdeb7fe640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efde4036790 0x7efde4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.133+0000 7efdeb7fe640 1 -- 172.21.15.42:0/4102807460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7eff140421e0 con 0x564526a07a40 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.133+0000 7eff19b43640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efde4036790 0x7efde4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.134+0000 7eff19b43640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efde4036790 0x7efde4038c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5645269ebd50 tx=0x7eff0c084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.134+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.134+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564526a1a6a0 0x564526a1cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.134+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a1d2b0 con 0x564526a1a6a0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.134+0000 7eff19342640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564526a1a6a0 0x564526a1cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.134+0000 7eff19342640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564526a1a6a0 0x564526a1cb60 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 realm 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a19b00 con 0x564526a1a6a0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a1dd30 con 0x564526a1a6a0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a1e5b0 con 0x564526a1a6a0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564526a1ef90 0x564526a21380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a21a50 con 0x564526a1ef90 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.135+0000 7eff1a344640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564526a1ef90 0x564526a21380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff1a344640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564526a1ef90 0x564526a21380 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7eff1400a4a0 con 0x564526a1ef90 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff1c044800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff1c044800 20 searching for the correct realm 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564526a239d0 0x564526a25e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a26560 con 0x564526a239d0 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff19b43640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564526a239d0 0x564526a25e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.136+0000 7eff19b43640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564526a239d0 0x564526a25e90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.137+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.137+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a26560 con 0x564526a1ef90 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.137+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1400a4a0 con 0x564526a1ef90 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.137+0000 7eff1a344640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7eff14040030 0x7eff1404a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.137+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.137+0000 7eff19342640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7eff14040030 0x7eff1404a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7eff14040030 0x7eff1404a5d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.138+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1ef90 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.139+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.140+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.140+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.140+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.140+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.140+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.140+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1ef90 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.141+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.142+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1ef90 2024-02-16T00:11:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x564526a1a6a0 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.143+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10006070 con 0x7eff14040030 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1ef90 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a239d0 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.144+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x7eff14040030 2024-02-16T00:11:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1a6a0 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7eff14037030 con 0x564526a1ef90 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a222c0 con 0x564526a1a6a0 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.145+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a22670 con 0x564526a1a6a0 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a22a50 con 0x564526a1a6a0 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 20 zone default found 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 4 Realm: () 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 20 zonegroup default 2024-02-16T00:11:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.146+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a269a0 con 0x7eff14040030 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a28820 con 0x564526a239d0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a28b80 con 0x564526a239d0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 started sync module instance, tier type = 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.147+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a27df0 con 0x564526a1ef90 2024-02-16T00:11:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.148+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.148+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94855000916704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a27df0 con 0x564526a1ef90 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.148+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a29560 con 0x564526a1a6a0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.149+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.149+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94855000920192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a29de0 con 0x564526a1a6a0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.149+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94855000916704] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.149+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2a5e0 con 0x564526a239d0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.150+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94855000920192] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.150+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.150+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94855000922432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2a200 con 0x564526a239d0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.151+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2ae20 con 0x564526a1ef90 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.151+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94855000922432] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.151+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.152+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94855000923488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2b1d0 con 0x564526a1ef90 2024-02-16T00:11:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.152+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2bc70 con 0x564526a1a6a0 2024-02-16T00:11:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.152+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.153+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94855000923488] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.153+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94855000930128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2bc70 con 0x564526a1a6a0 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.153+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2a960 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.153+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94855000930128] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.154+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.154+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94855000931712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2a960 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.154+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2d090 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.154+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94855000931712] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.155+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.155+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94855000934160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2cfd0 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.155+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2da30 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.155+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94855000934160] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94855000935216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2d9f0 con 0x7eff14040030 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=0 2024-02-16T00:11:45.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=1 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=2 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=3 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=4 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=5 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=6 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94855000935216] v27'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 20 add_watcher() i=7 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.156+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2d9c0 con 0x564526a1a6a0 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.157+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.157+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94855000940144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2e730 con 0x564526a1a6a0 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.158+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94855000940144] v27'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.158+0000 7efdcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.158+0000 7eff1c044800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.158+0000 7eff1c044800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.158+0000 7eff1c044800 5 note: GC not initialized 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7efdca7fc640 20 reqs_thread_entry: start 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 20 Filter name: none 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7efd3bfff640 20 reqs_thread_entry: start 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a63350 con 0x564526a1ef90 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 : miss 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.159+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.2 8:42d2f82b:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a64de0 con 0x564526a1ef90 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(63 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 info.flags=0x17 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 to cache LRU end 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 20 get_obj_state: octx=0x7eff1000e510 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564526a67438 s->prefetch_data=0 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 3.17s0 3:ea916f1c:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a68370 con 0x564526a1a6a0 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 10 manifest: total_size = 5 2024-02-16T00:11:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.160+0000 7eff1c044800 20 get_obj_state: setting s->obj_tag to _hgNN0wmk60R8M8dLDL6z89EJbqfPeSu 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.161+0000 7efdcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.161+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94855000940144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a68370 con 0x564526a1a6a0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.162+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94855000940144] v27'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.162+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94855000916704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a68370 con 0x564526a1ef90 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.163+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94855000916704] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.163+0000 7eff1c044800 20 remove_watcher() i=0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.163+0000 7eff1c044800 2 removed watcher, disabling cache 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.163+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94855000920192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a68370 con 0x564526a1a6a0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.164+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94855000920192] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.164+0000 7eff1c044800 20 remove_watcher() i=1 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.164+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94855000922432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a68370 con 0x564526a239d0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.165+0000 7eff19b43640 1 -- 172.21.15.42:0/4102807460 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94855000922432] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0c059040 con 0x564526a239d0 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.165+0000 7eff1c044800 20 remove_watcher() i=2 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.165+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94855000923488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a4cf70 con 0x564526a1ef90 2024-02-16T00:11:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.166+0000 7eff1a344640 1 -- 172.21.15.42:0/4102807460 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94855000923488] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff14062040 con 0x564526a1ef90 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.166+0000 7eff1c044800 20 remove_watcher() i=3 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.166+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94855000930128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a282e0 con 0x564526a1a6a0 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.167+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94855000930128] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x564526a1a6a0 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.167+0000 7eff1c044800 20 remove_watcher() i=4 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.167+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94855000931712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a282e0 con 0x7eff14040030 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.167+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94855000931712] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.168+0000 7eff1c044800 20 remove_watcher() i=5 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.168+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94855000934160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a2bd80 con 0x7eff14040030 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.168+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94855000934160] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.168+0000 7eff1c044800 20 remove_watcher() i=6 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.168+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94855000935216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564526a282e0 con 0x7eff14040030 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.169+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94855000935216] v27'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff10037040 con 0x7eff14040030 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.169+0000 7eff1c044800 20 remove_watcher() i=7 2024-02-16T00:11:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.169+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7eff14040030 msgr2=0x7eff1404a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7eff14040030 0x7eff1404a5d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564526a1a6a0 msgr2=0x564526a1cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564526a1a6a0 0x564526a1cb60 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564526a1ef90 msgr2=0x564526a21380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564526a1ef90 0x564526a21380 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564526a239d0 msgr2=0x564526a25e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564526a239d0 0x564526a25e90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efde4036790 msgr2=0x7efde4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efde4036790 0x7efde4038c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5645269ebd50 tx=0x7eff0c084000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 msgr2=0x564526a0e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff19342640 1 -- 172.21.15.42:0/4102807460 reap_dead start 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a0e8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7eff14013fd0 tx=0x7eff1404bf20 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 shutdown_connections 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/4102807460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564526a07a40 0x564526a0e8f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 >> 172.21.15.42:0/4102807460 conn(0x564526a03cc0 msgr2=0x564526a01320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 shutdown_connections 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/4102807460 wait complete. 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efdf40367e0 msgr2=0x7efdf4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efdf40367e0 0x7efdf4038ca0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5645269e3ec0 tx=0x7eff0c065f50 comp rx=0 tx=0).stop 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 msgr2=0x5645269fab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 0x5645269fab80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5645269e0a70 tx=0x7eff14018830 comp rx=0 tx=0).stop 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 shutdown_connections 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efdf40367e0 0x7efdf4038ca0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/2931316924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645269fa760 0x5645269fab80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 >> 172.21.15.42:0/2931316924 conn(0x5645269ee800 msgr2=0x5645269eec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 shutdown_connections 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2931316924 wait complete. 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5645268e60f0 msgr2=0x5645269e6810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5645268e60f0 0x5645269e6810 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5645269e8e80 msgr2=0x5645269eb270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.170+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5645269e8e80 0x5645269eb270 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efe000367e0 msgr2=0x7efe00038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efe000367e0 0x7efe00038ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff10000f60 tx=0x7eff100012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 msgr2=0x5645269dfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645269dfb50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7eff0c005870 tx=0x7eff0c002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 shutdown_connections 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5645269e8e80 0x5645269eb270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5645268e60f0 0x5645269e6810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efe000367e0 0x7efe00038ca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 --2- 172.21.15.42:0/2882976538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645268e4e90 0x5645269dfb50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 >> 172.21.15.42:0/2882976538 conn(0x5645268e04f0 msgr2=0x5645269cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 shutdown_connections 2024-02-16T00:11:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.171+0000 7eff1c044800 1 -- 172.21.15.42:0/2882976538 wait complete. 2024-02-16T00:11:45.186 INFO:teuthology.orchestra.run.smithi042.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-16T00:11:45.187 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-16T00:11:45.189 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-02-16T00:11:45.201 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:45.296 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-16T00:11:45.296 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-16T00:11:45.296 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T00:11:45.297 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-16T00:11:45.297 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-16T00:11:45.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-16T00:11:45.297 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-02-16T00:11:45.340 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:45.340 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb9733800 1 Processor -- start 2024-02-16T00:11:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb9733800 1 -- start start 2024-02-16T00:11:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb9733800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564527f1f3f0 0x564527f27ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb9733800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564527e69ba0 con 0x564527f1d8b0 2024-02-16T00:11:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb9733800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x564527e21450 con 0x564527f1f3f0 2024-02-16T00:11:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb4cf8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564527f1f3f0 0x564527f27ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb54f9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564527f1d8b0 0x564527f1dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51530/0 (socket says 172.21.15.42:51530) 2024-02-16T00:11:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2977731414 learned_addr learned my addr 172.21.15.42:0/2977731414 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.338+0000 7fcbb4cf8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564527f1f3f0 0x564527f27ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54828/0 (socket says 172.21.15.42:54828) 2024-02-16T00:11:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.339+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2977731414 >> v1:172.21.15.2:6789/0 conn(0x564527f1d8b0 legacy=0x564527f1dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.339+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2977731414 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564527e921a0 con 0x564527f1f3f0 2024-02-16T00:11:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.340+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/2977731414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1f3f0 0x564527f27ef0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00a470 tx=0x7fcbac01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca70b79232b9e63 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcba7fff640 1 -- 172.21.15.42:0/2977731414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbac04ad40 con 0x564527f1f3f0 2024-02-16T00:11:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcba7fff640 1 -- 172.21.15.42:0/2977731414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac052440 con 0x564527f1f3f0 2024-02-16T00:11:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcba7fff640 1 -- 172.21.15.42:0/2977731414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbac04aea0 con 0x564527f1f3f0 2024-02-16T00:11:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 -- 172.21.15.42:0/2977731414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1f3f0 msgr2=0x564527f27ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2977731414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1f3f0 0x564527f27ef0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00a470 tx=0x7fcbac01cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 -- 172.21.15.42:0/2977731414 shutdown_connections 2024-02-16T00:11:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2977731414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1f3f0 0x564527f27ef0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 -- 172.21.15.42:0/2977731414 >> 172.21.15.42:0/2977731414 conn(0x564527f194f0 msgr2=0x564527f1b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 -- 172.21.15.42:0/2977731414 shutdown_connections 2024-02-16T00:11:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.341+0000 7fcbb9733800 1 -- 172.21.15.42:0/2977731414 wait complete. 2024-02-16T00:11:45.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb9733800 1 Processor -- start 2024-02-16T00:11:45.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb9733800 1 -- start start 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb9733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528011300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb9733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564527e1e980 con 0x564527f1d8b0 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb54f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528011300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb54f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528011300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54832/0 (socket says 172.21.15.42:54832) 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb54f9640 1 -- 172.21.15.42:0/4240273545 learned_addr learned my addr 172.21.15.42:0/4240273545 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb54f9640 1 -- 172.21.15.42:0/4240273545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac005d20 con 0x564527f1d8b0 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.353+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/4240273545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528011300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcba80014a0 tx=0x7fcba8001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39903425ee5f4354 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcaa3606640 1 -- 172.21.15.42:0/4240273545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba8004520 con 0x564527f1d8b0 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcaa3606640 1 -- 172.21.15.42:0/4240273545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8004680 con 0x564527f1d8b0 2024-02-16T00:11:45.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcaa3606640 1 -- 172.21.15.42:0/4240273545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba8004980 con 0x564527f1d8b0 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 -- 172.21.15.42:0/4240273545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 msgr2=0x564528011300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 --2- 172.21.15.42:0/4240273545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528011300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcba80014a0 tx=0x7fcba8001960 comp rx=0 tx=0).stop 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 -- 172.21.15.42:0/4240273545 shutdown_connections 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 --2- 172.21.15.42:0/4240273545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528011300 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 -- 172.21.15.42:0/4240273545 >> 172.21.15.42:0/4240273545 conn(0x564527f194f0 msgr2=0x56452800cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 -- 172.21.15.42:0/4240273545 shutdown_connections 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.354+0000 7fcbb9733800 1 -- 172.21.15.42:0/4240273545 wait complete. 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb9733800 1 Processor -- start 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb9733800 1 -- start start 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb9733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528018990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb9733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564527e1a160 con 0x564527f1d8b0 2024-02-16T00:11:45.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb54f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528018990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb54f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528018990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54846/0 (socket says 172.21.15.42:54846) 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb54f9640 1 -- 172.21.15.42:0/161309461 learned_addr learned my addr 172.21.15.42:0/161309461 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.355+0000 7fcbb54f9640 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564527e69ba0 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528018990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcba80014a0 tx=0x7fcba8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcaa1e03640 1 -- 172.21.15.42:0/161309461 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba8013820 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcaa1e03640 1 -- 172.21.15.42:0/161309461 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8013980 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564528018ed0 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcaa1e03640 1 -- 172.21.15.42:0/161309461 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba8013c20 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645280193b0 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.356+0000 7fcaa1e03640 1 -- 172.21.15.42:0/161309461 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcba8028460 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcaa1e03640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca9c0367e0 0x7fca9c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcaa1e03640 1 -- 172.21.15.42:0/161309461 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fcba804c240 con 0x564527f1d8b0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca9c0367e0 0x7fca9c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564527f1f3f0 0x56452801f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452801fd10 con 0x564527f1f3f0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564527f1f3f0 0x56452801f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca9c0367e0 0x7fca9c038ca0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcbac054000 tx=0x7fcbac04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.357+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564527f1f3f0 0x56452801f6d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/161309461 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564527f1f3f0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452801cd60 con 0x564527f1f3f0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/161309461 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcbb00083e0 con 0x564527f1f3f0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528021f20 0x564528024310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528024a00 con 0x564528021f20 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528021f20 0x564528024310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.358+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528021f20 0x564528024310 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.359+0000 7fcbb54f9640 1 -- 172.21.15.42:0/161309461 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcba8024020 con 0x564528021f20 2024-02-16T00:11:45.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.359+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528020ea0 con 0x564527f1f3f0 2024-02-16T00:11:45.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.359+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/161309461 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcbb00083e0 con 0x564527f1f3f0 2024-02-16T00:11:45.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.359+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528021290 con 0x564527f1f3f0 2024-02-16T00:11:45.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.359+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/161309461 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcbb00083e0 con 0x564527f1f3f0 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.359+0000 7fcbb9733800 1 Processor -- start 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb9733800 1 -- start start 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb9733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 0x564528033c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb9733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564527dbce80 con 0x564528033800 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb5cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 0x564528033c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb5cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 0x564528033c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54852/0 (socket says 172.21.15.42:54852) 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/1542709767 learned_addr learned my addr 172.21.15.42:0/1542709767 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.360+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/1542709767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564528034160 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 0x564528033c20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x564528019560 tx=0x7fcbb000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fca9affd640 1 -- 172.21.15.42:0/1542709767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbb000f040 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fca9affd640 1 -- 172.21.15.42:0/1542709767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0007d00 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564528034bd0 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fca9affd640 1 -- 172.21.15.42:0/1542709767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbb0019420 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564528035090 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.361+0000 7fca9affd640 1 -- 172.21.15.42:0/1542709767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcbb0019580 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fca9affd640 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca8c0367e0 0x7fca8c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fca9affd640 1 -- 172.21.15.42:0/1542709767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fcbb004e2d0 con 0x564528033800 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca8c0367e0 0x7fca8c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb9733800 1 Processor -- start 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb9733800 1 -- start start 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca8c0367e0 0x7fca8c038ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5645280200e0 tx=0x7fcba804a5e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb9733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x564528040e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb9733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564527d925d0 con 0x564528040a20 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb5cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x564528040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb5cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x564528040e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54860/0 (socket says 172.21.15.42:54860) 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.362+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/29694776 learned_addr learned my addr 172.21.15.42:0/29694776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/29694776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564528041410 con 0x564528040a20 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/29694776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x564528040e40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcbb004c6e0 tx=0x7fcbb0022850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f996dfa65a2c50a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fca98ff9640 1 -- 172.21.15.42:0/29694776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbb004e0d0 con 0x564528040a20 2024-02-16T00:11:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fca98ff9640 1 -- 172.21.15.42:0/29694776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0022cb0 con 0x564528040a20 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fca98ff9640 1 -- 172.21.15.42:0/29694776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbb00223c0 con 0x564528040a20 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb9733800 1 -- 172.21.15.42:0/29694776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 msgr2=0x564528040e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb9733800 1 --2- 172.21.15.42:0/29694776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x564528040e40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcbb004c6e0 tx=0x7fcbb0022850 comp rx=0 tx=0).stop 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb9733800 1 -- 172.21.15.42:0/29694776 shutdown_connections 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb9733800 1 --2- 172.21.15.42:0/29694776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x564528040e40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb9733800 1 -- 172.21.15.42:0/29694776 >> 172.21.15.42:0/29694776 conn(0x56452803cd80 msgr2=0x56452803ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.363+0000 7fcbb9733800 1 -- 172.21.15.42:0/29694776 shutdown_connections 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb9733800 1 -- 172.21.15.42:0/29694776 wait complete. 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb9733800 1 Processor -- start 2024-02-16T00:11:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb9733800 1 -- start start 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb9733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x5645280479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb9733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564528047ef0 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb5cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x5645280479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb5cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x5645280479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54872/0 (socket says 172.21.15.42:54872) 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 learned_addr learned my addr 172.21.15.42:0/2166730967 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.364+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564528035090 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x5645280479b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00229a0 tx=0x7fcbb004c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fca8affd640 1 -- 172.21.15.42:0/2166730967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbb0023410 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fca8affd640 1 -- 172.21.15.42:0/2166730967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0022e20 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645280480f0 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fca8affd640 1 -- 172.21.15.42:0/2166730967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbb0018ba0 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645280485b0 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.365+0000 7fca8affd640 1 -- 172.21.15.42:0/2166730967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcbb0018d00 con 0x564528040a20 2024-02-16T00:11:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fca8affd640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca800367e0 0x7fca80038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fca8affd640 1 -- 172.21.15.42:0/2166730967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fcbb0038c80 con 0x564528040a20 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca800367e0 0x7fca80038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca800367e0 0x7fca80038ca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcba801db00 tx=0x7fcba8041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564528053570 0x564528055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528056180 con 0x564528053570 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.366+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564528053570 0x564528055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564528053570 0x564528055a30 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbac0525b0 con 0x564528053570 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 realm 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528056570 con 0x564528053570 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528056df0 con 0x564528053570 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.367+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528057150 con 0x564528053570 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528057e60 0x56452805a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805a860 con 0x564528057e60 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528057e60 0x56452805a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528057e60 0x56452805a250 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 20 searching for the correct realm 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56452805cb30 0x56452805eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.368+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56452805cb30 0x56452805eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.369+0000 7fcbb54f9640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56452805cb30 0x56452805eff0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.369+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.369+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528057e60 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.370+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.370+0000 7fcbb5cfa640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fcbb0019040 0x7fcbb002b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.370+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.370+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fcbb0019040 0x7fcbb002b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.370+0000 7fcbb4cf8640 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fcbb0019040 0x7fcbb002b570 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.371+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528057e60 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.372+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528057e60 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.373+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.374+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.375+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.375+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.375+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.375+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.375+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.375+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528057e60 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.376+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528057e60 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x56452805cb30 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x7fcbb0019040 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.377+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528053570 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805f6c0 con 0x564528057e60 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805c090 con 0x564528053570 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805b4c0 con 0x564528053570 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.378+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805b8e0 con 0x564528053570 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 zone default found 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 4 Realm: () 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 zonegroup default 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805fb00 con 0x7fcbb0019040 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452805b0d0 con 0x56452805cb30 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.379+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528061ac0 con 0x56452805cb30 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.380+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.380+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.380+0000 7fcbb9733800 20 started sync module instance, tier type = 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.380+0000 7fcbb9733800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.380+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528060f50 con 0x564528057e60 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.381+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.381+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94855024219184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528060f50 con 0x564528057e60 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.381+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528062600 con 0x564528053570 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.382+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94855024219184] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.382+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.382+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94855024222464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528060f50 con 0x564528053570 2024-02-16T00:11:45.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.382+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280630a0 con 0x56452805cb30 2024-02-16T00:11:45.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.383+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.383+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94855024225152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280638f0 con 0x56452805cb30 2024-02-16T00:11:45.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.383+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280643c0 con 0x564528057e60 2024-02-16T00:11:45.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.383+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94855024222464] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.384+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94855024225152] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.384+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.384+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94855024227408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528060ab0 con 0x564528057e60 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.384+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528064d80 con 0x564528053570 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.385+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94855024227408] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.385+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.385+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94855024230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528064d80 con 0x564528053570 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.386+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280656f0 con 0x7fcbb0019040 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.386+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.387+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94855024230048] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.386+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94855024235088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528065b10 con 0x7fcbb0019040 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.387+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280660c0 con 0x7fcbb0019040 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.387+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94855024235088] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.388+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.388+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94855024232672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280662a0 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.388+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528066aa0 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.388+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.388+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94855024232672] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94855024239744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528066ee0 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=0 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=1 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=2 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=3 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=4 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=5 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=6 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94855024239744] v27'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 20 add_watcher() i=7 2024-02-16T00:11:45.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.389+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806a2f0 con 0x564528053570 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.390+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.390+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94855024241024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528067760 con 0x564528053570 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.391+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94855024241024] v27'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.391+0000 7fca6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.391+0000 7fcbb9733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.391+0000 7fcbb9733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.391+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072920 con 0x564528053570 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.392+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'55 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.392+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072f30 con 0x7fcbb0019040 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.393+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.393+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528073460 con 0x56452805cb30 2024-02-16T00:11:45.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.394+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.394+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528073990 con 0x564528053570 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.395+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'189 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.395+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528073ec0 con 0x564528057e60 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.396+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'68 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.396+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280743f0 con 0x56452805cb30 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.397+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'53 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.397+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528074920 con 0x564528053570 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.398+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.398+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528074920 con 0x7fcbb0019040 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.399+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'48 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.399+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528074920 con 0x564528057e60 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.400+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.400+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528074e50 con 0x56452805cb30 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.401+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.401+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075380 con 0x564528057e60 2024-02-16T00:11:45.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.402+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'69 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.402+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x7fcbb0019040 2024-02-16T00:11:45.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.403+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.403+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x564528057e60 2024-02-16T00:11:45.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.404+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.404+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x7fcbb0019040 2024-02-16T00:11:45.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.405+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'59 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.405+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x564528053570 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.406+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'190 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.406+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x56452805cb30 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.407+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.407+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x564528057e60 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.408+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'70 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.408+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x56452805cb30 2024-02-16T00:11:45.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.409+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'36 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.409+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x564528053570 2024-02-16T00:11:45.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.410+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.410+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x564528053570 2024-02-16T00:11:45.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.411+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'191 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.411+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x56452805cb30 2024-02-16T00:11:45.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.413+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.413+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x564528057e60 2024-02-16T00:11:45.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.414+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'42 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.414+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x56452805cb30 2024-02-16T00:11:45.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.414+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.414+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x56452805cb30 2024-02-16T00:11:45.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.415+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'42 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.415+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528075820 con 0x56452805cb30 2024-02-16T00:11:45.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.416+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.416+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280759f0 con 0x56452805cb30 2024-02-16T00:11:45.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.417+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'54 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.417+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072390 con 0x7fcbb0019040 2024-02-16T00:11:45.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.418+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.418+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072390 con 0x56452805cb30 2024-02-16T00:11:45.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.419+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'36 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.419+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072390 con 0x7fcbb0019040 2024-02-16T00:11:45.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.420+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'49 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.420+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072390 con 0x56452805cb30 2024-02-16T00:11:45.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.421+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.421+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072390 con 0x7fcbb0019040 2024-02-16T00:11:45.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.422+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'60 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.422+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528072390 con 0x564528057e60 2024-02-16T00:11:45.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'31 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fca6a7e4640 20 reqs_thread_entry: start 2024-02-16T00:11:45.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fcbb9733800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:45.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fcbb9733800 20 Filter name: none 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fc9dbfff640 20 reqs_thread_entry: start 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fcbb9733800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.424+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452809f6e0 con 0x564528057e60 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 : miss 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 8.2 8:42d2f82b:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a0f10 con 0x564528057e60 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(95 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:11:45.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 info.flags=0x17 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 to cache LRU end 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:96 4.1d 4:bab640fa:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e440 con 0x56452805cb30 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(96 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.425+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 4.5 4:a24e5117:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e480 con 0x56452805cb30 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(97 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 4.31 4:8c41da0e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e4c0 con 0x564528053570 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(98 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 [call out=426b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb9733800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-02-16T00:11:45.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:99 4.11 4:885331f5:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e4c0 con 0x7fcbb0019040 2024-02-16T00:11:45.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(99 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.426+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 4.2a 4:57067e8f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e4c0 con 0x564528053570 2024-02-16T00:11:45.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.427+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(100 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.427+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:101 4.8 4:10eb4748:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e4c0 con 0x56452805cb30 2024-02-16T00:11:45.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.427+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(101 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.427+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 4.1e 4:7af5f5c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e4c0 con 0x7fcbb0019040 2024-02-16T00:11:45.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.427+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(102 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb9733800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-02-16T00:11:45.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:103 4.14 4:2babfa26:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e440 con 0x56452805cb30 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(103 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 4.21 4:848245bc:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e440 con 0x7fcbb0019040 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(104 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 [call out=426b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb9733800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:105 4.8 4:13ac9742:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e480 con 0x56452805cb30 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.428+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(105 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:106 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811e480 con 0x564528053570 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(106 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [call out=696b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+696 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:107 3.1bs0 3:d9fdb7af:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a1a30 con 0x56452805cb30 2024-02-16T00:11:45.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(107 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 10 manifest: total_size = 6 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.12409869416069115914 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 20 prepare_atomic_modification: state is not atomic. state=0x56452811d928 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.429+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:108 4.31 4:8c41da0e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a6300 con 0x564528053570 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.430+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(108 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 [stat,call,call] v27'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.430+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:109 3.1bs0 3:d9fdb7af:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a42e0 con 0x56452805cb30 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(109 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_9c8454ddf7aa50116496bac348d7550d [call] v27'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:110 4.31 4:8c41da0e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a68a0 con 0x564528053570 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:111 3.32s0 3:4c697921:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a68a0 con 0x56452805cb30 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(111 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 10 manifest: total_size = 3 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9685073806580910728 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 20 prepare_atomic_modification: state is not atomic. state=0x56452811d928 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 2024-02-16T00:11:45.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.432+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:112 4.1e 4:7af5f5c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a68a0 con 0x7fcbb0019040 2024-02-16T00:11:45.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.433+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(110 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 [stat,call,call] v27'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.433+0000 7fca98ff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.433+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(112 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 [stat,call,call] v27'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.433+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:113 3.32s0 3:4c697921:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a68a0 con 0x56452805cb30 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.434+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(113 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_b1b9a972ccd8c962a473909b97007eb4 [call] v27'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.434+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:114 4.1e 4:7af5f5c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x7fcbb0019040 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.434+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.434+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:115 3.34s0 3:2ea1a211:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7a40 con 0x564528053570 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(115 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb9733800 10 manifest: total_size = 4 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb9733800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.18271396325908200064 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb9733800 20 prepare_atomic_modification: state is not atomic. state=0x56452811d928 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb9733800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.435+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:116 4.21 4:848245bc:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280aaa70 con 0x7fcbb0019040 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.436+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(114 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 [stat,call,call] v27'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.436+0000 7fca8bfff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.436+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(116 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 [stat,call,call] v27'10 uv10 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.436+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:117 3.34s0 3:2ea1a211:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a68a0 con 0x564528053570 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(117 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v27'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:118 4.21 4:848245bc:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a68a0 con 0x7fcbb0019040 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:119 3.1cs0 3:395a8c0b:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x564528053570 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(119 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+891 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 10 manifest: total_size = 5 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.585241365450865293 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.437+0000 7fcbb9733800 20 prepare_atomic_modification: state is not atomic. state=0x56452811d928 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.438+0000 7fcbb9733800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.438+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:120 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.438+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(118 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 [stat,call,call] v27'11 uv11 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.438+0000 7fca98ff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.439+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(120 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [stat,call,call] v27'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.439+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:121 3.1cs0 3:395a8c0b:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a6f80 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(121 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_24d27c169c2c881eb09a065116f2aa5c [call] v27'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:122 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:123 3.17s0 3:ea916f1c:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(123 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 10 manifest: total_size = 5 2024-02-16T00:11:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 20 get_obj_state: setting s->obj_tag to _hgNN0wmk60R8M8dLDL6z89EJbqfPeSu 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 20 get_obj_state: octx=0x7fcbac04beb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56452811d928 s->prefetch_data=0 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 20 prepare_atomic_modification: state is not atomic. state=0x56452811d928 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.440+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:124 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x564528053570 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.441+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(122 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [stat,call,call] v27'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.441+0000 7fca8bfff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.441+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(124 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [stat,call,call] v27'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.441+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:125 3.17s0 3:ea916f1c:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a6f80 con 0x564528053570 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 41 ==== osd_op_reply(125 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5_bb3aec0fdcdbc2974890f805c585d432 [call] v27'8 uv8 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:126 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x564528053570 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 20 list_objects_ordered: starting attempt 1 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:127 4.1d 4:bab640fa:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a7420 con 0x56452805cb30 2024-02-16T00:11:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:128 4.5 4:a24e5117:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811dbe0 con 0x56452805cb30 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:129 4.31 4:8c41da0e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280af1f0 con 0x564528053570 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:130 4.11 4:885331f5:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811dbe0 con 0x7fcbb0019040 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:131 4.2a 4:57067e8f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280b4210 con 0x564528053570 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:132 4.8 4:10eb4748:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280b6f80 con 0x56452805cb30 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:133 4.1e 4:7af5f5c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280b6f80 con 0x7fcbb0019040 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:134 4.14 4:2babfa26:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bc280 con 0x56452805cb30 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:135 4.21 4:848245bc:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bec10 con 0x7fcbb0019040 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:136 4.8 4:13ac9742:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280c1a40 con 0x56452805cb30 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:137 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280c43d0 con 0x564528053570 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.443+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 42 ==== osd_op_reply(131 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 43 ==== osd_op_reply(129 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(128 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(127 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(132 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(130 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(135 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(133 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fcbac065040 con 0x7fcbb0019040 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(136 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(134 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 44 ==== osd_op_reply(126 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [stat,call,call] v27'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fca8bfff640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 45 ==== osd_op_reply(137 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fcbac065040 con 0x564528053570 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T00:11:45.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5])"; uploads.size()=0; is_truncated=0 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:138 4.1d 4:bab640fa:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280b6f80 con 0x56452805cb30 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:139 4.5 4:a24e5117:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280c43d0 con 0x56452805cb30 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:140 4.31 4:8c41da0e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bbb30 con 0x564528053570 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:141 4.11 4:885331f5:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811d740 con 0x7fcbb0019040 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:142 4.2a 4:57067e8f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280b6f80 con 0x564528053570 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:143 4.8 4:10eb4748:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811db70 con 0x56452805cb30 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.444+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:144 4.1e 4:7af5f5c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280c15b0 con 0x7fcbb0019040 2024-02-16T00:11:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:145 4.14 4:2babfa26:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280c43d0 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:146 4.21 4:848245bc:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811db70 con 0x7fcbb0019040 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 4.8 4:13ac9742:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280be5b0 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:148 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280b6f80 con 0x564528053570 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(138 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 41 ==== osd_op_reply(139 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 46 ==== osd_op_reply(140 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 42 ==== osd_op_reply(143 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 47 ==== osd_op_reply(142 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 48 ==== osd_op_reply(148 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(141 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(144 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 43 ==== osd_op_reply(147 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(146 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 44 ==== osd_op_reply(145 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.445+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811d740 con 0x564528057e60 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(149 foo.buckets [call] v27'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb9733800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb9733800 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb9733800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94855024991008 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811d740 con 0x7fcbb0019040 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== watch-notify(notify (1) cookie 94855024232672 notify 115964117007 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x564527e921a0 con 0x7fcbb0019040 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fca8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 94855024232672 notifier 4642 bl.length()=149 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(150 notify.6 [notify cookie 94855024991008 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fca8bfff640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fc9e8003310 con 0x7fcbb0019040 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== watch-notify(notify_complete (2) cookie 94855024991008 notify 115964117007 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcbac04e070 con 0x7fcbb0019040 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.447+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811d740 con 0x564528057e60 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.448+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(152 myfoo [call,call,delete] v27'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.448+0000 7fcbb9733800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 from cache 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.448+0000 7fcbb9733800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5, ofs0, ns] 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.448+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:153 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94855024504704 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a0e80 con 0x564528057e60 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== watch-notify(notify (1) cookie 94855024219184 notify 115964117023 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x5645280480f0 con 0x564528057e60 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fca8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117023 cookie 94855024219184 notifier 4642 bl.length()=206 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(153 notify.0 [notify cookie 94855024504704 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fca8bfff640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fc9e8003310 con 0x564528057e60 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(154 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== watch-notify(notify_complete (2) cookie 94855024504704 notify 115964117023 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcbb003b020 con 0x564528057e60 2024-02-16T00:11:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.449+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:155 8.2 8:42d2f82b:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811c1c0 con 0x564528057e60 2024-02-16T00:11:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(155 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 [call,call,delete] v27'4 uv4 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:156 4.1d 4:bab640fa:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811c1c0 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:157 4.5 4:a24e5117:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a0e80 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:158 4.31 4:8c41da0e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bbaf0 con 0x564528053570 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:159 4.11 4:885331f5:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811dbe0 con 0x7fcbb0019040 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:160 4.2a 4:57067e8f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bbe90 con 0x564528053570 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:161 4.8 4:10eb4748:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a0e80 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:162 4.1e 4:7af5f5c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x564528071d30 con 0x7fcbb0019040 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:163 4.14 4:2babfa26:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280baf20 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:164 4.21 4:848245bc:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bbaf0 con 0x7fcbb0019040 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:165 4.8 4:13ac9742:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280a0e80 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.450+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:166 4.12 4:49ff2c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280bbe90 con 0x564528053570 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.451+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 45 ==== osd_op_reply(163 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.7 [delete] v27'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 49 ==== osd_op_reply(166 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.10 [delete] v27'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 46 ==== osd_op_reply(156 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.0 [delete] v27'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 50 ==== osd_op_reply(160 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.4 [delete] v27'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== osd_op_reply(164 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.8 [delete] v27'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 47 ==== osd_op_reply(157 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.1 [delete] v27'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 48 ==== osd_op_reply(161 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.5 [delete] v27'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(159 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.3 [delete] v27'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== osd_op_reply(162 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.6 [delete] v27'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 51 ==== osd_op_reply(158 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.2 [delete] v27'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 49 ==== osd_op_reply(165 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5.9 [delete] v27'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 : miss 2024-02-16T00:11:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:167 6.6 6:63dedc67:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811dbe0 con 0x56452805cb30 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 50 ==== osd_op_reply(167 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 info.flags=0x0 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 10 adding default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 to cache LRU end 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 10 removing default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 from cache 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5, ofs0, ns] 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.452+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:168 7.9 7:93e5b521:::notify.7:head [notify cookie 94855024504704 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5645280baf20 con 0x7fcbb0019040 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== watch-notify(notify (1) cookie 94855024239744 notify 115964117008 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7fcbac04e070 con 0x7fcbb0019040 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fca8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94855024239744 notifier 4642 bl.length()=203 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fca8bfff640 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:169 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fc9e80032b0 con 0x7fcbb0019040 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== osd_op_reply(168 notify.7 [notify cookie 94855024504704 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 46 ==== osd_op_reply(169 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 47 ==== watch-notify(notify_complete (2) cookie 94855024504704 notify 115964117008 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcbac08dba0 con 0x7fcbb0019040 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.453+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:170 6.6 6:63dedc67:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811c1c0 con 0x56452805cb30 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.454+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 51 ==== osd_op_reply(170 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.5 [delete] v27'13 uv12 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.454+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452811c1c0 con 0x564528057e60 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.455+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(171 foo.buckets [call] v27'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.456+0000 7fca6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.456+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94855024241024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x564528053570 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.457+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 52 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94855024241024] v27'192 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.457+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94855024219184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x564528057e60 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.458+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94855024219184] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.458+0000 7fcbb9733800 20 remove_watcher() i=0 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.458+0000 7fcbb9733800 2 removed watcher, disabling cache 2024-02-16T00:11:45.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.458+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94855024222464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x564528053570 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.459+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 53 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94855024222464] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.459+0000 7fcbb9733800 20 remove_watcher() i=1 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.459+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94855024225152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x56452805cb30 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.460+0000 7fcbb54f9640 1 -- 172.21.15.42:0/2166730967 <== osd.3 v2:172.21.15.42:6810/474355007 52 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94855024225152] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcba8024020 con 0x56452805cb30 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.460+0000 7fcbb9733800 20 remove_watcher() i=2 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.460+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94855024227408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x564528057e60 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.461+0000 7fcbb5cfa640 1 -- 172.21.15.42:0/2166730967 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94855024227408] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbb00083e0 con 0x564528057e60 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.461+0000 7fcbb9733800 20 remove_watcher() i=3 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.461+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94855024230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x564528053570 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.462+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.1 v2:172.21.15.42:6800/2950936693 54 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94855024230048] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x564528053570 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.462+0000 7fcbb9733800 20 remove_watcher() i=4 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.462+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94855024235088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x7fcbb0019040 2024-02-16T00:11:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.463+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 48 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94855024235088] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.463+0000 7fcbb9733800 20 remove_watcher() i=5 2024-02-16T00:11:45.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.463+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94855024232672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x7fcbb0019040 2024-02-16T00:11:45.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.463+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 49 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94855024232672] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.464+0000 7fcbb9733800 20 remove_watcher() i=6 2024-02-16T00:11:45.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.464+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94855024239744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56452806e9e0 con 0x7fcbb0019040 2024-02-16T00:11:45.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.464+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 <== osd.0 v2:172.21.15.2:6800/1783370926 50 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94855024239744] v27'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcbac0a2040 con 0x7fcbb0019040 2024-02-16T00:11:45.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.464+0000 7fcbb9733800 20 remove_watcher() i=7 2024-02-16T00:11:45.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fcbb0019040 msgr2=0x7fcbb002b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fcbb0019040 0x7fcbb002b570 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564528053570 msgr2=0x564528055a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564528053570 0x564528055a30 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528057e60 msgr2=0x56452805a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528057e60 0x56452805a250 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56452805cb30 msgr2=0x56452805eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56452805cb30 0x56452805eff0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca800367e0 msgr2=0x7fca80038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca800367e0 0x7fca80038ca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcba801db00 tx=0x7fcba8041000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb4cf8640 1 -- 172.21.15.42:0/2166730967 reap_dead start 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 msgr2=0x5645280479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x5645280479b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00229a0 tx=0x7fcbb004c670 comp rx=0 tx=0).stop 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 shutdown_connections 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/2166730967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528040a20 0x5645280479b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 >> 172.21.15.42:0/2166730967 conn(0x56452803cd80 msgr2=0x56452803a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 shutdown_connections 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/2166730967 wait complete. 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca8c0367e0 msgr2=0x7fca8c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca8c0367e0 0x7fca8c038ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5645280200e0 tx=0x7fcba804a5e0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 msgr2=0x564528033c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 0x564528033c20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x564528019560 tx=0x7fcbb000aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 shutdown_connections 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca8c0367e0 0x7fca8c038ca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 --2- 172.21.15.42:0/1542709767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564528033800 0x564528033c20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 >> 172.21.15.42:0/1542709767 conn(0x5645280278a0 msgr2=0x564528027ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 shutdown_connections 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.465+0000 7fcbb9733800 1 -- 172.21.15.42:0/1542709767 wait complete. 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564527f1f3f0 msgr2=0x56452801f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564527f1f3f0 0x56452801f6d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528021f20 msgr2=0x564528024310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528021f20 0x564528024310 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca9c0367e0 msgr2=0x7fca9c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca9c0367e0 0x7fca9c038ca0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcbac054000 tx=0x7fcbac04e000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 msgr2=0x564528018990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528018990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcba80014a0 tx=0x7fcba8001250 comp rx=0 tx=0).stop 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 shutdown_connections 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564528021f20 0x564528024310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564527f1f3f0 0x56452801f6d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fca9c0367e0 0x7fca9c038ca0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 --2- 172.21.15.42:0/161309461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564527f1d8b0 0x564528018990 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 >> 172.21.15.42:0/161309461 conn(0x564527f194f0 msgr2=0x56452800b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 shutdown_connections 2024-02-16T00:11:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.466+0000 7fcbb9733800 1 -- 172.21.15.42:0/161309461 wait complete. 2024-02-16T00:11:45.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T00:11:45.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T00:11:45.481 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-02-16T00:11:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb7610800 1 Processor -- start 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb7610800 1 -- start start 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb7610800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5646f960de90 0x5646f960e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb7610800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5646f9559ba0 con 0x5646f960f0f0 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb7610800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5646f9511450 con 0x5646f960de90 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb2dbe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5646f960de90 0x5646f960e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb25bd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5646f960f0f0 0x5646f960f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51540/0 (socket says 172.21.15.42:51540) 2024-02-16T00:11:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.562+0000 7fceb25bd640 1 -- 172.21.15.42:0/340657069 learned_addr learned my addr 172.21.15.42:0/340657069 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.563+0000 7fceb2dbe640 1 -- 172.21.15.42:0/340657069 >> v1:172.21.15.2:6789/0 conn(0x5646f960f0f0 legacy=0x5646f960f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.563+0000 7fceb1dbc640 1 -- 172.21.15.42:0/340657069 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498800375 0 0) 0x5646f9559ba0 con 0x5646f960f0f0 2024-02-16T00:11:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.563+0000 7fceb2dbe640 1 -- 172.21.15.42:0/340657069 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646f960e980 con 0x5646f960de90 2024-02-16T00:11:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.564+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/340657069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f960e2b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcea400a470 tx=0x7fcea401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8a1eb6aba7a9a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb1dbc640 1 -- 172.21.15.42:0/340657069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea4052570 con 0x5646f960de90 2024-02-16T00:11:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb1dbc640 1 -- 172.21.15.42:0/340657069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40526d0 con 0x5646f960de90 2024-02-16T00:11:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb1dbc640 1 -- 172.21.15.42:0/340657069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea4052990 con 0x5646f960de90 2024-02-16T00:11:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 -- 172.21.15.42:0/340657069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 msgr2=0x5646f960e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 --2- 172.21.15.42:0/340657069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f960e2b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcea400a470 tx=0x7fcea401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 -- 172.21.15.42:0/340657069 shutdown_connections 2024-02-16T00:11:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 --2- 172.21.15.42:0/340657069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f960e2b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 -- 172.21.15.42:0/340657069 >> 172.21.15.42:0/340657069 conn(0x5646f96094f0 msgr2=0x5646f960b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 -- 172.21.15.42:0/340657069 shutdown_connections 2024-02-16T00:11:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.565+0000 7fceb7610800 1 -- 172.21.15.42:0/340657069 wait complete. 2024-02-16T00:11:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb7610800 1 Processor -- start 2024-02-16T00:11:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb7610800 1 -- start start 2024-02-16T00:11:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb7610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f9581f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb7610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646f950e980 con 0x5646f960de90 2024-02-16T00:11:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb2dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f9581f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb2dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f9581f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54888/0 (socket says 172.21.15.42:54888) 2024-02-16T00:11:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb2dbe640 1 -- 172.21.15.42:0/4012680625 learned_addr learned my addr 172.21.15.42:0/4012680625 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.577+0000 7fceb2dbe640 1 -- 172.21.15.42:0/4012680625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4005d20 con 0x5646f960de90 2024-02-16T00:11:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.578+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/4012680625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f9581f50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcea4055040 tx=0x7fcea404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcbf7e0e8d242a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.578+0000 7fcda0e09640 1 -- 172.21.15.42:0/4012680625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea400a170 con 0x5646f960de90 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.578+0000 7fcda0e09640 1 -- 172.21.15.42:0/4012680625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400a2d0 con 0x5646f960de90 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.578+0000 7fcda0e09640 1 -- 172.21.15.42:0/4012680625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea4052990 con 0x5646f960de90 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.578+0000 7fceb7610800 1 -- 172.21.15.42:0/4012680625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 msgr2=0x5646f9581f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.578+0000 7fceb7610800 1 --2- 172.21.15.42:0/4012680625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f9581f50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcea4055040 tx=0x7fcea404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 -- 172.21.15.42:0/4012680625 shutdown_connections 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 --2- 172.21.15.42:0/4012680625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f9581f50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 -- 172.21.15.42:0/4012680625 >> 172.21.15.42:0/4012680625 conn(0x5646f96094f0 msgr2=0x5646f96f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 -- 172.21.15.42:0/4012680625 shutdown_connections 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 -- 172.21.15.42:0/4012680625 wait complete. 2024-02-16T00:11:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 Processor -- start 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 -- start start 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f97089a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb7610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646f950a160 con 0x5646f960de90 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb2dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f97089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb2dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f97089a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54898/0 (socket says 172.21.15.42:54898) 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb2dbe640 1 -- 172.21.15.42:0/445031108 learned_addr learned my addr 172.21.15.42:0/445031108 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.579+0000 7fceb2dbe640 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea404e070 con 0x5646f960de90 2024-02-16T00:11:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.580+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f97089a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.580+0000 7fcd9f606640 1 -- 172.21.15.42:0/445031108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea4072440 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.580+0000 7fcd9f606640 1 -- 172.21.15.42:0/445031108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40725c0 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.580+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646f9708ee0 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.580+0000 7fcd9f606640 1 -- 172.21.15.42:0/445031108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea40728a0 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.580+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646f9709420 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fcd9f606640 1 -- 172.21.15.42:0/445031108 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcea4072a00 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fcd9f606640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd980367e0 0x7fcd98038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fcd9f606640 1 -- 172.21.15.42:0/445031108 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fcea408dd40 con 0x5646f960de90 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fceb25bd640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd980367e0 0x7fcd98038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f960f0f0 0x5646f970f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f970fb50 con 0x5646f960f0f0 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fceb35bf640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f960f0f0 0x5646f970f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.581+0000 7fceb25bd640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd980367e0 0x7fcd98038ca0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000c00 tx=0x7fcea80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb35bf640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f960f0f0 0x5646f970f610 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb35bf640 1 -- 172.21.15.42:0/445031108 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fceac00a4a0 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f970cd20 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb35bf640 1 -- 172.21.15.42:0/445031108 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fceac00a4a0 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9711db0 0x5646f97141a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9714870 con 0x5646f9711db0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9711db0 0x5646f97141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.582+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9711db0 0x5646f97141a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.583+0000 7fceb2dbe640 1 -- 172.21.15.42:0/445031108 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fcea4063070 con 0x5646f9711db0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.583+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9710d30 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.583+0000 7fceb35bf640 1 -- 172.21.15.42:0/445031108 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fceac00a4a0 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.583+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9711140 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.583+0000 7fceb35bf640 1 -- 172.21.15.42:0/445031108 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fceac00a4a0 con 0x5646f960f0f0 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb7610800 1 Processor -- start 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb7610800 1 -- start start 2024-02-16T00:11:45.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb7610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 0x5646f97239a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb7610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646f94ace80 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb35bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 0x5646f97239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb35bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 0x5646f97239a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54914/0 (socket says 172.21.15.42:54914) 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb35bf640 1 -- 172.21.15.42:0/506681568 learned_addr learned my addr 172.21.15.42:0/506681568 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.584+0000 7fceb35bf640 1 -- 172.21.15.42:0/506681568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646f9723ee0 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.585+0000 7fceb35bf640 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 0x5646f97239a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x5646f9709a00 tx=0x7fceac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.585+0000 7fcd9ce01640 1 -- 172.21.15.42:0/506681568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac01d070 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.585+0000 7fcd9ce01640 1 -- 172.21.15.42:0/506681568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac014450 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.585+0000 7fcd9ce01640 1 -- 172.21.15.42:0/506681568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac014730 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.585+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646f9724950 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.585+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646f9724e10 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fcd9ce01640 1 -- 172.21.15.42:0/506681568 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fceac020020 con 0x5646f9723580 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fcd9ce01640 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd8c0367e0 0x7fcd8c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fcd9ce01640 1 -- 172.21.15.42:0/506681568 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fceac04dd90 con 0x5646f9723580 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd8c0367e0 0x7fcd8c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb7610800 1 Processor -- start 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb7610800 1 -- start start 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd8c0367e0 0x7fcd8c038ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5646f970ff40 tx=0x7fcea4065470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb7610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f9730be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb7610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646f94825d0 con 0x5646f97307c0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb35bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f9730be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb35bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f9730be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54918/0 (socket says 172.21.15.42:54918) 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.586+0000 7fceb35bf640 1 -- 172.21.15.42:0/3995286233 learned_addr learned my addr 172.21.15.42:0/3995286233 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb35bf640 1 -- 172.21.15.42:0/3995286233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646f97311b0 con 0x5646f97307c0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb35bf640 1 --2- 172.21.15.42:0/3995286233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f9730be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fceac04c1a0 tx=0x7fceac014950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4497b69176488784 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fcd967fc640 1 -- 172.21.15.42:0/3995286233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac014c10 con 0x5646f97307c0 2024-02-16T00:11:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fcd967fc640 1 -- 172.21.15.42:0/3995286233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac014d70 con 0x5646f97307c0 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fcd967fc640 1 -- 172.21.15.42:0/3995286233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac02b4c0 con 0x5646f97307c0 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb7610800 1 -- 172.21.15.42:0/3995286233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 msgr2=0x5646f9730be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb7610800 1 --2- 172.21.15.42:0/3995286233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f9730be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fceac04c1a0 tx=0x7fceac014950 comp rx=0 tx=0).stop 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb7610800 1 -- 172.21.15.42:0/3995286233 shutdown_connections 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb7610800 1 --2- 172.21.15.42:0/3995286233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f9730be0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.587+0000 7fceb7610800 1 -- 172.21.15.42:0/3995286233 >> 172.21.15.42:0/3995286233 conn(0x5646f972cae0 msgr2=0x5646f972ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb7610800 1 -- 172.21.15.42:0/3995286233 shutdown_connections 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb7610800 1 -- 172.21.15.42:0/3995286233 wait complete. 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb7610800 1 Processor -- start 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb7610800 1 -- start start 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb7610800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f97377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb7610800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646f9737d10 con 0x5646f97307c0 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb35bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f97377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb35bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f97377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54932/0 (socket says 172.21.15.42:54932) 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 learned_addr learned my addr 172.21.15.42:0/3846771087 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.588+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646f9724e10 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fceb35bf640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f97377d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fceac0118b0 tx=0x7fceac04c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fcd94ff9640 1 -- 172.21.15.42:0/3846771087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac013c80 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fcd94ff9640 1 -- 172.21.15.42:0/3846771087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac013de0 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646f9737f10 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fcd94ff9640 1 -- 172.21.15.42:0/3846771087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac022880 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646f97383d0 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.589+0000 7fcd94ff9640 1 -- 172.21.15.42:0/3846771087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fceac0229e0 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fcd94ff9640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd7c0367e0 0x7fcd7c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fcd94ff9640 1 -- 172.21.15.42:0/3846771087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fceac038c80 con 0x5646f97307c0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd7c0367e0 0x7fcd7c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd7c0367e0 0x7fcd7c038ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcea4052460 tx=0x7fcea4092000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f9743440 0x5646f9745900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9746050 con 0x5646f9743440 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.590+0000 7fceb25bd640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f9743440 0x5646f9745900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb25bd640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f9743440 0x5646f9745900 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 realm 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97428a0 con 0x5646f9743440 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9746ad0 con 0x5646f9743440 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.591+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9747350 con 0x5646f9743440 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9747d30 0x5646f974a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974a890 con 0x5646f9747d30 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb35bf640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9747d30 0x5646f974a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb35bf640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9747d30 0x5646f974a120 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 20 searching for the correct realm 2024-02-16T00:11:45.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5646f974cba0 0x5646f974f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.592+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974f6e0 con 0x5646f974cba0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.593+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5646f974cba0 0x5646f974f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.593+0000 7fceb2dbe640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5646f974cba0 0x5646f974f060 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.593+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.593+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974f6e0 con 0x5646f9747d30 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb35bf640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fceac0133b0 0x7fceac02c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974a890 con 0x7fceac0133b0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb25bd640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fceac0133b0 0x7fceac02c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb25bd640 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fceac0133b0 0x7fceac02c5f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x7fceac0133b0 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.594+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974a890 con 0x5646f9743440 2024-02-16T00:11:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974a890 con 0x5646f9743440 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974a890 con 0x7fceac0133b0 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x7fceac0133b0 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x7fceac0133b0 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.595+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9747d30 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9743440 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x7fceac0133b0 2024-02-16T00:11:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.596+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9743440 2024-02-16T00:11:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9747d30 2024-02-16T00:11:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.597+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x7fceac0133b0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.598+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9743440 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9743440 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x7fceac0133b0 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.599+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9747d30 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.600+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.600+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9743440 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.600+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea800f5f0 con 0x5646f9743440 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.600+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.600+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.600+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9747d30 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f974cba0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.601+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x7fceac0133b0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.602+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.602+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9743440 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.602+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.602+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcea802c040 con 0x5646f9747d30 2024-02-16T00:11:45.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974afa0 con 0x5646f9743440 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974b350 con 0x5646f9743440 2024-02-16T00:11:45.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974b730 con 0x5646f9743440 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 zone default found 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 4 Realm: () 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 zonegroup default 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.603+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f974bb20 con 0x7fceac0133b0 2024-02-16T00:11:45.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9751500 con 0x5646f974cba0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9751860 con 0x5646f974cba0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 started sync module instance, tier type = 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.604+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9750de0 con 0x5646f9747d30 2024-02-16T00:11:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.605+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.605+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94862832896320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9750d60 con 0x5646f9747d30 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.605+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9752570 con 0x5646f9743440 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.606+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94862832896320] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.607+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.607+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94862832901168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97524f0 con 0x5646f9743440 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.607+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9752e60 con 0x5646f974cba0 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.608+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94862832901168] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.608+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.608+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94862832902224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9752470 con 0x5646f974cba0 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.608+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9753c70 con 0x5646f9747d30 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.609+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94862832902224] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.609+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.609+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94862832908240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9754090 con 0x5646f9747d30 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.609+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9754a00 con 0x5646f9743440 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.610+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.610+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94862832911712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9754980 con 0x5646f9743440 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.610+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9755940 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.610+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94862832908240] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.611+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94862832911712] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.611+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.611+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94862832915488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9755900 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.611+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9754ed0 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.612+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(56 notify.6 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.612+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94862832915488] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.612+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94862832917744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9754f10 con 0x7fceac0133b0 2024-02-16T00:11:45.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.612+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9753c10 con 0x7fceac0133b0 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94862832917744] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94862832918800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9756ca0 con 0x7fceac0133b0 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=0 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=1 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=2 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=3 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=4 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=5 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.613+0000 7fceb7610800 20 add_watcher() i=6 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.614+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94862832918800] v27'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.614+0000 7fceb7610800 20 add_watcher() i=7 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.614+0000 7fceb7610800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.614+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f975a0d0 con 0x5646f9743440 2024-02-16T00:11:45.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.614+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.614+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94862832933632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9756e10 con 0x5646f9743440 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.615+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94862832933632] v27'193 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.615+0000 7fcd697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.615+0000 7fceb7610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.615+0000 7fceb7610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.615+0000 7fceb7610800 5 note: GC not initialized 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fcce3fff640 20 reqs_thread_entry: start 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 20 Filter name: none 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fcce1ffb640 20 reqs_thread_entry: start 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f978c010 con 0x5646f9743440 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.616+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~370 in=370b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9791de0 con 0x5646f9743440 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~370] v27'16 uv16 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb7610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb7610800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb7610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94862833162464 in=558b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f978e9d0 con 0x5646f9743440 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94862832911712 notify 115964117008 ret 0) v3 ==== 588+0+0 (crc 0 0 0) 0x7fcea803d9b0 con 0x5646f9743440 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94862833162464 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fcd967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94862832911712 notifier 4649 bl.length()=546 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fcd967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:45.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fcd967fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fcd967fc640 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7fcd78003e90 con 0x5646f9743440 2024-02-16T00:11:45.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.618+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94862833162464 notify 115964117008 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcea803db40 con 0x5646f9743440 2024-02-16T00:11:45.633 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.619+0000 7fcd697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.619+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94862832933632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f978adb0 con 0x5646f9743440 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.620+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94862832933632] v27'194 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.620+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94862832896320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9759b00 con 0x5646f9747d30 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.621+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94862832896320] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.621+0000 7fceb7610800 20 remove_watcher() i=0 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.621+0000 7fceb7610800 2 removed watcher, disabling cache 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.621+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94862832901168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9750940 con 0x5646f9743440 2024-02-16T00:11:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.622+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94862832901168] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.622+0000 7fceb7610800 20 remove_watcher() i=1 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.622+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94862832902224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f9750940 con 0x5646f974cba0 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.623+0000 7fceb2dbe640 1 -- 172.21.15.42:0/3846771087 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94862832902224] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea4063070 con 0x5646f974cba0 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.623+0000 7fceb7610800 20 remove_watcher() i=2 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.623+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94862832908240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97520d0 con 0x5646f9747d30 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.624+0000 7fceb35bf640 1 -- 172.21.15.42:0/3846771087 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94862832908240] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fceac046070 con 0x5646f9747d30 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.624+0000 7fceb7610800 20 remove_watcher() i=3 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.624+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94862832911712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97520d0 con 0x5646f9743440 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.625+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94862832911712] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x5646f9743440 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.625+0000 7fceb7610800 20 remove_watcher() i=4 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.625+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94862832915488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97520d0 con 0x7fceac0133b0 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.626+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94862832915488] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8038040 con 0x7fceac0133b0 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.626+0000 7fceb7610800 20 remove_watcher() i=5 2024-02-16T00:11:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.626+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94862832917744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97520d0 con 0x7fceac0133b0 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.627+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94862832917744] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8047040 con 0x7fceac0133b0 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.627+0000 7fceb7610800 20 remove_watcher() i=6 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.627+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94862832918800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5646f97520d0 con 0x7fceac0133b0 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94862832918800] v27'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcea8047040 con 0x7fceac0133b0 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 20 remove_watcher() i=7 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fceac0133b0 msgr2=0x7fceac02c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fceac0133b0 0x7fceac02c5f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f9743440 msgr2=0x5646f9745900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f9743440 0x5646f9745900 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9747d30 msgr2=0x5646f974a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9747d30 0x5646f974a120 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5646f974cba0 msgr2=0x5646f974f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5646f974cba0 0x5646f974f060 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd7c0367e0 msgr2=0x7fcd7c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd7c0367e0 0x7fcd7c038ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcea4052460 tx=0x7fcea4092000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 msgr2=0x5646f97377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.628+0000 7fceb7610800 1 --2- 172.21.15.42:0/3846771087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f97307c0 0x5646f97377d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fceac0118b0 tx=0x7fceac04c130 comp rx=0 tx=0).stop 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb25bd640 1 -- 172.21.15.42:0/3846771087 reap_dead start 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 shutdown_connections 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 >> 172.21.15.42:0/3846771087 conn(0x5646f972cae0 msgr2=0x5646f972a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 shutdown_connections 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/3846771087 wait complete. 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd8c0367e0 msgr2=0x7fcd8c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd8c0367e0 0x7fcd8c038ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5646f970ff40 tx=0x7fcea4065470 comp rx=0 tx=0).stop 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 msgr2=0x5646f97239a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 0x5646f97239a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x5646f9709a00 tx=0x7fceac018830 comp rx=0 tx=0).stop 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 shutdown_connections 2024-02-16T00:11:45.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd8c0367e0 0x7fcd8c038ca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/506681568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f9723580 0x5646f97239a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 >> 172.21.15.42:0/506681568 conn(0x5646f9717620 msgr2=0x5646f9717a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 shutdown_connections 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/506681568 wait complete. 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f960f0f0 msgr2=0x5646f970f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f960f0f0 0x5646f970f610 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9711db0 msgr2=0x5646f97141a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9711db0 0x5646f97141a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd980367e0 msgr2=0x7fcd98038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd980367e0 0x7fcd98038ca0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000c00 tx=0x7fcea80013b0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 msgr2=0x5646f97089a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.629+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f97089a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea4002fb0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 shutdown_connections 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5646f9711db0 0x5646f97141a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5646f960f0f0 0x5646f970f610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fcd980367e0 0x7fcd98038ca0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 --2- 172.21.15.42:0/445031108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5646f960de90 0x5646f97089a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 >> 172.21.15.42:0/445031108 conn(0x5646f96094f0 msgr2=0x5646f96f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 shutdown_connections 2024-02-16T00:11:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.630+0000 7fceb7610800 1 -- 172.21.15.42:0/445031108 wait complete. 2024-02-16T00:11:45.644 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:45.644 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T00:11:45.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T00:11:45.644 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-02-16T00:11:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:45.728 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.725+0000 7f9d0552f800 1 Processor -- start 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d0552f800 1 -- start start 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d0552f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559542778a20 0x55954277ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d0552f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595426c2ba0 con 0x55954277b350 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d0552f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55954267a450 con 0x559542778a20 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d01267640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559542778a20 0x55954277ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d00a66640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55954277b350 0x55954277d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51552/0 (socket says 172.21.15.42:51552) 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d00a66640 1 -- 172.21.15.42:0/1442719486 learned_addr learned my addr 172.21.15.42:0/1442719486 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d01267640 1 -- 172.21.15.42:0/1442719486 >> v1:172.21.15.2:6789/0 conn(0x55954277b350 legacy=0x55954277d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.726+0000 7f9d01267640 1 -- 172.21.15.42:0/1442719486 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55954277fe70 con 0x559542778a20 2024-02-16T00:11:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.728+0000 7f9d01267640 1 --2- 172.21.15.42:0/1442719486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954277ae10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4005fd0 tx=0x7f9cf401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510efe2a1a685d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.728+0000 7f9cf3fff640 1 -- 172.21.15.42:0/1442719486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf4052560 con 0x559542778a20 2024-02-16T00:11:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.728+0000 7f9cf3fff640 1 -- 172.21.15.42:0/1442719486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40526c0 con 0x559542778a20 2024-02-16T00:11:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.728+0000 7f9cf3fff640 1 -- 172.21.15.42:0/1442719486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf40529e0 con 0x559542778a20 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 -- 172.21.15.42:0/1442719486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 msgr2=0x55954277ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 --2- 172.21.15.42:0/1442719486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954277ae10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4005fd0 tx=0x7f9cf401cb90 comp rx=0 tx=0).stop 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 -- 172.21.15.42:0/1442719486 shutdown_connections 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 --2- 172.21.15.42:0/1442719486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954277ae10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 -- 172.21.15.42:0/1442719486 >> 172.21.15.42:0/1442719486 conn(0x5595427724f0 msgr2=0x559542774910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 -- 172.21.15.42:0/1442719486 shutdown_connections 2024-02-16T00:11:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.729+0000 7f9d0552f800 1 -- 172.21.15.42:0/1442719486 wait complete. 2024-02-16T00:11:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.740+0000 7f9d0552f800 1 Processor -- start 2024-02-16T00:11:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.740+0000 7f9d0552f800 1 -- start start 2024-02-16T00:11:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d0552f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x559542867f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d0552f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559542677980 con 0x559542778a20 2024-02-16T00:11:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d01267640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x559542867f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d01267640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x559542867f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54946/0 (socket says 172.21.15.42:54946) 2024-02-16T00:11:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d01267640 1 -- 172.21.15.42:0/1598638767 learned_addr learned my addr 172.21.15.42:0/1598638767 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d01267640 1 -- 172.21.15.42:0/1598638767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf400a100 con 0x559542778a20 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.741+0000 7f9d01267640 1 --2- 172.21.15.42:0/1598638767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x559542867f80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4054040 tx=0x7f9cf404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f0b13f0249e526 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9bef606640 1 -- 172.21.15.42:0/1598638767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf4052960 con 0x559542778a20 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9bef606640 1 -- 172.21.15.42:0/1598638767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4052ac0 con 0x559542778a20 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9bef606640 1 -- 172.21.15.42:0/1598638767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf4052d80 con 0x559542778a20 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 -- 172.21.15.42:0/1598638767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 msgr2=0x559542867f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 --2- 172.21.15.42:0/1598638767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x559542867f80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4054040 tx=0x7f9cf404c000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 -- 172.21.15.42:0/1598638767 shutdown_connections 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 --2- 172.21.15.42:0/1598638767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x559542867f80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 -- 172.21.15.42:0/1598638767 >> 172.21.15.42:0/1598638767 conn(0x5595427724f0 msgr2=0x5595428638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 -- 172.21.15.42:0/1598638767 shutdown_connections 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.742+0000 7f9d0552f800 1 -- 172.21.15.42:0/1598638767 wait complete. 2024-02-16T00:11:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d0552f800 1 Processor -- start 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d0552f800 1 -- start start 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d0552f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954286f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d0552f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559542673160 con 0x559542778a20 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d01267640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954286f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d01267640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954286f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54952/0 (socket says 172.21.15.42:54952) 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d01267640 1 -- 172.21.15.42:0/2400844761 learned_addr learned my addr 172.21.15.42:0/2400844761 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d01267640 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55954277fe70 con 0x559542778a20 2024-02-16T00:11:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.743+0000 7f9d01267640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954286f5d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9cf401d2c0 tx=0x7f9cf4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9bede03640 1 -- 172.21.15.42:0/2400844761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf4066410 con 0x559542778a20 2024-02-16T00:11:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9bede03640 1 -- 172.21.15.42:0/2400844761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4066570 con 0x559542778a20 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55954286fb10 con 0x559542778a20 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9bede03640 1 -- 172.21.15.42:0/2400844761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf4066850 con 0x559542778a20 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55954286fff0 con 0x559542778a20 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9bede03640 1 -- 172.21.15.42:0/2400844761 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9cf40669b0 con 0x559542778a20 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.744+0000 7f9bede03640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9be80367e0 0x7f9be8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9bede03640 1 -- 172.21.15.42:0/2400844761 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9cf408e550 con 0x559542778a20 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d00a66640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9be80367e0 0x7f9be8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55954277b350 0x559542876400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428769d0 con 0x55954277b350 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d01a68640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55954277b350 0x559542876400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d00a66640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9be80367e0 0x7f9be8038ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8000f60 tx=0x7f9cf80012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d01a68640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55954277b350 0x559542876400 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d01a68640 1 -- 172.21.15.42:0/2400844761 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9cfc0083e0 con 0x55954277b350 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.745+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428739a0 con 0x55954277b350 2024-02-16T00:11:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d01a68640 1 -- 172.21.15.42:0/2400844761 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9cfc0083e0 con 0x55954277b350 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559542878c10 0x55954287b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x55954287b6d0 con 0x559542878c10 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d01267640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559542878c10 0x55954287b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d01267640 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559542878c10 0x55954287b000 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d01267640 1 -- 172.21.15.42:0/2400844761 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9cf4077070 con 0x559542878c10 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.746+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559542877b90 con 0x55954277b350 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d01a68640 1 -- 172.21.15.42:0/2400844761 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9cfc0083e0 con 0x55954277b350 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x559542877fa0 con 0x55954277b350 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d01a68640 1 -- 172.21.15.42:0/2400844761 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9cfc0083e0 con 0x55954277b350 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d0552f800 1 Processor -- start 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d0552f800 1 -- start start 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d0552f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 0x55954288a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.747+0000 7f9d0552f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559542615e80 con 0x55954288a410 2024-02-16T00:11:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9d01a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 0x55954288a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9d01a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 0x55954288a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54964/0 (socket says 172.21.15.42:54964) 2024-02-16T00:11:45.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9d01a68640 1 -- 172.21.15.42:0/4051067462 learned_addr learned my addr 172.21.15.42:0/4051067462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9d01a68640 1 -- 172.21.15.42:0/4051067462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55954288ad70 con 0x55954288a410 2024-02-16T00:11:45.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9d01a68640 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 0x55954288a830 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5595428701a0 tx=0x7f9cfc00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9be6ffd640 1 -- 172.21.15.42:0/4051067462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cfc00f040 con 0x55954288a410 2024-02-16T00:11:45.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9be6ffd640 1 -- 172.21.15.42:0/4051067462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc007d00 con 0x55954288a410 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55954288b7e0 con 0x55954288a410 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.748+0000 7f9be6ffd640 1 -- 172.21.15.42:0/4051067462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cfc01a430 con 0x55954288a410 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.749+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55954288bca0 con 0x55954288a410 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.749+0000 7f9be6ffd640 1 -- 172.21.15.42:0/4051067462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9cfc01a590 con 0x55954288a410 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.749+0000 7f9be6ffd640 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bd80367e0 0x7f9bd8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.749+0000 7f9be6ffd640 1 -- 172.21.15.42:0/4051067462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9cfc04e2a0 con 0x55954288a410 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.749+0000 7f9d01267640 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bd80367e0 0x7f9bd8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d0552f800 1 Processor -- start 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d0552f800 1 -- start start 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d01267640 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bd80367e0 0x7f9bd8038ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x559542876da0 tx=0x7f9cf4083040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d0552f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x559542897a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d0552f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595425eb5d0 con 0x559542897620 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d01a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x559542897a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d01a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x559542897a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54980/0 (socket says 172.21.15.42:54980) 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d01a68640 1 -- 172.21.15.42:0/1795090691 learned_addr learned my addr 172.21.15.42:0/1795090691 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d01a68640 1 -- 172.21.15.42:0/1795090691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559542898010 con 0x559542897620 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9d01a68640 1 --2- 172.21.15.42:0/1795090691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x559542897a40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc04c6b0 tx=0x7f9cfc023640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb07fc55c6ad4ec server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9be4ff9640 1 -- 172.21.15.42:0/1795090691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cfc04a030 con 0x559542897620 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9be4ff9640 1 -- 172.21.15.42:0/1795090691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc04b230 con 0x559542897620 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.750+0000 7f9be4ff9640 1 -- 172.21.15.42:0/1795090691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cfc0194f0 con 0x559542897620 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- 172.21.15.42:0/1795090691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 msgr2=0x559542897a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 --2- 172.21.15.42:0/1795090691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x559542897a40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc04c6b0 tx=0x7f9cfc023640 comp rx=0 tx=0).stop 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- 172.21.15.42:0/1795090691 shutdown_connections 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 --2- 172.21.15.42:0/1795090691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x559542897a40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- 172.21.15.42:0/1795090691 >> 172.21.15.42:0/1795090691 conn(0x5595428938f0 msgr2=0x559542891950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- 172.21.15.42:0/1795090691 shutdown_connections 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- 172.21.15.42:0/1795090691 wait complete. 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 Processor -- start 2024-02-16T00:11:45.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- start start 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x55954289e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.751+0000 7f9d0552f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954289eaf0 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d01a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x55954289e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d01a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x55954289e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54996/0 (socket says 172.21.15.42:54996) 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 learned_addr learned my addr 172.21.15.42:0/781437784 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55954288bca0 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d01a68640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x55954289e5b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc04c6b0 tx=0x7f9cfc019f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9bd6ffd640 1 -- 172.21.15.42:0/781437784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cfc04a050 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9bd6ffd640 1 -- 172.21.15.42:0/781437784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc018ce0 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55954289ecf0 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9bd6ffd640 1 -- 172.21.15.42:0/781437784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cfc047040 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.752+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55954289f150 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.753+0000 7f9bd6ffd640 1 -- 172.21.15.42:0/781437784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9cfc0183c0 con 0x559542897620 2024-02-16T00:11:45.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.753+0000 7f9bd6ffd640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bcc036830 0x7f9bcc038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.753+0000 7f9bd6ffd640 1 -- 172.21.15.42:0/781437784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9cfc04b070 con 0x559542897620 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.753+0000 7f9d01267640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bcc036830 0x7f9bcc038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5595428aa2f0 0x5595428ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428acf00 con 0x5595428aa2f0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d01267640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bcc036830 0x7f9bcc038cf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4070e00 tx=0x7f9cf408b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d00a66640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5595428aa2f0 0x5595428ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d00a66640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5595428aa2f0 0x5595428ac7b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 20 realm 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.754+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428a9750 con 0x5595428aa2f0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428ad980 con 0x5595428aa2f0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428ae200 con 0x5595428aa2f0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5595428aebe0 0x5595428b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b16a0 con 0x5595428aebe0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.755+0000 7f9d01a68640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5595428aebe0 0x5595428b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d01a68640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5595428aebe0 0x5595428b0fd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d0552f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d0552f800 20 searching for the correct realm 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5595428b3990 0x5595428b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d01267640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5595428b3990 0x5595428b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.756+0000 7f9d01267640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5595428b3990 0x5595428b5e50 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.757+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.757+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aebe0 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.757+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.757+0000 7f9d01a68640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9cfc03d830 0x7f9cfc04c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.757+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.757+0000 7f9d00a66640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9cfc03d830 0x7f9cfc04c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9cfc03d830 0x7f9cfc04c990 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.758+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aebe0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.759+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aebe0 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.760+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.761+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.762+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aebe0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aa2f0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x5595428aa2f0 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.763+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428b3990 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x7f9cfc03d830 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8006070 con 0x7f9cfc03d830 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6520 con 0x5595428aebe0 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9cfc05c080 con 0x5595428b3990 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.764+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9cfc05c080 con 0x7f9cfc03d830 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9cfc05c080 con 0x5595428aa2f0 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9cfc05c080 con 0x5595428aebe0 2024-02-16T00:11:45.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.765+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b2ef0 con 0x5595428aa2f0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b1eb0 con 0x5595428aa2f0 2024-02-16T00:11:45.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b27e0 con 0x5595428aa2f0 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 zone default found 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 4 Realm: () 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 zonegroup default 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.766+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b6e00 con 0x7f9cfc03d830 2024-02-16T00:11:45.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b88d0 con 0x5595428b3990 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b8d50 con 0x5595428b3990 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 started sync module instance, tier type = 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:45.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.767+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b8500 con 0x5595428aebe0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.768+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.768+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94099554924416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b9170 con 0x5595428aebe0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.768+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b9970 con 0x5595428aa2f0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.769+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94099554924416] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.770+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.770+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94099554931056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b9d20 con 0x5595428aa2f0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.770+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428ba520 con 0x5595428b3990 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.771+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.771+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94099554934528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bad20 con 0x5595428b3990 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.771+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bb730 con 0x5595428aebe0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.771+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94099554931056] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.772+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94099554934528] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.772+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.772+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94099554936960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bb220 con 0x5595428aebe0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.772+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bc0f0 con 0x5595428aa2f0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.773+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.773+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94099554942032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bc510 con 0x5595428aa2f0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.773+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bcfb0 con 0x7f9cfc03d830 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.773+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94099554936960] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.774+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94099554942032] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.774+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.774+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94099554945680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bc070 con 0x7f9cfc03d830 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.774+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bd800 con 0x7f9cfc03d830 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.775+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94099554945680] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.775+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.775+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94099554932112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bc070 con 0x7f9cfc03d830 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.775+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bde10 con 0x7f9cfc03d830 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94099554932112] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(58 notify.7 [create] v27'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94099554947808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bde10 con 0x7f9cfc03d830 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=0 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=1 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=2 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=3 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=4 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=5 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.776+0000 7f9d0552f800 20 add_watcher() i=6 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.777+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94099554947808] v27'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.777+0000 7f9d0552f800 20 add_watcher() i=7 2024-02-16T00:11:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.777+0000 7f9d0552f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.777+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bde00 con 0x5595428aa2f0 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.777+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.777+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94099554951728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428beb50 con 0x5595428aa2f0 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.778+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94099554951728] v27'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9bb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 5 note: GC not initialized 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9bb67e4640 20 reqs_thread_entry: start 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 20 Filter name: none 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9b27fff640 20 reqs_thread_entry: start 2024-02-16T00:11:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.779+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428f3660 con 0x5595428aa2f0 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.780+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~370 out=370b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 231+0+493 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.780+0000 7f9d0552f800 20 rados_obj.operate() r=0 bl.length=370 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.780+0000 7f9d0552f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.780+0000 7f9d0552f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.780+0000 7f9d0552f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:45.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.780+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428f9470 con 0x5595428aa2f0 2024-02-16T00:11:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v27'17 uv17 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d0552f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d0552f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d0552f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94099555192624 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428f6020 con 0x5595428aa2f0 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== watch-notify(notify (1) cookie 94099554942032 notify 115964117009 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x5595426c2ba0 con 0x5595428aa2f0 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9be4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 94099554942032 notifier 4656 bl.length()=534 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(64 notify.4 [notify cookie 94099555192624 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9be4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9be4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9be4ff9640 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x7f9bc4003e90 con 0x5595428aa2f0 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.781+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== watch-notify(notify_complete (2) cookie 94099555192624 notify 115964117009 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9cf802f830 con 0x5595428aa2f0 2024-02-16T00:11:45.795 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.782+0000 7f9bb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.782+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94099554951728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428f23e0 con 0x5595428aa2f0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.783+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94099554951728] v27'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.783+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94099554924416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428be230 con 0x5595428aebe0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.784+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94099554924416] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.784+0000 7f9d0552f800 20 remove_watcher() i=0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.784+0000 7f9d0552f800 2 removed watcher, disabling cache 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.784+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94099554931056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428be230 con 0x5595428aa2f0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.785+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94099554931056] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.785+0000 7f9d0552f800 20 remove_watcher() i=1 2024-02-16T00:11:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.785+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94099554934528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428b9170 con 0x5595428b3990 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.786+0000 7f9d01267640 1 -- 172.21.15.42:0/781437784 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94099554934528] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf4077070 con 0x5595428b3990 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.786+0000 7f9d0552f800 20 remove_watcher() i=2 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.786+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94099554936960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428be230 con 0x5595428aebe0 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.787+0000 7f9d01a68640 1 -- 172.21.15.42:0/781437784 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94099554936960] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cfc012070 con 0x5595428aebe0 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.787+0000 7f9d0552f800 20 remove_watcher() i=3 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.787+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94099554942032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428ba880 con 0x5595428aa2f0 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.788+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94099554942032] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x5595428aa2f0 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.788+0000 7f9d0552f800 20 remove_watcher() i=4 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.788+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94099554945680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428be230 con 0x7f9cfc03d830 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.789+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94099554945680] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.789+0000 7f9d0552f800 20 remove_watcher() i=5 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.789+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94099554932112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bbc50 con 0x7f9cfc03d830 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.790+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94099554932112] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.790+0000 7f9d0552f800 20 remove_watcher() i=6 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.790+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94099554947808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x5595428bbc50 con 0x7f9cfc03d830 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94099554947808] v27'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf8037040 con 0x7f9cfc03d830 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 20 remove_watcher() i=7 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9cfc03d830 msgr2=0x7f9cfc04c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9cfc03d830 0x7f9cfc04c990 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5595428aa2f0 msgr2=0x5595428ac7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5595428aa2f0 0x5595428ac7b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5595428aebe0 msgr2=0x5595428b0fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5595428aebe0 0x5595428b0fd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5595428b3990 msgr2=0x5595428b5e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.791+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5595428b3990 0x5595428b5e50 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bcc036830 msgr2=0x7f9bcc038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bcc036830 0x7f9bcc038cf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4070e00 tx=0x7f9cf408b000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 msgr2=0x55954289e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d00a66640 1 -- 172.21.15.42:0/781437784 reap_dead start 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x55954289e5b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc04c6b0 tx=0x7f9cfc019f40 comp rx=0 tx=0).stop 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 shutdown_connections 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/781437784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542897620 0x55954289e5b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 >> 172.21.15.42:0/781437784 conn(0x5595428938f0 msgr2=0x559542890f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 shutdown_connections 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/781437784 wait complete. 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bd80367e0 msgr2=0x7f9bd8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bd80367e0 0x7f9bd8038ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x559542876da0 tx=0x7f9cf4083040 comp rx=0 tx=0).stop 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 msgr2=0x55954288a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 0x55954288a830 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5595428701a0 tx=0x7f9cfc00aea0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 shutdown_connections 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9bd80367e0 0x7f9bd8038ca0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/4051067462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55954288a410 0x55954288a830 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 >> 172.21.15.42:0/4051067462 conn(0x55954287e4b0 msgr2=0x55954287e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 shutdown_connections 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/4051067462 wait complete. 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55954277b350 msgr2=0x559542876400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55954277b350 0x559542876400 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559542878c10 msgr2=0x55954287b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559542878c10 0x55954287b000 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9be80367e0 msgr2=0x7f9be8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.792+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9be80367e0 0x7f9be8038ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8000f60 tx=0x7f9cf80012b0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 msgr2=0x55954286f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954286f5d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9cf401d2c0 tx=0x7f9cf4003330 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 shutdown_connections 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559542878c10 0x55954287b000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55954277b350 0x559542876400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9be80367e0 0x7f9be8038ca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 --2- 172.21.15.42:0/2400844761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559542778a20 0x55954286f5d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 >> 172.21.15.42:0/2400844761 conn(0x5595427724f0 msgr2=0x5595428620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 shutdown_connections 2024-02-16T00:11:45.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.793+0000 7f9d0552f800 1 -- 172.21.15.42:0/2400844761 wait complete. 2024-02-16T00:11:45.807 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:11:45.816 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:45.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T00:11:45.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T00:11:45.817 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T00:11:45.858 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:11:45.859 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.856+0000 7fe1c1b1f800 1 Processor -- start 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1c1b1f800 1 -- start start 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1c1b1f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56470dcba3d0 0x56470dcc2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1c1b1f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56470dc04bb0 con 0x56470dcb8890 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1c1b1f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x56470dbbc450 con 0x56470dcba3d0 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1bcfeb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56470dcba3d0 0x56470dcc2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1bd7ec640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56470dcb8890 0x56470dcb8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:51564/0 (socket says 172.21.15.42:51564) 2024-02-16T00:11:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1bcfeb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56470dcba3d0 0x56470dcc2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:55012/0 (socket says 172.21.15.42:55012) 2024-02-16T00:11:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/2156011894 learned_addr learned my addr 172.21.15.42:0/2156011894 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:11:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/2156011894 >> v1:172.21.15.2:6789/0 conn(0x56470dcb8890 legacy=0x56470dcb8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1affff640 1 -- 172.21.15.42:0/2156011894 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440299444 0 0) 0x56470dc04bb0 con 0x56470dcb8890 2024-02-16T00:11:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.857+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/2156011894 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56470dc2d180 con 0x56470dcba3d0 2024-02-16T00:11:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.859+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/2156011894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcba3d0 0x56470dcc2ed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400a470 tx=0x7fe1b401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151931b9fdbae50f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.859+0000 7fe1affff640 1 -- 172.21.15.42:0/2156011894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b404ad40 con 0x56470dcba3d0 2024-02-16T00:11:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.859+0000 7fe1affff640 1 -- 172.21.15.42:0/2156011894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4052440 con 0x56470dcba3d0 2024-02-16T00:11:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.859+0000 7fe1affff640 1 -- 172.21.15.42:0/2156011894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b404aea0 con 0x56470dcba3d0 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/2156011894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcba3d0 msgr2=0x56470dcc2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/2156011894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcba3d0 0x56470dcc2ed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400a470 tx=0x7fe1b401cd60 comp rx=0 tx=0).stop 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/2156011894 shutdown_connections 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/2156011894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcba3d0 0x56470dcc2ed0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/2156011894 >> 172.21.15.42:0/2156011894 conn(0x56470dcb44d0 msgr2=0x56470dcb68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/2156011894 shutdown_connections 2024-02-16T00:11:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.860+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/2156011894 wait complete. 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.871+0000 7fe1c1b1f800 1 Processor -- start 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.871+0000 7fe1c1b1f800 1 -- start start 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1c1b1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1c1b1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470dbb9980 con 0x56470dcb8890 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1bd7ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1bd7ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:55020/0 (socket says 172.21.15.42:55020) 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1144515525 learned_addr learned my addr 172.21.15.42:0/1144515525 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1144515525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4005d20 con 0x56470dcb8890 2024-02-16T00:11:45.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1144515525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddac0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b210 tx=0x7fe1b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eadee12ff1b3dac server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe0ab606640 1 -- 172.21.15.42:0/1144515525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0014070 con 0x56470dcb8890 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe0ab606640 1 -- 172.21.15.42:0/1144515525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b000d500 con 0x56470dcb8890 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.872+0000 7fe0ab606640 1 -- 172.21.15.42:0/1144515525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000d800 con 0x56470dcb8890 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1144515525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 msgr2=0x56470ddac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1144515525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddac0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b210 tx=0x7fe1b000b6d0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1144515525 shutdown_connections 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1144515525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddac0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1144515525 >> 172.21.15.42:0/1144515525 conn(0x56470dcb44d0 msgr2=0x56470dda79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1144515525 shutdown_connections 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.873+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1144515525 wait complete. 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1c1b1f800 1 Processor -- start 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1c1b1f800 1 -- start start 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1c1b1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddb3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1c1b1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470dbb5160 con 0x56470dcb8890 2024-02-16T00:11:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1bd7ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddb3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1bd7ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddb3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:55024/0 (socket says 172.21.15.42:55024) 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/3202350546 learned_addr learned my addr 172.21.15.42:0/3202350546 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0001b70 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddb3840 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b210 tx=0x7fe1b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe0a9e03640 1 -- 172.21.15.42:0/3202350546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000f950 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe0a9e03640 1 -- 172.21.15.42:0/3202350546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0020070 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.874+0000 7fe0a9e03640 1 -- 172.21.15.42:0/3202350546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000fc20 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.875+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56470ddb3d80 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.875+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56470ddb4260 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.875+0000 7fe0a9e03640 1 -- 172.21.15.42:0/3202350546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe1b000d040 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.875+0000 7fe0a9e03640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0a40367e0 0x7fe0a4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.875+0000 7fe0a9e03640 1 -- 172.21.15.42:0/3202350546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe1b000a040 con 0x56470dcb8890 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0a40367e0 0x7fe0a4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470dcba3d0 0x56470ddba520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddbaaf0 con 0x56470dcba3d0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470dcba3d0 0x56470ddba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0a40367e0 0x7fe0a4038ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4054000 tx=0x7fe1b404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470dcba3d0 0x56470ddba520 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1bdfed640 1 -- 172.21.15.42:0/3202350546 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470dcba3d0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.876+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddb7c50 con 0x56470dcba3d0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1bdfed640 1 -- 172.21.15.42:0/3202350546 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470dcba3d0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddbcd60 0x56470ddbf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddbf840 con 0x56470ddbcd60 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddbcd60 0x56470ddbf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddbcd60 0x56470ddbf150 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/3202350546 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe1b0016070 con 0x56470ddbcd60 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.877+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddbbce0 con 0x56470dcba3d0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.878+0000 7fe1bdfed640 1 -- 172.21.15.42:0/3202350546 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470dcba3d0 2024-02-16T00:11:45.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.878+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddbc0d0 con 0x56470dcba3d0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.878+0000 7fe1bdfed640 1 -- 172.21.15.42:0/3202350546 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470dcba3d0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.878+0000 7fe1c1b1f800 1 Processor -- start 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.878+0000 7fe1c1b1f800 1 -- start start 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1c1b1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 0x56470ddce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1c1b1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470db57e80 con 0x56470ddce5a0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1bdfed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 0x56470ddce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1bdfed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 0x56470ddce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:55038/0 (socket says 172.21.15.42:55038) 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1675277836 learned_addr learned my addr 172.21.15.42:0/1675277836 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1675277836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56470ddcef00 con 0x56470ddce5a0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 0x56470ddce9c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x56470ddb4c40 tx=0x7fe1b8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe0a2ffd640 1 -- 172.21.15.42:0/1675277836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b801d070 con 0x56470ddce5a0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe0a2ffd640 1 -- 172.21.15.42:0/1675277836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b80182e0 con 0x56470ddce5a0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56470ddcf970 con 0x56470ddce5a0 2024-02-16T00:11:45.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe0a2ffd640 1 -- 172.21.15.42:0/1675277836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b80145a0 con 0x56470ddce5a0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.879+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56470ddcfe30 con 0x56470ddce5a0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.880+0000 7fe0a2ffd640 1 -- 172.21.15.42:0/1675277836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe1b8020020 con 0x56470ddce5a0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.880+0000 7fe0a2ffd640 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0980367e0 0x7fe098038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.880+0000 7fe0a2ffd640 1 -- 172.21.15.42:0/1675277836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe1b804dbe0 con 0x56470ddce5a0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.880+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0980367e0 0x7fe098038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.880+0000 7fe1c1b1f800 1 Processor -- start 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1c1b1f800 1 -- start start 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0980367e0 0x7fe098038ca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56470ddbaec0 tx=0x7fe1b0019e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1c1b1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dddbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1c1b1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470db2d5d0 con 0x56470dddb8a0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1bdfed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dddbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1bdfed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dddbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:55040/0 (socket says 172.21.15.42:55040) 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1032778181 learned_addr learned my addr 172.21.15.42:0/1032778181 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1032778181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56470dddc270 con 0x56470dddb8a0 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/1032778181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dddbca0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe1b804bf70 tx=0x7fe1b8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5379cb057446398 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe0a0ff9640 1 -- 172.21.15.42:0/1032778181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b8004730 con 0x56470dddb8a0 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe0a0ff9640 1 -- 172.21.15.42:0/1032778181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b802b350 con 0x56470dddb8a0 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.881+0000 7fe0a0ff9640 1 -- 172.21.15.42:0/1032778181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b80400d0 con 0x56470dddb8a0 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1032778181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 msgr2=0x56470dddbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1032778181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dddbca0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe1b804bf70 tx=0x7fe1b8011f20 comp rx=0 tx=0).stop 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1032778181 shutdown_connections 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1032778181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dddbca0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1032778181 >> 172.21.15.42:0/1032778181 conn(0x56470ddd7b20 msgr2=0x56470ddd5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1032778181 shutdown_connections 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1032778181 wait complete. 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 Processor -- start 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- start start 2024-02-16T00:11:45.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dde27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.882+0000 7fe1c1b1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470dde2d30 con 0x56470dddb8a0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1bdfed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dde27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1bdfed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dde27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:55042/0 (socket says 172.21.15.42:55042) 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 learned_addr learned my addr 172.21.15.42:0/1405425243 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56470ddcfe30 con 0x56470dddb8a0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dde27f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8016750 tx=0x7fe1b804bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe08effd640 1 -- 172.21.15.42:0/1405425243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b8033070 con 0x56470dddb8a0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe08effd640 1 -- 172.21.15.42:0/1405425243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b802b4c0 con 0x56470dddb8a0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56470dde2f30 con 0x56470dddb8a0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe08effd640 1 -- 172.21.15.42:0/1405425243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b804d3e0 con 0x56470dddb8a0 2024-02-16T00:11:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.883+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56470dde3390 con 0x56470dddb8a0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.884+0000 7fe08effd640 1 -- 172.21.15.42:0/1405425243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe1b804d540 con 0x56470dddb8a0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.884+0000 7fe08effd640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0880367e0 0x7fe088038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.884+0000 7fe08effd640 1 -- 172.21.15.42:0/1405425243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fe1b8039c60 con 0x56470dddb8a0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.884+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0880367e0 0x7fe088038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0880367e0 0x7fe088038ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b0042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470ddee550 0x56470ddf0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf1160 con 0x56470ddee550 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470ddee550 0x56470ddf0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470ddee550 0x56470ddf0a10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 20 realm 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.885+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf14f0 con 0x56470ddee550 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf1d70 con 0x56470ddee550 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf20d0 con 0x56470ddee550 2024-02-16T00:11:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddf2de0 0x56470ddf51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf2de0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddf2de0 0x56470ddf51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.886+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddf2de0 0x56470ddf51d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1c1b1f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1c1b1f800 20 searching for the correct realm 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56470ddf7b30 0x56470ddf9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfa6c0 con 0x56470ddf7b30 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56470ddf7b30 0x56470ddf9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.887+0000 7fe1bd7ec640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56470ddf7b30 0x56470ddf9ff0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfa6c0 con 0x56470ddf2de0 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bdfed640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe1b8014070 0x7fe1b804f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe1b8014070 0x7fe1b804f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.888+0000 7fe1bcfeb640 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe1b8014070 0x7fe1b804f0d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.889+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf2de0 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.890+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf2de0 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.891+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.892+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.892+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.892+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.892+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.892+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.893+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.894+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.894+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf2de0 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.894+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.894+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.894+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.894+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf2de0 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.895+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf7b30 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x7fe1b8014070 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddee550 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5820 con 0x56470ddf2de0 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:11:45.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.896+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf5f30 con 0x56470ddee550 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf62e0 con 0x56470ddee550 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf66c0 con 0x56470ddee550 2024-02-16T00:11:45.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 zone default found 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 4 Realm: () 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 zonegroup default 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfab00 con 0x7fe1b8014070 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.897+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddf6e70 con 0x56470ddf7b30 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfca50 con 0x56470ddf7b30 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:11:45.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 20 started sync module instance, tier type = 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.898+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfbf50 con 0x56470ddf2de0 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.899+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(44 notify.0 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.899+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863175435280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfce70 con 0x56470ddf2de0 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.899+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfd670 con 0x56470ddee550 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.900+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863175435280] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.900+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.900+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863175437936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfda20 con 0x56470ddee550 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.900+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfe220 con 0x56470ddf7b30 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.901+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863175437936] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.901+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.901+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863175440928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfde40 con 0x56470ddf7b30 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.901+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfeec0 con 0x56470ddf2de0 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.902+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863175440928] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.903+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(50 notify.3 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.903+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863175444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddff270 con 0x56470ddf2de0 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.903+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddffc50 con 0x56470ddee550 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.904+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.904+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863175448432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddffc50 con 0x56470ddee550 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.904+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863175444320] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.904+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de00bf0 con 0x7fe1b8014070 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.905+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863175448432] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.905+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(54 notify.5 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.905+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863175445584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddffef0 con 0x7fe1b8014070 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.905+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de010b0 con 0x7fe1b8014070 2024-02-16T00:11:45.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.906+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863175445584] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.906+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(56 notify.6 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.906+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863175453616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01070 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.906+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01a60 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(58 notify.7 [create] v27'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863175456064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01ec0 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=0 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=1 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=2 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=3 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=4 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=5 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863175453616] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.907+0000 7fe1c1b1f800 20 add_watcher() i=6 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.908+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863175456064] v27'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.908+0000 7fe1c1b1f800 20 add_watcher() i=7 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.908+0000 7fe1c1b1f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.908+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01ec0 con 0x56470ddee550 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.908+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.908+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863175457312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de02860 con 0x56470ddee550 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.909+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863175457312] v27'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.909+0000 7fe0737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.909+0000 7fe1c1b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.909+0000 7fe1c1b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.909+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de04b50 con 0x56470ddee550 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.910+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'56 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.910+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de04b10 con 0x7fe1b8014070 2024-02-16T00:11:45.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.911+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.911+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0e430 con 0x56470ddf7b30 2024-02-16T00:11:45.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.912+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.912+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0e850 con 0x56470ddee550 2024-02-16T00:11:45.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.913+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'198 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.913+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0ed80 con 0x56470ddf2de0 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.914+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'71 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.914+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0f2b0 con 0x56470ddf7b30 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.915+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'55 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.915+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0f7e0 con 0x56470ddee550 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.916+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.916+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0fc80 con 0x7fe1b8014070 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.918+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'50 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.918+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0fc80 con 0x56470ddf2de0 2024-02-16T00:11:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.918+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.918+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0d860 con 0x56470ddf7b30 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.919+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.919+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de0d860 con 0x56470ddf2de0 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.920+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'72 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.920+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de109c0 con 0x7fe1b8014070 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.921+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.921+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de109c0 con 0x56470ddf2de0 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.922+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.922+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x7fe1b8014070 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.923+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'61 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.923+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddee550 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.924+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'199 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.924+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.925+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.925+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf2de0 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.926+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'73 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.926+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.927+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'37 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.927+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddee550 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.928+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.928+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddee550 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.929+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'200 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.929+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.930+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.930+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf2de0 2024-02-16T00:11:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.931+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'43 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.931+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.932+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.932+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.933+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'43 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.933+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.934+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.934+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.935+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'56 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.935+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x7fe1b8014070 2024-02-16T00:11:45.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.936+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.936+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.937+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'37 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.937+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x7fe1b8014070 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.938+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'51 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.938+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf7b30 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.939+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.939+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x7fe1b8014070 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.940+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'62 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.940+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de10c90 con 0x56470ddf2de0 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.941+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'32 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe0727e4640 20 reqs_thread_entry: start 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 20 init_complete bucket index max shards: 11 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 20 Filter name: none 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fdfe3fff640 20 reqs_thread_entry: start 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 20 rados->read ofs=0 len=0 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de3a750 con 0x56470ddee550 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:11:45.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:11:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.942+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de3cc30 con 0x56470ddf2de0 2024-02-16T00:11:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.943+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T00:11:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.944+0000 7fe0737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:11:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.944+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863175457312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de101b0 con 0x56470ddee550 2024-02-16T00:11:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.945+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94863175457312] v27'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.945+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863175435280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01a20 con 0x56470ddf2de0 2024-02-16T00:11:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.946+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94863175435280] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.946+0000 7fe1c1b1f800 20 remove_watcher() i=0 2024-02-16T00:11:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.946+0000 7fe1c1b1f800 2 removed watcher, disabling cache 2024-02-16T00:11:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.946+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863175437936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01a20 con 0x56470ddee550 2024-02-16T00:11:45.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.947+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94863175437936] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.947+0000 7fe1c1b1f800 20 remove_watcher() i=1 2024-02-16T00:11:45.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.947+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863175440928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfce70 con 0x56470ddf7b30 2024-02-16T00:11:45.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.948+0000 7fe1bd7ec640 1 -- 172.21.15.42:0/1405425243 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94863175440928] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b0051040 con 0x56470ddf7b30 2024-02-16T00:11:45.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.948+0000 7fe1c1b1f800 20 remove_watcher() i=2 2024-02-16T00:11:45.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.948+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863175444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01a20 con 0x56470ddf2de0 2024-02-16T00:11:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.949+0000 7fe1bdfed640 1 -- 172.21.15.42:0/1405425243 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94863175444320] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b800a4a0 con 0x56470ddf2de0 2024-02-16T00:11:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.949+0000 7fe1c1b1f800 20 remove_watcher() i=3 2024-02-16T00:11:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.949+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863175448432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfda20 con 0x56470ddee550 2024-02-16T00:11:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.950+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94863175448432] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x56470ddee550 2024-02-16T00:11:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.950+0000 7fe1c1b1f800 20 remove_watcher() i=4 2024-02-16T00:11:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.950+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863175445584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfce70 con 0x7fe1b8014070 2024-02-16T00:11:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.951+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94863175445584] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.951+0000 7fe1c1b1f800 20 remove_watcher() i=5 2024-02-16T00:11:45.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.951+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863175453616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470de01a20 con 0x7fe1b8014070 2024-02-16T00:11:45.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.952+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94863175453616] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.952+0000 7fe1c1b1f800 20 remove_watcher() i=6 2024-02-16T00:11:45.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.952+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863175456064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) v8 -- 0x56470ddfda20 con 0x7fe1b8014070 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94863175456064] v27'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b40525b0 con 0x7fe1b8014070 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 20 remove_watcher() i=7 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe1b8014070 msgr2=0x7fe1b804f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fe1b8014070 0x7fe1b804f0d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470ddee550 msgr2=0x56470ddf0a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470ddee550 0x56470ddf0a10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddf2de0 msgr2=0x56470ddf51d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddf2de0 0x56470ddf51d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56470ddf7b30 msgr2=0x56470ddf9ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56470ddf7b30 0x56470ddf9ff0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0880367e0 msgr2=0x7fe088038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0880367e0 0x7fe088038ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b0042000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 msgr2=0x56470dde27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1bcfeb640 1 -- 172.21.15.42:0/1405425243 reap_dead start 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dde27f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8016750 tx=0x7fe1b804bf00 comp rx=0 tx=0).stop 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 shutdown_connections 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1405425243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dddb8a0 0x56470dde27f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 >> 172.21.15.42:0/1405425243 conn(0x56470ddd7b20 msgr2=0x56470ddd5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 shutdown_connections 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1405425243 wait complete. 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0980367e0 msgr2=0x7fe098038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0980367e0 0x7fe098038ca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56470ddbaec0 tx=0x7fe1b0019e70 comp rx=0 tx=0).stop 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 msgr2=0x56470ddce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 0x56470ddce9c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x56470ddb4c40 tx=0x7fe1b8018830 comp rx=0 tx=0).stop 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 shutdown_connections 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0980367e0 0x7fe098038ca0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/1675277836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470ddce5a0 0x56470ddce9c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.953+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 >> 172.21.15.42:0/1675277836 conn(0x56470ddc2640 msgr2=0x56470ddc2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 shutdown_connections 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/1675277836 wait complete. 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470dcba3d0 msgr2=0x56470ddba520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470dcba3d0 0x56470ddba520 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddbcd60 msgr2=0x56470ddbf150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddbcd60 0x56470ddbf150 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0a40367e0 msgr2=0x7fe0a4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0a40367e0 0x7fe0a4038ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4054000 tx=0x7fe1b404e000 comp rx=0 tx=0).stop 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 msgr2=0x56470ddb3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddb3840 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b210 tx=0x7fe1b0000ed0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 shutdown_connections 2024-02-16T00:11:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56470ddbcd60 0x56470ddbf150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56470dcba3d0 0x56470ddba520 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fe0a40367e0 0x7fe0a4038ca0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 --2- 172.21.15.42:0/3202350546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56470dcb8890 0x56470ddb3840 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:11:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 >> 172.21.15.42:0/3202350546 conn(0x56470dcb44d0 msgr2=0x56470dda6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:11:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 shutdown_connections 2024-02-16T00:11:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:11:45.954+0000 7fe1c1b1f800 1 -- 172.21.15.42:0/3202350546 wait complete. 2024-02-16T00:11:45.964 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T00:11:45.980 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:11:45.985 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-16T00:12:20.986 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-02-16T00:12:20.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-02-16T00:12:20.987 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-02-16T00:12:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.037 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.035+0000 7fa4df511800 1 Processor -- start 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.035+0000 7fa4df511800 1 -- start start 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.035+0000 7fa4df511800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a94975e300 0x55a9497606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.035+0000 7fa4df511800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a9496a5bb0 con 0x55a949759e70 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.035+0000 7fa4df511800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a94965d450 con 0x55a94975e300 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.036+0000 7fa4dc80f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55a94975e300 0x55a9497606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.036+0000 7fa4dd010640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55a949759e70 0x55a94975a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53474/0 (socket says 172.21.15.42:53474) 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.036+0000 7fa4dd010640 1 -- 172.21.15.42:0/3972944646 learned_addr learned my addr 172.21.15.42:0/3972944646 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.036+0000 7fa4dc80f640 1 -- 172.21.15.42:0/3972944646 >> v1:172.21.15.2:6789/0 conn(0x55a949759e70 legacy=0x55a94975a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.036+0000 7fa4dc80f640 1 -- 172.21.15.42:0/3972944646 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a949761d20 con 0x55a94975e300 2024-02-16T00:12:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.038+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/3972944646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94975e300 0x55a9497606f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a470 tx=0x7fa4d401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4adf5b99f09aa3b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.038+0000 7fa4cffff640 1 -- 172.21.15.42:0/3972944646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4052570 con 0x55a94975e300 2024-02-16T00:12:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.038+0000 7fa4cffff640 1 -- 172.21.15.42:0/3972944646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d40526d0 con 0x55a94975e300 2024-02-16T00:12:21.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.038+0000 7fa4cffff640 1 -- 172.21.15.42:0/3972944646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4052990 con 0x55a94975e300 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 -- 172.21.15.42:0/3972944646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94975e300 msgr2=0x55a9497606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 --2- 172.21.15.42:0/3972944646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94975e300 0x55a9497606f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a470 tx=0x7fa4d401cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 -- 172.21.15.42:0/3972944646 shutdown_connections 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 --2- 172.21.15.42:0/3972944646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94975e300 0x55a9497606f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 -- 172.21.15.42:0/3972944646 >> 172.21.15.42:0/3972944646 conn(0x55a9497554d0 msgr2=0x55a9497578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 -- 172.21.15.42:0/3972944646 shutdown_connections 2024-02-16T00:12:21.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.039+0000 7fa4df511800 1 -- 172.21.15.42:0/3972944646 wait complete. 2024-02-16T00:12:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4df511800 1 Processor -- start 2024-02-16T00:12:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4df511800 1 -- start start 2024-02-16T00:12:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4df511800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a949849f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4df511800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94965a980 con 0x55a949759e70 2024-02-16T00:12:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4dd010640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a949849f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4dd010640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a949849f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53388/0 (socket says 172.21.15.42:53388) 2024-02-16T00:12:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.053+0000 7fa4dd010640 1 -- 172.21.15.42:0/508091115 learned_addr learned my addr 172.21.15.42:0/508091115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.054+0000 7fa4dd010640 1 -- 172.21.15.42:0/508091115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4005d20 con 0x55a949759e70 2024-02-16T00:12:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.054+0000 7fa4dd010640 1 --2- 172.21.15.42:0/508091115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a949849f40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00014d0 tx=0x7fa4d0001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8067a149a57f8b00 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.054+0000 7fa3cb606640 1 -- 172.21.15.42:0/508091115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d0004520 con 0x55a949759e70 2024-02-16T00:12:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.054+0000 7fa3cb606640 1 -- 172.21.15.42:0/508091115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0004680 con 0x55a949759e70 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.054+0000 7fa3cb606640 1 -- 172.21.15.42:0/508091115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d0004980 con 0x55a949759e70 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 -- 172.21.15.42:0/508091115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 msgr2=0x55a949849f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 --2- 172.21.15.42:0/508091115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a949849f40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00014d0 tx=0x7fa4d0001990 comp rx=0 tx=0).stop 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 -- 172.21.15.42:0/508091115 shutdown_connections 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 --2- 172.21.15.42:0/508091115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a949849f40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 -- 172.21.15.42:0/508091115 >> 172.21.15.42:0/508091115 conn(0x55a9497554d0 msgr2=0x55a949845860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 -- 172.21.15.42:0/508091115 shutdown_connections 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 -- 172.21.15.42:0/508091115 wait complete. 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 Processor -- start 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.055+0000 7fa4df511800 1 -- start start 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4df511800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a9498515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4df511800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a949656160 con 0x55a949759e70 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4dd010640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a9498515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4dd010640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a9498515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53396/0 (socket says 172.21.15.42:53396) 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4dd010640 1 -- 172.21.15.42:0/831490034 learned_addr learned my addr 172.21.15.42:0/831490034 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4dd010640 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9496a5bb0 con 0x55a949759e70 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.056+0000 7fa4dd010640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a9498515d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00014d0 tx=0x7fa4d0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.057+0000 7fa3c9e03640 1 -- 172.21.15.42:0/831490034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d0014870 con 0x55a949759e70 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.057+0000 7fa3c9e03640 1 -- 172.21.15.42:0/831490034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d00149f0 con 0x55a949759e70 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.057+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a949851b10 con 0x55a949759e70 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.057+0000 7fa3c9e03640 1 -- 172.21.15.42:0/831490034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d0014cd0 con 0x55a949759e70 2024-02-16T00:12:21.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.057+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a949851ff0 con 0x55a949759e70 2024-02-16T00:12:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.057+0000 7fa3c9e03640 1 -- 172.21.15.42:0/831490034 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa4d001e3f0 con 0x55a949759e70 2024-02-16T00:12:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa3c9e03640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c40367e0 0x7fa3c4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa3c9e03640 1 -- 172.21.15.42:0/831490034 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa4d004c470 con 0x55a949759e70 2024-02-16T00:12:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c40367e0 0x7fa3c4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94975e300 0x55a949858330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949858920 con 0x55a94975e300 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa4dd811640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94975e300 0x55a949858330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c40367e0 0x7fa3c4038ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4054000 tx=0x7fa4d404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.058+0000 7fa4dd811640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94975e300 0x55a949858330 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.059+0000 7fa4dd811640 1 -- 172.21.15.42:0/831490034 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a94975e300 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.059+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498559c0 con 0x55a94975e300 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.059+0000 7fa4dd811640 1 -- 172.21.15.42:0/831490034 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a94975e300 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.059+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a94985ab30 0x55a94985cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.059+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94985d610 con 0x55a94985ab30 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.059+0000 7fa4dd010640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a94985ab30 0x55a94985cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.060+0000 7fa4dd010640 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a94985ab30 0x55a94985cf20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.060+0000 7fa4dd010640 1 -- 172.21.15.42:0/831490034 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa4d0024070 con 0x55a94985ab30 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.060+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949859ab0 con 0x55a94975e300 2024-02-16T00:12:21.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.060+0000 7fa4dd811640 1 -- 172.21.15.42:0/831490034 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a94975e300 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.060+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949859f00 con 0x55a94975e300 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.061+0000 7fa4dd811640 1 -- 172.21.15.42:0/831490034 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a94975e300 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.061+0000 7fa4df511800 1 Processor -- start 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.061+0000 7fa4df511800 1 -- start start 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.061+0000 7fa4df511800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 0x55a949870500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.061+0000 7fa4df511800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9495f8e80 con 0x55a94986e110 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.061+0000 7fa4dd811640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 0x55a949870500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa4dd811640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 0x55a949870500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53410/0 (socket says 172.21.15.42:53410) 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa4dd811640 1 -- 172.21.15.42:0/3144033374 learned_addr learned my addr 172.21.15.42:0/3144033374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa4dd811640 1 -- 172.21.15.42:0/3144033374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9496ce1f0 con 0x55a94986e110 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa4dd811640 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 0x55a949870500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55a9498529d0 tx=0x7fa4d800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa3c2ffd640 1 -- 172.21.15.42:0/3144033374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d800f040 con 0x55a94986e110 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa3c2ffd640 1 -- 172.21.15.42:0/3144033374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d8007d00 con 0x55a94986e110 2024-02-16T00:12:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa3c2ffd640 1 -- 172.21.15.42:0/3144033374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d8019420 con 0x55a94986e110 2024-02-16T00:12:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a949870a40 con 0x55a94986e110 2024-02-16T00:12:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.062+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a949870ea0 con 0x55a94986e110 2024-02-16T00:12:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.063+0000 7fa3c2ffd640 1 -- 172.21.15.42:0/3144033374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa4d8019580 con 0x55a94986e110 2024-02-16T00:12:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.063+0000 7fa3c2ffd640 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b40367e0 0x7fa3b4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.063+0000 7fa3c2ffd640 1 -- 172.21.15.42:0/3144033374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa4d804e480 con 0x55a94986e110 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.063+0000 7fa4dd010640 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b40367e0 0x7fa3b4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4df511800 1 Processor -- start 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4df511800 1 -- start start 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4dd010640 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b40367e0 0x7fa3b4038ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55a949858cf0 tx=0x7fa4d004a680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4df511800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a94987ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4df511800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9495ce5d0 con 0x55a94987a830 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4dd811640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a94987ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4dd811640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a94987ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53414/0 (socket says 172.21.15.42:53414) 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.064+0000 7fa4dd811640 1 -- 172.21.15.42:0/470572875 learned_addr learned my addr 172.21.15.42:0/470572875 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.065+0000 7fa4dd811640 1 -- 172.21.15.42:0/470572875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a94987b220 con 0x55a94987a830 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.065+0000 7fa4dd811640 1 --2- 172.21.15.42:0/470572875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a94987ac50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa4d804c730 tx=0x7fa4d8017bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9182044197f8ed4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.065+0000 7fa3c0ff9640 1 -- 172.21.15.42:0/470572875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d804e0d0 con 0x55a94987a830 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.065+0000 7fa3c0ff9640 1 -- 172.21.15.42:0/470572875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d804e230 con 0x55a94987a830 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.065+0000 7fa3c0ff9640 1 -- 172.21.15.42:0/470572875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d8022de0 con 0x55a94987a830 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- 172.21.15.42:0/470572875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 msgr2=0x55a94987ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 --2- 172.21.15.42:0/470572875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a94987ac50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa4d804c730 tx=0x7fa4d8017bd0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- 172.21.15.42:0/470572875 shutdown_connections 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 --2- 172.21.15.42:0/470572875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a94987ac50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- 172.21.15.42:0/470572875 >> 172.21.15.42:0/470572875 conn(0x55a949876b50 msgr2=0x55a949874bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- 172.21.15.42:0/470572875 shutdown_connections 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- 172.21.15.42:0/470572875 wait complete. 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 Processor -- start 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- start start 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a9498817e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4df511800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a949881d20 con 0x55a94987a830 2024-02-16T00:12:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4dd811640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a9498817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4dd811640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a9498817e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53430/0 (socket says 172.21.15.42:53430) 2024-02-16T00:12:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.066+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 learned_addr learned my addr 172.21.15.42:0/2323759408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a949870ea0 con 0x55a94987a830 2024-02-16T00:12:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa4dd811640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a9498817e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa4d804b5d0 tx=0x7fa4d804c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa3b2ffd640 1 -- 172.21.15.42:0/2323759408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d8018a30 con 0x55a94987a830 2024-02-16T00:12:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa3b2ffd640 1 -- 172.21.15.42:0/2323759408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d8018b90 con 0x55a94987a830 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a949881f20 con 0x55a94987a830 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa3b2ffd640 1 -- 172.21.15.42:0/2323759408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d8018e50 con 0x55a94987a830 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.067+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9498823e0 con 0x55a94987a830 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa3b2ffd640 1 -- 172.21.15.42:0/2323759408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa4d803b260 con 0x55a94987a830 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa3b2ffd640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a8036790 0x7fa3a8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa3b2ffd640 1 -- 172.21.15.42:0/2323759408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa4d8040e40 con 0x55a94987a830 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa4dd010640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a8036790 0x7fa3a8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94988d310 0x55a94988f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.068+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94988ff20 con 0x55a94988d310 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94988d310 0x55a94988f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4dd010640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a8036790 0x7fa3a8038c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0012fd0 tx=0x7fa4d0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94988d310 0x55a94988f7d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4df511800 20 realm 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498902b0 con 0x55a94988d310 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.069+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949890b30 con 0x55a94988d310 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949890e90 con 0x55a94988d310 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a949891ba0 0x55a949893f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498944d0 con 0x55a949891ba0 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4dd811640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a949891ba0 0x55a949893f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.070+0000 7fa4dd811640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a949891ba0 0x55a949893f90 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4df511800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4df511800 20 searching for the correct realm 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a949896420 0x55a9498988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4dd010640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a949896420 0x55a9498988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.071+0000 7fa4dd010640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a949896420 0x55a9498988c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.072+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.072+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.072+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.072+0000 7fa4dd811640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d8019040 0x7fa4d802e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.072+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.072+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d8019040 0x7fa4d802e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.073+0000 7fa4dc80f640 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d8019040 0x7fa4d802e040 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.073+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.073+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.073+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.073+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.074+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.074+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.074+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.074+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.074+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.074+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.075+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.075+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.075+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.075+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.075+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.075+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.076+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.077+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.077+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.077+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.077+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.077+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.077+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.078+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.079+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.079+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.079+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.079+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.079+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.079+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.080+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.080+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.080+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.080+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.081+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.081+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.081+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.081+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949896420 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.081+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.081+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x7fa4d8019040 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a94988d310 2024-02-16T00:12:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949898f90 con 0x55a949891ba0 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949894e90 con 0x55a94988d310 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.082+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949894ae0 con 0x55a94988d310 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949895730 con 0x55a94988d310 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 zone default found 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 4 Realm: () 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 zonegroup default 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a949899870 con 0x7fa4d8019040 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.083+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989b2b0 con 0x55a949896420 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989b760 con 0x55a949896420 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 20 started sync module instance, tier type = 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.084+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989a820 con 0x55a949891ba0 2024-02-16T00:12:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.085+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.085+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94185571593472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989bb80 con 0x55a949891ba0 2024-02-16T00:12:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.085+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989c380 con 0x55a94988d310 2024-02-16T00:12:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.086+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94185571593472] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.087+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.087+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94185571597184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989c730 con 0x55a94988d310 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.087+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989cf30 con 0x55a949896420 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.088+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94185571597184] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.088+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.088+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94185571600176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989cb50 con 0x55a949896420 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.088+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989dbd0 con 0x55a949891ba0 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.090+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94185571600176] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.090+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.090+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94185571603568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989df80 con 0x55a949891ba0 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.090+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989e9d0 con 0x55a94988d310 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.091+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94185571603568] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.091+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.091+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94185571607728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989e990 con 0x55a94988d310 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.091+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989f400 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.092+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94185571607728] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.092+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.092+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94185571610400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989f400 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.092+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989fe00 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.093+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(56 notify.6 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.093+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94185571612960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498a0240 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.093+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498a0d10 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.093+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94185571610400] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(58 notify.7 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94185571612960] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94185571616752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498a0cd0 con 0x7fa4d8019040 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=0 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=1 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=2 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=3 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=4 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=5 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.094+0000 7fa4df511800 20 add_watcher() i=6 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.095+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94185571616752] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.095+0000 7fa4df511800 20 add_watcher() i=7 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.095+0000 7fa4df511800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.096+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498a40c0 con 0x55a94988d310 2024-02-16T00:12:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.096+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.096+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94185571604752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498a1530 con 0x55a94988d310 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.097+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94185571604752] v29'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.097+0000 7fa3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.097+0000 7fa4df511800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.097+0000 7fa4df511800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.097+0000 7fa4df511800 5 note: GC not initialized 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.097+0000 7fa3927e4640 20 reqs_thread_entry: start 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4df511800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4df511800 20 Filter name: none 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa303fff640 20 reqs_thread_entry: start 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d61c0 con 0x55a94988d310 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d61c0 con 0x55a949891ba0 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.098+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d61c0 con 0x55a94988d310 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d61c0 con 0x55a949896420 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d6620 con 0x55a949896420 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d69d0 con 0x55a949896420 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.099+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d69d0 con 0x55a94988d310 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d69d0 con 0x55a94988d310 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d69d0 con 0x55a949896420 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d69d0 con 0x55a949896420 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.100+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d69d0 con 0x7fa4d8019040 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8380 con 0x55a94988d310 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8380 con 0x55a949891ba0 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8380 con 0x55a949896420 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.101+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8380 con 0x7fa4d8019040 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d82c0 con 0x7fa4d8019040 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d82c0 con 0x55a949896420 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.102+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d82c0 con 0x7fa4d8019040 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.103+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.103+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8250 con 0x55a94988d310 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.103+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.103+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8250 con 0x55a949896420 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.103+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.103+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x7fa4d8019040 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.104+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.104+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a949891ba0 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.104+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.104+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x7fa4d8019040 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.105+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.105+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a94988d310 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.105+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.105+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a94988d310 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.105+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.105+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a949896420 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a94988d310 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a94988d310 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a949896420 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.106+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a949896420 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.107+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.107+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x55a949896420 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.107+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.107+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d8200 con 0x7fa4d8019040 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.107+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.108+0000 7fa3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.108+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94185571604752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a9498d3f10 con 0x55a94988d310 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.109+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94185571604752] v29'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.109+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94185571593472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989d910 con 0x55a949891ba0 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.110+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94185571593472] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.110+0000 7fa4df511800 20 remove_watcher() i=0 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.110+0000 7fa4df511800 2 removed watcher, disabling cache 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.110+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94185571597184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989ace0 con 0x55a94988d310 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.111+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94185571597184] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.111+0000 7fa4df511800 20 remove_watcher() i=1 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.111+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94185571600176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989bb80 con 0x55a949896420 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.113+0000 7fa4dd010640 1 -- 172.21.15.42:0/2323759408 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94185571600176] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d0024070 con 0x55a949896420 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.113+0000 7fa4df511800 20 remove_watcher() i=2 2024-02-16T00:12:21.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.113+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94185571603568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989bb80 con 0x55a949891ba0 2024-02-16T00:12:21.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.114+0000 7fa4dd811640 1 -- 172.21.15.42:0/2323759408 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94185571603568] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d80083e0 con 0x55a949891ba0 2024-02-16T00:12:21.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.114+0000 7fa4df511800 20 remove_watcher() i=3 2024-02-16T00:12:21.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.114+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94185571607728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989bb80 con 0x55a94988d310 2024-02-16T00:12:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.115+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94185571607728] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x55a94988d310 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.115+0000 7fa4df511800 20 remove_watcher() i=4 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.115+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94185571610400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989bb80 con 0x7fa4d8019040 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.116+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94185571610400] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.116+0000 7fa4df511800 20 remove_watcher() i=5 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.116+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94185571612960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989ef20 con 0x7fa4d8019040 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.117+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94185571612960] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.117+0000 7fa4df511800 20 remove_watcher() i=6 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.117+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94185571616752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a94989bb80 con 0x7fa4d8019040 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94185571616752] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d4059040 con 0x7fa4d8019040 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 20 remove_watcher() i=7 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d8019040 msgr2=0x7fa4d802e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d8019040 0x7fa4d802e040 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94988d310 msgr2=0x55a94988f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94988d310 0x55a94988f7d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a949891ba0 msgr2=0x55a949893f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a949891ba0 0x55a949893f90 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a949896420 msgr2=0x55a9498988c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55a949896420 0x55a9498988c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a8036790 msgr2=0x7fa3a8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a8036790 0x7fa3a8038c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0012fd0 tx=0x7fa4d0032000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 msgr2=0x55a9498817e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4dc80f640 1 -- 172.21.15.42:0/2323759408 reap_dead start 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a9498817e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa4d804b5d0 tx=0x7fa4d804c690 comp rx=0 tx=0).stop 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 shutdown_connections 2024-02-16T00:12:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/2323759408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94987a830 0x55a9498817e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 >> 172.21.15.42:0/2323759408 conn(0x55a949876b50 msgr2=0x55a9498741b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 shutdown_connections 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/2323759408 wait complete. 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b40367e0 msgr2=0x7fa3b4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b40367e0 0x7fa3b4038ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55a949858cf0 tx=0x7fa4d004a680 comp rx=0 tx=0).stop 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 msgr2=0x55a949870500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 0x55a949870500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55a9498529d0 tx=0x7fa4d800aea0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 shutdown_connections 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b40367e0 0x7fa3b4038ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 --2- 172.21.15.42:0/3144033374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a94986e110 0x55a949870500 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 >> 172.21.15.42:0/3144033374 conn(0x55a949860510 msgr2=0x55a949860910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.119+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 shutdown_connections 2024-02-16T00:12:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/3144033374 wait complete. 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94975e300 msgr2=0x55a949858330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94975e300 0x55a949858330 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a94985ab30 msgr2=0x55a94985cf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a94985ab30 0x55a94985cf20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c40367e0 msgr2=0x7fa3c4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c40367e0 0x7fa3c4038ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4054000 tx=0x7fa4d404e000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 msgr2=0x55a9498515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a9498515d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00014d0 tx=0x7fa4d0001250 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 shutdown_connections 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55a94985ab30 0x55a94985cf20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55a94975e300 0x55a949858330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c40367e0 0x7fa3c4038ca0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 --2- 172.21.15.42:0/831490034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a949759e70 0x55a9498515d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 >> 172.21.15.42:0/831490034 conn(0x55a9497554d0 msgr2=0x55a9498440e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 shutdown_connections 2024-02-16T00:12:21.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.120+0000 7fa4df511800 1 -- 172.21.15.42:0/831490034 wait complete. 2024-02-16T00:12:21.136 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-16T00:12:21.136 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-16T00:12:21.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-16T00:12:21.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-16T00:12:21.136 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-16T00:12:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.177 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b7830800 1 Processor -- start 2024-02-16T00:12:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b7830800 1 -- start start 2024-02-16T00:12:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b7830800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627c8de7e60 0x5627c8de8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b7830800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5627c8d33ba0 con 0x5627c8de90c0 2024-02-16T00:12:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b7830800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5627c8ceb450 con 0x5627c8de7e60 2024-02-16T00:12:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b2b33640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627c8de7e60 0x5627c8de8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b2b33640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5627c8de7e60 0x5627c8de8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53436/0 (socket says 172.21.15.42:53436) 2024-02-16T00:12:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b2b33640 1 -- 172.21.15.42:0/1691212755 learned_addr learned my addr 172.21.15.42:0/1691212755 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.175+0000 7f12b2332640 1 --1- 172.21.15.42:0/1691212755 >> v1:172.21.15.2:6789/0 conn(0x5627c8de90c0 0x5627c8de9540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53476/0 (socket says 172.21.15.42:53476) 2024-02-16T00:12:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.176+0000 7f12b2b33640 1 -- 172.21.15.42:0/1691212755 >> v1:172.21.15.2:6789/0 conn(0x5627c8de90c0 legacy=0x5627c8de9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.176+0000 7f12b2b33640 1 -- 172.21.15.42:0/1691212755 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c8de8950 con 0x5627c8de7e60 2024-02-16T00:12:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b2b33640 1 --2- 172.21.15.42:0/1691212755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8de8280 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f12a400a520 tx=0x7f12a401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d61431343843b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b1b31640 1 -- 172.21.15.42:0/1691212755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a4052570 con 0x5627c8de7e60 2024-02-16T00:12:21.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b1b31640 1 -- 172.21.15.42:0/1691212755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40526d0 con 0x5627c8de7e60 2024-02-16T00:12:21.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b1b31640 1 -- 172.21.15.42:0/1691212755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a4052990 con 0x5627c8de7e60 2024-02-16T00:12:21.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 -- 172.21.15.42:0/1691212755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 msgr2=0x5627c8de8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 --2- 172.21.15.42:0/1691212755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8de8280 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f12a400a520 tx=0x7f12a401cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 -- 172.21.15.42:0/1691212755 shutdown_connections 2024-02-16T00:12:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 --2- 172.21.15.42:0/1691212755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8de8280 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 -- 172.21.15.42:0/1691212755 >> 172.21.15.42:0/1691212755 conn(0x5627c8de34c0 msgr2=0x5627c8de58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 -- 172.21.15.42:0/1691212755 shutdown_connections 2024-02-16T00:12:21.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.178+0000 7f12b7830800 1 -- 172.21.15.42:0/1691212755 wait complete. 2024-02-16T00:12:21.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.189+0000 7f12b7830800 1 Processor -- start 2024-02-16T00:12:21.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b7830800 1 -- start start 2024-02-16T00:12:21.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b7830800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8d5bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b7830800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c8ce8980 con 0x5627c8de7e60 2024-02-16T00:12:21.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b2b33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8d5bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b2b33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8d5bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53452/0 (socket says 172.21.15.42:53452) 2024-02-16T00:12:21.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b2b33640 1 -- 172.21.15.42:0/757820222 learned_addr learned my addr 172.21.15.42:0/757820222 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.190+0000 7f12b2b33640 1 -- 172.21.15.42:0/757820222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4005de0 con 0x5627c8de7e60 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f12b2b33640 1 --2- 172.21.15.42:0/757820222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8d5bf20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f12a401cf20 tx=0x7f12a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db906c25df1a26b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f11a0e09640 1 -- 172.21.15.42:0/757820222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a4052840 con 0x5627c8de7e60 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f11a0e09640 1 -- 172.21.15.42:0/757820222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40529a0 con 0x5627c8de7e60 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f11a0e09640 1 -- 172.21.15.42:0/757820222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a4052c80 con 0x5627c8de7e60 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f12b7830800 1 -- 172.21.15.42:0/757820222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 msgr2=0x5627c8d5bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f12b7830800 1 --2- 172.21.15.42:0/757820222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8d5bf20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f12a401cf20 tx=0x7f12a404c000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f12b7830800 1 -- 172.21.15.42:0/757820222 shutdown_connections 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f12b7830800 1 --2- 172.21.15.42:0/757820222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8d5bf20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.191+0000 7f12b7830800 1 -- 172.21.15.42:0/757820222 >> 172.21.15.42:0/757820222 conn(0x5627c8de34c0 msgr2=0x5627c8ed3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b7830800 1 -- 172.21.15.42:0/757820222 shutdown_connections 2024-02-16T00:12:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b7830800 1 -- 172.21.15.42:0/757820222 wait complete. 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b7830800 1 Processor -- start 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b7830800 1 -- start start 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b7830800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8ee0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b7830800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c8ce4160 con 0x5627c8de7e60 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b2b33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8ee0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b2b33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8ee0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53458/0 (socket says 172.21.15.42:53458) 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.192+0000 7f12b2b33640 1 -- 172.21.15.42:0/719646788 learned_addr learned my addr 172.21.15.42:0/719646788 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f12b2b33640 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a404e070 con 0x5627c8de7e60 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f12b2b33640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8ee0860 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f12a401ceb0 tx=0x7f12a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f119f606640 1 -- 172.21.15.42:0/719646788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a406c070 con 0x5627c8de7e60 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f119f606640 1 -- 172.21.15.42:0/719646788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a405d5b0 con 0x5627c8de7e60 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627c8ee0da0 con 0x5627c8de7e60 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f119f606640 1 -- 172.21.15.42:0/719646788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a405d850 con 0x5627c8de7e60 2024-02-16T00:12:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.193+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627c8ee12e0 con 0x5627c8de7e60 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f119f606640 1 -- 172.21.15.42:0/719646788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f12a4059040 con 0x5627c8de7e60 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f119f606640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1198036790 0x7f1198038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f119f606640 1 -- 172.21.15.42:0/719646788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f12a408d6d0 con 0x5627c8de7e60 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f12b2332640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1198036790 0x7f1198038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8de90c0 0x5627c8ee7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8ee7a60 con 0x5627c8de90c0 2024-02-16T00:12:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.194+0000 7f12b3334640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8de90c0 0x5627c8ee7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b2332640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1198036790 0x7f1198038c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f12a8000f60 tx=0x7f12a8001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b3334640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8de90c0 0x5627c8ee7520 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b3334640 1 -- 172.21.15.42:0/719646788 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12ac00a4a0 con 0x5627c8de90c0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8ee4c40 con 0x5627c8de90c0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b3334640 1 -- 172.21.15.42:0/719646788 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f12ac00a4a0 con 0x5627c8de90c0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8ee9ca0 0x5627c8eec090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8eec760 con 0x5627c8ee9ca0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.195+0000 7f12b2b33640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8ee9ca0 0x5627c8eec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.196+0000 7f12b2b33640 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8ee9ca0 0x5627c8eec090 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.196+0000 7f12b2b33640 1 -- 172.21.15.42:0/719646788 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f12a408bbb0 con 0x5627c8ee9ca0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.196+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8ee8c20 con 0x5627c8de90c0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.196+0000 7f12b3334640 1 -- 172.21.15.42:0/719646788 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12ac00a4a0 con 0x5627c8de90c0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.196+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8ee9030 con 0x5627c8de90c0 2024-02-16T00:12:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.196+0000 7f12b3334640 1 -- 172.21.15.42:0/719646788 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f12ac00a4a0 con 0x5627c8de90c0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b7830800 1 Processor -- start 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b7830800 1 -- start start 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b7830800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 0x5627c8efb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b7830800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c8c86e80 con 0x5627c8efb4e0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b3334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 0x5627c8efb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b3334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 0x5627c8efb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53464/0 (socket says 172.21.15.42:53464) 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b3334640 1 -- 172.21.15.42:0/720124633 learned_addr learned my addr 172.21.15.42:0/720124633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.197+0000 7f12b3334640 1 -- 172.21.15.42:0/720124633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c8efbe40 con 0x5627c8efb4e0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.198+0000 7f12b3334640 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 0x5627c8efb900 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5627c8ee1c60 tx=0x7f12ac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.198+0000 7f119ce01640 1 -- 172.21.15.42:0/720124633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac01d070 con 0x5627c8efb4e0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.198+0000 7f119ce01640 1 -- 172.21.15.42:0/720124633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac0182e0 con 0x5627c8efb4e0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.198+0000 7f119ce01640 1 -- 172.21.15.42:0/720124633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac0145a0 con 0x5627c8efb4e0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.198+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627c8efc8b0 con 0x5627c8efb4e0 2024-02-16T00:12:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.198+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627c8efcd70 con 0x5627c8efb4e0 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f119ce01640 1 -- 172.21.15.42:0/720124633 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f12ac020020 con 0x5627c8efb4e0 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f119ce01640 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f118c0367e0 0x7f118c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f119ce01640 1 -- 172.21.15.42:0/720124633 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f12ac04dca0 con 0x5627c8efb4e0 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f12b2b33640 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f118c0367e0 0x7f118c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f12b7830800 1 Processor -- start 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f12b7830800 1 -- start start 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f12b2b33640 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f118c0367e0 0x7f118c038ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5627c8ee7df0 tx=0x7f12a4005130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f12b7830800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f08b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.199+0000 7f12b7830800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c8c5c5d0 con 0x5627c8f08750 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f12b3334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f08b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f12b3334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f08b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53474/0 (socket says 172.21.15.42:53474) 2024-02-16T00:12:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f12b3334640 1 -- 172.21.15.42:0/105887700 learned_addr learned my addr 172.21.15.42:0/105887700 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f12b3334640 1 -- 172.21.15.42:0/105887700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c8f09140 con 0x5627c8f08750 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f12b3334640 1 --2- 172.21.15.42:0/105887700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f08b70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f12ac04c010 tx=0x7f12ac02bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c0a537be3c76b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f11967fc640 1 -- 172.21.15.42:0/105887700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac016570 con 0x5627c8f08750 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f11967fc640 1 -- 172.21.15.42:0/105887700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac02b350 con 0x5627c8f08750 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.200+0000 7f11967fc640 1 -- 172.21.15.42:0/105887700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac0401c0 con 0x5627c8f08750 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- 172.21.15.42:0/105887700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 msgr2=0x5627c8f08b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 --2- 172.21.15.42:0/105887700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f08b70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f12ac04c010 tx=0x7f12ac02bc70 comp rx=0 tx=0).stop 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- 172.21.15.42:0/105887700 shutdown_connections 2024-02-16T00:12:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 --2- 172.21.15.42:0/105887700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f08b70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- 172.21.15.42:0/105887700 >> 172.21.15.42:0/105887700 conn(0x5627c8f04a60 msgr2=0x5627c8f02ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- 172.21.15.42:0/105887700 shutdown_connections 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- 172.21.15.42:0/105887700 wait complete. 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 Processor -- start 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- start start 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f0f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b7830800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627c8f0fb80 con 0x5627c8f08750 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b3334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f0f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b3334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f0f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53486/0 (socket says 172.21.15.42:53486) 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.201+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 learned_addr learned my addr 172.21.15.42:0/351715691 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627c8efcd70 con 0x5627c8f08750 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f12b3334640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f0f640 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5627c8f05160 tx=0x7f12ac04bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f1194ff9640 1 -- 172.21.15.42:0/351715691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac034070 con 0x5627c8f08750 2024-02-16T00:12:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f1194ff9640 1 -- 172.21.15.42:0/351715691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac013ca0 con 0x5627c8f08750 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627c8f0fd80 con 0x5627c8f08750 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f1194ff9640 1 -- 172.21.15.42:0/351715691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac022740 con 0x5627c8f08750 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.202+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627c8f10240 con 0x5627c8f08750 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f1194ff9640 1 -- 172.21.15.42:0/351715691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f12ac037020 con 0x5627c8f08750 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f1194ff9640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f117c0367e0 0x7f117c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f1194ff9640 1 -- 172.21.15.42:0/351715691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f12ac04a070 con 0x5627c8f08750 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f12b2b33640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f117c0367e0 0x7f117c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8f1b360 0x5627c8f1d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f1df70 con 0x5627c8f1b360 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.203+0000 7f12b2332640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8f1b360 0x5627c8f1d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b2b33640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f117c0367e0 0x7f117c038ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5627c8eecb20 tx=0x7f12a4085000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b2332640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8f1b360 0x5627c8f1d820 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 realm 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f1a7c0 con 0x5627c8f1b360 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f1e9f0 con 0x5627c8f1b360 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.204+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f1e690 con 0x5627c8f1b360 2024-02-16T00:12:21.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8f1fcc0 0x5627c8f220b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f22630 con 0x5627c8f1fcc0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b3334640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8f1fcc0 0x5627c8f220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b3334640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8f1fcc0 0x5627c8f220b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 20 searching for the correct realm 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627c8f243c0 0x5627c8f267b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f26e60 con 0x5627c8f243c0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.205+0000 7f12b2b33640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627c8f243c0 0x5627c8f267b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.206+0000 7f12b2b33640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627c8f243c0 0x5627c8f267b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.206+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.206+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f26e60 con 0x5627c8f1fcc0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.206+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.206+0000 7f12b3334640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f12ac0133b0 0x7f12ac032440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.206+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.207+0000 7f12b2332640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f12ac0133b0 0x7f12ac032440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.207+0000 7f12b2332640 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f12ac0133b0 0x7f12ac032440 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.207+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.207+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.208+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.209+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.210+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.211+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.211+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.211+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.211+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.211+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.211+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.212+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.213+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f243c0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x7f12ac0133b0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.214+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1b360 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f12ac039070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f22ea0 con 0x5627c8f1b360 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.215+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f23250 con 0x5627c8f1b360 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f23630 con 0x5627c8f1b360 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 zone default found 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 4 Realm: () 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 zonegroup default 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f27280 con 0x7f12ac0133b0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f29100 con 0x5627c8f243c0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.216+0000 7f12b7830800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.217+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f29460 con 0x5627c8f243c0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.217+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.217+0000 7f12b7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.217+0000 7f12b7830800 20 started sync module instance, tier type = 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.217+0000 7f12b7830800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.217+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f286d0 con 0x5627c8f1fcc0 2024-02-16T00:12:21.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.218+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.218+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728875051648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f286d0 con 0x5627c8f1fcc0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.218+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f29e90 con 0x5627c8f1b360 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.219+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728875051648] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.219+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.219+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728875055504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f286d0 con 0x5627c8f1b360 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.219+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2a8f0 con 0x5627c8f243c0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.220+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.220+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728875058144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2b140 con 0x5627c8f243c0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.220+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2bbd0 con 0x5627c8f1fcc0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.220+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728875055504] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.221+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728875058144] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.221+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.221+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728875060384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f28230 con 0x5627c8f1fcc0 2024-02-16T00:12:21.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.221+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2c590 con 0x5627c8f1b360 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.222+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.222+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728875060384] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.222+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728875065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2c9b0 con 0x5627c8f1b360 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.222+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2b730 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.223+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.223+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728875069232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2b730 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.223+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2de60 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.223+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728875065584] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.224+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728875069232] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.224+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.225+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728875070288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2de20 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.225+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2e2c0 con 0x7f12ac0133b0 2024-02-16T00:12:21.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(58 notify.7 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728875066640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2e280 con 0x7f12ac0133b0 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=0 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=1 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=2 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=3 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=4 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=5 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728875070288] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=6 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728875066640] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.226+0000 7f12b7830800 20 add_watcher() i=7 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.227+0000 7f12b7830800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.227+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2da40 con 0x5627c8f1b360 2024-02-16T00:12:21.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.227+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.227+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728875075104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2da40 con 0x5627c8f1b360 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728875075104] v29'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f11697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f12b7830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f12b7830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f12b7830800 5 note: GC not initialized 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f10e3fff640 20 reqs_thread_entry: start 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f12b7830800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.228+0000 7f12b7830800 20 Filter name: none 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f10e1ffb640 20 reqs_thread_entry: start 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f63d40 con 0x5627c8f1b360 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f63d40 con 0x5627c8f1fcc0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f63d40 con 0x5627c8f1b360 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f63d40 con 0x5627c8f243c0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.229+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64150 con 0x5627c8f243c0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64540 con 0x5627c8f243c0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64540 con 0x5627c8f1b360 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64540 con 0x5627c8f1b360 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.230+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64540 con 0x5627c8f243c0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.231+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.231+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64540 con 0x5627c8f243c0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.231+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.231+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f64540 con 0x7f12ac0133b0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.231+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.231+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65f50 con 0x5627c8f1b360 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65f50 con 0x5627c8f1fcc0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65f50 con 0x5627c8f243c0 2024-02-16T00:12:21.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65f50 con 0x7f12ac0133b0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.232+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65f00 con 0x7f12ac0133b0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.233+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.233+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65f00 con 0x5627c8f243c0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.233+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.233+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e80 con 0x7f12ac0133b0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.233+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.233+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e30 con 0x5627c8f1b360 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e30 con 0x5627c8f243c0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x7f12ac0133b0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f1fcc0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.234+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x7f12ac0133b0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f1b360 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f1b360 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f243c0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f1b360 2024-02-16T00:12:21.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.235+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f1b360 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f243c0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f243c0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x5627c8f243c0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.236+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f65e10 con 0x7f12ac0133b0 2024-02-16T00:12:21.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.237+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.237+0000 7f11697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.237+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728875075104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f30ce0 con 0x5627c8f1b360 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.238+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94728875075104] v29'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.238+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728875051648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2e620 con 0x5627c8f1fcc0 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.239+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94728875051648] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.239+0000 7f12b7830800 20 remove_watcher() i=0 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.239+0000 7f12b7830800 2 removed watcher, disabling cache 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.239+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728875055504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f28a80 con 0x5627c8f1b360 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.241+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94728875055504] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.241+0000 7f12b7830800 20 remove_watcher() i=1 2024-02-16T00:12:21.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.241+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728875058144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f28a80 con 0x5627c8f243c0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.242+0000 7f12b2b33640 1 -- 172.21.15.42:0/351715691 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94728875058144] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a4095040 con 0x5627c8f243c0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.242+0000 7f12b7830800 20 remove_watcher() i=2 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.242+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728875060384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f28a80 con 0x5627c8f1fcc0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.243+0000 7f12b3334640 1 -- 172.21.15.42:0/351715691 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94728875060384] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12ac046070 con 0x5627c8f1fcc0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.243+0000 7f12b7830800 20 remove_watcher() i=3 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.243+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728875065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f28a80 con 0x5627c8f1b360 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.244+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94728875065584] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x5627c8f1b360 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.244+0000 7f12b7830800 20 remove_watcher() i=4 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.244+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728875069232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2c0f0 con 0x7f12ac0133b0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.245+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94728875069232] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.245+0000 7f12b7830800 20 remove_watcher() i=5 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.245+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728875070288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f28a80 con 0x7f12ac0133b0 2024-02-16T00:12:21.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.246+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94728875070288] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.246+0000 7f12b7830800 20 remove_watcher() i=6 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.246+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728875066640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5627c8f2c0f0 con 0x7f12ac0133b0 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94728875066640] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a800f610 con 0x7f12ac0133b0 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 20 remove_watcher() i=7 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f12ac0133b0 msgr2=0x7f12ac032440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f12ac0133b0 0x7f12ac032440 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8f1b360 msgr2=0x5627c8f1d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8f1b360 0x5627c8f1d820 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8f1fcc0 msgr2=0x5627c8f220b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8f1fcc0 0x5627c8f220b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627c8f243c0 msgr2=0x5627c8f267b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5627c8f243c0 0x5627c8f267b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f117c0367e0 msgr2=0x7f117c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f117c0367e0 0x7f117c038ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5627c8eecb20 tx=0x7f12a4085000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 msgr2=0x5627c8f0f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b2332640 1 -- 172.21.15.42:0/351715691 reap_dead start 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.247+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f0f640 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5627c8f05160 tx=0x7f12ac04bf70 comp rx=0 tx=0).stop 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 shutdown_connections 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/351715691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8f08750 0x5627c8f0f640 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 >> 172.21.15.42:0/351715691 conn(0x5627c8f04a60 msgr2=0x5627c8f02a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 shutdown_connections 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/351715691 wait complete. 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f118c0367e0 msgr2=0x7f118c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f118c0367e0 0x7f118c038ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5627c8ee7df0 tx=0x7f12a4005130 comp rx=0 tx=0).stop 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 msgr2=0x5627c8efb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 0x5627c8efb900 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5627c8ee1c60 tx=0x7f12ac018830 comp rx=0 tx=0).stop 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 shutdown_connections 2024-02-16T00:12:21.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f118c0367e0 0x7f118c038ca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/720124633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8efb4e0 0x5627c8efb900 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 >> 172.21.15.42:0/720124633 conn(0x5627c8eef580 msgr2=0x5627c8eef980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 shutdown_connections 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/720124633 wait complete. 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8de90c0 msgr2=0x5627c8ee7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8de90c0 0x5627c8ee7520 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8ee9ca0 msgr2=0x5627c8eec090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8ee9ca0 0x5627c8eec090 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1198036790 msgr2=0x7f1198038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1198036790 0x7f1198038c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f12a8000f60 tx=0x7f12a8001370 comp rx=0 tx=0).stop 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 msgr2=0x5627c8ee0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8ee0860 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f12a401ceb0 tx=0x7f12a4002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 shutdown_connections 2024-02-16T00:12:21.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5627c8ee9ca0 0x5627c8eec090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5627c8de90c0 0x5627c8ee7520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1198036790 0x7f1198038c50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 --2- 172.21.15.42:0/719646788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5627c8de7e60 0x5627c8ee0860 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.248+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 >> 172.21.15.42:0/719646788 conn(0x5627c8de34c0 msgr2=0x5627c8ed23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.249+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 shutdown_connections 2024-02-16T00:12:21.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.249+0000 7f12b7830800 1 -- 172.21.15.42:0/719646788 wait complete. 2024-02-16T00:12:21.264 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-16T00:12:21.264 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-16T00:12:21.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-16T00:12:21.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-16T00:12:21.265 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-16T00:12:21.346 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.347 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.344+0000 7fa900f4b800 1 Processor -- start 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.344+0000 7fa900f4b800 1 -- start start 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa900f4b800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5650f2a0a3d0 0x5650f2a12ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa900f4b800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5650f2954bb0 con 0x5650f2a08890 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa900f4b800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5650f290c450 con 0x5650f2a0a3d0 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa8fe250640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5650f2a0a3d0 0x5650f2a12ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa8fea51640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5650f2a08890 0x5650f2a08cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53490/0 (socket says 172.21.15.42:53490) 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa8fe250640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5650f2a0a3d0 0x5650f2a12ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53494/0 (socket says 172.21.15.42:53494) 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa8fea51640 1 -- 172.21.15.42:0/3599964125 learned_addr learned my addr 172.21.15.42:0/3599964125 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:21.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa8fe250640 1 -- 172.21.15.42:0/3599964125 >> v1:172.21.15.2:6789/0 conn(0x5650f2a08890 legacy=0x5650f2a08cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.345+0000 7fa8fe250640 1 -- 172.21.15.42:0/3599964125 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f297d180 con 0x5650f2a0a3d0 2024-02-16T00:12:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.347+0000 7fa8fe250640 1 --2- 172.21.15.42:0/3599964125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a0a3d0 0x5650f2a12ed0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400a470 tx=0x7fa8f401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed48c75cd51af72 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.347+0000 7fa8fda4f640 1 -- 172.21.15.42:0/3599964125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f404ad40 con 0x5650f2a0a3d0 2024-02-16T00:12:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.347+0000 7fa8fda4f640 1 -- 172.21.15.42:0/3599964125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4052440 con 0x5650f2a0a3d0 2024-02-16T00:12:21.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.347+0000 7fa8fda4f640 1 -- 172.21.15.42:0/3599964125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f404aea0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 -- 172.21.15.42:0/3599964125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a0a3d0 msgr2=0x5650f2a12ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 --2- 172.21.15.42:0/3599964125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a0a3d0 0x5650f2a12ed0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400a470 tx=0x7fa8f401cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 -- 172.21.15.42:0/3599964125 shutdown_connections 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 --2- 172.21.15.42:0/3599964125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a0a3d0 0x5650f2a12ed0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 -- 172.21.15.42:0/3599964125 >> 172.21.15.42:0/3599964125 conn(0x5650f2a044d0 msgr2=0x5650f2a068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 -- 172.21.15.42:0/3599964125 shutdown_connections 2024-02-16T00:12:21.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.348+0000 7fa900f4b800 1 -- 172.21.15.42:0/3599964125 wait complete. 2024-02-16T00:12:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.359+0000 7fa900f4b800 1 Processor -- start 2024-02-16T00:12:21.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.359+0000 7fa900f4b800 1 -- start start 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.359+0000 7fa900f4b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2a0e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.359+0000 7fa900f4b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f2909980 con 0x5650f2a08890 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa8fea51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2a0e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa8fea51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2a0e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53508/0 (socket says 172.21.15.42:53508) 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa8fea51640 1 -- 172.21.15.42:0/2779638218 learned_addr learned my addr 172.21.15.42:0/2779638218 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa8fea51640 1 -- 172.21.15.42:0/2779638218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4005d20 con 0x5650f2a08890 2024-02-16T00:12:21.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa8fea51640 1 --2- 172.21.15.42:0/2779638218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2a0e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0006f70 tx=0x7fa8f0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e584cc034cd7465 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa7ece09640 1 -- 172.21.15.42:0/2779638218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f0006320 con 0x5650f2a08890 2024-02-16T00:12:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa7ece09640 1 -- 172.21.15.42:0/2779638218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0004520 con 0x5650f2a08890 2024-02-16T00:12:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.360+0000 7fa7ece09640 1 -- 172.21.15.42:0/2779638218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f0004880 con 0x5650f2a08890 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 -- 172.21.15.42:0/2779638218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 msgr2=0x5650f2a0e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 --2- 172.21.15.42:0/2779638218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2a0e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0006f70 tx=0x7fa8f0001930 comp rx=0 tx=0).stop 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 -- 172.21.15.42:0/2779638218 shutdown_connections 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 --2- 172.21.15.42:0/2779638218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2a0e320 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 -- 172.21.15.42:0/2779638218 >> 172.21.15.42:0/2779638218 conn(0x5650f2a044d0 msgr2=0x5650f2af7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 -- 172.21.15.42:0/2779638218 shutdown_connections 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 -- 172.21.15.42:0/2779638218 wait complete. 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 Processor -- start 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.361+0000 7fa900f4b800 1 -- start start 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa900f4b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2b07dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa900f4b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f2905160 con 0x5650f2a08890 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa8fea51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2b07dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa8fea51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2b07dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53510/0 (socket says 172.21.15.42:53510) 2024-02-16T00:12:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa8fea51640 1 -- 172.21.15.42:0/4216451385 learned_addr learned my addr 172.21.15.42:0/4216451385 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa8fea51640 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f2954bb0 con 0x5650f2a08890 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa8fea51640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2b07dd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000f000 tx=0x7fa8f0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa7eb606640 1 -- 172.21.15.42:0/4216451385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f0023030 con 0x5650f2a08890 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa7eb606640 1 -- 172.21.15.42:0/4216451385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0013820 con 0x5650f2a08890 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa7eb606640 1 -- 172.21.15.42:0/4216451385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f0013ae0 con 0x5650f2a08890 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.362+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650f2b08310 con 0x5650f2a08890 2024-02-16T00:12:21.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.363+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650f2b087f0 con 0x5650f2a08890 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.363+0000 7fa7eb606640 1 -- 172.21.15.42:0/4216451385 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa8f0026070 con 0x5650f2a08890 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.363+0000 7fa7eb606640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7e4036790 0x7fa7e4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.363+0000 7fa7eb606640 1 -- 172.21.15.42:0/4216451385 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa8f0024070 con 0x5650f2a08890 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa8fe250640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7e4036790 0x7fa7e4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2a0a3d0 0x5650f2b0eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b0f130 con 0x5650f2a0a3d0 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa8ff252640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2a0a3d0 0x5650f2b0eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa8fe250640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7e4036790 0x7fa7e4038c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4054000 tx=0x7fa8f404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa8ff252640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2a0a3d0 0x5650f2b0eb10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa8ff252640 1 -- 172.21.15.42:0/4216451385 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.364+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b0c1c0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa8ff252640 1 -- 172.21.15.42:0/4216451385 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b11370 0x5650f2b13760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b13e60 con 0x5650f2b11370 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa8fea51640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b11370 0x5650f2b13760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa8fea51640 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b11370 0x5650f2b13760 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa8fea51640 1 -- 172.21.15.42:0/4216451385 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa8f0013d50 con 0x5650f2b11370 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.365+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b102f0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa8ff252640 1 -- 172.21.15.42:0/4216451385 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b106e0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa8ff252640 1 -- 172.21.15.42:0/4216451385 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2a0a3d0 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa900f4b800 1 Processor -- start 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa900f4b800 1 -- start start 2024-02-16T00:12:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa900f4b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 0x5650f2b23010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.366+0000 7fa900f4b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f28a7e80 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa8ff252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 0x5650f2b23010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa8ff252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 0x5650f2b23010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53526/0 (socket says 172.21.15.42:53526) 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa8ff252640 1 -- 172.21.15.42:0/462471828 learned_addr learned my addr 172.21.15.42:0/462471828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa8ff252640 1 -- 172.21.15.42:0/462471828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f2b23550 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa8ff252640 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 0x5650f2b23010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x5650f2b091d0 tx=0x7fa8f800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa7e8e01640 1 -- 172.21.15.42:0/462471828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f800f040 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa7e8e01640 1 -- 172.21.15.42:0/462471828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8007d00 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650f2b23fc0 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.367+0000 7fa7e8e01640 1 -- 172.21.15.42:0/462471828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f8019420 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.368+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650f2b24480 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.368+0000 7fa7e8e01640 1 -- 172.21.15.42:0/462471828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa8f8019580 con 0x5650f2b22bf0 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.368+0000 7fa7e8e01640 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7d80367e0 0x7fa7d8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.368+0000 7fa7e8e01640 1 -- 172.21.15.42:0/462471828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa8f804e110 con 0x5650f2b22bf0 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.368+0000 7fa8fea51640 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7d80367e0 0x7fa7d8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa900f4b800 1 Processor -- start 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa900f4b800 1 -- start start 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa8fea51640 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7d80367e0 0x7fa7d8038ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5650f2b0f530 tx=0x7fa8f004a310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa900f4b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b30340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa900f4b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f287d5d0 con 0x5650f2b2ff20 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa8ff252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b30340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa8ff252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b30340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53532/0 (socket says 172.21.15.42:53532) 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.369+0000 7fa8ff252640 1 -- 172.21.15.42:0/3917094748 learned_addr learned my addr 172.21.15.42:0/3917094748 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa8ff252640 1 -- 172.21.15.42:0/3917094748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f2b30910 con 0x5650f2b2ff20 2024-02-16T00:12:21.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa8ff252640 1 --2- 172.21.15.42:0/3917094748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b30340 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa8f804c3c0 tx=0x7fa8f8014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226d2c55513ef62e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa7e27fc640 1 -- 172.21.15.42:0/3917094748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f80183b0 con 0x5650f2b2ff20 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa7e27fc640 1 -- 172.21.15.42:0/3917094748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8018510 con 0x5650f2b2ff20 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa7e27fc640 1 -- 172.21.15.42:0/3917094748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f8019d30 con 0x5650f2b2ff20 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 -- 172.21.15.42:0/3917094748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 msgr2=0x5650f2b30340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 --2- 172.21.15.42:0/3917094748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b30340 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa8f804c3c0 tx=0x7fa8f8014f30 comp rx=0 tx=0).stop 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 -- 172.21.15.42:0/3917094748 shutdown_connections 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 --2- 172.21.15.42:0/3917094748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b30340 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 -- 172.21.15.42:0/3917094748 >> 172.21.15.42:0/3917094748 conn(0x5650f2b2c1a0 msgr2=0x5650f2b2a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 -- 172.21.15.42:0/3917094748 shutdown_connections 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.370+0000 7fa900f4b800 1 -- 172.21.15.42:0/3917094748 wait complete. 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa900f4b800 1 Processor -- start 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa900f4b800 1 -- start start 2024-02-16T00:12:21.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa900f4b800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b36e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa900f4b800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f2b37360 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa8ff252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b36e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa8ff252640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b36e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53546/0 (socket says 172.21.15.42:53546) 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 learned_addr learned my addr 172.21.15.42:0/136899128 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f2b24480 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.371+0000 7fa8ff252640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b36e20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80186c0 tx=0x7fa8f804c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.372+0000 7fa7e0ff9640 1 -- 172.21.15.42:0/136899128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f80183b0 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.372+0000 7fa7e0ff9640 1 -- 172.21.15.42:0/136899128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8017de0 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.372+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650f2b37560 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.372+0000 7fa7e0ff9640 1 -- 172.21.15.42:0/136899128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8f804cae0 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.372+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650f2b37a20 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.372+0000 7fa7e0ff9640 1 -- 172.21.15.42:0/136899128 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa8f804cc40 con 0x5650f2b2ff20 2024-02-16T00:12:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa7e0ff9640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7c80367e0 0x7fa7c8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa7e0ff9640 1 -- 172.21.15.42:0/136899128 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa8f8037d20 con 0x5650f2b2ff20 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa8fea51640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7c80367e0 0x7fa7c8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2b42b90 0x5650f2b45030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b45780 con 0x5650f2b42b90 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa8fe250640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2b42b90 0x5650f2b45030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa8fea51640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7c80367e0 0x7fa7c8038ca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8f004c070 tx=0x7fa8f0046000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa8fe250640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2b42b90 0x5650f2b45030 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 20 realm 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.373+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b45b70 con 0x5650f2b42b90 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b463f0 con 0x5650f2b42b90 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b46750 con 0x5650f2b42b90 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b47460 0x5650f2b49850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b49d90 con 0x5650f2b47460 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.374+0000 7fa8ff252640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b47460 0x5650f2b49850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa8ff252640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b47460 0x5650f2b49850 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa900f4b800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa900f4b800 20 searching for the correct realm 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5650f2b4bd20 0x5650f2b4e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa8fea51640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5650f2b4bd20 0x5650f2b4e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.375+0000 7fa8fea51640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5650f2b4bd20 0x5650f2b4e1e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.376+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.376+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.376+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.376+0000 7fa8ff252640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa8f8019040 0x7fa8f80247d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.376+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.376+0000 7fa8fe250640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa8f8019040 0x7fa8f80247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.377+0000 7fa8fe250640 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa8f8019040 0x7fa8f80247d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.377+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.377+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.377+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.377+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.378+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.379+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.379+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.379+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.379+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.379+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.379+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.380+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.381+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.382+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.383+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.384+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.384+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.384+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.384+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x7fa8f8019040 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.384+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.384+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b42b90 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4e8b0 con 0x5650f2b47460 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4a790 con 0x5650f2b42b90 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4a3b0 con 0x5650f2b42b90 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.385+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4b020 con 0x5650f2b42b90 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 zone default found 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 4 Realm: () 2024-02-16T00:12:21.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 zonegroup default 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b4ac60 con 0x7fa8f8019040 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b50bf0 con 0x5650f2b4bd20 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b50fd0 con 0x5650f2b4bd20 2024-02-16T00:12:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.386+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.387+0000 7fa900f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.387+0000 7fa900f4b800 20 started sync module instance, tier type = 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.387+0000 7fa900f4b800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.387+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b504d0 con 0x5650f2b47460 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.388+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.388+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94905669320752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b50450 con 0x5650f2b47460 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.388+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51d30 con 0x5650f2b42b90 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.388+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94905669320752] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.389+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.389+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94905669325808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51cb0 con 0x5650f2b42b90 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.389+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b526b0 con 0x5650f2b4bd20 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.390+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94905669325808] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.390+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.390+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94905669326864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51c30 con 0x5650f2b4bd20 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.390+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b53510 con 0x5650f2b47460 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.391+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.391+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94905669326864] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.391+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94905669333584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b53c90 con 0x5650f2b47460 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.391+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b52a80 con 0x5650f2b42b90 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.392+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94905669333584] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.392+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.392+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94905669334768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b53c50 con 0x5650f2b42b90 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.392+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b54cf0 con 0x7fa8f8019040 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.393+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.393+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94905669334768] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.393+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94905669339216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b55110 con 0x7fa8f8019040 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.393+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b54260 con 0x7fa8f8019040 2024-02-16T00:12:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.394+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94905669339216] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.394+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.394+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94905669340272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b55090 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.394+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b56040 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(58 notify.7 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94905669344096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b56480 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 20 add_watcher() i=0 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 20 add_watcher() i=1 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 20 add_watcher() i=2 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 20 add_watcher() i=3 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 20 add_watcher() i=4 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.395+0000 7fa900f4b800 20 add_watcher() i=5 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.396+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94905669340272] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.396+0000 7fa900f4b800 20 add_watcher() i=6 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.396+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94905669344096] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.396+0000 7fa900f4b800 20 add_watcher() i=7 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.396+0000 7fa900f4b800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.396+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b59950 con 0x5650f2b42b90 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.397+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.397+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94905669345152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b56dc0 con 0x5650f2b42b90 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94905669345152] v29'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa7b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 5 note: GC not initialized 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa72ffff640 20 reqs_thread_entry: start 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 20 Filter name: none 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa72dffb640 20 reqs_thread_entry: start 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.398+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b8b020 con 0x5650f2b42b90 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.399+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.399+0000 7fa900f4b800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.399+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b8c530 con 0x7fa8f8019040 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.399+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.401+0000 7fa7b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.401+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94905669345152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b8a2e0 con 0x5650f2b42b90 2024-02-16T00:12:21.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.401+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94905669345152] v29'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.401+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94905669320752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b8a2e0 con 0x5650f2b47460 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.402+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94905669320752] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.402+0000 7fa900f4b800 20 remove_watcher() i=0 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.402+0000 7fa900f4b800 2 removed watcher, disabling cache 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.402+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94905669325808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b8a2e0 con 0x5650f2b42b90 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.404+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94905669325808] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.404+0000 7fa900f4b800 20 remove_watcher() i=1 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.404+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94905669326864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b8a2e0 con 0x5650f2b4bd20 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.405+0000 7fa8fea51640 1 -- 172.21.15.42:0/136899128 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94905669326864] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f004d040 con 0x5650f2b4bd20 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.405+0000 7fa900f4b800 20 remove_watcher() i=2 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.405+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94905669333584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51890 con 0x5650f2b47460 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.405+0000 7fa8ff252640 1 -- 172.21.15.42:0/136899128 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94905669333584] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f80083e0 con 0x5650f2b47460 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.406+0000 7fa900f4b800 20 remove_watcher() i=3 2024-02-16T00:12:21.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.406+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94905669334768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51890 con 0x5650f2b42b90 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.406+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94905669334768] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x5650f2b42b90 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.406+0000 7fa900f4b800 20 remove_watcher() i=4 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.406+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94905669339216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51890 con 0x7fa8f8019040 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.407+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94905669339216] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.407+0000 7fa900f4b800 20 remove_watcher() i=5 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.408+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94905669340272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51890 con 0x7fa8f8019040 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.409+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94905669340272] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.409+0000 7fa900f4b800 20 remove_watcher() i=6 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.409+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94905669344096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5650f2b51890 con 0x7fa8f8019040 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94905669344096] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8f400a0a0 con 0x7fa8f8019040 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 20 remove_watcher() i=7 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa8f8019040 msgr2=0x7fa8f80247d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa8f8019040 0x7fa8f80247d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2b42b90 msgr2=0x5650f2b45030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2b42b90 0x5650f2b45030 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b47460 msgr2=0x5650f2b49850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b47460 0x5650f2b49850 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5650f2b4bd20 msgr2=0x5650f2b4e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5650f2b4bd20 0x5650f2b4e1e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7c80367e0 msgr2=0x7fa7c8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7c80367e0 0x7fa7c8038ca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8f004c070 tx=0x7fa8f0046000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 msgr2=0x5650f2b36e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b36e20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80186c0 tx=0x7fa8f804c320 comp rx=0 tx=0).stop 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa8fe250640 1 -- 172.21.15.42:0/136899128 reap_dead start 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 shutdown_connections 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 --2- 172.21.15.42:0/136899128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b2ff20 0x5650f2b36e20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 >> 172.21.15.42:0/136899128 conn(0x5650f2b2c1a0 msgr2=0x5650f2b29800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 shutdown_connections 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.410+0000 7fa900f4b800 1 -- 172.21.15.42:0/136899128 wait complete. 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7d80367e0 msgr2=0x7fa7d8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7d80367e0 0x7fa7d8038ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5650f2b0f530 tx=0x7fa8f004a310 comp rx=0 tx=0).stop 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 msgr2=0x5650f2b23010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 0x5650f2b23010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x5650f2b091d0 tx=0x7fa8f800aec0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 shutdown_connections 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7d80367e0 0x7fa7d8038ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/462471828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2b22bf0 0x5650f2b23010 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 >> 172.21.15.42:0/462471828 conn(0x5650f2b16c90 msgr2=0x5650f2b17090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 shutdown_connections 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/462471828 wait complete. 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2a0a3d0 msgr2=0x5650f2b0eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2a0a3d0 0x5650f2b0eb10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b11370 msgr2=0x5650f2b13760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b11370 0x5650f2b13760 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7e4036790 msgr2=0x7fa7e4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7e4036790 0x7fa7e4038c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4054000 tx=0x7fa8f404e000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 msgr2=0x5650f2b07dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2b07dd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000f000 tx=0x7fa8f0000f40 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 shutdown_connections 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5650f2b11370 0x5650f2b13760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5650f2a0a3d0 0x5650f2b0eb10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa7e4036790 0x7fa7e4038c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 --2- 172.21.15.42:0/4216451385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5650f2a08890 0x5650f2b07dd0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 >> 172.21.15.42:0/4216451385 conn(0x5650f2a044d0 msgr2=0x5650f2af7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 shutdown_connections 2024-02-16T00:12:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.411+0000 7fa900f4b800 1 -- 172.21.15.42:0/4216451385 wait complete. 2024-02-16T00:12:21.422 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-16T00:12:21.423 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-16T00:12:21.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-16T00:12:21.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-16T00:12:21.423 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-02-16T00:12:21.506 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.601 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b83af800 1 Processor -- start 2024-02-16T00:12:21.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b83af800 1 -- start start 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b83af800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f6b5c67e90 0x55f6b5c682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b83af800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f6b5bb3ba0 con 0x55f6b5c690f0 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b83af800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f6b5b6b450 con 0x55f6b5c67e90 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b5eae640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f6b5c67e90 0x55f6b5c682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b5eae640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55f6b5c67e90 0x55f6b5c682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53548/0 (socket says 172.21.15.42:53548) 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b5eae640 1 -- 172.21.15.42:0/3701299517 learned_addr learned my addr 172.21.15.42:0/3701299517 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b56ad640 1 --1- 172.21.15.42:0/3701299517 >> v1:172.21.15.2:6789/0 conn(0x55f6b5c690f0 0x55f6b5c69570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53494/0 (socket says 172.21.15.42:53494) 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b5eae640 1 -- 172.21.15.42:0/3701299517 >> v1:172.21.15.2:6789/0 conn(0x55f6b5c690f0 legacy=0x55f6b5c69570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.505+0000 7fd1b5eae640 1 -- 172.21.15.42:0/3701299517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6b5c68980 con 0x55f6b5c67e90 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.507+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/3701299517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5c682b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800a520 tx=0x7fd1a801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a5bc7cd35ddeeb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.507+0000 7fd1b4eac640 1 -- 172.21.15.42:0/3701299517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1a8052570 con 0x55f6b5c67e90 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.507+0000 7fd1b4eac640 1 -- 172.21.15.42:0/3701299517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a80526d0 con 0x55f6b5c67e90 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.507+0000 7fd1b4eac640 1 -- 172.21.15.42:0/3701299517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1a8052990 con 0x55f6b5c67e90 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 -- 172.21.15.42:0/3701299517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 msgr2=0x55f6b5c682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3701299517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5c682b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800a520 tx=0x7fd1a801cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 -- 172.21.15.42:0/3701299517 shutdown_connections 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3701299517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5c682b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 -- 172.21.15.42:0/3701299517 >> 172.21.15.42:0/3701299517 conn(0x55f6b5c634f0 msgr2=0x55f6b5c65910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 -- 172.21.15.42:0/3701299517 shutdown_connections 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.508+0000 7fd1b83af800 1 -- 172.21.15.42:0/3701299517 wait complete. 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.519+0000 7fd1b83af800 1 Processor -- start 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.519+0000 7fd1b83af800 1 -- start start 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.519+0000 7fd1b83af800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.519+0000 7fd1b83af800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b5b68980 con 0x55f6b5c67e90 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd1b5eae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd1b5eae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53552/0 (socket says 172.21.15.42:53552) 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd1b5eae640 1 -- 172.21.15.42:0/3363944280 learned_addr learned my addr 172.21.15.42:0/3363944280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd1b5eae640 1 -- 172.21.15.42:0/3363944280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8005de0 con 0x55f6b5c67e90 2024-02-16T00:12:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/3363944280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d572b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd1a801cf20 tx=0x7fd1a804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea45bdab6856874 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd0a3e07640 1 -- 172.21.15.42:0/3363944280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1a8052840 con 0x55f6b5c67e90 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd0a3e07640 1 -- 172.21.15.42:0/3363944280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a80529a0 con 0x55f6b5c67e90 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.520+0000 7fd0a3e07640 1 -- 172.21.15.42:0/3363944280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1a8052c80 con 0x55f6b5c67e90 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 -- 172.21.15.42:0/3363944280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 msgr2=0x55f6b5d572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3363944280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d572b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd1a801cf20 tx=0x7fd1a804c000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 -- 172.21.15.42:0/3363944280 shutdown_connections 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3363944280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d572b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 -- 172.21.15.42:0/3363944280 >> 172.21.15.42:0/3363944280 conn(0x55f6b5c634f0 msgr2=0x55f6b5d52bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 -- 172.21.15.42:0/3363944280 shutdown_connections 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 -- 172.21.15.42:0/3363944280 wait complete. 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.521+0000 7fd1b83af800 1 Processor -- start 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b83af800 1 -- start start 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b83af800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d62d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b83af800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b5b64160 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b5eae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d62d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b5eae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d62d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53566/0 (socket says 172.21.15.42:53566) 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b5eae640 1 -- 172.21.15.42:0/577078473 learned_addr learned my addr 172.21.15.42:0/577078473 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b5eae640 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a804e070 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.522+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d62d10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1a801ceb0 tx=0x7fd1a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.523+0000 7fd0a2604640 1 -- 172.21.15.42:0/577078473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1a806c070 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.523+0000 7fd0a2604640 1 -- 172.21.15.42:0/577078473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a805d5b0 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.523+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f6b5d63250 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.523+0000 7fd0a2604640 1 -- 172.21.15.42:0/577078473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1a805d870 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.523+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6b5d63790 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.523+0000 7fd0a2604640 1 -- 172.21.15.42:0/577078473 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd1a8059040 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd0a2604640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd09c0367e0 0x7fd09c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd0a2604640 1 -- 172.21.15.42:0/577078473 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd1a808d7b0 con 0x55f6b5c67e90 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd1b56ad640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd09c0367e0 0x7fd09c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5c690f0 0x55f6b5d699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5d69f10 con 0x55f6b5c690f0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd1b66af640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5c690f0 0x55f6b5d699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd1b56ad640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd09c0367e0 0x7fd09c038ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000f60 tx=0x7fd1ac006390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.524+0000 7fd1b66af640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5c690f0 0x55f6b5d699d0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b66af640 1 -- 172.21.15.42:0/577078473 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5c690f0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5d6a2f0 con 0x55f6b5c690f0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b66af640 1 -- 172.21.15.42:0/577078473 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5c690f0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5d6c0b0 0x55f6b5d6e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5d6eb70 con 0x55f6b5d6c0b0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5d6c0b0 0x55f6b5d6e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.525+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5d6c0b0 0x55f6b5d6e4a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b5eae640 1 -- 172.21.15.42:0/577078473 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd1a8067450 con 0x55f6b5d6c0b0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5d6b030 con 0x55f6b5c690f0 2024-02-16T00:12:21.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b66af640 1 -- 172.21.15.42:0/577078473 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5c690f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5d6b440 con 0x55f6b5c690f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b66af640 1 -- 172.21.15.42:0/577078473 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5c690f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b83af800 1 Processor -- start 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.526+0000 7fd1b83af800 1 -- start start 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b83af800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 0x55f6b5d7dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b83af800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b5b06e80 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b66af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 0x55f6b5d7dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b66af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 0x55f6b5d7dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53570/0 (socket says 172.21.15.42:53570) 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b66af640 1 -- 172.21.15.42:0/3747264847 learned_addr learned my addr 172.21.15.42:0/3747264847 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b66af640 1 -- 172.21.15.42:0/3747264847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6b5d7e250 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.527+0000 7fd1b66af640 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 0x55f6b5d7dd10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55f6b5d63a70 tx=0x7fd1b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd09b7fe640 1 -- 172.21.15.42:0/3747264847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1b001d070 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd09b7fe640 1 -- 172.21.15.42:0/3747264847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b00182e0 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f6b5d7ecc0 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd09b7fe640 1 -- 172.21.15.42:0/3747264847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1b00145e0 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6b5d7f180 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd09b7fe640 1 -- 172.21.15.42:0/3747264847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd1b0020020 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.528+0000 7fd09b7fe640 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0900367e0 0x7fd090038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd09b7fe640 1 -- 172.21.15.42:0/3747264847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd1b004dce0 con 0x55f6b5d7d8f0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0900367e0 0x7fd090038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b83af800 1 Processor -- start 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b83af800 1 -- start start 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0900367e0 0x7fd090038ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55f6b5d67050 tx=0x7fd1a8067f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b83af800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d8af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b83af800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b5adc5d0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b66af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d8af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b66af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d8af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53580/0 (socket says 172.21.15.42:53580) 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b66af640 1 -- 172.21.15.42:0/3092411298 learned_addr learned my addr 172.21.15.42:0/3092411298 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.529+0000 7fd1b66af640 1 -- 172.21.15.42:0/3092411298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6b5d8b520 con 0x55f6b5d8ab30 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b66af640 1 --2- 172.21.15.42:0/3092411298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d8af50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0013010 tx=0x7fd1b0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74dec185c5a9864 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd0997fa640 1 -- 172.21.15.42:0/3092411298 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1b0016440 con 0x55f6b5d8ab30 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd0997fa640 1 -- 172.21.15.42:0/3092411298 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b00165a0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd0997fa640 1 -- 172.21.15.42:0/3092411298 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1b0014bf0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 -- 172.21.15.42:0/3092411298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 msgr2=0x55f6b5d8af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3092411298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d8af50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0013010 tx=0x7fd1b0011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 -- 172.21.15.42:0/3092411298 shutdown_connections 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3092411298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d8af50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 -- 172.21.15.42:0/3092411298 >> 172.21.15.42:0/3092411298 conn(0x55f6b5d86e50 msgr2=0x55f6b5d84eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 -- 172.21.15.42:0/3092411298 shutdown_connections 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.530+0000 7fd1b83af800 1 -- 172.21.15.42:0/3092411298 wait complete. 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b83af800 1 Processor -- start 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b83af800 1 -- start start 2024-02-16T00:12:21.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b83af800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d91b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b83af800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b5d92080 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b66af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d91b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b66af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d91b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53582/0 (socket says 172.21.15.42:53582) 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 learned_addr learned my addr 172.21.15.42:0/4070799335 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.531+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6b5d7f180 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd1b66af640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d91b40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0011ae0 tx=0x7fd1b004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd0877fe640 1 -- 172.21.15.42:0/4070799335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1b00116f0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd0877fe640 1 -- 172.21.15.42:0/4070799335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b00148c0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f6b5d92280 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd0877fe640 1 -- 172.21.15.42:0/4070799335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1b00134e0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6b5d926e0 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.532+0000 7fd0877fe640 1 -- 172.21.15.42:0/4070799335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd1b0013640 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd0877fe640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0800367e0 0x7fd080038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd0877fe640 1 -- 172.21.15.42:0/4070799335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd1b0038d50 con 0x55f6b5d8ab30 2024-02-16T00:12:21.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0800367e0 0x7fd080038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5d9d650 0x55f6b5d9fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da0260 con 0x55f6b5d9d650 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b56ad640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5d9d650 0x55f6b5d9fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0800367e0 0x7fd080038ca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8052c70 tx=0x7fd1a8085000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.533+0000 7fd1b56ad640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5d9d650 0x55f6b5d9fb10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 realm 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5d9cab0 con 0x55f6b5d9d650 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da0ce0 con 0x55f6b5d9d650 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da0980 con 0x55f6b5d9d650 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.534+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5da1fb0 0x55f6b5da43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da4920 con 0x55f6b5da1fb0 2024-02-16T00:12:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b66af640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5da1fb0 0x55f6b5da43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b66af640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5da1fb0 0x55f6b5da43a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b83af800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b83af800 20 searching for the correct realm 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f6b5da6900 0x55f6b5da8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da9490 con 0x55f6b5da6900 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.535+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f6b5da6900 0x55f6b5da8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.536+0000 7fd1b5eae640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f6b5da6900 0x55f6b5da8dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.536+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.536+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da9490 con 0x55f6b5da1fb0 2024-02-16T00:12:21.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.536+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.536+0000 7fd1b66af640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1b0014070 0x7fd1b002d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.536+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da4920 con 0x7fd1b0014070 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.537+0000 7fd1b56ad640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1b0014070 0x7fd1b002d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.537+0000 7fd1b56ad640 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1b0014070 0x7fd1b002d450 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.537+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.537+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da4920 con 0x55f6b5d9d650 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.537+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.537+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da4920 con 0x55f6b5d9d650 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x7fd1b0014070 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.538+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5d9d650 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x7fd1b0014070 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5d9d650 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.539+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x7fd1b0014070 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.540+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5d9d650 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5d9d650 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.541+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5d9d650 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.542+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x7fd1b0014070 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x7fd1b0014070 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.543+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da6900 2024-02-16T00:12:21.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x7fd1b0014070 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1ac00bba0 con 0x7fd1b0014070 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5d9d650 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1ac026040 con 0x55f6b5da1fb0 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:21.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.544+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da5220 con 0x55f6b5d9d650 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da55d0 con 0x55f6b5d9d650 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1ac00bba0 con 0x55f6b5d9d650 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da55d0 con 0x55f6b5d9d650 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 zone default found 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 4 Realm: () 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:21.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 zonegroup default 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.545+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da59b0 con 0x7fd1b0014070 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5da5db0 con 0x55f6b5da6900 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dab2b0 con 0x55f6b5da6900 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 started sync module instance, tier type = 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.546+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5daab90 con 0x55f6b5da1fb0 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.547+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.547+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94518101321456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5daaf40 con 0x55f6b5da1fb0 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.547+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dabf50 con 0x55f6b5d9d650 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.548+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94518101321456] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.548+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.549+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94518101325600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dac0e0 con 0x55f6b5d9d650 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.549+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dacbb0 con 0x55f6b5da6900 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.550+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.550+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94518101325600] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.550+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94518101329552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dad400 con 0x55f6b5da6900 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.550+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dabbc0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.551+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.551+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94518101329552] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.551+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94518101334400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dae240 con 0x55f6b5da1fb0 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.551+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dacfa0 con 0x55f6b5d9d650 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.552+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.552+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94518101337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dacfa0 con 0x55f6b5d9d650 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.552+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5daf740 con 0x7fd1b0014070 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.552+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94518101334400] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.553+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.553+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94518101340736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5daf700 con 0x7fd1b0014070 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.553+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5db0100 con 0x7fd1b0014070 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.553+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94518101337952] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.554+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94518101340736] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.554+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.554+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94518101335456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dafc60 con 0x7fd1b0014070 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.554+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5db05d0 con 0x7fd1b0014070 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94518101335456] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94518101339008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5db05d0 con 0x7fd1b0014070 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=0 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=1 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=2 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=3 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=4 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=5 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.555+0000 7fd1b83af800 20 add_watcher() i=6 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.556+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94518101339008] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.556+0000 7fd1b83af800 20 add_watcher() i=7 2024-02-16T00:12:21.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.556+0000 7fd1b83af800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.556+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5db05a0 con 0x55f6b5d9d650 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.557+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.557+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94518101346704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5db1250 con 0x55f6b5d9d650 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94518101346704] v29'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd04f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 5 note: GC not initialized 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd04e7fc640 20 reqs_thread_entry: start 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 20 Filter name: none 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fcfd7fff640 20 reqs_thread_entry: start 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.558+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5de5570 con 0x55f6b5d9d650 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.559+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.559+0000 7fd1b83af800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.559+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5de5570 con 0x7fd1b0014070 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.559+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.560+0000 7fd04f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.560+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94518101346704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5de5570 con 0x55f6b5d9d650 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.561+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94518101346704] v29'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.561+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94518101321456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5de5570 con 0x55f6b5da1fb0 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.562+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94518101321456] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.562+0000 7fd1b83af800 20 remove_watcher() i=0 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.562+0000 7fd1b83af800 2 removed watcher, disabling cache 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.562+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94518101325600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5de5570 con 0x55f6b5d9d650 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.563+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94518101325600] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.564+0000 7fd1b83af800 20 remove_watcher() i=1 2024-02-16T00:12:21.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.564+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94518101329552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5de5570 con 0x55f6b5da6900 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.565+0000 7fd1b5eae640 1 -- 172.21.15.42:0/4070799335 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94518101329552] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1a80a1040 con 0x55f6b5da6900 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.565+0000 7fd1b83af800 20 remove_watcher() i=2 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.565+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94518101334400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5daa6f0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.566+0000 7fd1b66af640 1 -- 172.21.15.42:0/4070799335 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94518101334400] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1b000a4a0 con 0x55f6b5da1fb0 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.566+0000 7fd1b83af800 20 remove_watcher() i=3 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.566+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94518101337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dad980 con 0x55f6b5d9d650 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.567+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94518101337952] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x55f6b5d9d650 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.567+0000 7fd1b83af800 20 remove_watcher() i=4 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.567+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94518101340736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5daa6f0 con 0x7fd1b0014070 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.568+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94518101340736] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.568+0000 7fd1b83af800 20 remove_watcher() i=5 2024-02-16T00:12:21.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.568+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94518101335456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dae760 con 0x7fd1b0014070 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.569+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94518101335456] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.569+0000 7fd1b83af800 20 remove_watcher() i=6 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.569+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94518101339008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f6b5dade20 con 0x7fd1b0014070 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94518101339008] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1ac03d040 con 0x7fd1b0014070 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 20 remove_watcher() i=7 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1b0014070 msgr2=0x7fd1b002d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1b0014070 0x7fd1b002d450 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5d9d650 msgr2=0x55f6b5d9fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5d9d650 0x55f6b5d9fb10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5da1fb0 msgr2=0x55f6b5da43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5da1fb0 0x55f6b5da43a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f6b5da6900 msgr2=0x55f6b5da8dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.570+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55f6b5da6900 0x55f6b5da8dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0800367e0 msgr2=0x7fd080038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0800367e0 0x7fd080038ca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8052c70 tx=0x7fd1a8085000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 msgr2=0x55f6b5d91b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b56ad640 1 -- 172.21.15.42:0/4070799335 reap_dead start 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d91b40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0011ae0 tx=0x7fd1b004bf30 comp rx=0 tx=0).stop 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 shutdown_connections 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/4070799335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d8ab30 0x55f6b5d91b40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 >> 172.21.15.42:0/4070799335 conn(0x55f6b5d86e50 msgr2=0x55f6b5d844b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 shutdown_connections 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/4070799335 wait complete. 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0900367e0 msgr2=0x7fd090038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0900367e0 0x7fd090038ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55f6b5d67050 tx=0x7fd1a8067f50 comp rx=0 tx=0).stop 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 msgr2=0x55f6b5d7dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 0x55f6b5d7dd10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55f6b5d63a70 tx=0x7fd1b0018830 comp rx=0 tx=0).stop 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 shutdown_connections 2024-02-16T00:12:21.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0900367e0 0x7fd090038ca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/3747264847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5d7d8f0 0x55f6b5d7dd10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 >> 172.21.15.42:0/3747264847 conn(0x55f6b5d71990 msgr2=0x55f6b5d71d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 shutdown_connections 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/3747264847 wait complete. 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5c690f0 msgr2=0x55f6b5d699d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5c690f0 0x55f6b5d699d0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5d6c0b0 msgr2=0x55f6b5d6e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.571+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5d6c0b0 0x55f6b5d6e4a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd09c0367e0 msgr2=0x7fd09c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd09c0367e0 0x7fd09c038ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000f60 tx=0x7fd1ac006390 comp rx=0 tx=0).stop 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 msgr2=0x55f6b5d62d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d62d10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1a801ceb0 tx=0x7fd1a8002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 shutdown_connections 2024-02-16T00:12:21.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55f6b5d6c0b0 0x55f6b5d6e4a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55f6b5c690f0 0x55f6b5d699d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd09c0367e0 0x7fd09c038ca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 --2- 172.21.15.42:0/577078473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6b5c67e90 0x55f6b5d62d10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 >> 172.21.15.42:0/577078473 conn(0x55f6b5c634f0 msgr2=0x55f6b5d51430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 shutdown_connections 2024-02-16T00:12:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.572+0000 7fd1b83af800 1 -- 172.21.15.42:0/577078473 wait complete. 2024-02-16T00:12:21.665 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-02-16T00:12:21.665 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-02-16T00:12:21.665 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-16T00:12:21.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-16T00:12:21.666 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-02-16T00:12:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4dd644800 1 Processor -- start 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4dd644800 1 -- start start 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4dd644800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561b709a34d0 0x561b709a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4dd644800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b708e9ba0 con 0x561b7099f040 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4dd644800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b708a1450 con 0x561b709a34d0 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4d2942640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x561b709a34d0 0x561b709a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4db143640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x561b7099f040 0x561b7099f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53506/0 (socket says 172.21.15.42:53506) 2024-02-16T00:12:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4db143640 1 -- 172.21.15.42:0/3373558770 learned_addr learned my addr 172.21.15.42:0/3373558770 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.708+0000 7fa4d2942640 1 --2- 172.21.15.42:0/3373558770 >> v2:172.21.15.2:3300/0 conn(0x561b709a34d0 0x561b709a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53594/0 (socket says 172.21.15.42:53594) 2024-02-16T00:12:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.709+0000 7fa4d2942640 1 -- 172.21.15.42:0/3373558770 >> v1:172.21.15.2:6789/0 conn(0x561b7099f040 legacy=0x561b7099f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.709+0000 7fa4d2942640 1 -- 172.21.15.42:0/3373558770 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b709a6ef0 con 0x561b709a34d0 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.710+0000 7fa4d2942640 1 --2- 172.21.15.42:0/3373558770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b709a34d0 0x561b709a58c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400a470 tx=0x7fa4c401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac7fee59540c434 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4da942640 1 -- 172.21.15.42:0/3373558770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4c4052570 con 0x561b709a34d0 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4da942640 1 -- 172.21.15.42:0/3373558770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c40526d0 con 0x561b709a34d0 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4da942640 1 -- 172.21.15.42:0/3373558770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4c4052990 con 0x561b709a34d0 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 -- 172.21.15.42:0/3373558770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b709a34d0 msgr2=0x561b709a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 --2- 172.21.15.42:0/3373558770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b709a34d0 0x561b709a58c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400a470 tx=0x7fa4c401cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 -- 172.21.15.42:0/3373558770 shutdown_connections 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 --2- 172.21.15.42:0/3373558770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b709a34d0 0x561b709a58c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 -- 172.21.15.42:0/3373558770 >> 172.21.15.42:0/3373558770 conn(0x561b7099a5e0 msgr2=0x561b7099ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 -- 172.21.15.42:0/3373558770 shutdown_connections 2024-02-16T00:12:21.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.711+0000 7fa4dd644800 1 -- 172.21.15.42:0/3373558770 wait complete. 2024-02-16T00:12:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.722+0000 7fa4dd644800 1 Processor -- start 2024-02-16T00:12:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4dd644800 1 -- start start 2024-02-16T00:12:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4dd644800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a8f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4dd644800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7089e980 con 0x561b7099f040 2024-02-16T00:12:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4db143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a8f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4db143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a8f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53608/0 (socket says 172.21.15.42:53608) 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4db143640 1 -- 172.21.15.42:0/81757825 learned_addr learned my addr 172.21.15.42:0/81757825 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4db143640 1 -- 172.21.15.42:0/81757825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4005d20 con 0x561b7099f040 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.723+0000 7fa4db143640 1 --2- 172.21.15.42:0/81757825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a8f020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc001bf0 tx=0x7fa4cc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cdd5af09dc23f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa3c960a640 1 -- 172.21.15.42:0/81757825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc00e470 con 0x561b7099f040 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa3c960a640 1 -- 172.21.15.42:0/81757825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00e5f0 con 0x561b7099f040 2024-02-16T00:12:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa3c960a640 1 -- 172.21.15.42:0/81757825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc00e910 con 0x561b7099f040 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 -- 172.21.15.42:0/81757825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 msgr2=0x561b70a8f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 --2- 172.21.15.42:0/81757825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a8f020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc001bf0 tx=0x7fa4cc00b6c0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 -- 172.21.15.42:0/81757825 shutdown_connections 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 --2- 172.21.15.42:0/81757825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a8f020 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 -- 172.21.15.42:0/81757825 >> 172.21.15.42:0/81757825 conn(0x561b7099a5e0 msgr2=0x561b70a8a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 -- 172.21.15.42:0/81757825 shutdown_connections 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.724+0000 7fa4dd644800 1 -- 172.21.15.42:0/81757825 wait complete. 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4dd644800 1 Processor -- start 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4dd644800 1 -- start start 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4dd644800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a96730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4dd644800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7089a160 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4db143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a96730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4db143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a96730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53612/0 (socket says 172.21.15.42:53612) 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4db143640 1 -- 172.21.15.42:0/4081598146 learned_addr learned my addr 172.21.15.42:0/4081598146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.725+0000 7fa4db143640 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b708e9ba0 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.726+0000 7fa4db143640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a96730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004000 tx=0x7fa4cc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.726+0000 7fa3c7e07640 1 -- 172.21.15.42:0/4081598146 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc01f070 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.726+0000 7fa3c7e07640 1 -- 172.21.15.42:0/4081598146 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc0197c0 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.726+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b70a96c70 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.726+0000 7fa3c7e07640 1 -- 172.21.15.42:0/4081598146 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc019a80 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.726+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b70a970f0 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa3c7e07640 1 -- 172.21.15.42:0/4081598146 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa4cc019be0 con 0x561b7099f040 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa3c7e07640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c0036790 0x7fa3c0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa3c7e07640 1 -- 172.21.15.42:0/4081598146 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa4cc04c7d0 con 0x561b7099f040 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa4d2942640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c0036790 0x7fa3c0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b709a34d0 0x561b70a9d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70a9d9c0 con 0x561b709a34d0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa4db944640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b709a34d0 0x561b70a9d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa4d2942640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c0036790 0x7fa3c0038c50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4054000 tx=0x7fa4c404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.727+0000 7fa4db944640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b709a34d0 0x561b70a9d3a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4db944640 1 -- 172.21.15.42:0/4081598146 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4d400a4a0 con 0x561b709a34d0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70a9aaf0 con 0x561b709a34d0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4db944640 1 -- 172.21.15.42:0/4081598146 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa4d400a4a0 con 0x561b709a34d0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70a9fc30 0x561b70aa2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70aa2710 con 0x561b70a9fc30 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4db143640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70a9fc30 0x561b70aa2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.728+0000 7fa4db143640 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70a9fc30 0x561b70aa2020 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.729+0000 7fa4db143640 1 -- 172.21.15.42:0/4081598146 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70a9fc30 2024-02-16T00:12:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.729+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70a9ebb0 con 0x561b709a34d0 2024-02-16T00:12:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.729+0000 7fa4db944640 1 -- 172.21.15.42:0/4081598146 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa4d400a4a0 con 0x561b709a34d0 2024-02-16T00:12:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.729+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70a9efa0 con 0x561b709a34d0 2024-02-16T00:12:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.729+0000 7fa4db944640 1 -- 172.21.15.42:0/4081598146 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa4d400a4a0 con 0x561b709a34d0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4dd644800 1 Processor -- start 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4dd644800 1 -- start start 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4dd644800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 0x561b70ab1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4dd644800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7083ce80 con 0x561b70ab14e0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4db944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 0x561b70ab1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4db944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 0x561b70ab1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53618/0 (socket says 172.21.15.42:53618) 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4db944640 1 -- 172.21.15.42:0/1862559230 learned_addr learned my addr 172.21.15.42:0/1862559230 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.730+0000 7fa4db944640 1 -- 172.21.15.42:0/1862559230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b70ab1e40 con 0x561b70ab14e0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.731+0000 7fa4db944640 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 0x561b70ab1900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x561b70a97ae0 tx=0x7fa4d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.731+0000 7fa3c5602640 1 -- 172.21.15.42:0/1862559230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d401d070 con 0x561b70ab14e0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.731+0000 7fa3c5602640 1 -- 172.21.15.42:0/1862559230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d40182e0 con 0x561b70ab14e0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.731+0000 7fa3c5602640 1 -- 172.21.15.42:0/1862559230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d40145a0 con 0x561b70ab14e0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.731+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b70ab28b0 con 0x561b70ab14e0 2024-02-16T00:12:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.731+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b70ab2d70 con 0x561b70ab14e0 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa3c5602640 1 -- 172.21.15.42:0/1862559230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa4d4020020 con 0x561b70ab14e0 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa3c5602640 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b4036790 0x7fa3b4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa3c5602640 1 -- 172.21.15.42:0/1862559230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa4d404dd10 con 0x561b70ab14e0 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa4db143640 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b4036790 0x7fa3b4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa4dd644800 1 Processor -- start 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa4dd644800 1 -- start start 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa4db143640 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b4036790 0x7fa3b4038c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561b70a9dd90 tx=0x7fa4cc019f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa4dd644800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70abebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.732+0000 7fa4dd644800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b708125d0 con 0x561b70abe790 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa4db944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70abebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa4db944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70abebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53632/0 (socket says 172.21.15.42:53632) 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa4db944640 1 -- 172.21.15.42:0/3345459689 learned_addr learned my addr 172.21.15.42:0/3345459689 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa4db944640 1 -- 172.21.15.42:0/3345459689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b70abf180 con 0x561b70abe790 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa4db944640 1 --2- 172.21.15.42:0/3345459689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70abebb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4d404bfd0 tx=0x7fa4d4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c95903a6c0b5809 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa3beffd640 1 -- 172.21.15.42:0/3345459689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4016570 con 0x561b70abe790 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa3beffd640 1 -- 172.21.15.42:0/3345459689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4014ad0 con 0x561b70abe790 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.733+0000 7fa3beffd640 1 -- 172.21.15.42:0/3345459689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d402bc50 con 0x561b70abe790 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- 172.21.15.42:0/3345459689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 msgr2=0x561b70abebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 --2- 172.21.15.42:0/3345459689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70abebb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4d404bfd0 tx=0x7fa4d4011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- 172.21.15.42:0/3345459689 shutdown_connections 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 --2- 172.21.15.42:0/3345459689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70abebb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- 172.21.15.42:0/3345459689 >> 172.21.15.42:0/3345459689 conn(0x561b70abaaa0 msgr2=0x561b70ab8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- 172.21.15.42:0/3345459689 shutdown_connections 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- 172.21.15.42:0/3345459689 wait complete. 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 Processor -- start 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- start start 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70ac56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4dd644800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b70ac5c30 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4db944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70ac56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4db944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70ac56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53636/0 (socket says 172.21.15.42:53636) 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.734+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 learned_addr learned my addr 172.21.15.42:0/539524902 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b70ab2d70 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa4db944640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70ac56f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa4d403e040 tx=0x7fa4d404bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa3bd7fa640 1 -- 172.21.15.42:0/539524902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d404d570 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa3bd7fa640 1 -- 172.21.15.42:0/539524902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d404d6f0 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b70ac5e30 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa3bd7fa640 1 -- 172.21.15.42:0/539524902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d404d9d0 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.735+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b70ac6290 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa3bd7fa640 1 -- 172.21.15.42:0/539524902 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa4d402b350 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa3bd7fa640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a40367e0 0x7fa3a4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa3bd7fa640 1 -- 172.21.15.42:0/539524902 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa4d4037d50 con 0x561b70abe790 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa4db143640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a40367e0 0x7fa3a4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b70ad12d0 0x561b70ad3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad3ee0 con 0x561b70ad12d0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa4d2942640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b70ad12d0 0x561b70ad3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.736+0000 7fa4db143640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a40367e0 0x7fa3a4038ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc04ad70 tx=0x7fa4cc038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4d2942640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b70ad12d0 0x561b70ad3790 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 realm 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad4270 con 0x561b70ad12d0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad4ac0 con 0x561b70ad12d0 2024-02-16T00:12:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.737+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad4e20 con 0x561b70ad12d0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70ad5b30 0x561b70ad7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4db944640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70ad5b30 0x561b70ad7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4db944640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70ad5b30 0x561b70ad7f20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 20 searching for the correct realm 2024-02-16T00:12:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561b70ada450 0x561b70adc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70adcfb0 con 0x561b70ada450 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.738+0000 7fa4db143640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561b70ada450 0x561b70adc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.739+0000 7fa4db143640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561b70ada450 0x561b70adc8e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.739+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.739+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70adcfb0 con 0x561b70ad5b30 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.739+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.739+0000 7fa4db944640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d4014070 0x7fa4d402b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.739+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.740+0000 7fa4d2942640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d4014070 0x7fa4d402b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.740+0000 7fa4d2942640 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d4014070 0x7fa4d402b600 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.740+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.740+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.741+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.742+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.743+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.744+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.745+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.746+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ada450 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x7fa4d4014070 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad12d0 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad84a0 con 0x561b70ad5b30 2024-02-16T00:12:21.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.747+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad8d70 con 0x561b70ad12d0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad9120 con 0x561b70ad12d0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ad9500 con 0x561b70ad12d0 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 zone default found 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 4 Realm: () 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 zonegroup default 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70add3f0 con 0x7fa4d4014070 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.748+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70adf270 con 0x561b70ada450 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70adf5d0 con 0x561b70ada450 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 20 started sync module instance, tier type = 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.749+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade700 con 0x561b70ad5b30 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.750+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.750+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675854552000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade700 con 0x561b70ad5b30 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.750+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae0010 con 0x561b70ad12d0 2024-02-16T00:12:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.751+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94675854552000] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.751+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.751+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675854555888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade700 con 0x561b70ad12d0 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.751+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae0a60 con 0x561b70ada450 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.753+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94675854555888] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.753+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.753+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675854549600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade680 con 0x561b70ada450 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.753+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae18f0 con 0x561b70ad5b30 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.754+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.754+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94675854549600] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.754+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675854562864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae2090 con 0x561b70ad5b30 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.754+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae0e80 con 0x561b70ad12d0 2024-02-16T00:12:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.755+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94675854562864] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.755+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.755+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675854564080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae2050 con 0x561b70ad12d0 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.755+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae30f0 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.756+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.756+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675854568528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae3070 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.756+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae3ff0 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.756+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94675854564080] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.757+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94675854568528] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.757+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.757+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675854566976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae3ff0 con 0x7fa4d4014070 2024-02-16T00:12:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.757+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae35c0 con 0x7fa4d4014070 2024-02-16T00:12:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94675854566976] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675854572256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae35c0 con 0x7fa4d4014070 2024-02-16T00:12:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=0 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=1 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=2 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=3 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=4 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=5 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.758+0000 7fa4dd644800 20 add_watcher() i=6 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.759+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94675854572256] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.759+0000 7fa4dd644800 20 add_watcher() i=7 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.759+0000 7fa4dd644800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.759+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae79b0 con 0x561b70ad12d0 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.760+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.760+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675854574496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae4c60 con 0x561b70ad12d0 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94675854574496] v29'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa4dd644800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa4dd644800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa4dd644800 5 note: GC not initialized 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa390fe1640 20 reqs_thread_entry: start 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa4dd644800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa4dd644800 20 Filter name: none 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.761+0000 7fa30a7fc640 20 reqs_thread_entry: start 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.762+0000 7fa4dd644800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.762+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70b19460 con 0x561b70ad12d0 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.762+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.762+0000 7fa4dd644800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.762+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70b19460 con 0x7fa4d4014070 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.763+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.763+0000 7fa391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.763+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675854574496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70b19460 con 0x561b70ad12d0 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.764+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94675854574496] v29'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.764+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675854552000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70b19460 con 0x561b70ad5b30 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.765+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94675854552000] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.765+0000 7fa4dd644800 20 remove_watcher() i=0 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.765+0000 7fa4dd644800 2 removed watcher, disabling cache 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.765+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675854555888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70b19460 con 0x561b70ad12d0 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.766+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94675854555888] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.766+0000 7fa4dd644800 20 remove_watcher() i=1 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.766+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675854549600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70b19460 con 0x561b70ada450 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.767+0000 7fa4db143640 1 -- 172.21.15.42:0/539524902 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94675854549600] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4cc00d590 con 0x561b70ada450 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.767+0000 7fa4dd644800 20 remove_watcher() i=2 2024-02-16T00:12:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.767+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675854562864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade260 con 0x561b70ad5b30 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.768+0000 7fa4db944640 1 -- 172.21.15.42:0/539524902 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94675854562864] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4d403c050 con 0x561b70ad5b30 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.768+0000 7fa4dd644800 20 remove_watcher() i=3 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.768+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675854564080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae1630 con 0x561b70ad12d0 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.769+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94675854564080] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x561b70ad12d0 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.769+0000 7fa4dd644800 20 remove_watcher() i=4 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.769+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675854568528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade260 con 0x7fa4d4014070 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.770+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94675854568528] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.770+0000 7fa4dd644800 20 remove_watcher() i=5 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.770+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675854566976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ae1630 con 0x7fa4d4014070 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.771+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94675854566976] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.771+0000 7fa4dd644800 20 remove_watcher() i=6 2024-02-16T00:12:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.772+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675854572256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561b70ade260 con 0x7fa4d4014070 2024-02-16T00:12:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94675854572256] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa4c4059040 con 0x7fa4d4014070 2024-02-16T00:12:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 20 remove_watcher() i=7 2024-02-16T00:12:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d4014070 msgr2=0x7fa4d402b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fa4d4014070 0x7fa4d402b600 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b70ad12d0 msgr2=0x561b70ad3790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b70ad12d0 0x561b70ad3790 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70ad5b30 msgr2=0x561b70ad7f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70ad5b30 0x561b70ad7f20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561b70ada450 msgr2=0x561b70adc8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x561b70ada450 0x561b70adc8e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a40367e0 msgr2=0x7fa3a4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3a40367e0 0x7fa3a4038ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc04ad70 tx=0x7fa4cc038000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 msgr2=0x561b70ac56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/539524902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70abe790 0x561b70ac56f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa4d403e040 tx=0x7fa4d404bf60 comp rx=0 tx=0).stop 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 reap_dead start 2024-02-16T00:12:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4d2942640 1 -- 172.21.15.42:0/539524902 reap_dead start 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 shutdown_connections 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 >> 172.21.15.42:0/539524902 conn(0x561b70abaaa0 msgr2=0x561b70ab8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 shutdown_connections 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/539524902 wait complete. 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b4036790 msgr2=0x7fa3b4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b4036790 0x7fa3b4038c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561b70a9dd90 tx=0x7fa4cc019f10 comp rx=0 tx=0).stop 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 msgr2=0x561b70ab1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.773+0000 7fa4dd644800 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 0x561b70ab1900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x561b70a97ae0 tx=0x7fa4d4018830 comp rx=0 tx=0).stop 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 shutdown_connections 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3b4036790 0x7fa3b4038c50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/1862559230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b70ab14e0 0x561b70ab1900 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 >> 172.21.15.42:0/1862559230 conn(0x561b70aa5580 msgr2=0x561b70aa5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 shutdown_connections 2024-02-16T00:12:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/1862559230 wait complete. 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b709a34d0 msgr2=0x561b70a9d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b709a34d0 0x561b70a9d3a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70a9fc30 msgr2=0x561b70aa2020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70a9fc30 0x561b70aa2020 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c0036790 msgr2=0x7fa3c0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c0036790 0x7fa3c0038c50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4054000 tx=0x7fa4c404e000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 msgr2=0x561b70a96730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a96730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004000 tx=0x7fa4cc000bc0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 shutdown_connections 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x561b70a9fc30 0x561b70aa2020 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x561b709a34d0 0x561b70a9d3a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa3c0036790 0x7fa3c0038c50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 --2- 172.21.15.42:0/4081598146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7099f040 0x561b70a96730 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 >> 172.21.15.42:0/4081598146 conn(0x561b7099a5e0 msgr2=0x561b70a8da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 shutdown_connections 2024-02-16T00:12:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.774+0000 7fa4dd644800 1 -- 172.21.15.42:0/4081598146 wait complete. 2024-02-16T00:12:21.786 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-02-16T00:12:21.786 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-02-16T00:12:21.786 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-16T00:12:21.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-16T00:12:21.786 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-02-16T00:12:21.831 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.832 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6d09d800 1 Processor -- start 2024-02-16T00:12:21.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6d09d800 1 -- start start 2024-02-16T00:12:21.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6d09d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556370de7410 0x556370deff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6d09d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556370d31ba0 con 0x556370de58d0 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6d09d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x556370ce9450 con 0x556370de7410 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6a3a2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556370de7410 0x556370deff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6aba3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x556370de58d0 0x556370de5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53522/0 (socket says 172.21.15.42:53522) 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6a3a2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x556370de7410 0x556370deff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53648/0 (socket says 172.21.15.42:53648) 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6aba3640 1 -- 172.21.15.42:0/1551462813 learned_addr learned my addr 172.21.15.42:0/1551462813 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/1551462813 >> v1:172.21.15.2:6789/0 conn(0x556370de58d0 legacy=0x556370de5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.830+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/1551462813 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556370d5a180 con 0x556370de7410 2024-02-16T00:12:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.832+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/1551462813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de7410 0x556370deff10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400a470 tx=0x7f1a5401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73cb3f1e7a392b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.832+0000 7f1a69ba1640 1 -- 172.21.15.42:0/1551462813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5404ad40 con 0x556370de7410 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.832+0000 7f1a69ba1640 1 -- 172.21.15.42:0/1551462813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54052440 con 0x556370de7410 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.832+0000 7f1a69ba1640 1 -- 172.21.15.42:0/1551462813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5404aea0 con 0x556370de7410 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1551462813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de7410 msgr2=0x556370deff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/1551462813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de7410 0x556370deff10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400a470 tx=0x7f1a5401cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1551462813 shutdown_connections 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/1551462813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de7410 0x556370deff10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1551462813 >> 172.21.15.42:0/1551462813 conn(0x556370de14f0 msgr2=0x556370de3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1551462813 shutdown_connections 2024-02-16T00:12:21.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.833+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1551462813 wait complete. 2024-02-16T00:12:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.844+0000 7f1a6d09d800 1 Processor -- start 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.844+0000 7f1a6d09d800 1 -- start start 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.844+0000 7f1a6d09d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ed9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.844+0000 7f1a6d09d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556370ce6980 con 0x556370de58d0 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1a6aba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ed9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1a6aba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ed9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53654/0 (socket says 172.21.15.42:53654) 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1a6aba3640 1 -- 172.21.15.42:0/861657057 learned_addr learned my addr 172.21.15.42:0/861657057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1a6aba3640 1 -- 172.21.15.42:0/861657057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54005d20 con 0x556370de58d0 2024-02-16T00:12:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/861657057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ed9360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1a640014a0 tx=0x7f1a64001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab6e15ace2f125c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1958e09640 1 -- 172.21.15.42:0/861657057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a64004520 con 0x556370de58d0 2024-02-16T00:12:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1958e09640 1 -- 172.21.15.42:0/861657057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64004680 con 0x556370de58d0 2024-02-16T00:12:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.845+0000 7f1958e09640 1 -- 172.21.15.42:0/861657057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a64004980 con 0x556370de58d0 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 -- 172.21.15.42:0/861657057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 msgr2=0x556370ed9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/861657057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ed9360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1a640014a0 tx=0x7f1a64001960 comp rx=0 tx=0).stop 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 -- 172.21.15.42:0/861657057 shutdown_connections 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/861657057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ed9360 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 -- 172.21.15.42:0/861657057 >> 172.21.15.42:0/861657057 conn(0x556370de14f0 msgr2=0x556370ed4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 -- 172.21.15.42:0/861657057 shutdown_connections 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 -- 172.21.15.42:0/861657057 wait complete. 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 Processor -- start 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.846+0000 7f1a6d09d800 1 -- start start 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6d09d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ee0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6d09d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556370ce2160 con 0x556370de58d0 2024-02-16T00:12:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6aba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ee0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6aba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ee0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53666/0 (socket says 172.21.15.42:53666) 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6aba3640 1 -- 172.21.15.42:0/3479043535 learned_addr learned my addr 172.21.15.42:0/3479043535 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6aba3640 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556370d31ba0 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ee0a20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1a640014a0 tx=0x7f1a64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1957606640 1 -- 172.21.15.42:0/3479043535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a64013820 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1957606640 1 -- 172.21.15.42:0/3479043535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64013980 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556370ee0f60 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1957606640 1 -- 172.21.15.42:0/3479043535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a64013c20 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.847+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556370ee1440 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.848+0000 7f1957606640 1 -- 172.21.15.42:0/3479043535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1a64028460 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.848+0000 7f1957606640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1950036790 0x7f1950038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.848+0000 7f1957606640 1 -- 172.21.15.42:0/3479043535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f1a6404c440 con 0x556370de58d0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1950036790 0x7f1950038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370de7410 0x556370ee7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370ee7ce0 con 0x556370de7410 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370de7410 0x556370ee7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1950036790 0x7f1950038c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a54054000 tx=0x7f1a5404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370de7410 0x556370ee7710 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/3479043535 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370de7410 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.849+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370ee4da0 con 0x556370de7410 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/3479043535 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370de7410 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370ee9f20 0x556370eec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370eeca00 con 0x556370ee9f20 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370ee9f20 0x556370eec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370ee9f20 0x556370eec310 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6aba3640 1 -- 172.21.15.42:0/3479043535 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1a64024020 con 0x556370ee9f20 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.850+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370ee8e70 con 0x556370de7410 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/3479043535 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370de7410 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370ee9260 con 0x556370de7410 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/3479043535 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370de7410 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6d09d800 1 Processor -- start 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6d09d800 1 -- start start 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6d09d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 0x556370efbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.851+0000 7f1a6d09d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556370c84e80 con 0x556370efb7a0 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1a6b3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 0x556370efbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1a6b3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 0x556370efbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53680/0 (socket says 172.21.15.42:53680) 2024-02-16T00:12:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/1943440720 learned_addr learned my addr 172.21.15.42:0/1943440720 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/1943440720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556370efc100 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 0x556370efbbc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x556370ee1a80 tx=0x7f1a5c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1954e01640 1 -- 172.21.15.42:0/1943440720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c00f040 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1954e01640 1 -- 172.21.15.42:0/1943440720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c007d00 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556370efcb70 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.852+0000 7f1954e01640 1 -- 172.21.15.42:0/1943440720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c019420 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.853+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556370efd030 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.853+0000 7f1954e01640 1 -- 172.21.15.42:0/1943440720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1a5c0195a0 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.853+0000 7f1954e01640 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19440367e0 0x7f1944038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.853+0000 7f1954e01640 1 -- 172.21.15.42:0/1943440720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f1a5c04e0f0 con 0x556370efb7a0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.853+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19440367e0 0x7f1944038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6d09d800 1 Processor -- start 2024-02-16T00:12:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6d09d800 1 -- start start 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19440367e0 0x7f1944038ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a640019a0 tx=0x7f1a6404a650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6d09d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f08ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6d09d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556370c5a5d0 con 0x556370f08aa0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6b3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f08ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6b3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f08ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53690/0 (socket says 172.21.15.42:53690) 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/2342665886 learned_addr learned my addr 172.21.15.42:0/2342665886 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/2342665886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556370f09470 con 0x556370f08aa0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.854+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/2342665886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f08ea0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c04c3a0 tx=0x7f1a5c015710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea50ca771301210 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f194e7fc640 1 -- 172.21.15.42:0/2342665886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c0198a0 con 0x556370f08aa0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f194e7fc640 1 -- 172.21.15.42:0/2342665886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c019a00 con 0x556370f08aa0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f194e7fc640 1 -- 172.21.15.42:0/2342665886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c018500 con 0x556370f08aa0 2024-02-16T00:12:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 -- 172.21.15.42:0/2342665886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 msgr2=0x556370f08ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/2342665886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f08ea0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c04c3a0 tx=0x7f1a5c015710 comp rx=0 tx=0).stop 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 -- 172.21.15.42:0/2342665886 shutdown_connections 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/2342665886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f08ea0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 -- 172.21.15.42:0/2342665886 >> 172.21.15.42:0/2342665886 conn(0x556370f04d20 msgr2=0x556370f02d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 -- 172.21.15.42:0/2342665886 shutdown_connections 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 -- 172.21.15.42:0/2342665886 wait complete. 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 Processor -- start 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.855+0000 7f1a6d09d800 1 -- start start 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6d09d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f0fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6d09d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556370f0ff40 con 0x556370f08aa0 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6b3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f0fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6b3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f0fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53706/0 (socket says 172.21.15.42:53706) 2024-02-16T00:12:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 learned_addr learned my addr 172.21.15.42:0/686179039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556370efd030 con 0x556370f08aa0 2024-02-16T00:12:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.856+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f0fa00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c014ab0 tx=0x7f1a5c04c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.858+0000 7f194cff9640 1 -- 172.21.15.42:0/686179039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c0198a0 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.858+0000 7f194cff9640 1 -- 172.21.15.42:0/686179039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0158c0 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.858+0000 7f194cff9640 1 -- 172.21.15.42:0/686179039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c017520 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.858+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556370f10140 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.858+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556370f10600 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f194cff9640 1 -- 172.21.15.42:0/686179039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1a5c04c740 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f194cff9640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19340367e0 0x7f1934038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f194cff9640 1 -- 172.21.15.42:0/686179039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f1a5c037d20 con 0x556370f08aa0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19340367e0 0x7f1934038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370f1b740 0x556370f1dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f1e320 con 0x556370f1b740 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.859+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370f1b740 0x556370f1dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19340367e0 0x7f1934038ca0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x556370eecdc0 tx=0x7f1a64041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370f1b740 0x556370f1dbd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a540525b0 con 0x556370f1b740 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 realm 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f1e710 con 0x556370f1b740 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f1ef90 con 0x556370f1b740 2024-02-16T00:12:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.860+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f1f2f0 con 0x556370f1b740 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370f20000 0x556370f223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f22930 con 0x556370f20000 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370f20000 0x556370f223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370f20000 0x556370f223f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 20 searching for the correct realm 2024-02-16T00:12:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x556370f24880 0x556370f26d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.861+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x556370f24880 0x556370f26d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.862+0000 7f1a6aba3640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x556370f24880 0x556370f26d40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.862+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.862+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.863+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.863+0000 7f1a6b3a4640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1a5c019040 0x7f1a5c0247d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.863+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.863+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1a5c019040 0x7f1a5c0247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.863+0000 7f1a6a3a2640 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1a5c019040 0x7f1a5c0247d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.863+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.864+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.865+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.865+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.865+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.865+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.865+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.865+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.866+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.867+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.867+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.867+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.867+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.868+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.869+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.869+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.869+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.869+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.869+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.870+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f24880 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x7f1a5c019040 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a54065040 con 0x7f1a5c019040 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f1b740 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27410 con 0x556370f20000 2024-02-16T00:12:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.871+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f232f0 con 0x556370f1b740 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f23730 con 0x556370f1b740 2024-02-16T00:12:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a54065040 con 0x556370f1b740 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f23b50 con 0x556370f1b740 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 zone default found 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 4 Realm: () 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 zonegroup default 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f27850 con 0x7f1a5c019040 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.872+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f22f70 con 0x556370f24880 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f297d0 con 0x556370f24880 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 20 started sync module instance, tier type = 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.873+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f28ca0 con 0x556370f20000 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.874+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.874+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93885585068416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f29bf0 con 0x556370f20000 2024-02-16T00:12:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.874+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2a430 con 0x556370f1b740 2024-02-16T00:12:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.875+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93885585068416] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.875+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.875+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93885585066048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2a090 con 0x556370f1b740 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.875+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2ae10 con 0x556370f24880 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.877+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.877+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93885585066048] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.877+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93885585074512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2b170 con 0x556370f24880 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.877+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2bbd0 con 0x556370f20000 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.878+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93885585074512] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.878+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.878+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93885585071088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2bf80 con 0x556370f20000 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.878+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2c9b0 con 0x556370f1b740 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.879+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.879+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93885585081520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2c9b0 con 0x556370f1b740 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.879+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93885585071088] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.879+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2d940 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.880+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93885585081520] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.880+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.880+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93885585078032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2cbd0 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.880+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2dda0 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.881+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93885585078032] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.881+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.881+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93885585085472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2dda0 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.881+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2e760 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93885585085472] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93885585086720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2e940 con 0x7f1a5c019040 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=0 2024-02-16T00:12:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=1 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=2 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=3 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=4 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=5 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.882+0000 7f1a6d09d800 20 add_watcher() i=6 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.883+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93885585086720] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.883+0000 7f1a6d09d800 20 add_watcher() i=7 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.883+0000 7f1a6d09d800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.883+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f31c90 con 0x556370f1b740 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.883+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.883+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93885585102480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2e9a0 con 0x556370f1b740 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.884+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93885585102480] v29'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.884+0000 7f19217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.884+0000 7f1a6d09d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.884+0000 7f1a6d09d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.884+0000 7f1a6d09d800 5 note: GC not initialized 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f189bfff640 20 reqs_thread_entry: start 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6d09d800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6d09d800 20 Filter name: none 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1899ffb640 20 reqs_thread_entry: start 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6d09d800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f63770 con 0x556370f1b740 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6d09d800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.885+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f63770 con 0x7f1a5c019040 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.886+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.887+0000 7f19217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.887+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93885585102480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f63770 con 0x556370f1b740 2024-02-16T00:12:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.888+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93885585102480] v29'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.888+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93885585068416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f63770 con 0x556370f20000 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.889+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93885585068416] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.889+0000 7f1a6d09d800 20 remove_watcher() i=0 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.889+0000 7f1a6d09d800 2 removed watcher, disabling cache 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.889+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93885585066048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f63770 con 0x556370f1b740 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.890+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93885585066048] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.890+0000 7f1a6d09d800 20 remove_watcher() i=1 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.890+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93885585074512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f63770 con 0x556370f24880 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.891+0000 7f1a6aba3640 1 -- 172.21.15.42:0/686179039 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93885585074512] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a64051040 con 0x556370f24880 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.891+0000 7f1a6d09d800 20 remove_watcher() i=2 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.891+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93885585071088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2a950 con 0x556370f20000 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.892+0000 7f1a6b3a4640 1 -- 172.21.15.42:0/686179039 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93885585071088] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0083e0 con 0x556370f20000 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.892+0000 7f1a6d09d800 20 remove_watcher() i=3 2024-02-16T00:12:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.892+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93885585081520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f29bf0 con 0x556370f1b740 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.893+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93885585081520] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x556370f1b740 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.893+0000 7f1a6d09d800 20 remove_watcher() i=4 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.893+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93885585078032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2a950 con 0x7f1a5c019040 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.894+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93885585078032] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.894+0000 7f1a6d09d800 20 remove_watcher() i=5 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.894+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93885585085472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f2c4b0 con 0x7f1a5c019040 2024-02-16T00:12:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.895+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93885585085472] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.895+0000 7f1a6d09d800 20 remove_watcher() i=6 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.895+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93885585086720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556370f29bf0 con 0x7f1a5c019040 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93885585086720] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a5408c040 con 0x7f1a5c019040 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 20 remove_watcher() i=7 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1a5c019040 msgr2=0x7f1a5c0247d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f1a5c019040 0x7f1a5c0247d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370f1b740 msgr2=0x556370f1dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370f1b740 0x556370f1dbd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370f20000 msgr2=0x556370f223f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370f20000 0x556370f223f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x556370f24880 msgr2=0x556370f26d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x556370f24880 0x556370f26d40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19340367e0 msgr2=0x7f1934038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19340367e0 0x7f1934038ca0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x556370eecdc0 tx=0x7f1a64041000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 msgr2=0x556370f0fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6a3a2640 1 -- 172.21.15.42:0/686179039 reap_dead start 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.896+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f0fa00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c014ab0 tx=0x7f1a5c04c300 comp rx=0 tx=0).stop 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 shutdown_connections 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/686179039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370f08aa0 0x556370f0fa00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 >> 172.21.15.42:0/686179039 conn(0x556370f04d20 msgr2=0x556370f02380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 shutdown_connections 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/686179039 wait complete. 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19440367e0 msgr2=0x7f1944038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19440367e0 0x7f1944038ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a640019a0 tx=0x7f1a6404a650 comp rx=0 tx=0).stop 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 msgr2=0x556370efbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 0x556370efbbc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x556370ee1a80 tx=0x7f1a5c00aea0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 shutdown_connections 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f19440367e0 0x7f1944038ca0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/1943440720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370efb7a0 0x556370efbbc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 >> 172.21.15.42:0/1943440720 conn(0x556370eef840 msgr2=0x556370eefc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 shutdown_connections 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/1943440720 wait complete. 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370de7410 msgr2=0x556370ee7710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370de7410 0x556370ee7710 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370ee9f20 msgr2=0x556370eec310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370ee9f20 0x556370eec310 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1950036790 msgr2=0x7f1950038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1950036790 0x7f1950038c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a54054000 tx=0x7f1a5404e000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 msgr2=0x556370ee0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ee0a20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1a640014a0 tx=0x7f1a64001250 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 shutdown_connections 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x556370ee9f20 0x556370eec310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x556370de7410 0x556370ee7710 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1950036790 0x7f1950038c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 --2- 172.21.15.42:0/3479043535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556370de58d0 0x556370ee0a20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.897+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 >> 172.21.15.42:0/3479043535 conn(0x556370de14f0 msgr2=0x556370ed3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.898+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 shutdown_connections 2024-02-16T00:12:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.898+0000 7f1a6d09d800 1 -- 172.21.15.42:0/3479043535 wait complete. 2024-02-16T00:12:21.908 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-16T00:12:21.908 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-16T00:12:21.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-16T00:12:21.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-16T00:12:21.909 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-02-16T00:12:21.952 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:21.952 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.950+0000 7f9d85724800 1 Processor -- start 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.950+0000 7f9d85724800 1 -- start start 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d85724800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56536d825e90 0x56536d8262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d85724800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56536d771ba0 con 0x56536d8270f0 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d85724800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x56536d729450 con 0x56536d825e90 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d813c8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56536d825e90 0x56536d8262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d813c8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56536d825e90 0x56536d8262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53708/0 (socket says 172.21.15.42:53708) 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d813c8640 1 -- 172.21.15.42:0/955581227 learned_addr learned my addr 172.21.15.42:0/955581227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d813c8640 1 -- 172.21.15.42:0/955581227 >> v1:172.21.15.2:6789/0 conn(0x56536d8270f0 legacy=0x56536d827570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.951+0000 7f9d813c8640 1 -- 172.21.15.42:0/955581227 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56536d826980 con 0x56536d825e90 2024-02-16T00:12:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.953+0000 7f9d813c8640 1 --2- 172.21.15.42:0/955581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d8262b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00a520 tx=0x7f9d7c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dbd9eef414ae45 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.953+0000 7f9d7bfff640 1 -- 172.21.15.42:0/955581227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c052570 con 0x56536d825e90 2024-02-16T00:12:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.953+0000 7f9d7bfff640 1 -- 172.21.15.42:0/955581227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0526d0 con 0x56536d825e90 2024-02-16T00:12:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.953+0000 7f9d7bfff640 1 -- 172.21.15.42:0/955581227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c052990 con 0x56536d825e90 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 -- 172.21.15.42:0/955581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 msgr2=0x56536d8262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 --2- 172.21.15.42:0/955581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d8262b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00a520 tx=0x7f9d7c01cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 -- 172.21.15.42:0/955581227 shutdown_connections 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 --2- 172.21.15.42:0/955581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d8262b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 -- 172.21.15.42:0/955581227 >> 172.21.15.42:0/955581227 conn(0x56536d8214f0 msgr2=0x56536d823910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 -- 172.21.15.42:0/955581227 shutdown_connections 2024-02-16T00:12:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.954+0000 7f9d85724800 1 -- 172.21.15.42:0/955581227 wait complete. 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d85724800 1 Processor -- start 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d85724800 1 -- start start 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d85724800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d799f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d85724800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56536d726980 con 0x56536d825e90 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d813c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d799f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d813c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d799f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53716/0 (socket says 172.21.15.42:53716) 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.965+0000 7f9d813c8640 1 -- 172.21.15.42:0/2384592235 learned_addr learned my addr 172.21.15.42:0/2384592235 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.966+0000 7f9d813c8640 1 -- 172.21.15.42:0/2384592235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c005de0 con 0x56536d825e90 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.966+0000 7f9d813c8640 1 --2- 172.21.15.42:0/2384592235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d799f50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c01cf20 tx=0x7f9d7c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416ac4530b5482b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.966+0000 7f9c6f606640 1 -- 172.21.15.42:0/2384592235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c052840 con 0x56536d825e90 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.966+0000 7f9c6f606640 1 -- 172.21.15.42:0/2384592235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0529a0 con 0x56536d825e90 2024-02-16T00:12:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.966+0000 7f9c6f606640 1 -- 172.21.15.42:0/2384592235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c052c80 con 0x56536d825e90 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- 172.21.15.42:0/2384592235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 msgr2=0x56536d799f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 --2- 172.21.15.42:0/2384592235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d799f50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c01cf20 tx=0x7f9d7c04c000 comp rx=0 tx=0).stop 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- 172.21.15.42:0/2384592235 shutdown_connections 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 --2- 172.21.15.42:0/2384592235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d799f50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- 172.21.15.42:0/2384592235 >> 172.21.15.42:0/2384592235 conn(0x56536d8214f0 msgr2=0x56536d911bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- 172.21.15.42:0/2384592235 shutdown_connections 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- 172.21.15.42:0/2384592235 wait complete. 2024-02-16T00:12:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 Processor -- start 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- start start 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d91e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d85724800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56536d722160 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d813c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d91e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d813c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d91e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53724/0 (socket says 172.21.15.42:53724) 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.967+0000 7f9d813c8640 1 -- 172.21.15.42:0/4216982563 learned_addr learned my addr 172.21.15.42:0/4216982563 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9d813c8640 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c04e070 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d91e9d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c01ceb0 tx=0x7f9d7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9c6de03640 1 -- 172.21.15.42:0/4216982563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c06c070 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9c6de03640 1 -- 172.21.15.42:0/4216982563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c05d5b0 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56536d91ef10 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9c6de03640 1 -- 172.21.15.42:0/4216982563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c05d870 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.968+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56536d91f450 con 0x56536d825e90 2024-02-16T00:12:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9c6de03640 1 -- 172.21.15.42:0/4216982563 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9d7c059040 con 0x56536d825e90 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9c6de03640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c680367e0 0x7f9c68038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9c6de03640 1 -- 172.21.15.42:0/4216982563 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9d7c08d800 con 0x56536d825e90 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9d80bc7640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c680367e0 0x7f9c68038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d8270f0 0x56536d925690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d925bd0 con 0x56536d8270f0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.969+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d8270f0 0x56536d925690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d80bc7640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c680367e0 0x7f9c68038ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c001e10 tx=0x7f9d6c001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d8270f0 0x56536d925690 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4216982563 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d8270f0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d922da0 con 0x56536d8270f0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4216982563 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d8270f0 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d927e10 0x56536d92a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.970+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d92a8a0 con 0x56536d927e10 2024-02-16T00:12:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.971+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d927e10 0x56536d92a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.971+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d927e10 0x56536d92a200 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.971+0000 7f9d813c8640 1 -- 172.21.15.42:0/4216982563 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9d7c06f370 con 0x56536d927e10 2024-02-16T00:12:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.971+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d926d90 con 0x56536d8270f0 2024-02-16T00:12:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.971+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4216982563 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d8270f0 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.971+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d927180 con 0x56536d8270f0 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.972+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4216982563 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d8270f0 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.972+0000 7f9d85724800 1 Processor -- start 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.972+0000 7f9d85724800 1 -- start start 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.972+0000 7f9d85724800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 0x56536d939a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.972+0000 7f9d85724800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56536d6c4e80 con 0x56536d939640 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d81bc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 0x56536d939a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d81bc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 0x56536d939a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53734/0 (socket says 172.21.15.42:53734) 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d81bc9640 1 -- 172.21.15.42:0/1873404986 learned_addr learned my addr 172.21.15.42:0/1873404986 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d81bc9640 1 -- 172.21.15.42:0/1873404986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56536d939fa0 con 0x56536d939640 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 0x56536d939a60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x56536d925f30 tx=0x7f9d74018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9c66ffd640 1 -- 172.21.15.42:0/1873404986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7401d070 con 0x56536d939640 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9c66ffd640 1 -- 172.21.15.42:0/1873404986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740182e0 con 0x56536d939640 2024-02-16T00:12:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9c66ffd640 1 -- 172.21.15.42:0/1873404986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d740145e0 con 0x56536d939640 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56536d93aa10 con 0x56536d939640 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.973+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56536d93aed0 con 0x56536d939640 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.974+0000 7f9c66ffd640 1 -- 172.21.15.42:0/1873404986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9d74020020 con 0x56536d939640 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.974+0000 7f9c66ffd640 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c580367e0 0x7f9c58038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.974+0000 7f9c66ffd640 1 -- 172.21.15.42:0/1873404986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9d7404dd70 con 0x56536d939640 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.974+0000 7f9d813c8640 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c580367e0 0x7f9c58038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.974+0000 7f9d85724800 1 Processor -- start 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.974+0000 7f9d85724800 1 -- start start 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d813c8640 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c580367e0 0x7f9c58038ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x56536d925fa0 tx=0x7f9d7c006f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d85724800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d917ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d85724800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56536d69a5d0 con 0x56536d9176a0 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d81bc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d917ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d81bc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d917ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53748/0 (socket says 172.21.15.42:53748) 2024-02-16T00:12:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d81bc9640 1 -- 172.21.15.42:0/3156451369 learned_addr learned my addr 172.21.15.42:0/3156451369 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d81bc9640 1 -- 172.21.15.42:0/3156451369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56536d915ea0 con 0x56536d9176a0 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/3156451369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d917ac0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9d7404c020 tx=0x7f9d74011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eee08623f1a3bf2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9c64ff9640 1 -- 172.21.15.42:0/3156451369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d7404d070 con 0x56536d9176a0 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9c64ff9640 1 -- 172.21.15.42:0/3156451369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74016440 con 0x56536d9176a0 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.975+0000 7f9c64ff9640 1 -- 172.21.15.42:0/3156451369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d74014b10 con 0x56536d9176a0 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- 172.21.15.42:0/3156451369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 msgr2=0x56536d917ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 --2- 172.21.15.42:0/3156451369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d917ac0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9d7404c020 tx=0x7f9d74011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- 172.21.15.42:0/3156451369 shutdown_connections 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 --2- 172.21.15.42:0/3156451369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d917ac0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- 172.21.15.42:0/3156451369 >> 172.21.15.42:0/3156451369 conn(0x56536d942be0 msgr2=0x56536d940c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- 172.21.15.42:0/3156451369 shutdown_connections 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- 172.21.15.42:0/3156451369 wait complete. 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 Processor -- start 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- start start 2024-02-16T00:12:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d94fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.976+0000 7f9d85724800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56536d94ff40 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d81bc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d94fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d81bc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d94fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53756/0 (socket says 172.21.15.42:53756) 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 learned_addr learned my addr 172.21.15.42:0/4072661933 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56536d93aed0 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d94fa00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9d7404bf50 tx=0x7f9d7404bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9c56ffd640 1 -- 172.21.15.42:0/4072661933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d74032070 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9c56ffd640 1 -- 172.21.15.42:0/4072661933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740116f0 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56536d950140 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9c56ffd640 1 -- 172.21.15.42:0/4072661933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d740133b0 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.977+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56536d9505a0 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.978+0000 7f9c56ffd640 1 -- 172.21.15.42:0/4072661933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9d74013510 con 0x56536d9176a0 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.978+0000 7f9c56ffd640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c4c0367e0 0x7f9c4c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.978+0000 7f9c56ffd640 1 -- 172.21.15.42:0/4072661933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f9d74037d40 con 0x56536d9176a0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.978+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c4c0367e0 0x7f9c4c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.978+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d95b6c0 0x56536d95db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d95e2d0 con 0x56536d95b6c0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d80bc7640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d95b6c0 0x56536d95db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c4c0367e0 0x7f9c4c038ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c078ff0 tx=0x7f9d7c086000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d80bc7640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d95b6c0 0x56536d95db80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 20 realm 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d95ab20 con 0x56536d95b6c0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.979+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d95ed50 con 0x56536d95b6c0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d95f5d0 con 0x56536d95b6c0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d95fe40 0x56536d962250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d95fe40 0x56536d962250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.980+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d95fe40 0x56536d962250 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d85724800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d85724800 20 searching for the correct realm 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56536d9649e0 0x56536d966ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d967570 con 0x56536d9649e0 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56536d9649e0 0x56536d966ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.981+0000 7f9d813c8640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56536d9649e0 0x56536d966ea0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d967570 con 0x56536d95fe40 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d81bc9640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9d74014070 0x7f9d74017630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d80bc7640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9d74014070 0x7f9d74017630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.982+0000 7f9d80bc7640 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9d74014070 0x7f9d74017630 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.983+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.984+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.985+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.986+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.987+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.988+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.988+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.988+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.988+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.988+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.988+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d9649e0 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.989+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x7f9d74014070 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95b6c0 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9629b0 con 0x56536d95fe40 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d963300 con 0x56536d95b6c0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.990+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9636b0 con 0x56536d95b6c0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d963a90 con 0x56536d95b6c0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 zone default found 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 4 Realm: () 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 zonegroup default 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9679b0 con 0x7f9d74014070 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.991+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d969830 con 0x56536d9649e0 2024-02-16T00:12:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d969b90 con 0x56536d9649e0 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 20 started sync module instance, tier type = 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.992+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d968cc0 con 0x56536d95fe40 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.993+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.993+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94916320858496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d968cc0 con 0x56536d95fe40 2024-02-16T00:12:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.993+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96a5b0 con 0x56536d95b6c0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.994+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94916320858496] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.994+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.994+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94916320862384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d968cc0 con 0x56536d95b6c0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.994+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96b050 con 0x56536d9649e0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.995+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94916320862384] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.995+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.995+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94916320856096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d968c40 con 0x56536d9649e0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.995+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96beb0 con 0x56536d95fe40 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.996+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94916320856096] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.996+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.996+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94916320868880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96c2d0 con 0x56536d95fe40 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.996+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96cc40 con 0x56536d95b6c0 2024-02-16T00:12:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.997+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.997+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94916320872352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96cc40 con 0x56536d95b6c0 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.997+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96dc00 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.997+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94916320868880] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.998+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94916320872352] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.999+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.999+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94916320876256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96dc00 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.999+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96d0f0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:21.999+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94916320876256] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.000+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.000+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94916320874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96dfb0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.000+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96ea30 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94916320874672] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94916320879920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96e9f0 con 0x7f9d74014070 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=0 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=1 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=2 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=3 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=4 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=5 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.001+0000 7f9d85724800 20 add_watcher() i=6 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.002+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94916320879920] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.002+0000 7f9d85724800 20 add_watcher() i=7 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.002+0000 7f9d85724800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.002+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d971f90 con 0x56536d95b6c0 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.002+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.002+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94916320869936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96f2e0 con 0x56536d95b6c0 2024-02-16T00:12:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94916320869936] v29'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9d85724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9d85724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9d85724800 5 note: GC not initialized 2024-02-16T00:12:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9c367e4640 20 reqs_thread_entry: start 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.003+0000 7f9d85724800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9d85724800 20 Filter name: none 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9ba7fff640 20 reqs_thread_entry: start 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9d85724800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9a39e0 con 0x56536d95b6c0 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9d85724800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.004+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9a39e0 con 0x7f9d74014070 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.005+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.005+0000 7f9c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.005+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94916320869936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9a39e0 con 0x56536d95b6c0 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.006+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94916320869936] v29'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.006+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94916320858496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9a39e0 con 0x56536d95fe40 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.007+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94916320858496] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.007+0000 7f9d85724800 20 remove_watcher() i=0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.007+0000 7f9d85724800 2 removed watcher, disabling cache 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.007+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94916320862384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9a39e0 con 0x56536d95b6c0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.008+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94916320862384] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.008+0000 7f9d85724800 20 remove_watcher() i=1 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.008+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94916320856096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d9a39e0 con 0x56536d9649e0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.010+0000 7f9d813c8640 1 -- 172.21.15.42:0/4072661933 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94916320856096] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7c095040 con 0x56536d9649e0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.010+0000 7f9d85724800 20 remove_watcher() i=2 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.010+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94916320868880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96a0b0 con 0x56536d95fe40 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.010+0000 7f9d81bc9640 1 -- 172.21.15.42:0/4072661933 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94916320868880] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d7400a4a0 con 0x56536d95fe40 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.010+0000 7f9d85724800 20 remove_watcher() i=3 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.010+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94916320872352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96beb0 con 0x56536d95b6c0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.011+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94916320872352] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x56536d95b6c0 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.011+0000 7f9d85724800 20 remove_watcher() i=4 2024-02-16T00:12:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.011+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94916320876256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96beb0 con 0x7f9d74014070 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.012+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94916320876256] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.012+0000 7f9d85724800 20 remove_watcher() i=5 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.012+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94916320874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96beb0 con 0x7f9d74014070 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.013+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94916320874672] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.013+0000 7f9d85724800 20 remove_watcher() i=6 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.013+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94916320879920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56536d96beb0 con 0x7f9d74014070 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94916320879920] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d6c00bdb0 con 0x7f9d74014070 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 20 remove_watcher() i=7 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9d74014070 msgr2=0x7f9d74017630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f9d74014070 0x7f9d74017630 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d95b6c0 msgr2=0x56536d95db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d95b6c0 0x56536d95db80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d95fe40 msgr2=0x56536d962250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d95fe40 0x56536d962250 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56536d9649e0 msgr2=0x56536d966ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56536d9649e0 0x56536d966ea0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c4c0367e0 msgr2=0x7f9c4c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c4c0367e0 0x7f9c4c038ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c078ff0 tx=0x7f9d7c086000 comp rx=0 tx=0).stop 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d80bc7640 1 -- 172.21.15.42:0/4072661933 reap_dead start 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.014+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 msgr2=0x56536d94fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d94fa00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9d7404bf50 tx=0x7f9d7404bf80 comp rx=0 tx=0).stop 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 shutdown_connections 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/4072661933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d9176a0 0x56536d94fa00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 >> 172.21.15.42:0/4072661933 conn(0x56536d942be0 msgr2=0x56536d940240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 shutdown_connections 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4072661933 wait complete. 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c580367e0 msgr2=0x7f9c58038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c580367e0 0x7f9c58038ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x56536d925fa0 tx=0x7f9d7c006f40 comp rx=0 tx=0).stop 2024-02-16T00:12:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 msgr2=0x56536d939a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 0x56536d939a60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x56536d925f30 tx=0x7f9d74018830 comp rx=0 tx=0).stop 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 shutdown_connections 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c580367e0 0x7f9c58038ca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/1873404986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d939640 0x56536d939a60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 >> 172.21.15.42:0/1873404986 conn(0x56536d92d6e0 msgr2=0x56536d92dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 shutdown_connections 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/1873404986 wait complete. 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d8270f0 msgr2=0x56536d925690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d8270f0 0x56536d925690 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d927e10 msgr2=0x56536d92a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d927e10 0x56536d92a200 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c680367e0 msgr2=0x7f9c68038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c680367e0 0x7f9c68038ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c001e10 tx=0x7f9d6c001390 comp rx=0 tx=0).stop 2024-02-16T00:12:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 msgr2=0x56536d91e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.015+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d91e9d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c01ceb0 tx=0x7f9d7c002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 shutdown_connections 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56536d927e10 0x56536d92a200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56536d8270f0 0x56536d925690 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f9c680367e0 0x7f9c68038ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 --2- 172.21.15.42:0/4216982563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56536d825e90 0x56536d91e9d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 >> 172.21.15.42:0/4216982563 conn(0x56536d8214f0 msgr2=0x56536d910430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 shutdown_connections 2024-02-16T00:12:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.016+0000 7f9d85724800 1 -- 172.21.15.42:0/4216982563 wait complete. 2024-02-16T00:12:22.028 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-16T00:00:00.000000Z","epoch":1708041600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-02-16T00:12:22.028 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-16T00:00:00.000000Z', 'epoch': 1708041600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-02-16T00:12:22.028 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-16T00:12:22.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-16T00:12:22.029 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-02-16T00:12:22.079 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:22.079 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb79931800 1 Processor -- start 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb79931800 1 -- start start 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb79931800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5594e1025170 0x5594e10b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb79931800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5594e0ffcbd0 con 0x5594e10b5100 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb79931800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5594e0fb4450 con 0x5594e1025170 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb7563b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5594e1025170 0x5594e10b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb7563b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5594e1025170 0x5594e10b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53764/0 (socket says 172.21.15.42:53764) 2024-02-16T00:12:22.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb74e3a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5594e10b5100 0x5594e10b75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53540/0 (socket says 172.21.15.42:53540) 2024-02-16T00:12:22.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.077+0000 7fbb7563b640 1 -- 172.21.15.42:0/3443473512 learned_addr learned my addr 172.21.15.42:0/3443473512 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.078+0000 7fbb7563b640 1 -- 172.21.15.42:0/3443473512 >> v1:172.21.15.2:6789/0 conn(0x5594e10b5100 legacy=0x5594e10b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.078+0000 7fbb7563b640 1 -- 172.21.15.42:0/3443473512 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e10b9e60 con 0x5594e1025170 2024-02-16T00:12:22.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.079+0000 7fbb7563b640 1 --2- 172.21.15.42:0/3443473512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e10b4b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800a520 tx=0x7fbb6801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63552216470eca7e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb67fff640 1 -- 172.21.15.42:0/3443473512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb68052570 con 0x5594e1025170 2024-02-16T00:12:22.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb67fff640 1 -- 172.21.15.42:0/3443473512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680526d0 con 0x5594e1025170 2024-02-16T00:12:22.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb67fff640 1 -- 172.21.15.42:0/3443473512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb68052990 con 0x5594e1025170 2024-02-16T00:12:22.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 -- 172.21.15.42:0/3443473512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 msgr2=0x5594e10b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 --2- 172.21.15.42:0/3443473512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e10b4b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800a520 tx=0x7fbb6801cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 -- 172.21.15.42:0/3443473512 shutdown_connections 2024-02-16T00:12:22.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 --2- 172.21.15.42:0/3443473512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e10b4b60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 -- 172.21.15.42:0/3443473512 >> 172.21.15.42:0/3443473512 conn(0x5594e10ac520 msgr2=0x5594e10ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 -- 172.21.15.42:0/3443473512 shutdown_connections 2024-02-16T00:12:22.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.080+0000 7fbb79931800 1 -- 172.21.15.42:0/3443473512 wait complete. 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb79931800 1 Processor -- start 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb79931800 1 -- start start 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb79931800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb79931800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e0fb1980 con 0x5594e1025170 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb7563b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb7563b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53766/0 (socket says 172.21.15.42:53766) 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb7563b640 1 -- 172.21.15.42:0/3183432619 learned_addr learned my addr 172.21.15.42:0/3183432619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.092+0000 7fbb7563b640 1 -- 172.21.15.42:0/3183432619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68005de0 con 0x5594e1025170 2024-02-16T00:12:22.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.093+0000 7fbb7563b640 1 --2- 172.21.15.42:0/3183432619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a2080 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbb6801cf20 tx=0x7fbb6804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29de715dee508d6b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.093+0000 7fba63606640 1 -- 172.21.15.42:0/3183432619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb68052840 con 0x5594e1025170 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.093+0000 7fba63606640 1 -- 172.21.15.42:0/3183432619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680529a0 con 0x5594e1025170 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.093+0000 7fba63606640 1 -- 172.21.15.42:0/3183432619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb68052c80 con 0x5594e1025170 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- 172.21.15.42:0/3183432619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 msgr2=0x5594e11a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 --2- 172.21.15.42:0/3183432619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a2080 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbb6801cf20 tx=0x7fbb6804c000 comp rx=0 tx=0).stop 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- 172.21.15.42:0/3183432619 shutdown_connections 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 --2- 172.21.15.42:0/3183432619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a2080 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- 172.21.15.42:0/3183432619 >> 172.21.15.42:0/3183432619 conn(0x5594e10ac520 msgr2=0x5594e119d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- 172.21.15.42:0/3183432619 shutdown_connections 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- 172.21.15.42:0/3183432619 wait complete. 2024-02-16T00:12:22.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 Processor -- start 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- start start 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb79931800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e0fad160 con 0x5594e1025170 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb7563b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb7563b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53770/0 (socket says 172.21.15.42:53770) 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.094+0000 7fbb7563b640 1 -- 172.21.15.42:0/974989606 learned_addr learned my addr 172.21.15.42:0/974989606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fbb7563b640 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e10b9e60 con 0x5594e1025170 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fbb7563b640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a9640 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbb6801ceb0 tx=0x7fbb68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fba61e03640 1 -- 172.21.15.42:0/974989606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb6806c070 con 0x5594e1025170 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5594e11a9b80 con 0x5594e1025170 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fba61e03640 1 -- 172.21.15.42:0/974989606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6805d7c0 con 0x5594e1025170 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fba61e03640 1 -- 172.21.15.42:0/974989606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb6805da60 con 0x5594e1025170 2024-02-16T00:12:22.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.095+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594e11aa0c0 con 0x5594e1025170 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fba61e03640 1 -- 172.21.15.42:0/974989606 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbb68059040 con 0x5594e1025170 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fba61e03640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba5c0367e0 0x7fba5c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fba61e03640 1 -- 172.21.15.42:0/974989606 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbb6808da40 con 0x5594e1025170 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fbb74e3a640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba5c0367e0 0x7fba5c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e10b5100 0x5594e11b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11b09b0 con 0x5594e10b5100 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.096+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e10b5100 0x5594e11b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb74e3a640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba5c0367e0 0x7fba5c038ca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c000f60 tx=0x7fbb6c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e10b5100 0x5594e11b0470 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb75e3c640 1 -- 172.21.15.42:0/974989606 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e10b5100 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ada30 con 0x5594e10b5100 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb75e3c640 1 -- 172.21.15.42:0/974989606 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e10b5100 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11b2bf0 0x5594e11b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11b56b0 con 0x5594e11b2bf0 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.097+0000 7fbb7563b640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11b2bf0 0x5594e11b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.098+0000 7fbb7563b640 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11b2bf0 0x5594e11b4fe0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.098+0000 7fbb7563b640 1 -- 172.21.15.42:0/974989606 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbb680673f0 con 0x5594e11b2bf0 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.098+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11b1b70 con 0x5594e10b5100 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.098+0000 7fbb75e3c640 1 -- 172.21.15.42:0/974989606 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e10b5100 2024-02-16T00:12:22.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.098+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11b1f80 con 0x5594e10b5100 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb75e3c640 1 -- 172.21.15.42:0/974989606 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e10b5100 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb79931800 1 Processor -- start 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb79931800 1 -- start start 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb79931800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 0x5594e11c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb79931800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e0f4fe80 con 0x5594e11c4430 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb75e3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 0x5594e11c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb75e3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 0x5594e11c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53780/0 (socket says 172.21.15.42:53780) 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.099+0000 7fbb75e3c640 1 -- 172.21.15.42:0/3388709014 learned_addr learned my addr 172.21.15.42:0/3388709014 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fbb75e3c640 1 -- 172.21.15.42:0/3388709014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e11c4d90 con 0x5594e11c4430 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 0x5594e11c4850 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x5594e11b0d10 tx=0x7fbb70018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fba5affd640 1 -- 172.21.15.42:0/3388709014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb7001d070 con 0x5594e11c4430 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fba5affd640 1 -- 172.21.15.42:0/3388709014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700182e0 con 0x5594e11c4430 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fba5affd640 1 -- 172.21.15.42:0/3388709014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb700145e0 con 0x5594e11c4430 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5594e11c5800 con 0x5594e11c4430 2024-02-16T00:12:22.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.100+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594e11c5cc0 con 0x5594e11c4430 2024-02-16T00:12:22.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fba5affd640 1 -- 172.21.15.42:0/3388709014 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbb70020020 con 0x5594e11c4430 2024-02-16T00:12:22.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fba5affd640 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba4c036830 0x7fba4c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fba5affd640 1 -- 172.21.15.42:0/3388709014 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbb7004dd20 con 0x5594e11c4430 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fbb7563b640 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba4c036830 0x7fba4c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fbb79931800 1 Processor -- start 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fbb79931800 1 -- start start 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.101+0000 7fbb7563b640 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba4c036830 0x7fba4c038cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5594e11b0d80 tx=0x7fbb680058d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb79931800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e11d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb79931800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e0f255d0 con 0x5594e11d16c0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb75e3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e11d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb75e3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e11d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53794/0 (socket says 172.21.15.42:53794) 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb75e3c640 1 -- 172.21.15.42:0/1798458970 learned_addr learned my addr 172.21.15.42:0/1798458970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb75e3c640 1 -- 172.21.15.42:0/1798458970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e11d20b0 con 0x5594e11d16c0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/1798458970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e11d1ae0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbb70013010 tx=0x7fbb70011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856132094ab565f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fba58ff9640 1 -- 172.21.15.42:0/1798458970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb70016570 con 0x5594e11d16c0 2024-02-16T00:12:22.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fba58ff9640 1 -- 172.21.15.42:0/1798458970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70014ac0 con 0x5594e11d16c0 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.102+0000 7fba58ff9640 1 -- 172.21.15.42:0/1798458970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb7002b350 con 0x5594e11d16c0 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- 172.21.15.42:0/1798458970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 msgr2=0x5594e11d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 --2- 172.21.15.42:0/1798458970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e11d1ae0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbb70013010 tx=0x7fbb70011460 comp rx=0 tx=0).stop 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- 172.21.15.42:0/1798458970 shutdown_connections 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 --2- 172.21.15.42:0/1798458970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e11d1ae0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- 172.21.15.42:0/1798458970 >> 172.21.15.42:0/1798458970 conn(0x5594e11cd990 msgr2=0x5594e11cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- 172.21.15.42:0/1798458970 shutdown_connections 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- 172.21.15.42:0/1798458970 wait complete. 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 Processor -- start 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- start start 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e10b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.103+0000 7fbb79931800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e10b2910 con 0x5594e11d16c0 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb75e3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e10b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb75e3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e10b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53806/0 (socket says 172.21.15.42:53806) 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 learned_addr learned my addr 172.21.15.42:0/2083460630 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e11c5cc0 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e10b23d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbb7003e040 tx=0x7fbb7004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fba4affd640 1 -- 172.21.15.42:0/2083460630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb70014c30 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fba4affd640 1 -- 172.21.15.42:0/2083460630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700133b0 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5594e10b0ac0 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fba4affd640 1 -- 172.21.15.42:0/2083460630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb70013690 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.104+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594e10b0f80 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.105+0000 7fba4affd640 1 -- 172.21.15.42:0/2083460630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbb70022740 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.105+0000 7fba4affd640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba400367e0 0x7fba40038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.105+0000 7fba4affd640 1 -- 172.21.15.42:0/2083460630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbb70038d50 con 0x5594e11d16c0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.105+0000 7fbb7563b640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba400367e0 0x7fba40038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb7563b640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba400367e0 0x7fba40038ca0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb68067700 tx=0x7fbb68071000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e11e6340 0x5594e11e8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11e8f50 con 0x5594e11e6340 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb74e3a640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e11e6340 0x5594e11e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb74e3a640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e11e6340 0x5594e11e8800 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.106+0000 7fbb79931800 20 realm 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11e57a0 con 0x5594e11e6340 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11e99d0 con 0x5594e11e6340 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ea250 con 0x5594e11e6340 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11eac30 0x5594e11ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ed720 con 0x5594e11eac30 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.107+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11eac30 0x5594e11ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11eac30 0x5594e11ed020 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb79931800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb79931800 20 searching for the correct realm 2024-02-16T00:12:22.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5594e11efa30 0x5594e11f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f25c0 con 0x5594e11efa30 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb7563b640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5594e11efa30 0x5594e11f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.108+0000 7fbb7563b640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5594e11efa30 0x5594e11f1ef0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.109+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.109+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f25c0 con 0x5594e11eac30 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.109+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.109+0000 7fbb75e3c640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbb70014070 0x7fbb7002c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.109+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ed720 con 0x7fbb70014070 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.109+0000 7fbb74e3a640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbb70014070 0x7fbb7002c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.110+0000 7fbb74e3a640 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbb70014070 0x7fbb7002c820 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.110+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.110+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ed720 con 0x5594e11e6340 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ed720 con 0x5594e11e6340 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ed720 con 0x7fbb70014070 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.111+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.112+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.112+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11e6340 2024-02-16T00:12:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.112+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.112+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x7fbb70014070 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.112+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.112+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11e6340 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.113+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x7fbb70014070 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11e6340 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.114+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11e6340 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11e6340 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.115+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x7fbb70014070 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x7fbb70014070 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.116+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11efa30 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x7fbb70014070 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11e6340 2024-02-16T00:12:22.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.117+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbb6c02c040 con 0x5594e11eac30 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ede30 con 0x5594e11e6340 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ee1e0 con 0x5594e11e6340 2024-02-16T00:12:22.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ee5c0 con 0x5594e11e6340 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 zone default found 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 4 Realm: () 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 zonegroup default 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.118+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11ee9b0 con 0x7fbb70014070 2024-02-16T00:12:22.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f43e0 con 0x5594e11efa30 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f4740 con 0x5594e11efa30 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 started sync module instance, tier type = 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.119+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f3cc0 con 0x5594e11eac30 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.120+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.120+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94097920440352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f3c40 con 0x5594e11eac30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.120+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f53e0 con 0x5594e11e6340 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.121+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94097920440352] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.122+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.122+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94097920445088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f5360 con 0x5594e11e6340 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.122+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f5d10 con 0x5594e11efa30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.123+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94097920445088] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.123+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.123+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94097920446144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f52e0 con 0x5594e11efa30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.123+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f6a80 con 0x5594e11eac30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.124+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.124+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94097920451936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f7310 con 0x5594e11eac30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.124+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f7de0 con 0x5594e11e6340 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.124+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94097920446144] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.125+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94097920451936] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.125+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.125+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94097920456896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f7da0 con 0x5594e11e6340 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.125+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f8630 con 0x7fbb70014070 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.126+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94097920456896] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.126+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.126+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94097920450752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f8240 con 0x7fbb70014070 2024-02-16T00:12:22.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.126+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f8cc0 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.127+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94097920450752] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.127+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.127+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94097920460736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f8ea0 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.127+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f96a0 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94097920460736] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94097920462496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f9760 con 0x7fbb70014070 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=0 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=1 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=2 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=3 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=4 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=5 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.128+0000 7fbb79931800 20 add_watcher() i=6 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.129+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94097920462496] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.129+0000 7fbb79931800 20 add_watcher() i=7 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.129+0000 7fbb79931800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.129+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11fcc00 con 0x5594e11e6340 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.129+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.129+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94097920476720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f98d0 con 0x5594e11e6340 2024-02-16T00:12:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94097920476720] v29'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fba2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fbb79931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fbb79931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fbb79931800 5 note: GC not initialized 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fba2a7e4640 20 reqs_thread_entry: start 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.130+0000 7fbb79931800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 20 Filter name: none 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fb99bfff640 20 reqs_thread_entry: start 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e122ec20 con 0x7fbb70014070 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e122ec20 con 0x5594e11e6340 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.131+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e122d7f0 con 0x7fbb70014070 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~347] v29'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb79931800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-16T00:12:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb79931800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb79931800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94097920676640 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e1232220 con 0x7fbb70014070 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== watch-notify(notify (1) cookie 94097920462496 notify 124554051602 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7fbb6c036040 con 0x7fbb70014070 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fba58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94097920462496 notifier 4719 bl.length()=523 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fba58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fba58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(65 notify.7 [notify cookie 94097920676640 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.133+0000 7fba58ff9640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fba38003e90 con 0x7fbb70014070 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.134+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.134+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== watch-notify(notify_complete (2) cookie 94097920676640 notify 124554051602 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbb6c006070 con 0x7fbb70014070 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.134+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e122d2d0 con 0x5594e11e6340 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb79931800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb79931800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T00:12:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb79931800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94097920676560 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e1232610 con 0x7fbb70014070 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== watch-notify(notify (1) cookie 94097920450752 notify 124554051603 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fbb6c006070 con 0x7fbb70014070 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fba4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94097920450752 notifier 4719 bl.length()=177 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fba4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fba4bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(68 notify.5 [notify cookie 94097920676560 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fba4bfff640 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb9a80033f0 con 0x7fbb70014070 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.135+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== watch-notify(notify_complete (2) cookie 94097920676560 notify 124554051603 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5594e0ffcbd0 con 0x7fbb70014070 2024-02-16T00:12:22.147 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.136+0000 7fba2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.136+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94097920476720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11fbbf0 con 0x5594e11e6340 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.137+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94097920476720] v29'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.137+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94097920440352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11fb750 con 0x5594e11eac30 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.138+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94097920440352] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.138+0000 7fbb79931800 20 remove_watcher() i=0 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.138+0000 7fbb79931800 2 removed watcher, disabling cache 2024-02-16T00:12:22.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.138+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94097920445088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f3820 con 0x5594e11e6340 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.139+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94097920445088] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.139+0000 7fbb79931800 20 remove_watcher() i=1 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.139+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94097920446144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f3820 con 0x5594e11efa30 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.140+0000 7fbb7563b640 1 -- 172.21.15.42:0/2083460630 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94097920446144] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb680a1040 con 0x5594e11efa30 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.140+0000 7fbb79931800 20 remove_watcher() i=2 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.140+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94097920451936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f4aa0 con 0x5594e11eac30 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.141+0000 7fbb75e3c640 1 -- 172.21.15.42:0/2083460630 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94097920451936] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb7000a4a0 con 0x5594e11eac30 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.141+0000 7fbb79931800 20 remove_watcher() i=3 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.141+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94097920456896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f6560 con 0x5594e11e6340 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.143+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94097920456896] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x5594e11e6340 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.143+0000 7fbb79931800 20 remove_watcher() i=4 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.143+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94097920450752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f78c0 con 0x7fbb70014070 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.144+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94097920450752] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c00f610 con 0x7fbb70014070 2024-02-16T00:12:22.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.144+0000 7fbb79931800 20 remove_watcher() i=5 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.144+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94097920460736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f78c0 con 0x7fbb70014070 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.145+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94097920460736] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c048040 con 0x7fbb70014070 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.145+0000 7fbb79931800 20 remove_watcher() i=6 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.145+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94097920462496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5594e11f87c0 con 0x7fbb70014070 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94097920462496] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb6c048040 con 0x7fbb70014070 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 20 remove_watcher() i=7 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbb70014070 msgr2=0x7fbb7002c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbb70014070 0x7fbb7002c820 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e11e6340 msgr2=0x5594e11e8800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e11e6340 0x5594e11e8800 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11eac30 msgr2=0x5594e11ed020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11eac30 0x5594e11ed020 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5594e11efa30 msgr2=0x5594e11f1ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5594e11efa30 0x5594e11f1ef0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba400367e0 msgr2=0x7fba40038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba400367e0 0x7fba40038ca0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb68067700 tx=0x7fbb68071000 comp rx=0 tx=0).stop 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 msgr2=0x5594e10b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb74e3a640 1 -- 172.21.15.42:0/2083460630 reap_dead start 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e10b23d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbb7003e040 tx=0x7fbb7004bf30 comp rx=0 tx=0).stop 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 shutdown_connections 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/2083460630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11d16c0 0x5594e10b23d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 >> 172.21.15.42:0/2083460630 conn(0x5594e11cd990 msgr2=0x5594e11caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 shutdown_connections 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/2083460630 wait complete. 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba4c036830 msgr2=0x7fba4c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba4c036830 0x7fba4c038cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5594e11b0d80 tx=0x7fbb680058d0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 msgr2=0x5594e11c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.146+0000 7fbb79931800 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 0x5594e11c4850 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x5594e11b0d10 tx=0x7fbb70018830 comp rx=0 tx=0).stop 2024-02-16T00:12:22.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 shutdown_connections 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba4c036830 0x7fba4c038cf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/3388709014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e11c4430 0x5594e11c4850 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 >> 172.21.15.42:0/3388709014 conn(0x5594e11b84d0 msgr2=0x5594e11b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 shutdown_connections 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/3388709014 wait complete. 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e10b5100 msgr2=0x5594e11b0470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e10b5100 0x5594e11b0470 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11b2bf0 msgr2=0x5594e11b4fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11b2bf0 0x5594e11b4fe0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba5c0367e0 msgr2=0x7fba5c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba5c0367e0 0x7fba5c038ca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c000f60 tx=0x7fbb6c001370 comp rx=0 tx=0).stop 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 msgr2=0x5594e11a9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a9640 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbb6801ceb0 tx=0x7fbb68002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 shutdown_connections 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5594e11b2bf0 0x5594e11b4fe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5594e10b5100 0x5594e11b0470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fba5c0367e0 0x7fba5c038ca0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 --2- 172.21.15.42:0/974989606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5594e1025170 0x5594e11a9640 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 >> 172.21.15.42:0/974989606 conn(0x5594e10ac520 msgr2=0x5594e11a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 shutdown_connections 2024-02-16T00:12:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.147+0000 7fbb79931800 1 -- 172.21.15.42:0/974989606 wait complete. 2024-02-16T00:12:22.159 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:12:22.172 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:12:22.177 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-02-16T00:12:22.177 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-16T00:12:22.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-16T00:12:22.177 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-02-16T00:12:22.222 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:22.222 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.220+0000 7fbdbe131800 1 Processor -- start 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.220+0000 7fbdbe131800 1 -- start start 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdbe131800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559d25f04320 0x559d25f06710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdbe131800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559d25e4bba0 con 0x559d25effe90 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdbe131800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x559d25e03450 con 0x559d25f04320 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdb96f1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559d25f04320 0x559d25f06710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdb9ef2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x559d25effe90 0x559d25f002b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53554/0 (socket says 172.21.15.42:53554) 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/78919963 learned_addr learned my addr 172.21.15.42:0/78919963 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdb96f1640 1 -- 172.21.15.42:0/78919963 >> v1:172.21.15.2:6789/0 conn(0x559d25effe90 legacy=0x559d25f002b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.221+0000 7fbdb96f1640 1 -- 172.21.15.42:0/78919963 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d25f07d40 con 0x559d25f04320 2024-02-16T00:12:22.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.223+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/78919963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25f04320 0x559d25f06710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000a470 tx=0x7fbdb001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b3109a65459cfd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.223+0000 7fbdb8ef0640 1 -- 172.21.15.42:0/78919963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb0052570 con 0x559d25f04320 2024-02-16T00:12:22.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.223+0000 7fbdb8ef0640 1 -- 172.21.15.42:0/78919963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb00526d0 con 0x559d25f04320 2024-02-16T00:12:22.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.223+0000 7fbdb8ef0640 1 -- 172.21.15.42:0/78919963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb0052990 con 0x559d25f04320 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 -- 172.21.15.42:0/78919963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25f04320 msgr2=0x559d25f06710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 --2- 172.21.15.42:0/78919963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25f04320 0x559d25f06710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000a470 tx=0x7fbdb001cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 -- 172.21.15.42:0/78919963 shutdown_connections 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 --2- 172.21.15.42:0/78919963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25f04320 0x559d25f06710 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 -- 172.21.15.42:0/78919963 >> 172.21.15.42:0/78919963 conn(0x559d25efb4f0 msgr2=0x559d25efd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 -- 172.21.15.42:0/78919963 shutdown_connections 2024-02-16T00:12:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.224+0000 7fbdbe131800 1 -- 172.21.15.42:0/78919963 wait complete. 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.235+0000 7fbdbe131800 1 Processor -- start 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.235+0000 7fbdbe131800 1 -- start start 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.235+0000 7fbdbe131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25e73f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.235+0000 7fbdbe131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d25e00980 con 0x559d25effe90 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.235+0000 7fbdb9ef2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25e73f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.235+0000 7fbdb9ef2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25e73f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53824/0 (socket says 172.21.15.42:53824) 2024-02-16T00:12:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.236+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/627512969 learned_addr learned my addr 172.21.15.42:0/627512969 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.236+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/627512969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0005d20 con 0x559d25effe90 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.236+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/627512969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25e73f50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbdac001c80 tx=0x7fbdac00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f00e7746cf1f59 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.236+0000 7fbca7e07640 1 -- 172.21.15.42:0/627512969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdac00e470 con 0x559d25effe90 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.236+0000 7fbca7e07640 1 -- 172.21.15.42:0/627512969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac00e5d0 con 0x559d25effe90 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.236+0000 7fbca7e07640 1 -- 172.21.15.42:0/627512969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdac00e8d0 con 0x559d25effe90 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- 172.21.15.42:0/627512969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 msgr2=0x559d25e73f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 --2- 172.21.15.42:0/627512969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25e73f50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbdac001c80 tx=0x7fbdac00b6c0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- 172.21.15.42:0/627512969 shutdown_connections 2024-02-16T00:12:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 --2- 172.21.15.42:0/627512969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25e73f50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- 172.21.15.42:0/627512969 >> 172.21.15.42:0/627512969 conn(0x559d25efb4f0 msgr2=0x559d25feb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- 172.21.15.42:0/627512969 shutdown_connections 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- 172.21.15.42:0/627512969 wait complete. 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 Processor -- start 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- start start 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25ff8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdbe131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d25dfc160 con 0x559d25effe90 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdb9ef2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25ff8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdb9ef2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25ff8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53830/0 (socket says 172.21.15.42:53830) 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.237+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/3841262135 learned_addr learned my addr 172.21.15.42:0/3841262135 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d25e4bba0 con 0x559d25effe90 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25ff8710 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbdac001c80 tx=0x7fbdac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbca6604640 1 -- 172.21.15.42:0/3841262135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdac01f070 con 0x559d25effe90 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbca6604640 1 -- 172.21.15.42:0/3841262135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac018770 con 0x559d25effe90 2024-02-16T00:12:22.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559d25ff8c50 con 0x559d25effe90 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbca6604640 1 -- 172.21.15.42:0/3841262135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdac018a10 con 0x559d25effe90 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.238+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d25ff9130 con 0x559d25effe90 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbca6604640 1 -- 172.21.15.42:0/3841262135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbdac018c40 con 0x559d25effe90 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbca6604640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbca0036790 0x7fbca0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbca6604640 1 -- 172.21.15.42:0/3841262135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbdac04c5f0 con 0x559d25effe90 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbca0036790 0x7fbca0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d25f04320 0x559d25fff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d25fff9e0 con 0x559d25f04320 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.239+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d25f04320 0x559d25fff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbca0036790 0x7fbca0038c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0054000 tx=0x7fbdb004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d25f04320 0x559d25fff410 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3841262135 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d25f04320 2024-02-16T00:12:22.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d25ffcb00 con 0x559d25f04320 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3841262135 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d25f04320 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26001c20 0x559d26004010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260046e0 con 0x559d26001c20 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.240+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26001c20 0x559d26004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.241+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26001c20 0x559d26004010 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.241+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/3841262135 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbdac014070 con 0x559d26001c20 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.241+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26000ba0 con 0x559d25f04320 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.241+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3841262135 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d25f04320 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.241+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26000fb0 con 0x559d25f04320 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.241+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3841262135 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d25f04320 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdbe131800 1 Processor -- start 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdbe131800 1 -- start start 2024-02-16T00:12:22.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdbe131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 0x559d25fefd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdbe131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d25d9ee80 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdba6f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 0x559d25fefd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdba6f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 0x559d25fefd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53838/0 (socket says 172.21.15.42:53838) 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3969435529 learned_addr learned my addr 172.21.15.42:0/3969435529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.242+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3969435529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d25ff0280 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 0x559d25fefd40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x559d25fffd40 tx=0x7fbdb4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbc9f7fe640 1 -- 172.21.15.42:0/3969435529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb401d070 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbc9f7fe640 1 -- 172.21.15.42:0/3969435529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb40182e0 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559d25ff04d0 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbc9f7fe640 1 -- 172.21.15.42:0/3969435529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb40145e0 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d25ff0990 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.243+0000 7fbc9f7fe640 1 -- 172.21.15.42:0/3969435529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbdb4020020 con 0x559d25ff18d0 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbc9f7fe640 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc94036830 0x7fbc94038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbc9f7fe640 1 -- 172.21.15.42:0/3969435529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbdb404dd20 con 0x559d25ff18d0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc94036830 0x7fbc94038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdbe131800 1 Processor -- start 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdbe131800 1 -- start start 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc94036830 0x7fbc94038cf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x559d25fffdb0 tx=0x7fbdac017f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdbe131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26022ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdbe131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d25d745d0 con 0x559d260228e0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdba6f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26022ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdba6f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26022ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53842/0 (socket says 172.21.15.42:53842) 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.244+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3244415335 learned_addr learned my addr 172.21.15.42:0/3244415335 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdba6f3640 1 -- 172.21.15.42:0/3244415335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d260232b0 con 0x559d260228e0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/3244415335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26022ce0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4013010 tx=0x7fbdb4011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31314eb773895d4d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/3244415335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4016570 con 0x559d260228e0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/3244415335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4014ac0 con 0x559d260228e0 2024-02-16T00:12:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/3244415335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb402b350 con 0x559d260228e0 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 -- 172.21.15.42:0/3244415335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 msgr2=0x559d26022ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3244415335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26022ce0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4013010 tx=0x7fbdb4011460 comp rx=0 tx=0).stop 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 -- 172.21.15.42:0/3244415335 shutdown_connections 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3244415335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26022ce0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 -- 172.21.15.42:0/3244415335 >> 172.21.15.42:0/3244415335 conn(0x559d2601ebb0 msgr2=0x559d2601cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 -- 172.21.15.42:0/3244415335 shutdown_connections 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.245+0000 7fbdbe131800 1 -- 172.21.15.42:0/3244415335 wait complete. 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdbe131800 1 Processor -- start 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdbe131800 1 -- start start 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdbe131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26029800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdbe131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d26029d40 con 0x559d260228e0 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdba6f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26029800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdba6f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26029800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53846/0 (socket says 172.21.15.42:53846) 2024-02-16T00:12:22.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 learned_addr learned my addr 172.21.15.42:0/2263703269 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.246+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d25ff0990 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.247+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26029800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbdb404aec0 tx=0x7fbdb404bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.247+0000 7fbc8b7fe640 1 -- 172.21.15.42:0/2263703269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4014c30 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.247+0000 7fbc8b7fe640 1 -- 172.21.15.42:0/2263703269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb40133b0 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.247+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559d26029f40 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.247+0000 7fbc8b7fe640 1 -- 172.21.15.42:0/2263703269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4013690 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.247+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d2602a400 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbc8b7fe640 1 -- 172.21.15.42:0/2263703269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbdb4022740 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbc8b7fe640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc840367e0 0x7fbc84038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbc8b7fe640 1 -- 172.21.15.42:0/2263703269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fbdb4038d50 con 0x559d260228e0 2024-02-16T00:12:22.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc840367e0 0x7fbc84038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc840367e0 0x7fbc84038ca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbdac03efd0 tx=0x7fbdac035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d260353c0 0x559d26037880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26037fd0 con 0x559d260353c0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.248+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d260353c0 0x559d26037880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d260353c0 0x559d26037880 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 20 realm 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26038360 con 0x559d260353c0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26038be0 con 0x559d260353c0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.249+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26038f40 con 0x559d260353c0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26039c50 0x559d2603c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26039c50 0x559d2603c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26039c50 0x559d2603c040 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.250+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdbe131800 20 searching for the correct realm 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559d2603e920 0x559d26040de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260414b0 con 0x559d2603e920 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559d2603e920 0x559d26040de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdb9ef2640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559d2603e920 0x559d26040de0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.251+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260414b0 con 0x559d26039c50 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdba6f3640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbdb4014070 0x7fbdb402c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbdb4014070 0x7fbdb402c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdb96f1640 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbdb4014070 0x7fbdb402c820 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.252+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.253+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.254+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.255+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.256+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.257+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.258+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.258+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.258+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.258+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.258+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.258+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d2603e920 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x7fbdb4014070 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.259+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d26039c50 2024-02-16T00:12:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603cd20 con 0x559d260353c0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603d0d0 con 0x559d260353c0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.260+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603d4b0 con 0x559d260353c0 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 20 zone default found 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 4 Realm: () 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 20 zonegroup default 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260418f0 con 0x7fbdb4014070 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.261+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26043770 con 0x559d2603e920 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26043ad0 con 0x559d2603e920 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 20 started sync module instance, tier type = 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.262+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26042d40 con 0x559d26039c50 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.263+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.263+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94133436035360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26042d40 con 0x559d26039c50 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.263+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26044480 con 0x559d260353c0 2024-02-16T00:12:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.264+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94133436035360] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.264+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.264+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94133436039072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26042d40 con 0x559d260353c0 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.264+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26044f70 con 0x559d2603e920 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.265+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94133436039072] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.265+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.265+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94133436033184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26042cc0 con 0x559d2603e920 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.265+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26045ce0 con 0x559d26039c50 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.266+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94133436033184] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.266+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.266+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94133436044064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26046090 con 0x559d26039c50 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.266+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26046ac0 con 0x559d260353c0 2024-02-16T00:12:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.267+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94133436044064] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.267+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.267+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94133436048832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26046a80 con 0x559d260353c0 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.267+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26047530 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.268+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.268+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94133436051568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26047530 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.268+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26048460 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.269+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94133436048832] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.269+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(56 notify.6 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.269+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94133436045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26048460 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.269+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26048e60 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94133436051568] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94133436045120] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94133436057952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26047f50 con 0x7fbdb4014070 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=0 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=1 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=2 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=3 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=4 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=5 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.270+0000 7fbdbe131800 20 add_watcher() i=6 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.271+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94133436057952] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.271+0000 7fbdbe131800 20 add_watcher() i=7 2024-02-16T00:12:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.271+0000 7fbdbe131800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.272+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2604be50 con 0x559d260353c0 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.272+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.272+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94133436053664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26049330 con 0x559d260353c0 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94133436053664] v29'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbc6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbdbe131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbdbe131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbdbe131800 5 note: GC not initialized 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbc6a7fc640 20 reqs_thread_entry: start 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbdbe131800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.273+0000 7fbdbe131800 20 Filter name: none 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbbdbfff640 20 reqs_thread_entry: start 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T00:12:22.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2607dde0 con 0x7fbdb4014070 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(62 bar [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.274+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26081ab0 con 0x559d26039c50 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.275+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v29'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.275+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.275+0000 7fbdbe131800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.275+0000 7fbdbe131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.275+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94133436287120 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26082730 con 0x7fbdb4014070 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== watch-notify(notify (1) cookie 94133436051568 notify 124554051604 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7fbdb0084040 con 0x7fbdb4014070 2024-02-16T00:12:22.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbc9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94133436051568 notifier 4726 bl.length()=357 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbc9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbc9d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(64 notify.5 [notify cookie 94133436287120 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbc7c003e90 con 0x7fbdb4014070 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== watch-notify(notify_complete (2) cookie 94133436287120 notify 124554051604 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbdb0079040 con 0x7fbdb4014070 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260825f0 con 0x559d260353c0 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdbe131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 : miss 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.276+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 8.c 8:335c062c:root::.bucket.meta.myfoo6%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260801d0 con 0x559d260353c0 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(67 .bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv12 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=353 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 info.flags=0x17 2024-02-16T00:12:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 to cache LRU end 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.277+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 8.c 8:335c062c:root::.bucket.meta.myfoo6%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26089b90 con 0x559d260353c0 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 .bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v29'13 uv13 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 info.flags=0x17 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdbe131800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 to cache LRU end 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdbe131800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdbe131800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9, ofs0, ns] 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94133436286992 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260815a0 con 0x559d26039c50 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.278+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== watch-notify(notify (1) cookie 94133436044064 notify 124554051621 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x559d26029f40 con 0x559d26039c50 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbc9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051621 cookie 94133436044064 notifier 4726 bl.length()=721 2024-02-16T00:12:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbc9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 info.flags=0x17 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbc9d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 to cache LRU end 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbc9d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(69 notify.3 [notify cookie 94133436286992 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbc7c003e90 con 0x559d26039c50 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb400a4a0 con 0x559d26039c50 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== watch-notify(notify_complete (2) cookie 94133436286992 notify 124554051621 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbdb406a020 con 0x559d26039c50 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdbe131800 20 handle_bi_update(): bucket=:myfoo6[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9]): orig_sources= new_sources= 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdbe131800 20 handle_bi_update(): bucket=:myfoo6[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9]): potential sources added=[] removed=[] 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdbe131800 20 handle_bi_update(): bucket=:myfoo6[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9]): orig_dests= new_dests= 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdbe131800 20 handle_bi_update(): bucket=:myfoo6[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9]): potential dests added=[] removed=[] 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.279+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26084b40 con 0x559d260353c0 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(71 bud.buckets [call] v29'3 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-02-16T00:12:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 20 rados->read ofs=0 len=0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26083b30 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 20 rados_obj.operate() r=0 bl.length=166 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.280+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:73 4.2c 4:36d46c2a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.281+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(73 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.281+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:74 4.9 4:9058c993:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.281+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(74 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.281+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 4.27 4:e6a9567e:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d260353c0 2024-02-16T00:12:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.281+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(75 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.281+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 4.2 4:41da6761:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.282+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(76 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.282+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:77 4.20 4:07c5fe0b:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.282+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(77 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.282+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:78 4.2 4:42a4a613:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.282+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(78 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.282+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:79 4.26 4:66a954f7:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x7fbdb4014070 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(79 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:80 4.0 4:0169c6e0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085b50 con 0x559d2603e920 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(80 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.7 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 4.2c 4:3501e1c4:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085fa0 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(81 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 4.3b 4:de4e4306:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26085fa0 con 0x559d2603e920 2024-02-16T00:12:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.283+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(82 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9 [call out=377b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 10 cls_bucket_list_unordered: got thirteen 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:83 4.22 4:45bdc7c5:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26086390 con 0x559d260353c0 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(83 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 get_obj_state: octx=0x559d2607ffc0 obj=myfoo6:thirteen state=0x559d26083d18 s->prefetch_data=0 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 3.ds0 3:b208f400:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26086390 con 0x559d2603e920 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(84 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 10 manifest: total_size = 8 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.1381267197583126888 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.acl 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.content_type 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.etag 2024-02-16T00:12:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.idtag 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.manifest 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 get_obj_state: octx=0x559d2607ffc0 obj=myfoo6:thirteen state=0x559d26083d18 s->prefetch_data=0 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 : hit (requested=0x17, cached=0x17) 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.284+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 4.3b 4:de4e4306:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d260893d0 con 0x559d2603e920 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.285+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(85 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9 [stat,call,call] v29'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.285+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 3.ds0 3:b208f400:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2608c1c0 con 0x559d2603e920 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.286+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(86 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v29'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.287+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 4.3b 4:de4e4306:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2608d750 con 0x559d2603e920 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:1 objects processed in :myfoo6[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9]). Next marker thirteen 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.287+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2608d750 con 0x559d26039c50 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(87 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.9.9 [stat,call,call] v29'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbc9cff9640 20 handle_completion(): completion ok for obj=thirteen 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~347] v29'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fbdb406c040 con 0x559d26039c50 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdbe131800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdbe131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94133436286992 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26088f30 con 0x7fbdb4014070 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== watch-notify(notify (1) cookie 94133436051568 notify 124554051605 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7fbdb009d040 con 0x7fbdb4014070 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbc9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94133436051568 notifier 4726 bl.length()=523 2024-02-16T00:12:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbc9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbc9d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbc7c0041f0 con 0x7fbdb4014070 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(89 notify.5 [notify cookie 94133436286992 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.288+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== watch-notify(notify_complete (2) cookie 94133436286992 notify 124554051605 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbdb0094040 con 0x7fbdb4014070 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.289+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26088f30 con 0x559d260353c0 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'2 uv2 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94133436341536 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26088f30 con 0x7fbdb4014070 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== watch-notify(notify (1) cookie 94133436051568 notify 124554051606 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fbdb0094040 con 0x7fbdb4014070 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbc9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94133436051568 notifier 4726 bl.length()=177 2024-02-16T00:12:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbc9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbc9cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(92 notify.5 [notify cookie 94133436341536 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbc9cff9640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbbe40033f0 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== watch-notify(notify_complete (2) cookie 94133436341536 notify 124554051606 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbdb0079040 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 10 removing user index: bar 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 10 removing default.rgw.meta+users.uid+bar from cache 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.290+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94133436321584 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2608d700 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== watch-notify(notify (1) cookie 94133436057952 notify 124554051607 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fbdb0079040 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbc9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94133436057952 notifier 4726 bl.length()=152 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbc9d7fa640 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fbc7c0041f0 con 0x7fbdb4014070 2024-02-16T00:12:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(94 notify.7 [notify cookie 94133436321584 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== watch-notify(notify_complete (2) cookie 94133436321584 notify 124554051607 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559d25f07d40 con 0x7fbdb4014070 2024-02-16T00:12:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.291+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26088f30 con 0x7fbdb4014070 2024-02-16T00:12:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.292+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(96 bar [delete] v29'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.309 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:12:22.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.293+0000 7fbc6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:22.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.293+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94133436053664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26067df0 con 0x559d260353c0 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.294+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94133436053664] v29'219 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.294+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94133436035360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d26067df0 con 0x559d26039c50 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.295+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94133436035360] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb406c040 con 0x559d26039c50 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.295+0000 7fbdbe131800 20 remove_watcher() i=0 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.295+0000 7fbdbe131800 2 removed watcher, disabling cache 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.295+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94133436039072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c650 con 0x559d260353c0 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.296+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94133436039072] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.296+0000 7fbdbe131800 20 remove_watcher() i=1 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.296+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94133436033184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c630 con 0x559d2603e920 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.297+0000 7fbdb9ef2640 1 -- 172.21.15.42:0/2263703269 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94133436033184] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdac014070 con 0x559d2603e920 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.297+0000 7fbdbe131800 20 remove_watcher() i=2 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.297+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94133436044064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c630 con 0x559d26039c50 2024-02-16T00:12:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.298+0000 7fbdba6f3640 1 -- 172.21.15.42:0/2263703269 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94133436044064] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb406c040 con 0x559d26039c50 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.298+0000 7fbdbe131800 20 remove_watcher() i=3 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.298+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94133436048832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c630 con 0x559d260353c0 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.299+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94133436048832] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x559d260353c0 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.299+0000 7fbdbe131800 20 remove_watcher() i=4 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.299+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94133436051568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c630 con 0x7fbdb4014070 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.300+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94133436051568] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.300+0000 7fbdbe131800 20 remove_watcher() i=5 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.300+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94133436045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c630 con 0x7fbdb4014070 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.301+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94133436045120] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.301+0000 7fbdbe131800 20 remove_watcher() i=6 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.301+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94133436057952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559d2603c630 con 0x7fbdb4014070 2024-02-16T00:12:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94133436057952] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdb0059040 con 0x7fbdb4014070 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 20 remove_watcher() i=7 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbdb4014070 msgr2=0x7fbdb402c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fbdb4014070 0x7fbdb402c820 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d260353c0 msgr2=0x559d26037880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d260353c0 0x559d26037880 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26039c50 msgr2=0x559d2603c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26039c50 0x559d2603c040 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559d2603e920 msgr2=0x559d26040de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559d2603e920 0x559d26040de0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc840367e0 msgr2=0x7fbc84038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc840367e0 0x7fbc84038ca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbdac03efd0 tx=0x7fbdac035000 comp rx=0 tx=0).stop 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 msgr2=0x559d26029800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdb96f1640 1 -- 172.21.15.42:0/2263703269 reap_dead start 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26029800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbdb404aec0 tx=0x7fbdb404bf30 comp rx=0 tx=0).stop 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 shutdown_connections 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 --2- 172.21.15.42:0/2263703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d260228e0 0x559d26029800 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 >> 172.21.15.42:0/2263703269 conn(0x559d2601ebb0 msgr2=0x559d2601c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 shutdown_connections 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.302+0000 7fbdbe131800 1 -- 172.21.15.42:0/2263703269 wait complete. 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc94036830 msgr2=0x7fbc94038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc94036830 0x7fbc94038cf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x559d25fffdb0 tx=0x7fbdac017f90 comp rx=0 tx=0).stop 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 msgr2=0x559d25fefd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 0x559d25fefd40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x559d25fffd40 tx=0x7fbdb4018830 comp rx=0 tx=0).stop 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 shutdown_connections 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbc94036830 0x7fbc94038cf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3969435529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25ff18d0 0x559d25fefd40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 >> 172.21.15.42:0/3969435529 conn(0x559d26007500 msgr2=0x559d26007900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 shutdown_connections 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3969435529 wait complete. 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d25f04320 msgr2=0x559d25fff410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d25f04320 0x559d25fff410 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26001c20 msgr2=0x559d26004010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26001c20 0x559d26004010 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbca0036790 msgr2=0x7fbca0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbca0036790 0x7fbca0038c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0054000 tx=0x7fbdb004e000 comp rx=0 tx=0).stop 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 msgr2=0x559d25ff8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25ff8710 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbdac001c80 tx=0x7fbdac000ed0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 shutdown_connections 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559d26001c20 0x559d26004010 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559d25f04320 0x559d25fff410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fbca0036790 0x7fbca0038c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 --2- 172.21.15.42:0/3841262135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d25effe90 0x559d25ff8710 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:22.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 >> 172.21.15.42:0/3841262135 conn(0x559d25efb4f0 msgr2=0x559d25fea0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:22.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 shutdown_connections 2024-02-16T00:12:22.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:22.303+0000 7fbdbe131800 1 -- 172.21.15.42:0/3841262135 wait complete. 2024-02-16T00:12:22.320 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:12:27.327 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:12:27.327 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-16T00:12:27.327 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-16T00:12:27.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-16T00:12:27.328 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-02-16T00:12:27.385 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:27.385 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:27.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03cc81e800 1 Processor -- start 2024-02-16T00:12:27.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03cc81e800 1 -- start start 2024-02-16T00:12:27.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03cc81e800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b88287ead0 0x55b882880ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03cc81e800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b8827c8bd0 con 0x55b882881400 2024-02-16T00:12:27.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03cc81e800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b882780450 con 0x55b88287ead0 2024-02-16T00:12:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03c7e27640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b88287ead0 0x55b882880ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03c7e27640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55b88287ead0 0x55b882880ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53856/0 (socket says 172.21.15.42:53856) 2024-02-16T00:12:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03c7e27640 1 -- 172.21.15.42:0/591274101 learned_addr learned my addr 172.21.15.42:0/591274101 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.383+0000 7f03c7626640 1 --1- 172.21.15.42:0/591274101 >> v1:172.21.15.2:6789/0 conn(0x55b882881400 0x55b8828837f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53556/0 (socket says 172.21.15.42:53556) 2024-02-16T00:12:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.384+0000 7f03c7e27640 1 -- 172.21.15.42:0/591274101 >> v1:172.21.15.2:6789/0 conn(0x55b882881400 legacy=0x55b8828837f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.384+0000 7f03c7e27640 1 -- 172.21.15.42:0/591274101 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b882885f20 con 0x55b88287ead0 2024-02-16T00:12:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03c7e27640 1 --2- 172.21.15.42:0/591274101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882880ec0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f03b800a520 tx=0x7f03b801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c27a4340c7cc39f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03c6e25640 1 -- 172.21.15.42:0/591274101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8052570 con 0x55b88287ead0 2024-02-16T00:12:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03c6e25640 1 -- 172.21.15.42:0/591274101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b80526d0 con 0x55b88287ead0 2024-02-16T00:12:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03c6e25640 1 -- 172.21.15.42:0/591274101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8052990 con 0x55b88287ead0 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03cc81e800 1 -- 172.21.15.42:0/591274101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 msgr2=0x55b882880ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03cc81e800 1 --2- 172.21.15.42:0/591274101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882880ec0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f03b800a520 tx=0x7f03b801cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03cc81e800 1 -- 172.21.15.42:0/591274101 shutdown_connections 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03cc81e800 1 --2- 172.21.15.42:0/591274101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882880ec0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.386+0000 7f03cc81e800 1 -- 172.21.15.42:0/591274101 >> 172.21.15.42:0/591274101 conn(0x55b882878520 msgr2=0x55b88287a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.387+0000 7f03cc81e800 1 -- 172.21.15.42:0/591274101 shutdown_connections 2024-02-16T00:12:27.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.387+0000 7f03cc81e800 1 -- 172.21.15.42:0/591274101 wait complete. 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.400+0000 7f03cc81e800 1 Processor -- start 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.400+0000 7f03cc81e800 1 -- start start 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.400+0000 7f03cc81e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b88296e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.400+0000 7f03cc81e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88277d980 con 0x55b88287ead0 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f03c7e27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b88296e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f03c7e27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b88296e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53868/0 (socket says 172.21.15.42:53868) 2024-02-16T00:12:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f03c7e27640 1 -- 172.21.15.42:0/3894798771 learned_addr learned my addr 172.21.15.42:0/3894798771 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f03c7e27640 1 -- 172.21.15.42:0/3894798771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8005de0 con 0x55b88287ead0 2024-02-16T00:12:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f03c7e27640 1 --2- 172.21.15.42:0/3894798771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b88296e0e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f03b8055040 tx=0x7f03b804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb674a2a86f9fe6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f02b5e0b640 1 -- 172.21.15.42:0/3894798771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8052840 con 0x55b88287ead0 2024-02-16T00:12:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f02b5e0b640 1 -- 172.21.15.42:0/3894798771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b80529c0 con 0x55b88287ead0 2024-02-16T00:12:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.401+0000 7f02b5e0b640 1 -- 172.21.15.42:0/3894798771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8052ca0 con 0x55b88287ead0 2024-02-16T00:12:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 -- 172.21.15.42:0/3894798771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 msgr2=0x55b88296e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 --2- 172.21.15.42:0/3894798771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b88296e0e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f03b8055040 tx=0x7f03b804c000 comp rx=0 tx=0).stop 2024-02-16T00:12:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 -- 172.21.15.42:0/3894798771 shutdown_connections 2024-02-16T00:12:27.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 --2- 172.21.15.42:0/3894798771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b88296e0e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 -- 172.21.15.42:0/3894798771 >> 172.21.15.42:0/3894798771 conn(0x55b882878520 msgr2=0x55b882969a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 -- 172.21.15.42:0/3894798771 shutdown_connections 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.402+0000 7f03cc81e800 1 -- 172.21.15.42:0/3894798771 wait complete. 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03cc81e800 1 Processor -- start 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03cc81e800 1 -- start start 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03cc81e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882975690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03cc81e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b882779160 con 0x55b88287ead0 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03c7e27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882975690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03c7e27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882975690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53874/0 (socket says 172.21.15.42:53874) 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03c7e27640 1 -- 172.21.15.42:0/2055221709 learned_addr learned my addr 172.21.15.42:0/2055221709 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03c7e27640 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b882885f20 con 0x55b88287ead0 2024-02-16T00:12:27.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.403+0000 7f03c7e27640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882975690 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005870 tx=0x7f03b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.404+0000 7f02affff640 1 -- 172.21.15.42:0/2055221709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b806c070 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.404+0000 7f02affff640 1 -- 172.21.15.42:0/2055221709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b805d690 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.404+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b882975bd0 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.404+0000 7f02affff640 1 -- 172.21.15.42:0/2055221709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b805d930 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.404+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b882976110 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.404+0000 7f02affff640 1 -- 172.21.15.42:0/2055221709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f03b8059040 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f02affff640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02b0036790 0x7f02b0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f02affff640 1 -- 172.21.15.42:0/2055221709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f03b808d960 con 0x55b88287ead0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f03c7626640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02b0036790 0x7f02b0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b882881400 0x55b88297c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b88297c9b0 con 0x55b882881400 2024-02-16T00:12:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f03c8628640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b882881400 0x55b88297c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f03c7626640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02b0036790 0x7f02b0038c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f03bc000f60 tx=0x7f03bc001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.405+0000 7f03c8628640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b882881400 0x55b88297c470 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.406+0000 7f03c8628640 1 -- 172.21.15.42:0/2055221709 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b882881400 2024-02-16T00:12:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.406+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b882979a30 con 0x55b882881400 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.406+0000 7f03c8628640 1 -- 172.21.15.42:0/2055221709 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b882881400 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.406+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88297ebf0 0x55b882980fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.406+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829816b0 con 0x55b88297ebf0 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.406+0000 7f03c7e27640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88297ebf0 0x55b882980fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.407+0000 7f03c7e27640 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88297ebf0 0x55b882980fe0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.407+0000 7f03c7e27640 1 -- 172.21.15.42:0/2055221709 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f03b805c440 con 0x55b88297ebf0 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.407+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b88297db70 con 0x55b882881400 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.407+0000 7f03c8628640 1 -- 172.21.15.42:0/2055221709 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b882881400 2024-02-16T00:12:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.407+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b88297df80 con 0x55b882881400 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.407+0000 7f03c8628640 1 -- 172.21.15.42:0/2055221709 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b882881400 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03cc81e800 1 Processor -- start 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03cc81e800 1 -- start start 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03cc81e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 0x55b8829908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03cc81e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88271be80 con 0x55b8829904a0 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03c8628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 0x55b8829908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03c8628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 0x55b8829908c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53886/0 (socket says 172.21.15.42:53886) 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.408+0000 7f03c8628640 1 -- 172.21.15.42:0/595050522 learned_addr learned my addr 172.21.15.42:0/595050522 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f03c8628640 1 -- 172.21.15.42:0/595050522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b882990e00 con 0x55b8829904a0 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f03c8628640 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 0x55b8829908c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55b88297cd10 tx=0x7f03c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f02ad7fa640 1 -- 172.21.15.42:0/595050522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c001d070 con 0x55b8829904a0 2024-02-16T00:12:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f02ad7fa640 1 -- 172.21.15.42:0/595050522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c00182e0 con 0x55b8829904a0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b882991870 con 0x55b8829904a0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f02ad7fa640 1 -- 172.21.15.42:0/595050522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c00145e0 con 0x55b8829904a0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.409+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b882991d30 con 0x55b8829904a0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f02ad7fa640 1 -- 172.21.15.42:0/595050522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f03c0020020 con 0x55b8829904a0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f02ad7fa640 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02a00367e0 0x7f02a0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f02ad7fa640 1 -- 172.21.15.42:0/595050522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f03c004dd70 con 0x55b8829904a0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f03c7e27640 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02a00367e0 0x7f02a0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f03cc81e800 1 Processor -- start 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f03cc81e800 1 -- start start 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.410+0000 7f03c7e27640 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02a00367e0 0x7f02a0038ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55b88297cd80 tx=0x7f03b8070410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03cc81e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b88287c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03cc81e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8826f15d0 con 0x55b88287e1d0 2024-02-16T00:12:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03c8628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b88287c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03c8628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b88287c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53890/0 (socket says 172.21.15.42:53890) 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03c8628640 1 -- 172.21.15.42:0/3955835583 learned_addr learned my addr 172.21.15.42:0/3955835583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03c8628640 1 -- 172.21.15.42:0/3955835583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88287e640 con 0x55b88287e1d0 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f03c8628640 1 --2- 172.21.15.42:0/3955835583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b88287c8c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f03c004c020 tx=0x7f03c0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211fd9b9df9f8165 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f02a6ffd640 1 -- 172.21.15.42:0/3955835583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c004d070 con 0x55b88287e1d0 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f02a6ffd640 1 -- 172.21.15.42:0/3955835583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0016440 con 0x55b88287e1d0 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.411+0000 7f02a6ffd640 1 -- 172.21.15.42:0/3955835583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c0014b10 con 0x55b88287e1d0 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- 172.21.15.42:0/3955835583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 msgr2=0x55b88287c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 --2- 172.21.15.42:0/3955835583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b88287c8c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f03c004c020 tx=0x7f03c0011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- 172.21.15.42:0/3955835583 shutdown_connections 2024-02-16T00:12:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 --2- 172.21.15.42:0/3955835583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b88287c8c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- 172.21.15.42:0/3955835583 >> 172.21.15.42:0/3955835583 conn(0x55b882999a40 msgr2=0x55b882997aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- 172.21.15.42:0/3955835583 shutdown_connections 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- 172.21.15.42:0/3955835583 wait complete. 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 Processor -- start 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- start start 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b8829a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.412+0000 7f03cc81e800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8829a6da0 con 0x55b88287e1d0 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03c8628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b8829a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03c8628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b8829a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53896/0 (socket says 172.21.15.42:53896) 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 learned_addr learned my addr 172.21.15.42:0/754256888 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b882991d30 con 0x55b88287e1d0 2024-02-16T00:12:27.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03c8628640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b8829a6860 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f03c004bf50 tx=0x7f03c004bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f02a57fa640 1 -- 172.21.15.42:0/754256888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c0032070 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f02a57fa640 1 -- 172.21.15.42:0/754256888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c00116f0 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f02a57fa640 1 -- 172.21.15.42:0/754256888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03c00133b0 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b8829a6fa0 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.413+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8829a7400 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.414+0000 7f02a57fa640 1 -- 172.21.15.42:0/754256888 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f03c0013510 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.414+0000 7f02a57fa640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02900367e0 0x7f0290038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f02a57fa640 1 -- 172.21.15.42:0/754256888 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f03c0037d20 con 0x55b88287e1d0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f03c7e27640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02900367e0 0x7f0290038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b8829b2540 0x55b8829b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b5150 con 0x55b8829b2540 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f03c7e27640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02900367e0 0x7f0290038ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03b8052970 tx=0x7f03b8080000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.415+0000 7f03c7626640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b8829b2540 0x55b8829b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03c7626640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b8829b2540 0x55b8829b4a00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 realm 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b19a0 con 0x55b8829b2540 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b5bd0 con 0x55b8829b2540 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.416+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b6450 con 0x55b8829b2540 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b8829b6e30 0x55b8829b9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03c8628640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b8829b6e30 0x55b8829b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03c8628640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b8829b6e30 0x55b8829b9220 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 20 searching for the correct realm 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b8829bbc10 0x55b8829be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.417+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829be7a0 con 0x55b8829bbc10 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.418+0000 7f03c7e27640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b8829bbc10 0x55b8829be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.418+0000 7f03c7e27640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b8829bbc10 0x55b8829be0d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.418+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.418+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829be7a0 con 0x55b8829b6e30 2024-02-16T00:12:27.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.419+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.419+0000 7f03c8628640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03c0014070 0x7f03c0026640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.419+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.419+0000 7f03c7626640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03c0014070 0x7f03c0026640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.419+0000 7f03c7626640 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03c0014070 0x7f03c0026640 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.420+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.420+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.420+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.420+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.420+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.420+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.421+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.422+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.422+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.422+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.422+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.422+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.422+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.423+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.424+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.425+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.426+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.426+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.426+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.426+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.426+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829bbc10 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x7f03c0014070 2024-02-16T00:12:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.427+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b2540 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829b9920 con 0x55b8829b6e30 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829ba010 con 0x55b8829b2540 2024-02-16T00:12:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.428+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829ba3c0 con 0x55b8829b2540 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829ba7a0 con 0x55b8829b2540 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 zone default found 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 4 Realm: () 2024-02-16T00:12:27.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 zonegroup default 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829bebe0 con 0x7f03c0014070 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.429+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c0a60 con 0x55b8829bbc10 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c0dc0 con 0x55b8829bbc10 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 20 started sync module instance, tier type = 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.430+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c0030 con 0x55b8829b6e30 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.431+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.431+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250953606160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c0030 con 0x55b8829b6e30 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.431+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c1770 con 0x55b8829b2540 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.432+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250953606160] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.433+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.433+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250953609872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c0030 con 0x55b8829b2540 2024-02-16T00:12:27.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.433+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c21e0 con 0x55b8829bbc10 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.434+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.434+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250953612480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c2a30 con 0x55b8829bbc10 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.434+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c34b0 con 0x55b8829b6e30 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.434+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250953609872] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.435+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.435+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250953617328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c3860 con 0x55b8829b6e30 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.435+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c42b0 con 0x55b8829b2540 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.435+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250953612480] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.436+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250953617328] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.436+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.436+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250953603984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c4270 con 0x55b8829b2540 2024-02-16T00:12:27.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.436+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c4b00 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.438+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250953603984] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.438+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.438+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250953620880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c4710 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.438+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c51b0 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.439+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250953620880] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.439+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.439+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250953624720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c5390 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.439+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c5b90 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250953624720] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250953626512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c5c50 con 0x7f03c0014070 2024-02-16T00:12:27.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=0 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=1 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=2 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=3 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=4 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=5 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.440+0000 7f03cc81e800 20 add_watcher() i=6 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.441+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250953626512] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.441+0000 7f03cc81e800 20 add_watcher() i=7 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.441+0000 7f03cc81e800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.441+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c90b0 con 0x55b8829b2540 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.442+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.442+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250953640624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c5dc0 con 0x55b8829b2540 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250953640624] v29'220 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f027dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 5 note: GC not initialized 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f027cfe1640 20 reqs_thread_entry: start 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:27.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 20 Filter name: none 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f01f67fc640 20 reqs_thread_entry: start 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.443+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829fb0d0 con 0x7f03c0014070 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829f9780 con 0x7f03c0014070 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.444+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829fa000 con 0x7f03c0014070 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.445+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v29'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.445+0000 7f03cc81e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.445+0000 7f03cc81e800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:12:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.445+0000 7f03cc81e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.445+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94250953841504 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829f9f80 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== watch-notify(notify (1) cookie 94250953620880 notify 124554051608 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f03bc038040 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f02a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94250953620880 notifier 4733 bl.length()=523 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f02a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f02a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f02a6ffd640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f028c003e90 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(65 notify.5 [notify cookie 94250953841504 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== watch-notify(notify_complete (2) cookie 94250953841504 notify 124554051608 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f03bc006070 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.446+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829f9fb0 con 0x7f03c0014070 2024-02-16T00:12:27.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.447+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'11 uv11 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.447+0000 7f03cc81e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.447+0000 7f03cc81e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.447+0000 7f03cc81e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.447+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94250953841424 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829f9f30 con 0x55b8829bbc10 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== watch-notify(notify (1) cookie 94250953612480 notify 124554051593 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f03b8084040 con 0x55b8829bbc10 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f02a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94250953612480 notifier 4733 bl.length()=177 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f02a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f02a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(68 notify.2 [notify cookie 94250953841424 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f02a67fc640 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f01fc0033f0 con 0x55b8829bbc10 2024-02-16T00:12:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.448+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== watch-notify(notify_complete (2) cookie 94250953841424 notify 124554051593 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b882976110 con 0x55b8829bbc10 2024-02-16T00:12:27.466 INFO:teuthology.orchestra.run.smithi042.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.449+0000 7f027dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.449+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250953640624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c80e0 con 0x55b8829b2540 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.450+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94250953640624] v29'221 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.450+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250953606160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c8ab0 con 0x55b8829b6e30 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.451+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94250953606160] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.451+0000 7f03cc81e800 20 remove_watcher() i=0 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.451+0000 7f03cc81e800 2 removed watcher, disabling cache 2024-02-16T00:12:27.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.451+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250953609872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c0410 con 0x55b8829b2540 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.452+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94250953609872] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.452+0000 7f03cc81e800 20 remove_watcher() i=1 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.452+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250953612480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c1290 con 0x55b8829bbc10 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.453+0000 7f03c7e27640 1 -- 172.21.15.42:0/754256888 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94250953612480] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b809e040 con 0x55b8829bbc10 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.453+0000 7f03cc81e800 20 remove_watcher() i=2 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.453+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250953617328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c1290 con 0x55b8829b6e30 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.454+0000 7f03c8628640 1 -- 172.21.15.42:0/754256888 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94250953617328] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03c000a4a0 con 0x55b8829b6e30 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.454+0000 7f03cc81e800 20 remove_watcher() i=3 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.454+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250953603984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c1290 con 0x55b8829b2540 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.455+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94250953603984] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x55b8829b2540 2024-02-16T00:12:27.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.455+0000 7f03cc81e800 20 remove_watcher() i=4 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.456+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250953620880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829bfb90 con 0x7f03c0014070 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.457+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94250953620880] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc00f610 con 0x7f03c0014070 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.457+0000 7f03cc81e800 20 remove_watcher() i=5 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.457+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250953624720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c1290 con 0x7f03c0014070 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.458+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94250953624720] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc048040 con 0x7f03c0014070 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.458+0000 7f03cc81e800 20 remove_watcher() i=6 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.458+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250953626512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b8829c4c90 con 0x7f03c0014070 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94250953626512] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc048040 con 0x7f03c0014070 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 20 remove_watcher() i=7 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03c0014070 msgr2=0x7f03c0026640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f03c0014070 0x7f03c0026640 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b8829b2540 msgr2=0x55b8829b4a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b8829b2540 0x55b8829b4a00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b8829b6e30 msgr2=0x55b8829b9220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b8829b6e30 0x55b8829b9220 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b8829bbc10 msgr2=0x55b8829be0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55b8829bbc10 0x55b8829be0d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02900367e0 msgr2=0x7f0290038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02900367e0 0x7f0290038ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03b8052970 tx=0x7f03b8080000 comp rx=0 tx=0).stop 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 msgr2=0x55b8829a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03c7626640 1 -- 172.21.15.42:0/754256888 reap_dead start 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b8829a6860 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f03c004bf50 tx=0x7f03c004bf80 comp rx=0 tx=0).stop 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 shutdown_connections 2024-02-16T00:12:27.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 --2- 172.21.15.42:0/754256888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287e1d0 0x55b8829a6860 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 >> 172.21.15.42:0/754256888 conn(0x55b882999a40 msgr2=0x55b8829970a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 shutdown_connections 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.459+0000 7f03cc81e800 1 -- 172.21.15.42:0/754256888 wait complete. 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02a00367e0 msgr2=0x7f02a0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02a00367e0 0x7f02a0038ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55b88297cd80 tx=0x7f03b8070410 comp rx=0 tx=0).stop 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 msgr2=0x55b8829908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 0x55b8829908c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55b88297cd10 tx=0x7f03c0018830 comp rx=0 tx=0).stop 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 shutdown_connections 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02a00367e0 0x7f02a0038ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/595050522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8829904a0 0x55b8829908c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 >> 172.21.15.42:0/595050522 conn(0x55b882984540 msgr2=0x55b882984940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 shutdown_connections 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/595050522 wait complete. 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b882881400 msgr2=0x55b88297c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b882881400 0x55b88297c470 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88297ebf0 msgr2=0x55b882980fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88297ebf0 0x55b882980fe0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02b0036790 msgr2=0x7f02b0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02b0036790 0x7f02b0038c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f03bc000f60 tx=0x7f03bc001370 comp rx=0 tx=0).stop 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 msgr2=0x55b882975690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882975690 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005870 tx=0x7f03b8002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 shutdown_connections 2024-02-16T00:12:27.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55b88297ebf0 0x55b882980fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55b882881400 0x55b88297c470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f02b0036790 0x7f02b0038c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 --2- 172.21.15.42:0/2055221709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b88287ead0 0x55b882975690 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 >> 172.21.15.42:0/2055221709 conn(0x55b882878520 msgr2=0x55b882968260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 shutdown_connections 2024-02-16T00:12:27.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.460+0000 7f03cc81e800 1 -- 172.21.15.42:0/2055221709 wait complete. 2024-02-16T00:12:27.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T00:12:27.492 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:12:27.497 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-02-16T00:12:27.497 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-16T00:12:27.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-16T00:12:27.497 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-02-16T00:12:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:27.541 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ecc24800 1 Processor -- start 2024-02-16T00:12:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ecc24800 1 -- start start 2024-02-16T00:12:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ecc24800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559494e89320 0x559494e8b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ecc24800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559494dd0ba0 con 0x559494e84e90 2024-02-16T00:12:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ecc24800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x559494d88450 con 0x559494e89320 2024-02-16T00:12:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14e9f22640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559494e89320 0x559494e8b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ea723640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x559494e84e90 0x559494e852b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53570/0 (socket says 172.21.15.42:53570) 2024-02-16T00:12:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14ea723640 1 -- 172.21.15.42:0/1413977243 learned_addr learned my addr 172.21.15.42:0/1413977243 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14e9f22640 1 -- 172.21.15.42:0/1413977243 >> v1:172.21.15.2:6789/0 conn(0x559494e84e90 legacy=0x559494e852b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.540+0000 7f14e9f22640 1 -- 172.21.15.42:0/1413977243 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559494e8cd40 con 0x559494e89320 2024-02-16T00:12:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.542+0000 7f14e9f22640 1 --2- 172.21.15.42:0/1413977243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e89320 0x559494e8b710 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f14e000a470 tx=0x7f14e001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6971f969d103dd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.542+0000 7f14e9721640 1 -- 172.21.15.42:0/1413977243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e0052570 con 0x559494e89320 2024-02-16T00:12:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.542+0000 7f14e9721640 1 -- 172.21.15.42:0/1413977243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e00526d0 con 0x559494e89320 2024-02-16T00:12:27.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.542+0000 7f14e9721640 1 -- 172.21.15.42:0/1413977243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e0052990 con 0x559494e89320 2024-02-16T00:12:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 -- 172.21.15.42:0/1413977243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e89320 msgr2=0x559494e8b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1413977243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e89320 0x559494e8b710 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f14e000a470 tx=0x7f14e001cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 -- 172.21.15.42:0/1413977243 shutdown_connections 2024-02-16T00:12:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1413977243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e89320 0x559494e8b710 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 -- 172.21.15.42:0/1413977243 >> 172.21.15.42:0/1413977243 conn(0x559494e804f0 msgr2=0x559494e82910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 -- 172.21.15.42:0/1413977243 shutdown_connections 2024-02-16T00:12:27.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.543+0000 7f14ecc24800 1 -- 172.21.15.42:0/1413977243 wait complete. 2024-02-16T00:12:27.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.554+0000 7f14ecc24800 1 Processor -- start 2024-02-16T00:12:27.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.554+0000 7f14ecc24800 1 -- start start 2024-02-16T00:12:27.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.555+0000 7f14ecc24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494df8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.555+0000 7f14ecc24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559494d85980 con 0x559494e84e90 2024-02-16T00:12:27.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.555+0000 7f14ea723640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494df8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.555+0000 7f14ea723640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494df8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53924/0 (socket says 172.21.15.42:53924) 2024-02-16T00:12:27.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.555+0000 7f14ea723640 1 -- 172.21.15.42:0/1492469526 learned_addr learned my addr 172.21.15.42:0/1492469526 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.555+0000 7f14ea723640 1 -- 172.21.15.42:0/1492469526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0005d20 con 0x559494e84e90 2024-02-16T00:12:27.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.556+0000 7f14ea723640 1 --2- 172.21.15.42:0/1492469526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494df8f50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f14dc001bf0 tx=0x7f14dc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455da305f77e7f7c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.556+0000 7f13d8608640 1 -- 172.21.15.42:0/1492469526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14dc00e470 con 0x559494e84e90 2024-02-16T00:12:27.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.556+0000 7f13d8608640 1 -- 172.21.15.42:0/1492469526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc00e5f0 con 0x559494e84e90 2024-02-16T00:12:27.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.556+0000 7f13d8608640 1 -- 172.21.15.42:0/1492469526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14dc00e910 con 0x559494e84e90 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- 172.21.15.42:0/1492469526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 msgr2=0x559494df8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1492469526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494df8f50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f14dc001bf0 tx=0x7f14dc00b6c0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- 172.21.15.42:0/1492469526 shutdown_connections 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1492469526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494df8f50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- 172.21.15.42:0/1492469526 >> 172.21.15.42:0/1492469526 conn(0x559494e804f0 msgr2=0x559494f707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- 172.21.15.42:0/1492469526 shutdown_connections 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- 172.21.15.42:0/1492469526 wait complete. 2024-02-16T00:12:27.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 Processor -- start 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- start start 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494f7d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.557+0000 7f14ecc24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559494d81160 con 0x559494e84e90 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ea723640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494f7d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ea723640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494f7d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53928/0 (socket says 172.21.15.42:53928) 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ea723640 1 -- 172.21.15.42:0/1177439249 learned_addr learned my addr 172.21.15.42:0/1177439249 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ea723640 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559494dd0ba0 con 0x559494e84e90 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ea723640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494f7d6d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f14dc000f60 tx=0x7f14dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f13d6e05640 1 -- 172.21.15.42:0/1177439249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14dc01f070 con 0x559494e84e90 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f13d6e05640 1 -- 172.21.15.42:0/1177439249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0197c0 con 0x559494e84e90 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559494f7dc10 con 0x559494e84e90 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f13d6e05640 1 -- 172.21.15.42:0/1177439249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14dc019a60 con 0x559494e84e90 2024-02-16T00:12:27.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.558+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559494f7e0f0 con 0x559494e84e90 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.559+0000 7f13d6e05640 1 -- 172.21.15.42:0/1177439249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f14dc019bc0 con 0x559494e84e90 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.559+0000 7f13d6e05640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13d00367e0 0x7f13d0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.559+0000 7f13d6e05640 1 -- 172.21.15.42:0/1177439249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f14dc04c7c0 con 0x559494e84e90 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14e9f22640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13d00367e0 0x7f13d0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494e89320 0x559494f84430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494f84a20 con 0x559494e89320 2024-02-16T00:12:27.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14eaf24640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494e89320 0x559494f84430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14e9f22640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13d00367e0 0x7f13d0038ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f14e0054000 tx=0x7f14e004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14eaf24640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494e89320 0x559494f84430 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14eaf24640 1 -- 172.21.15.42:0/1177439249 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f14e400a4a0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.560+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494f81ae0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.561+0000 7f14eaf24640 1 -- 172.21.15.42:0/1177439249 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f14e400a4a0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.561+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494f86c60 0x559494f89050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.561+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494f89750 con 0x559494f86c60 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.561+0000 7f14ea723640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494f86c60 0x559494f89050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.561+0000 7f14ea723640 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494f86c60 0x559494f89050 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.561+0000 7f14ea723640 1 -- 172.21.15.42:0/1177439249 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f14dc00d590 con 0x559494f86c60 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.562+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494f85be0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.562+0000 7f14eaf24640 1 -- 172.21.15.42:0/1177439249 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f14e400a4a0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.562+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494f85fd0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.562+0000 7f14eaf24640 1 -- 172.21.15.42:0/1177439249 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f14e400a4a0 con 0x559494e89320 2024-02-16T00:12:27.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.562+0000 7f14ecc24800 1 Processor -- start 2024-02-16T00:12:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14ecc24800 1 -- start start 2024-02-16T00:12:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14ecc24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 0x559494f74ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14ecc24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559494d23e80 con 0x559494f76830 2024-02-16T00:12:27.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14eaf24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 0x559494f74ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14eaf24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 0x559494f74ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53938/0 (socket says 172.21.15.42:53938) 2024-02-16T00:12:27.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14eaf24640 1 -- 172.21.15.42:0/1276705474 learned_addr learned my addr 172.21.15.42:0/1276705474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.563+0000 7f14eaf24640 1 -- 172.21.15.42:0/1276705474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559494f751e0 con 0x559494f76830 2024-02-16T00:12:27.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.564+0000 7f14eaf24640 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 0x559494f74ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x559494f7e780 tx=0x7f14e4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.564+0000 7f13cffff640 1 -- 172.21.15.42:0/1276705474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e401d070 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.564+0000 7f13cffff640 1 -- 172.21.15.42:0/1276705474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40182e0 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.564+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559494f753d0 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.564+0000 7f13cffff640 1 -- 172.21.15.42:0/1276705474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e4014580 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.564+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559494f75890 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f13cffff640 1 -- 172.21.15.42:0/1276705474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f14e4020020 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f13cffff640 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13c4036790 0x7f13c4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f13cffff640 1 -- 172.21.15.42:0/1276705474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f14e404dcb0 con 0x559494f76830 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f14ea723640 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13c4036790 0x7f13c4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f14ecc24800 1 Processor -- start 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f14ecc24800 1 -- start start 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f14ea723640 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13c4036790 0x7f13c4038c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x559494f84df0 tx=0x7f14dc019ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f14ecc24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fa7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.565+0000 7f14ecc24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559494cf95d0 con 0x559494fa7950 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f14eaf24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fa7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f14eaf24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fa7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53954/0 (socket says 172.21.15.42:53954) 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f14eaf24640 1 -- 172.21.15.42:0/3165131912 learned_addr learned my addr 172.21.15.42:0/3165131912 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f14eaf24640 1 -- 172.21.15.42:0/3165131912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559494fa8340 con 0x559494fa7950 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f14eaf24640 1 --2- 172.21.15.42:0/3165131912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fa7d70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f14e404bff0 tx=0x7f14e4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b282e06292c67f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f13cdffb640 1 -- 172.21.15.42:0/3165131912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e404d070 con 0x559494fa7950 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f13cdffb640 1 -- 172.21.15.42:0/3165131912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e4016440 con 0x559494fa7950 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.566+0000 7f13cdffb640 1 -- 172.21.15.42:0/3165131912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e402b350 con 0x559494fa7950 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- 172.21.15.42:0/3165131912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 msgr2=0x559494fa7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3165131912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fa7d70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f14e404bff0 tx=0x7f14e4011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- 172.21.15.42:0/3165131912 shutdown_connections 2024-02-16T00:12:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3165131912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fa7d70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- 172.21.15.42:0/3165131912 >> 172.21.15.42:0/3165131912 conn(0x559494fa3c20 msgr2=0x559494fa1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- 172.21.15.42:0/3165131912 shutdown_connections 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- 172.21.15.42:0/3165131912 wait complete. 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 Processor -- start 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- start start 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.567+0000 7f14ecc24800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559494faedc0 con 0x559494fa7950 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f14eaf24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f14eaf24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53960/0 (socket says 172.21.15.42:53960) 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 learned_addr learned my addr 172.21.15.42:0/3388873182 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559494f75890 con 0x559494fa7950 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f14eaf24640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fae880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f14e404bf50 tx=0x7f14e404bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f13bbfff640 1 -- 172.21.15.42:0/3388873182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e4033070 con 0x559494fa7950 2024-02-16T00:12:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f13bbfff640 1 -- 172.21.15.42:0/3388873182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e4014940 con 0x559494fa7950 2024-02-16T00:12:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559494faefc0 con 0x559494fa7950 2024-02-16T00:12:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.568+0000 7f13bbfff640 1 -- 172.21.15.42:0/3388873182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e4014be0 con 0x559494fa7950 2024-02-16T00:12:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.569+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559494faf480 con 0x559494fa7950 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.569+0000 7f13bbfff640 1 -- 172.21.15.42:0/3388873182 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f14e4022710 con 0x559494fa7950 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.569+0000 7f13bbfff640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13b40367e0 0x7f13b4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.569+0000 7f13bbfff640 1 -- 172.21.15.42:0/3388873182 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f14e4039d30 con 0x559494fa7950 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.569+0000 7f14ea723640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13b40367e0 0x7f13b4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.570+0000 7f14ea723640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13b40367e0 0x7f13b4038ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14dc020000 tx=0x7f14dc040000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.570+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.570+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494fba600 0x559494fbcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.570+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fbd210 con 0x559494fba600 2024-02-16T00:12:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.570+0000 7f14e9f22640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494fba600 0x559494fbcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.570+0000 7f14e9f22640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494fba600 0x559494fbcac0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 realm 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fbd5a0 con 0x559494fba600 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fbde20 con 0x559494fba600 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fbe180 con 0x559494fba600 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494fbee90 0x559494fc1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.571+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14eaf24640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494fbee90 0x559494fc1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14eaf24640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494fbee90 0x559494fc1280 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f14e400a4a0 con 0x559494fbee90 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14ecc24800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14ecc24800 20 searching for the correct realm 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559494fc3be0 0x559494fc60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc6770 con 0x559494fc3be0 2024-02-16T00:12:27.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.572+0000 7f14ea723640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559494fc3be0 0x559494fc60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.573+0000 7f14ea723640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559494fc3be0 0x559494fc60a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.573+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.573+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc6770 con 0x559494fbee90 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.573+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e400a4a0 con 0x559494fbee90 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.573+0000 7f14eaf24640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f14e4014070 0x7f14e4023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.573+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.574+0000 7f14e9f22640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f14e4014070 0x7f14e4023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.574+0000 7f14e9f22640 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f14e4014070 0x7f14e4023420 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.574+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.574+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e4061040 con 0x559494fbee90 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.575+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.576+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e4061040 con 0x559494fbee90 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.576+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.576+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.576+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.576+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.576+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f14e4061040 con 0x559494fbee90 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.577+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.578+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e4061040 con 0x559494fbee90 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.579+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e4061040 con 0x559494fbee90 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.580+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.581+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.581+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.581+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.581+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fc3be0 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.581+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.581+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x7f14e4014070 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fba600 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc18d0 con 0x559494fbee90 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc1fe0 con 0x559494fba600 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.582+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc2390 con 0x559494fba600 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc2770 con 0x559494fba600 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 zone default found 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 4 Realm: () 2024-02-16T00:12:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 zonegroup default 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc6bb0 con 0x7f14e4014070 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.583+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc3160 con 0x559494fc3be0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc8b60 con 0x559494fc3be0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 20 started sync module instance, tier type = 2024-02-16T00:12:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.584+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc8000 con 0x559494fbee90 2024-02-16T00:12:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.585+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.585+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94096643097792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc8f80 con 0x559494fbee90 2024-02-16T00:12:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.585+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9780 con 0x559494fba600 2024-02-16T00:12:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.586+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94096643097792] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.586+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.586+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94096643100544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9840 con 0x559494fba600 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.586+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fca1b0 con 0x559494fc3be0 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.587+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94096643100544] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.587+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.588+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94096643101600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc97c0 con 0x559494fc3be0 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.588+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcafc0 con 0x559494fbee90 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.589+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.589+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94096643101600] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.589+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94096643108096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcb760 con 0x559494fbee90 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.589+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fca550 con 0x559494fba600 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.590+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94096643108096] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.590+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.590+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94096643109312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fca550 con 0x559494fba600 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.590+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcc7c0 con 0x7f14e4014070 2024-02-16T00:12:27.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.591+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.591+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94096643113760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcc740 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.591+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcd700 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.591+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94096643109312] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.592+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94096643113760] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.592+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.592+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94096643117536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcd6c0 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.592+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fccc90 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94096643117536] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94096643112208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fccc90 con 0x7f14e4014070 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=0 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=1 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=2 2024-02-16T00:12:27.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=3 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=4 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=5 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.593+0000 7f14ecc24800 20 add_watcher() i=6 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.594+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94096643112208] v29'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.594+0000 7f14ecc24800 20 add_watcher() i=7 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.594+0000 7f14ecc24800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.594+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fd10d0 con 0x559494fba600 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.595+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.595+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94096643119792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fce420 con 0x559494fba600 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94096643119792] v29'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f13a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 5 note: GC not initialized 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f131b7fe640 20 reqs_thread_entry: start 2024-02-16T00:12:27.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 20 Filter name: none 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f13197fa640 20 reqs_thread_entry: start 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.596+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559495003030 con 0x559494fbee90 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.597+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(62 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.597+0000 7f14ecc24800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.597+0000 7f14ecc24800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.597+0000 7f14ecc24800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.597+0000 7f14ecc24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.597+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559495006d40 con 0x7f14e4014070 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.598+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v29'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.599+0000 7f13a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.599+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94096643119792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fd0710 con 0x559494fba600 2024-02-16T00:12:27.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.600+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94096643119792] v29'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.600+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94096643097792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fcdab0 con 0x559494fbee90 2024-02-16T00:12:27.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.601+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94096643097792] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.601+0000 7f14ecc24800 20 remove_watcher() i=0 2024-02-16T00:12:27.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.601+0000 7f14ecc24800 2 removed watcher, disabling cache 2024-02-16T00:12:27.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.601+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94096643100544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc84c0 con 0x559494fba600 2024-02-16T00:12:27.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.602+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94096643100544] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.602+0000 7f14ecc24800 20 remove_watcher() i=1 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.602+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94096643101600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc84c0 con 0x559494fc3be0 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.603+0000 7f14ea723640 1 -- 172.21.15.42:0/3388873182 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94096643101600] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14dc044040 con 0x559494fc3be0 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.603+0000 7f14ecc24800 20 remove_watcher() i=2 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.603+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94096643108096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9420 con 0x559494fbee90 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.604+0000 7f14eaf24640 1 -- 172.21.15.42:0/3388873182 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94096643108096] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e406b040 con 0x559494fbee90 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.604+0000 7f14ecc24800 20 remove_watcher() i=3 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.604+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94096643109312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9420 con 0x559494fba600 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.605+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94096643109312] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x559494fba600 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.605+0000 7f14ecc24800 20 remove_watcher() i=4 2024-02-16T00:12:27.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.605+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94096643113760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9420 con 0x7f14e4014070 2024-02-16T00:12:27.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.607+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94096643113760] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.607+0000 7f14ecc24800 20 remove_watcher() i=5 2024-02-16T00:12:27.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.607+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94096643117536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9420 con 0x7f14e4014070 2024-02-16T00:12:27.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.608+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94096643117536] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.608+0000 7f14ecc24800 20 remove_watcher() i=6 2024-02-16T00:12:27.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.608+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94096643112208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559494fc9420 con 0x7f14e4014070 2024-02-16T00:12:27.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94096643112208] v29'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14e0059040 con 0x7f14e4014070 2024-02-16T00:12:27.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 20 remove_watcher() i=7 2024-02-16T00:12:27.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f14e4014070 msgr2=0x7f14e4023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f14e4014070 0x7f14e4023420 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494fba600 msgr2=0x559494fbcac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494fba600 0x559494fbcac0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494fbee90 msgr2=0x559494fc1280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494fbee90 0x559494fc1280 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559494fc3be0 msgr2=0x559494fc60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559494fc3be0 0x559494fc60a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13b40367e0 msgr2=0x7f13b4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13b40367e0 0x7f13b4038ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14dc020000 tx=0x7f14dc040000 comp rx=0 tx=0).stop 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 msgr2=0x559494fae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/3388873182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494fa7950 0x559494fae880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f14e404bf50 tx=0x7f14e404bf80 comp rx=0 tx=0).stop 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 reap_dead start 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14e9f22640 1 -- 172.21.15.42:0/3388873182 reap_dead start 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 shutdown_connections 2024-02-16T00:12:27.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 >> 172.21.15.42:0/3388873182 conn(0x559494fa3c20 msgr2=0x559494fa1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 shutdown_connections 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/3388873182 wait complete. 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13c4036790 msgr2=0x7f13c4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13c4036790 0x7f13c4038c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x559494f84df0 tx=0x7f14dc019ef0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 msgr2=0x559494f74ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 0x559494f74ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x559494f7e780 tx=0x7f14e4018830 comp rx=0 tx=0).stop 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 shutdown_connections 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13c4036790 0x7f13c4038c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1276705474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494f76830 0x559494f74ca0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 >> 172.21.15.42:0/1276705474 conn(0x559494f8c520 msgr2=0x559494f8c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 shutdown_connections 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.609+0000 7f14ecc24800 1 -- 172.21.15.42:0/1276705474 wait complete. 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494e89320 msgr2=0x559494f84430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494e89320 0x559494f84430 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494f86c60 msgr2=0x559494f89050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494f86c60 0x559494f89050 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13d00367e0 msgr2=0x7f13d0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13d00367e0 0x7f13d0038ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f14e0054000 tx=0x7f14e004e000 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 msgr2=0x559494f7d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494f7d6d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f14dc000f60 tx=0x7f14dc000bc0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 shutdown_connections 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559494f86c60 0x559494f89050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559494e89320 0x559494f84430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f13d00367e0 0x7f13d0038ca0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 --2- 172.21.15.42:0/1177439249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559494e84e90 0x559494f7d6d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 >> 172.21.15.42:0/1177439249 conn(0x559494e804f0 msgr2=0x559494f6f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 shutdown_connections 2024-02-16T00:12:27.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.610+0000 7f14ecc24800 1 -- 172.21.15.42:0/1177439249 wait complete. 2024-02-16T00:12:27.620 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T00:12:27.625 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:12:27.625 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-16T00:12:27.629 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-16T00:12:27.630 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-02-16T00:12:27.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-16T00:12:27.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-16T00:12:27.630 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-02-16T00:12:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f8f2f800 1 Processor -- start 2024-02-16T00:12:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f8f2f800 1 -- start start 2024-02-16T00:12:27.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f8f2f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cfcc588a20 0x55cfcc58ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f8f2f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cfcc4d2ba0 con 0x55cfcc58b350 2024-02-16T00:12:27.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f8f2f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cfcc48a450 con 0x55cfcc588a20 2024-02-16T00:12:27.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f4c67640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cfcc588a20 0x55cfcc58ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1effff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55cfcc58b350 0x55cfcc58d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53572/0 (socket says 172.21.15.42:53572) 2024-02-16T00:12:27.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1f4c67640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cfcc588a20 0x55cfcc58ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53968/0 (socket says 172.21.15.42:53968) 2024-02-16T00:12:27.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.671+0000 7fd1effff640 1 -- 172.21.15.42:0/38924804 learned_addr learned my addr 172.21.15.42:0/38924804 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:27.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.672+0000 7fd1f4c67640 1 -- 172.21.15.42:0/38924804 >> v1:172.21.15.2:6789/0 conn(0x55cfcc58b350 legacy=0x55cfcc58d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.672+0000 7fd1f4c67640 1 -- 172.21.15.42:0/38924804 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfcc58fe70 con 0x55cfcc588a20 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.673+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/38924804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc58ae10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800a470 tx=0x7fd1e801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5807f27e0363f351 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1ef7fe640 1 -- 172.21.15.42:0/38924804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1e8052570 con 0x55cfcc588a20 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1ef7fe640 1 -- 172.21.15.42:0/38924804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80526d0 con 0x55cfcc588a20 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1ef7fe640 1 -- 172.21.15.42:0/38924804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1e8052990 con 0x55cfcc588a20 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/38924804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 msgr2=0x55cfcc58ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/38924804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc58ae10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800a470 tx=0x7fd1e801cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/38924804 shutdown_connections 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/38924804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc58ae10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/38924804 >> 172.21.15.42:0/38924804 conn(0x55cfcc5824f0 msgr2=0x55cfcc584910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/38924804 shutdown_connections 2024-02-16T00:12:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.674+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/38924804 wait complete. 2024-02-16T00:12:27.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f8f2f800 1 Processor -- start 2024-02-16T00:12:27.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f8f2f800 1 -- start start 2024-02-16T00:12:27.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f8f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc677f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f8f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcc487980 con 0x55cfcc588a20 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f4c67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc677f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f4c67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc677f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53984/0 (socket says 172.21.15.42:53984) 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.686+0000 7fd1f4c67640 1 -- 172.21.15.42:0/1195263359 learned_addr learned my addr 172.21.15.42:0/1195263359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.687+0000 7fd1f4c67640 1 -- 172.21.15.42:0/1195263359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8005d20 con 0x55cfcc588a20 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.687+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/1195263359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc677f80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8055040 tx=0x7fd1e804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7abf6ff371d4003 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.687+0000 7fd0e2e05640 1 -- 172.21.15.42:0/1195263359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1e800a180 con 0x55cfcc588a20 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.687+0000 7fd0e2e05640 1 -- 172.21.15.42:0/1195263359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e800a300 con 0x55cfcc588a20 2024-02-16T00:12:27.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.687+0000 7fd0e2e05640 1 -- 172.21.15.42:0/1195263359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1e80529b0 con 0x55cfcc588a20 2024-02-16T00:12:27.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/1195263359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 msgr2=0x55cfcc677f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/1195263359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc677f80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8055040 tx=0x7fd1e804c000 comp rx=0 tx=0).stop 2024-02-16T00:12:27.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/1195263359 shutdown_connections 2024-02-16T00:12:27.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/1195263359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc677f80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/1195263359 >> 172.21.15.42:0/1195263359 conn(0x55cfcc5824f0 msgr2=0x55cfcc6738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/1195263359 shutdown_connections 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/1195263359 wait complete. 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 Processor -- start 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- start start 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc67f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f8f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcc483160 con 0x55cfcc588a20 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f4c67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc67f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f4c67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc67f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:53996/0 (socket says 172.21.15.42:53996) 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.688+0000 7fd1f4c67640 1 -- 172.21.15.42:0/2091438673 learned_addr learned my addr 172.21.15.42:0/2091438673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd1f4c67640 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfcc58fe70 con 0x55cfcc588a20 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc67f530 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd1e805f040 tx=0x7fd1e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd0e1602640 1 -- 172.21.15.42:0/2091438673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1e806a070 con 0x55cfcc588a20 2024-02-16T00:12:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd0e1602640 1 -- 172.21.15.42:0/2091438673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e805d420 con 0x55cfcc588a20 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cfcc67fa70 con 0x55cfcc588a20 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd0e1602640 1 -- 172.21.15.42:0/2091438673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1e805d6c0 con 0x55cfcc588a20 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.689+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfcc67ff50 con 0x55cfcc588a20 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.690+0000 7fd0e1602640 1 -- 172.21.15.42:0/2091438673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd1e805d820 con 0x55cfcc588a20 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.690+0000 7fd0e1602640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0dc036790 0x7fd0dc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.690+0000 7fd0e1602640 1 -- 172.21.15.42:0/2091438673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd1e808dce0 con 0x55cfcc588a20 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.690+0000 7fd1effff640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0dc036790 0x7fd0dc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.690+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc58b350 0x55cfcc686310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.690+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc686850 con 0x55cfcc58b350 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f5468640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc58b350 0x55cfcc686310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1effff640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0dc036790 0x7fd0dc038c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000f60 tx=0x7fd1e00012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f5468640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc58b350 0x55cfcc686310 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f5468640 1 -- 172.21.15.42:0/2091438673 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc58b350 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc686bd0 con 0x55cfcc58b350 2024-02-16T00:12:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f5468640 1 -- 172.21.15.42:0/2091438673 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc58b350 2024-02-16T00:12:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc688990 0x55cfcc68ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.691+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc68b450 con 0x55cfcc688990 2024-02-16T00:12:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.692+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc688990 0x55cfcc68ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.692+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc688990 0x55cfcc68ad80 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.692+0000 7fd1f4c67640 1 -- 172.21.15.42:0/2091438673 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc688990 2024-02-16T00:12:27.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.692+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc687910 con 0x55cfcc58b350 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.692+0000 7fd1f5468640 1 -- 172.21.15.42:0/2091438673 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc58b350 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.692+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc687d20 con 0x55cfcc58b350 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.693+0000 7fd1f5468640 1 -- 172.21.15.42:0/2091438673 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc58b350 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.693+0000 7fd1f8f2f800 1 Processor -- start 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.693+0000 7fd1f8f2f800 1 -- start start 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.693+0000 7fd1f8f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 0x55cfcc69a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.693+0000 7fd1f8f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcc425e80 con 0x55cfcc69a240 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd1f5468640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 0x55cfcc69a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd1f5468640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 0x55cfcc69a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54002/0 (socket says 172.21.15.42:54002) 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd1f5468640 1 -- 172.21.15.42:0/2354719641 learned_addr learned my addr 172.21.15.42:0/2354719641 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd1f5468640 1 -- 172.21.15.42:0/2354719641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfcc69aba0 con 0x55cfcc69a240 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd1f5468640 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 0x55cfcc69a660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55cfcc680500 tx=0x7fd1f0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd0da7fc640 1 -- 172.21.15.42:0/2354719641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1f001d070 con 0x55cfcc69a240 2024-02-16T00:12:27.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd0da7fc640 1 -- 172.21.15.42:0/2354719641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00182e0 con 0x55cfcc69a240 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cfcc69b610 con 0x55cfcc69a240 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.694+0000 7fd0da7fc640 1 -- 172.21.15.42:0/2354719641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1f00145e0 con 0x55cfcc69a240 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.695+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfcc69bad0 con 0x55cfcc69a240 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.695+0000 7fd0da7fc640 1 -- 172.21.15.42:0/2354719641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd1f0020020 con 0x55cfcc69a240 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.695+0000 7fd0da7fc640 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0cc0367e0 0x7fd0cc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.695+0000 7fd0da7fc640 1 -- 172.21.15.42:0/2354719641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd1f004dc60 con 0x55cfcc69a240 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.695+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0cc0367e0 0x7fd0cc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f8f2f800 1 Processor -- start 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f8f2f800 1 -- start start 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0cc0367e0 0x7fd0cc038ca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55cfcc683820 tx=0x7fd1e805ff70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f8f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f8f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcc3fb5d0 con 0x55cfcc6a7520 2024-02-16T00:12:27.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f5468640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f5468640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6a7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54010/0 (socket says 172.21.15.42:54010) 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f5468640 1 -- 172.21.15.42:0/3088733172 learned_addr learned my addr 172.21.15.42:0/3088733172 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.696+0000 7fd1f5468640 1 -- 172.21.15.42:0/3088733172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfcc6a7f10 con 0x55cfcc6a7520 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f5468640 1 --2- 172.21.15.42:0/3088733172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6a7940 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0013010 tx=0x7fd1f0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3689795c1f42f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd0cbfff640 1 -- 172.21.15.42:0/3088733172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1f0040500 con 0x55cfcc6a7520 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd0cbfff640 1 -- 172.21.15.42:0/3088733172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0014ac0 con 0x55cfcc6a7520 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd0cbfff640 1 -- 172.21.15.42:0/3088733172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1f002b350 con 0x55cfcc6a7520 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3088733172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 msgr2=0x55cfcc6a7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3088733172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6a7940 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0013010 tx=0x7fd1f0011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3088733172 shutdown_connections 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3088733172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6a7940 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3088733172 >> 172.21.15.42:0/3088733172 conn(0x55cfcc6a37a0 msgr2=0x55cfcc6a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3088733172 shutdown_connections 2024-02-16T00:12:27.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.697+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3088733172 wait complete. 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f8f2f800 1 Processor -- start 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f8f2f800 1 -- start start 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f8f2f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f8f2f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcc6ae920 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f5468640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f5468640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54018/0 (socket says 172.21.15.42:54018) 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 learned_addr learned my addr 172.21.15.42:0/3347292224 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.698+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfcc69bad0 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.699+0000 7fd1f5468640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6ae3e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd1f004aec0 tx=0x7fd1f004bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.699+0000 7fd0ca7fc640 1 -- 172.21.15.42:0/3347292224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1f0032070 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.699+0000 7fd0ca7fc640 1 -- 172.21.15.42:0/3347292224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0013c60 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.699+0000 7fd0ca7fc640 1 -- 172.21.15.42:0/3347292224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1f00133b0 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.699+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cfcc6aeb20 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.699+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfcc6aef80 con 0x55cfcc6a7520 2024-02-16T00:12:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd0ca7fc640 1 -- 172.21.15.42:0/3347292224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd1f0013510 con 0x55cfcc6a7520 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd0ca7fc640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0c00367e0 0x7fd0c0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd0ca7fc640 1 -- 172.21.15.42:0/3347292224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd1f0038d30 con 0x55cfcc6a7520 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0c00367e0 0x7fd0c0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc6ba1c0 0x55cfcc6bc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6bcdd0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.700+0000 7fd1effff640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc6ba1c0 0x55cfcc6bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0c00367e0 0x7fd0c0038ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1e808c2c0 tx=0x7fd1e8082000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1effff640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc6ba1c0 0x55cfcc6bc680 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 realm 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6b96a0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6bd850 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.701+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6be0d0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc6be9d0 0x55cfcc6c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c1570 con 0x55cfcc6be9d0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f5468640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc6be9d0 0x55cfcc6c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f5468640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc6be9d0 0x55cfcc6c0de0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 20 searching for the correct realm 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cfcc6c3520 0x55cfcc6c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.702+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c6010 con 0x55cfcc6c3520 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.703+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cfcc6c3520 0x55cfcc6c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.703+0000 7fd1f4c67640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cfcc6c3520 0x55cfcc6c59e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.703+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.703+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c6010 con 0x55cfcc6be9d0 2024-02-16T00:12:27.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.703+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.704+0000 7fd1f5468640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1f0057040 0x7fd1f0022740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.704+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.704+0000 7fd1effff640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1f0057040 0x7fd1f0022740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.704+0000 7fd1effff640 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1f0057040 0x7fd1f0022740 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.704+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.704+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.705+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1f000a4a0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.706+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.707+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.708+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.709+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.710+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.710+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.710+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.710+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.710+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.711+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6c3520 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x7fd1f0057040 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd1f0055040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.712+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c1940 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c1cf0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c20d0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:27.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 zone default found 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 4 Realm: () 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 zonegroup default 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.713+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c6450 con 0x7fd1f0057040 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c82d0 con 0x55cfcc6c3520 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c8630 con 0x55cfcc6c3520 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 started sync module instance, tier type = 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.714+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c78a0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.715+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.715+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350976253360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c78a0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.715+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c90b0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.716+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350976253360] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.716+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.716+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350976256944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c78a0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.716+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c9b10 con 0x55cfcc6c3520 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.718+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.718+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350976259632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6ca390 con 0x55cfcc6c3520 2024-02-16T00:12:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.718+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cae10 con 0x55cfcc6be9d0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.718+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350976256944] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.719+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.719+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350976259632] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.719+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350976264464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cb1c0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.719+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c9f10 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.720+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350976264464] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.720+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.720+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350976250880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c9f10 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.720+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cc1a0 con 0x7fd1f0057040 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.721+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350976250880] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.721+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.721+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350976268016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cc1a0 con 0x7fd1f0057040 2024-02-16T00:12:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.721+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6ccb50 con 0x7fd1f0057040 2024-02-16T00:12:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.722+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350976268016] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.722+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.722+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350976271984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6ccd30 con 0x7fd1f0057040 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.722+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cd530 con 0x7fd1f0057040 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.723+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350976271984] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350976273712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cd5f0 con 0x7fd1f0057040 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=0 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=1 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=2 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=3 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=4 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=5 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=6 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350976273712] v29'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 20 add_watcher() i=7 2024-02-16T00:12:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.724+0000 7fd1f8f2f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.725+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d0a70 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.725+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.725+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350976287824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cd760 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.726+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350976287824] v29'224 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.726+0000 7fd0aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.726+0000 7fd1f8f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.726+0000 7fd1f8f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.726+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d93a0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.727+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'57 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.727+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d9a30 con 0x7fd1f0057040 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.728+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.728+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d9e50 con 0x55cfcc6c3520 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.729+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.729+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6da820 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.730+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'225 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.730+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d5330 con 0x55cfcc6be9d0 2024-02-16T00:12:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.731+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'74 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.731+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d5300 con 0x55cfcc6c3520 2024-02-16T00:12:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.732+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'57 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.732+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6db560 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.733+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.733+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6db560 con 0x7fd1f0057040 2024-02-16T00:12:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.734+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'52 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.734+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6db560 con 0x55cfcc6be9d0 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.735+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.735+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dba90 con 0x55cfcc6c3520 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.736+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.736+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dbfc0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.737+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'75 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.738+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dc4f0 con 0x7fd1f0057040 2024-02-16T00:12:27.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.739+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.739+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dc4f0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.740+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.740+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dc630 con 0x7fd1f0057040 2024-02-16T00:12:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.741+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'63 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.741+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dc460 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.742+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'226 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.742+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6dc460 con 0x55cfcc6c3520 2024-02-16T00:12:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.743+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.743+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d74b0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.744+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'76 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.744+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d74b0 con 0x55cfcc6c3520 2024-02-16T00:12:27.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.745+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'38 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.745+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7480 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.746+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.746+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7480 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.747+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'227 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.747+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7480 con 0x55cfcc6c3520 2024-02-16T00:12:27.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.748+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.748+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d73f0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.749+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'44 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.749+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d73f0 con 0x55cfcc6c3520 2024-02-16T00:12:27.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.750+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.750+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d73f0 con 0x55cfcc6c3520 2024-02-16T00:12:27.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.751+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'44 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.751+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x55cfcc6c3520 2024-02-16T00:12:27.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.752+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.752+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x55cfcc6c3520 2024-02-16T00:12:27.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.753+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'58 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.753+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x7fd1f0057040 2024-02-16T00:12:27.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.754+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.754+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x55cfcc6c3520 2024-02-16T00:12:27.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.755+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'38 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.755+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x7fd1f0057040 2024-02-16T00:12:27.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.756+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'53 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.756+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x55cfcc6c3520 2024-02-16T00:12:27.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.757+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.757+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x7fd1f0057040 2024-02-16T00:12:27.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.758+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'64 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.758+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d7220 con 0x55cfcc6be9d0 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.759+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'33 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.759+0000 7fd0a9fe3640 20 reqs_thread_entry: start 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.759+0000 7fd1f8f2f800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.759+0000 7fd1f8f2f800 20 Filter name: none 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd01b7fe640 20 reqs_thread_entry: start 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc706110 con 0x55cfcc6be9d0 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(94 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T00:12:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc706110 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.760+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94350976322448 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc708b30 con 0x7fd1f0057040 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== watch-notify(notify (1) cookie 94350976268016 notify 124554051609 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55cfcc4d2ba0 con 0x7fd1f0057040 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd0cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94350976268016 notifier 4747 bl.length()=170 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd0cbfff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd0b8003d50 con 0x7fd1f0057040 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(96 notify.5 [notify cookie 94350976322448 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== watch-notify(notify_complete (2) cookie 94350976322448 notify 124554051609 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd1e002e5e0 con 0x7fd1f0057040 2024-02-16T00:12:27.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.761+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d8b90 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v29'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1f8f2f800 10 removing email index: 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1f8f2f800 10 removing user buckets index 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1f8f2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94350976322448 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc708b30 con 0x7fd1f0057040 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== watch-notify(notify (1) cookie 94350976271984 notify 124554051610 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7fd1e002e5e0 con 0x7fd1f0057040 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd0cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94350976271984 notifier 4747 bl.length()=160 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(99 notify.6 [notify cookie 94350976322448 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.762+0000 7fd0cb7fe640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd0280032b0 con 0x7fd1f0057040 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.763+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.763+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== watch-notify(notify_complete (2) cookie 94350976322448 notify 124554051610 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd1e002e910 con 0x7fd1f0057040 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.763+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d8b90 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(101 bud.buckets [delete] v29'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1f8f2f800 10 removing user index: bud 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1f8f2f800 10 removing default.rgw.meta+users.uid+bud from cache 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1f8f2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94350976322448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc707a80 con 0x7fd1f0057040 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== watch-notify(notify (1) cookie 94350976268016 notify 124554051611 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fd1e002e910 con 0x7fd1f0057040 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd0cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94350976268016 notifier 4747 bl.length()=152 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd0cbfff640 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd0b8003d50 con 0x7fd1f0057040 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.764+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(102 notify.5 [notify cookie 94350976322448 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.765+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.765+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== watch-notify(notify_complete (2) cookie 94350976322448 notify 124554051611 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd1e002ed70 con 0x7fd1f0057040 2024-02-16T00:12:27.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.765+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc7075e0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.766+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(104 bud [call,call,delete] v29'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.766+0000 7fd0aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.767+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350976287824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6da380 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.767+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94350976287824] v29'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.767+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350976253360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6d0450 con 0x55cfcc6be9d0 2024-02-16T00:12:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.768+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94350976253360] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.768+0000 7fd1f8f2f800 20 remove_watcher() i=0 2024-02-16T00:12:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.768+0000 7fd1f8f2f800 2 removed watcher, disabling cache 2024-02-16T00:12:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.768+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350976256944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c7db0 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.770+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94350976256944] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.770+0000 7fd1f8f2f800 20 remove_watcher() i=1 2024-02-16T00:12:27.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.770+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350976259632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c7db0 con 0x55cfcc6c3520 2024-02-16T00:12:27.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.771+0000 7fd1f4c67640 1 -- 172.21.15.42:0/3347292224 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94350976259632] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e8059040 con 0x55cfcc6c3520 2024-02-16T00:12:27.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.771+0000 7fd1f8f2f800 20 remove_watcher() i=2 2024-02-16T00:12:27.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.771+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350976264464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c7db0 con 0x55cfcc6be9d0 2024-02-16T00:12:27.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.772+0000 7fd1f5468640 1 -- 172.21.15.42:0/3347292224 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94350976264464] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1f0062040 con 0x55cfcc6be9d0 2024-02-16T00:12:27.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.772+0000 7fd1f8f2f800 20 remove_watcher() i=3 2024-02-16T00:12:27.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.772+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350976250880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6ca910 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.773+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94350976250880] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x55cfcc6ba1c0 2024-02-16T00:12:27.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.773+0000 7fd1f8f2f800 20 remove_watcher() i=4 2024-02-16T00:12:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.773+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350976268016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6c7db0 con 0x7fd1f0057040 2024-02-16T00:12:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.774+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94350976268016] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.774+0000 7fd1f8f2f800 20 remove_watcher() i=5 2024-02-16T00:12:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.774+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350976271984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cb6f0 con 0x7fd1f0057040 2024-02-16T00:12:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.775+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94350976271984] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.775+0000 7fd1f8f2f800 20 remove_watcher() i=6 2024-02-16T00:12:27.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.775+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350976273712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cfcc6cc670 con 0x7fd1f0057040 2024-02-16T00:12:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94350976273712] v29'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1e0006070 con 0x7fd1f0057040 2024-02-16T00:12:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 20 remove_watcher() i=7 2024-02-16T00:12:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1f0057040 msgr2=0x7fd1f0022740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fd1f0057040 0x7fd1f0022740 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc6ba1c0 msgr2=0x55cfcc6bc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc6ba1c0 0x55cfcc6bc680 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc6be9d0 msgr2=0x55cfcc6c0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc6be9d0 0x55cfcc6c0de0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cfcc6c3520 msgr2=0x55cfcc6c59e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cfcc6c3520 0x55cfcc6c59e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0c00367e0 msgr2=0x7fd0c0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0c00367e0 0x7fd0c0038ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1e808c2c0 tx=0x7fd1e8082000 comp rx=0 tx=0).stop 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 msgr2=0x55cfcc6ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1effff640 1 -- 172.21.15.42:0/3347292224 reap_dead start 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6ae3e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd1f004aec0 tx=0x7fd1f004bf30 comp rx=0 tx=0).stop 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 shutdown_connections 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/3347292224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc6a7520 0x55cfcc6ae3e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 >> 172.21.15.42:0/3347292224 conn(0x55cfcc6a37a0 msgr2=0x55cfcc6a0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 shutdown_connections 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.776+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/3347292224 wait complete. 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0cc0367e0 msgr2=0x7fd0cc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0cc0367e0 0x7fd0cc038ca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55cfcc683820 tx=0x7fd1e805ff70 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 msgr2=0x55cfcc69a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 0x55cfcc69a660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55cfcc680500 tx=0x7fd1f0018830 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 shutdown_connections 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0cc0367e0 0x7fd0cc038ca0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2354719641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc69a240 0x55cfcc69a660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 >> 172.21.15.42:0/2354719641 conn(0x55cfcc68e2e0 msgr2=0x55cfcc68e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 shutdown_connections 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2354719641 wait complete. 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc58b350 msgr2=0x55cfcc686310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc58b350 0x55cfcc686310 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc688990 msgr2=0x55cfcc68ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc688990 0x55cfcc68ad80 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0dc036790 msgr2=0x7fd0dc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0dc036790 0x7fd0dc038c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000f60 tx=0x7fd1e00012b0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 msgr2=0x55cfcc67f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc67f530 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd1e805f040 tx=0x7fd1e8002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 shutdown_connections 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cfcc688990 0x55cfcc68ad80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cfcc58b350 0x55cfcc686310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd0dc036790 0x7fd0dc038c50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 --2- 172.21.15.42:0/2091438673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cfcc588a20 0x55cfcc67f530 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 >> 172.21.15.42:0/2091438673 conn(0x55cfcc5824f0 msgr2=0x55cfcc6720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 shutdown_connections 2024-02-16T00:12:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.777+0000 7fd1f8f2f800 1 -- 172.21.15.42:0/2091438673 wait complete. 2024-02-16T00:12:27.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-16T00:12:27.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-16T00:12:27.788 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-02-16T00:12:27.871 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.869+0000 7f627e522800 1 Processor -- start 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f627e522800 1 -- start start 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f627e522800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56348b51c3f0 0x56348b524ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f627e522800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56348b466ba0 con 0x56348b51a8b0 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f627e522800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x56348b41e450 con 0x56348b51c3f0 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f6279ab6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56348b51c3f0 0x56348b524ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f6279ab6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x56348b51c3f0 0x56348b524ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54028/0 (socket says 172.21.15.42:54028) 2024-02-16T00:12:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f627a2b7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x56348b51a8b0 0x56348b51acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:53580/0 (socket says 172.21.15.42:53580) 2024-02-16T00:12:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f6279ab6640 1 -- 172.21.15.42:0/377600606 learned_addr learned my addr 172.21.15.42:0/377600606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f6279ab6640 1 -- 172.21.15.42:0/377600606 >> v1:172.21.15.2:6789/0 conn(0x56348b51a8b0 legacy=0x56348b51acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.870+0000 7f6279ab6640 1 -- 172.21.15.42:0/377600606 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348b48f1a0 con 0x56348b51c3f0 2024-02-16T00:12:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.872+0000 7f6279ab6640 1 --2- 172.21.15.42:0/377600606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51c3f0 0x56348b524ef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f627000a520 tx=0x7f627001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d617c07e0a758b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.872+0000 7f62792b5640 1 -- 172.21.15.42:0/377600606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6270052570 con 0x56348b51c3f0 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.872+0000 7f62792b5640 1 -- 172.21.15.42:0/377600606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62700526d0 con 0x56348b51c3f0 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.872+0000 7f62792b5640 1 -- 172.21.15.42:0/377600606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6270052990 con 0x56348b51c3f0 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 -- 172.21.15.42:0/377600606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51c3f0 msgr2=0x56348b524ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 --2- 172.21.15.42:0/377600606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51c3f0 0x56348b524ef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f627000a520 tx=0x7f627001cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 -- 172.21.15.42:0/377600606 shutdown_connections 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 --2- 172.21.15.42:0/377600606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51c3f0 0x56348b524ef0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 -- 172.21.15.42:0/377600606 >> 172.21.15.42:0/377600606 conn(0x56348b5164f0 msgr2=0x56348b518910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 -- 172.21.15.42:0/377600606 shutdown_connections 2024-02-16T00:12:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.873+0000 7f627e522800 1 -- 172.21.15.42:0/377600606 wait complete. 2024-02-16T00:12:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.884+0000 7f627e522800 1 Processor -- start 2024-02-16T00:12:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.884+0000 7f627e522800 1 -- start start 2024-02-16T00:12:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.884+0000 7f627e522800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b60e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.884+0000 7f627e522800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348b41b980 con 0x56348b51a8b0 2024-02-16T00:12:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.885+0000 7f627a2b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b60e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.885+0000 7f627a2b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b60e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54042/0 (socket says 172.21.15.42:54042) 2024-02-16T00:12:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.885+0000 7f627a2b7640 1 -- 172.21.15.42:0/2514732847 learned_addr learned my addr 172.21.15.42:0/2514732847 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.885+0000 7f627a2b7640 1 -- 172.21.15.42:0/2514732847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270005de0 con 0x56348b51a8b0 2024-02-16T00:12:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.885+0000 7f627a2b7640 1 --2- 172.21.15.42:0/2514732847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b60e2a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f626c001c80 tx=0x7f626c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778eb9499813eea0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.885+0000 7f6168608640 1 -- 172.21.15.42:0/2514732847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f626c014070 con 0x56348b51a8b0 2024-02-16T00:12:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f6168608640 1 -- 172.21.15.42:0/2514732847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00f450 con 0x56348b51a8b0 2024-02-16T00:12:27.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f6168608640 1 -- 172.21.15.42:0/2514732847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f626c00f790 con 0x56348b51a8b0 2024-02-16T00:12:27.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 -- 172.21.15.42:0/2514732847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 msgr2=0x56348b60e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 --2- 172.21.15.42:0/2514732847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b60e2a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f626c001c80 tx=0x7f626c00b600 comp rx=0 tx=0).stop 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 -- 172.21.15.42:0/2514732847 shutdown_connections 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 --2- 172.21.15.42:0/2514732847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b60e2a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 -- 172.21.15.42:0/2514732847 >> 172.21.15.42:0/2514732847 conn(0x56348b5164f0 msgr2=0x56348b609bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 -- 172.21.15.42:0/2514732847 shutdown_connections 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.886+0000 7f627e522800 1 -- 172.21.15.42:0/2514732847 wait complete. 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627e522800 1 Processor -- start 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627e522800 1 -- start start 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627e522800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b6159b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627e522800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348b417160 con 0x56348b51a8b0 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627a2b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b6159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627a2b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b6159b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54048/0 (socket says 172.21.15.42:54048) 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627a2b7640 1 -- 172.21.15.42:0/1723636824 learned_addr learned my addr 172.21.15.42:0/1723636824 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627a2b7640 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348b466ba0 con 0x56348b51a8b0 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.887+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b6159b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f626c004000 tx=0x7f626c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.888+0000 7f6166e05640 1 -- 172.21.15.42:0/1723636824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f626c014070 con 0x56348b51a8b0 2024-02-16T00:12:27.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.888+0000 7f6166e05640 1 -- 172.21.15.42:0/1723636824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c020070 con 0x56348b51a8b0 2024-02-16T00:12:27.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.888+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56348b615ef0 con 0x56348b51a8b0 2024-02-16T00:12:27.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.888+0000 7f6166e05640 1 -- 172.21.15.42:0/1723636824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f626c0198e0 con 0x56348b51a8b0 2024-02-16T00:12:27.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.888+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56348b6163d0 con 0x56348b51a8b0 2024-02-16T00:12:27.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.888+0000 7f6166e05640 1 -- 172.21.15.42:0/1723636824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f626c019a40 con 0x56348b51a8b0 2024-02-16T00:12:27.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f6166e05640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6160036790 0x7f6160038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f6166e05640 1 -- 172.21.15.42:0/1723636824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f626c008030 con 0x56348b51a8b0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f6279ab6640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6160036790 0x7f6160038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b51c3f0 0x56348b61c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b61cd10 con 0x56348b51c3f0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f627aab8640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b51c3f0 0x56348b61c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f6279ab6640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6160036790 0x7f6160038c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6270054000 tx=0x7f627004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.889+0000 7f627aab8640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b51c3f0 0x56348b61c740 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627aab8640 1 -- 172.21.15.42:0/1723636824 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b51c3f0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b619da0 con 0x56348b51c3f0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627aab8640 1 -- 172.21.15.42:0/1723636824 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b51c3f0 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b61ef50 0x56348b621340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b621a10 con 0x56348b61ef50 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b61ef50 0x56348b621340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.890+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b61ef50 0x56348b621340 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.891+0000 7f627a2b7640 1 -- 172.21.15.42:0/1723636824 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f626c016070 con 0x56348b61ef50 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.891+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b61ded0 con 0x56348b51c3f0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.891+0000 7f627aab8640 1 -- 172.21.15.42:0/1723636824 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b51c3f0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.891+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b61e2e0 con 0x56348b51c3f0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.891+0000 7f627aab8640 1 -- 172.21.15.42:0/1723636824 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b51c3f0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.891+0000 7f627e522800 1 Processor -- start 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627e522800 1 -- start start 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627e522800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 0x56348b630bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627e522800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348b3b9e80 con 0x56348b630790 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627aab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 0x56348b630bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627aab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 0x56348b630bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54052/0 (socket says 172.21.15.42:54052) 2024-02-16T00:12:27.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627aab8640 1 -- 172.21.15.42:0/3730397979 learned_addr learned my addr 172.21.15.42:0/3730397979 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627aab8640 1 -- 172.21.15.42:0/3730397979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348b6310f0 con 0x56348b630790 2024-02-16T00:12:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.892+0000 7f627aab8640 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 0x56348b630bb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x56348b61d070 tx=0x7f6274018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.893+0000 7f615ffff640 1 -- 172.21.15.42:0/3730397979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f627401d070 con 0x56348b630790 2024-02-16T00:12:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.893+0000 7f615ffff640 1 -- 172.21.15.42:0/3730397979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740182e0 con 0x56348b630790 2024-02-16T00:12:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.893+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56348b631b60 con 0x56348b630790 2024-02-16T00:12:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.893+0000 7f615ffff640 1 -- 172.21.15.42:0/3730397979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62740145e0 con 0x56348b630790 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.893+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56348b632020 con 0x56348b630790 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.893+0000 7f615ffff640 1 -- 172.21.15.42:0/3730397979 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6274020020 con 0x56348b630790 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f615ffff640 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6154036790 0x7f6154038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f615ffff640 1 -- 172.21.15.42:0/3730397979 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f627404dd70 con 0x56348b630790 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627a2b7640 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6154036790 0x7f6154038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627e522800 1 Processor -- start 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627e522800 1 -- start start 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627a2b7640 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6154036790 0x7f6154038c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56348b61d0e0 tx=0x7f626c04a920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627e522800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b63dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627e522800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348b38f5d0 con 0x56348b63da80 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627aab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b63dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627aab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b63dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54068/0 (socket says 172.21.15.42:54068) 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.894+0000 7f627aab8640 1 -- 172.21.15.42:0/2848771067 learned_addr learned my addr 172.21.15.42:0/2848771067 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627aab8640 1 -- 172.21.15.42:0/2848771067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348b63e470 con 0x56348b63da80 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627aab8640 1 --2- 172.21.15.42:0/2848771067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b63dea0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f627404c020 tx=0x7f6274011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795641df36a62dd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f615dffb640 1 -- 172.21.15.42:0/2848771067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6274016440 con 0x56348b63da80 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f615dffb640 1 -- 172.21.15.42:0/2848771067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740165a0 con 0x56348b63da80 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f615dffb640 1 -- 172.21.15.42:0/2848771067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6274014b10 con 0x56348b63da80 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 -- 172.21.15.42:0/2848771067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 msgr2=0x56348b63dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 --2- 172.21.15.42:0/2848771067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b63dea0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f627404c020 tx=0x7f6274011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 -- 172.21.15.42:0/2848771067 shutdown_connections 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 --2- 172.21.15.42:0/2848771067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b63dea0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 -- 172.21.15.42:0/2848771067 >> 172.21.15.42:0/2848771067 conn(0x56348b639d50 msgr2=0x56348b637db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 -- 172.21.15.42:0/2848771067 shutdown_connections 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.895+0000 7f627e522800 1 -- 172.21.15.42:0/2848771067 wait complete. 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627e522800 1 Processor -- start 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627e522800 1 -- start start 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627e522800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b644990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627e522800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348b644ed0 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627aab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b644990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627aab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b644990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:54082/0 (socket says 172.21.15.42:54082) 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.896+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 learned_addr learned my addr 172.21.15.42:0/1446561358 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348b632020 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f627aab8640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b644990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6274016750 tx=0x7f627404bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f614bfff640 1 -- 172.21.15.42:0/1446561358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6274032070 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f614bfff640 1 -- 172.21.15.42:0/1446561358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740116f0 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56348b6450d0 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f614bfff640 1 -- 172.21.15.42:0/1446561358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62740136f0 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.897+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56348b645530 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f614bfff640 1 -- 172.21.15.42:0/1446561358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6274022740 con 0x56348b63da80 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f614bfff640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61440367e0 0x7f6144038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f614bfff640 1 -- 172.21.15.42:0/1446561358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6274037d20 con 0x56348b63da80 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61440367e0 0x7f6144038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61440367e0 0x7f6144038ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56348b621db0 tx=0x7f626c042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b6506e0 0x56348b652ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6532f0 con 0x56348b6506e0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.898+0000 7f6279ab6640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b6506e0 0x56348b652ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f6279ab6640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b6506e0 0x56348b652ba0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 20 realm 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6536e0 con 0x56348b6506e0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:27.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.899+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b653f60 con 0x56348b6506e0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6542c0 con 0x56348b6506e0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b654fd0 0x56348b6573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627aab8640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b654fd0 0x56348b6573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627aab8640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b654fd0 0x56348b6573c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.900+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627e522800 20 searching for the correct realm 2024-02-16T00:12:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56348b659ca0 0x56348b65c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65c830 con 0x56348b659ca0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56348b659ca0 0x56348b65c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627a2b7640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56348b659ca0 0x56348b65c160 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.901+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65c830 con 0x56348b654fd0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.902+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.902+0000 7f627aab8640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6274014070 0x7f627403d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.902+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.902+0000 7f6279ab6640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6274014070 0x7f627403d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:27.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6274014070 0x7f627403d7d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.903+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.904+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.905+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.906+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.907+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.908+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b659ca0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.909+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x7f6274014070 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b6506e0 2024-02-16T00:12:27.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6579d0 con 0x56348b654fd0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6580a0 con 0x56348b6506e0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.910+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b658450 con 0x56348b6506e0 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b658830 con 0x56348b6506e0 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 zone default found 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 4 Realm: () 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 zonegroup default 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65cc70 con 0x7f6274014070 2024-02-16T00:12:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.911+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6591f0 con 0x56348b659ca0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65ebf0 con 0x56348b659ca0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 20 started sync module instance, tier type = 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.912+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65e0c0 con 0x56348b654fd0 2024-02-16T00:12:27.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.913+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.913+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783676999072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65e0c0 con 0x56348b654fd0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.913+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65f700 con 0x56348b6506e0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.914+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783676999072] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.915+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.915+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783677002208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65e0c0 con 0x56348b6506e0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.915+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6601a0 con 0x56348b659ca0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.916+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783677002208] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.916+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.916+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783676996640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b65e040 con 0x56348b659ca0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.916+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b661000 con 0x56348b654fd0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.917+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.917+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783676996640] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.917+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783677009216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6617a0 con 0x56348b654fd0 2024-02-16T00:12:27.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.917+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b660570 con 0x56348b6506e0 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.918+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783677009216] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.918+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.918+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783677010432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b661760 con 0x56348b6506e0 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.918+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b662800 con 0x7f6274014070 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.919+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783677010432] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.919+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.919+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783677013328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b662800 con 0x7f6274014070 2024-02-16T00:12:27.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.919+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b663170 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.920+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783677013328] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.920+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.920+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783677017776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b662800 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.920+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b663b70 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783677017776] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783677019792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b663d50 con 0x7f6274014070 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=0 2024-02-16T00:12:27.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=1 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=2 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=3 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=4 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=5 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.921+0000 7f627e522800 20 add_watcher() i=6 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.922+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783677019792] v29'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.922+0000 7f627e522800 20 add_watcher() i=7 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.922+0000 7f627e522800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.922+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b667110 con 0x56348b6506e0 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.922+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.922+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783677021248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6645d0 con 0x56348b6506e0 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.923+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783677021248] v29'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.923+0000 7f6130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.924+0000 7f627e522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.924+0000 7f627e522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:27.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.924+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b666bc0 con 0x56348b6506e0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.925+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'58 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.925+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b666b80 con 0x7f6274014070 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.926+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.926+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b670470 con 0x56348b659ca0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.927+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.927+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b670e40 con 0x56348b6506e0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.928+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'230 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.928+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6711c0 con 0x56348b654fd0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.929+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'77 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.929+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6716f0 con 0x56348b659ca0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.930+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'59 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.930+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b671c20 con 0x56348b6506e0 2024-02-16T00:12:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.931+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.931+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6720c0 con 0x7f6274014070 2024-02-16T00:12:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.932+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'54 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.932+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6720c0 con 0x56348b654fd0 2024-02-16T00:12:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.933+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.933+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b66f900 con 0x56348b659ca0 2024-02-16T00:12:27.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.934+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.934+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b66f900 con 0x56348b654fd0 2024-02-16T00:12:27.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.935+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'78 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.935+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x7f6274014070 2024-02-16T00:12:27.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.936+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.936+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b654fd0 2024-02-16T00:12:27.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.937+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.937+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x7f6274014070 2024-02-16T00:12:27.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.939+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'65 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.939+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b6506e0 2024-02-16T00:12:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.940+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'231 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.940+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b659ca0 2024-02-16T00:12:27.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.941+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.941+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b654fd0 2024-02-16T00:12:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.942+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'79 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.942+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b659ca0 2024-02-16T00:12:27.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.943+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'39 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.943+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b6506e0 2024-02-16T00:12:27.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.944+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.944+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b6506e0 2024-02-16T00:12:27.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.945+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'232 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.945+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b66f630 con 0x56348b659ca0 2024-02-16T00:12:27.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.946+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.946+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b66f630 con 0x56348b654fd0 2024-02-16T00:12:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.947+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'45 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.947+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b673260 con 0x56348b659ca0 2024-02-16T00:12:27.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.948+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.948+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b673260 con 0x56348b659ca0 2024-02-16T00:12:27.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.949+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'45 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.949+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b659ca0 2024-02-16T00:12:27.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.949+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.950+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b659ca0 2024-02-16T00:12:27.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.950+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'60 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.950+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x7f6274014070 2024-02-16T00:12:27.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.951+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.951+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b659ca0 2024-02-16T00:12:27.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.952+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'39 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.952+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x7f6274014070 2024-02-16T00:12:27.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.953+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'55 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.953+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b659ca0 2024-02-16T00:12:27.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.954+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.954+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x7f6274014070 2024-02-16T00:12:27.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.956+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'66 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.956+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b672c30 con 0x56348b654fd0 2024-02-16T00:12:27.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'34 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f60ab7fe640 20 reqs_thread_entry: start 2024-02-16T00:12:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f627e522800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f627e522800 20 Filter name: none 2024-02-16T00:12:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f60a97fa640 20 reqs_thread_entry: start 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f627e522800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.957+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69c860 con 0x7f6274014070 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69ed60 con 0x7f6274014070 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 : miss 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:96 8.13 8:ce20ab98:root::.bucket.meta.myfoo7%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69ecd0 con 0x7f6274014070 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(96 .bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv12 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=355 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 info.flags=0x17 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 to cache LRU end 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.958+0000 7f627e522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.959+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:97 4.1f 4:fa33b8a1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c630 con 0x56348b659ca0 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.959+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(97 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.959+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:98 4.2e 4:744bb489:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c670 con 0x56348b659ca0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.959+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(98 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.959+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 4.2c 4:36aa402a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c670 con 0x56348b6506e0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.960+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(99 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.960+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:100 4.18 4:1800e17f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c670 con 0x56348b654fd0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.960+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(100 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.960+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:101 4.13 4:c95f4c03:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c670 con 0x56348b654fd0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.960+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(101 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.960+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:102 4.1f 4:fa99dc6f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c630 con 0x56348b659ca0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(102 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 [call out=377b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+377 (crc 0 0 0) 0x7f626c016070 con 0x56348b659ca0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f627e522800 10 cls_bucket_list_unordered: got fourteen 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:103 4.35 4:ad29fa4a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c630 con 0x56348b6506e0 2024-02-16T00:12:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(103 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:104 4.1f 4:f92d611f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c5b0 con 0x56348b659ca0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(104 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.961+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:105 4.6 4:6084d8a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c5b0 con 0x56348b659ca0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(105 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 4.e 4:724e7a4f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c5b0 con 0x56348b654fd0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(106 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:107 4.34 4:2f0bae73:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b71c5b0 con 0x56348b654fd0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(107 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627e522800 20 get_obj_state: octx=0x7f62700525e0 obj=myfoo7:fourteen state=0x56348b69ff28 s->prefetch_data=0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.962+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:108 3.es0 3:73b0e8b1:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a0d40 con 0x56348b654fd0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(108 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 239+0+872 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627e522800 10 manifest: total_size = 8 2024-02-16T00:12:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627e522800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.4267352830074218004 2024-02-16T00:12:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627e522800 20 get_obj_state: octx=0x7f62700525e0 obj=myfoo7:fourteen state=0x56348b69ff28 s->prefetch_data=0 2024-02-16T00:12:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627e522800 20 prepare_atomic_modification: state is not atomic. state=0x56348b69ff28 2024-02-16T00:12:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627e522800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 2024-02-16T00:12:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.963+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:109 4.1f 4:fa99dc6f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a55b0 con 0x56348b659ca0 2024-02-16T00:12:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.964+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(109 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 [stat,call,call] v29'6 uv6 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.964+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:110 3.es0 3:73b0e8b1:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a3590 con 0x56348b654fd0 2024-02-16T00:12:27.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== osd_op_reply(110 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10_fourteen [call] v29'4 uv4 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:111 4.1f 4:fa99dc6f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a3440 con 0x56348b659ca0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 20 list_objects_ordered: starting attempt 1 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:112 4.1f 4:fa33b8a1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a7300 con 0x56348b659ca0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:113 4.2e 4:744bb489:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a9bb0 con 0x56348b659ca0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:114 4.2c 4:36aa402a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6ac4c0 con 0x56348b6506e0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.965+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:115 4.18 4:1800e17f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6af2c0 con 0x56348b654fd0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:116 4.13 4:c95f4c03:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6af2c0 con 0x56348b654fd0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:117 4.1f 4:fa99dc6f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6af2c0 con 0x56348b659ca0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:118 4.35 4:ad29fa4a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b66a0 con 0x56348b6506e0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:119 4.1f 4:f92d611f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9400 con 0x56348b659ca0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:120 4.6 4:6084d8a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6bc230 con 0x56348b659ca0 2024-02-16T00:12:27.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:121 4.e 4:724e7a4f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6bf010 con 0x56348b654fd0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(114 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:122 4.34 4:2f0bae73:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6c19a0 con 0x56348b654fd0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(113 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(115 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(112 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(118 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(116 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(120 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.966+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(121 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(122 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(119 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(111 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 [stat,call,call] v29'7 uv7 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f615d7fa640 20 handle_completion(): completion ok for obj=fourteen 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(117 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10])"; uploads.size()=0; is_truncated=0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:123 4.1f 4:fa33b8a1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6af2c0 con 0x56348b659ca0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:124 4.2e 4:744bb489:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a9c10 con 0x56348b659ca0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:125 4.2c 4:36aa402a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6bc230 con 0x56348b6506e0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.967+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:126 4.18 4:1800e17f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6ac910 con 0x56348b654fd0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:127 4.13 4:c95f4c03:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6af2c0 con 0x56348b654fd0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:128 4.1f 4:fa99dc6f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a9c10 con 0x56348b659ca0 2024-02-16T00:12:27.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:129 4.35 4:ad29fa4a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6bc230 con 0x56348b6506e0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:130 4.1f 4:f92d611f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6ac910 con 0x56348b659ca0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:131 4.6 4:6084d8a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b8ba0 con 0x56348b659ca0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:132 4.e 4:724e7a4f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6bc230 con 0x56348b654fd0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:133 4.34 4:2f0bae73:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b1b60 con 0x56348b654fd0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(125 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(124 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(123 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 31 ==== osd_op_reply(126 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 32 ==== osd_op_reply(127 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(131 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(129 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 33 ==== osd_op_reply(132 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 41 ==== osd_op_reply(128 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 34 ==== osd_op_reply(133 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 42 ==== osd_op_reply(130 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.968+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6ac6d0 con 0x7f6274014070 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(134 fud.buckets [call] v29'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6ac6d0 con 0x56348b654fd0 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 35 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 20 rados_obj.operate() r=0 bl.length=168 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94783677370496 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a1f50 con 0x56348b654fd0 2024-02-16T00:12:27.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 36 ==== watch-notify(notify (1) cookie 94783677009216 notify 124554051623 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7f627406b040 con 0x56348b654fd0 2024-02-16T00:12:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f615d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051623 cookie 94783677009216 notifier 4754 bl.length()=150 2024-02-16T00:12:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.970+0000 7f615d7fa640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f60b00032b0 con 0x56348b654fd0 2024-02-16T00:12:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.971+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 37 ==== osd_op_reply(136 notify.3 [notify cookie 94783677370496 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.971+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 38 ==== watch-notify(notify_complete (2) cookie 94783677370496 notify 124554051623 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56348b645530 con 0x56348b654fd0 2024-02-16T00:12:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.971+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 39 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.971+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b654fd0 2024-02-16T00:12:27.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 40 ==== osd_op_reply(138 myfoo7 [call,call,delete] v29'45 uv45 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f627e522800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 from cache 2024-02-16T00:12:27.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f627e522800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10, ofs0, ns] 2024-02-16T00:12:27.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [notify cookie 94783677318864 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b659ca0 2024-02-16T00:12:27.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 43 ==== watch-notify(notify (1) cookie 94783676996640 notify 124554051595 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7f626c059000 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f615dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94783676996640 notifier 4754 bl.length()=208 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 44 ==== osd_op_reply(139 notify.2 [notify cookie 94783677318864 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.972+0000 7f615dffb640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f6140003d50 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.973+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 45 ==== osd_op_reply(140 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.973+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 46 ==== watch-notify(notify_complete (2) cookie 94783677318864 notify 124554051595 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56348b6163d0 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.973+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:141 8.13 8:ce20ab98:root::.bucket.meta.myfoo7%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(141 .bucket.meta.myfoo7:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 [call,call,delete] v29'13 uv13 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:142 4.1f 4:fa33b8a1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:143 4.2e 4:744bb489:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a1280 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:144 4.2c 4:36aa402a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69d390 con 0x56348b6506e0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:145 4.18 4:1800e17f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69dc10 con 0x56348b654fd0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:146 4.13 4:c95f4c03:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69e030 con 0x56348b654fd0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 4.1f 4:fa99dc6f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b659ca0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:148 4.35 4:ad29fa4a:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69d390 con 0x56348b6506e0 2024-02-16T00:12:27.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:149 4.1f 4:f92d611f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6a1280 con 0x56348b659ca0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:150 4.6 4:6084d8a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b659ca0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:151 4.e 4:724e7a4f:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69dc10 con 0x56348b654fd0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.974+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:152 4.34 4:2f0bae73:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b69d390 con 0x56348b654fd0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 41 ==== osd_op_reply(145 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.3 [delete] v29'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 42 ==== osd_op_reply(151 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.9 [delete] v29'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(144 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.2 [delete] v29'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 47 ==== osd_op_reply(142 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.0 [delete] v29'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 43 ==== osd_op_reply(146 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.4 [delete] v29'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 48 ==== osd_op_reply(147 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.5 [delete] v29'9 uv9 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(148 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.6 [delete] v29'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.976+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 49 ==== osd_op_reply(143 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.1 [delete] v29'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 44 ==== osd_op_reply(152 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.10 [delete] v29'8 uv8 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 50 ==== osd_op_reply(150 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.8 [delete] v29'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 51 ==== osd_op_reply(149 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10.7 [delete] v29'10 uv10 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 : miss 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 20 rados->read ofs=0 len=0 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:153 6.19 6:99e40056:::pubsub..bucket.myfoo7%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b6506e0 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(153 pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 info.flags=0x0 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 10 adding default.rgw.log++pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 to cache LRU end 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 10 removing default.rgw.log++pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 from cache 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10, ofs0, ns] 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 94783677256592 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== watch-notify(notify (1) cookie 94783677019792 notify 124554051612 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x56348b48f1a0 con 0x7f6274014070 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f615dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94783677019792 notifier 4754 bl.length()=205 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(154 notify.7 [notify cookie 94783677256592 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.977+0000 7f615dffb640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f6140003d50 con 0x7f6274014070 2024-02-16T00:12:27.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.978+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.978+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== watch-notify(notify_complete (2) cookie 94783677256592 notify 124554051612 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f627004e070 con 0x7f6274014070 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.978+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:156 6.19 6:99e40056:::pubsub..bucket.myfoo7%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b6506e0 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.979+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(156 pubsub..bucket.myfoo7/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.10 [delete] v29'59 uv52 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.979+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(157 fud.buckets [call] v29'9 uv9 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f627e522800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f627e522800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94783677254976 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b659ca0 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 52 ==== watch-notify(notify (1) cookie 94783676996640 notify 124554051596 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x56348b6163d0 con 0x56348b659ca0 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f615dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94783676996640 notifier 4754 bl.length()=170 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 53 ==== osd_op_reply(158 notify.2 [notify cookie 94783677254976 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f615dffb640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f6140003d50 con 0x56348b659ca0 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.980+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 54 ==== watch-notify(notify_complete (2) cookie 94783677254976 notify 124554051596 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56348b615ef0 con 0x56348b659ca0 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.981+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 55 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.981+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v29'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f627e522800 10 removing email index: 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f627e522800 10 removing user buckets index 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f627e522800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-16T00:12:27.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94783677254976 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== watch-notify(notify (1) cookie 94783677017776 notify 124554051613 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f627004e070 con 0x7f6274014070 2024-02-16T00:12:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f615dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94783677017776 notifier 4754 bl.length()=160 2024-02-16T00:12:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(161 notify.6 [notify cookie 94783677254976 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.982+0000 7f615dffb640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f6140003d50 con 0x7f6274014070 2024-02-16T00:12:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.983+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== watch-notify(notify_complete (2) cookie 94783677254976 notify 124554051613 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f627005de30 con 0x7f6274014070 2024-02-16T00:12:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.983+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.983+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(163 fud.buckets [delete] v29'10 uv10 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f627e522800 10 removing user index: fud 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f627e522800 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f627e522800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94783677061792 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== watch-notify(notify (1) cookie 94783677013328 notify 124554051614 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f627005de30 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f615dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94783677013328 notifier 4754 bl.length()=152 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(164 notify.5 [notify cookie 94783677061792 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.984+0000 7f615dffb640 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f6140003d50 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.985+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.985+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== watch-notify(notify_complete (2) cookie 94783677061792 notify 124554051614 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f62700846b0 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.985+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.986+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(166 fud [call,call,delete] v29'7 uv7 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.986+0000 7f6130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.987+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783677021248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b6506e0 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.987+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94783677021248] v29'233 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.987+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783676999072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b654fd0 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.988+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 45 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94783676999072] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.988+0000 7f627e522800 20 remove_watcher() i=0 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.988+0000 7f627e522800 2 removed watcher, disabling cache 2024-02-16T00:12:27.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.988+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783677002208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b6506e0 2024-02-16T00:12:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.990+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94783677002208] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.990+0000 7f627e522800 20 remove_watcher() i=1 2024-02-16T00:12:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.990+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783676996640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b659ca0 2024-02-16T00:12:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.991+0000 7f627a2b7640 1 -- 172.21.15.42:0/1446561358 <== osd.3 v2:172.21.15.42:6810/474355007 56 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94783676996640] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f626c05a040 con 0x56348b659ca0 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.991+0000 7f627e522800 20 remove_watcher() i=2 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.991+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783677009216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b654fd0 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.992+0000 7f627aab8640 1 -- 172.21.15.42:0/1446561358 <== osd.2 v2:172.21.15.42:6808/1288904824 46 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94783677009216] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f627400a4a0 con 0x56348b654fd0 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.992+0000 7f627e522800 20 remove_watcher() i=3 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.992+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783677010432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x56348b6506e0 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.993+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94783677010432] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x56348b6506e0 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.993+0000 7f627e522800 20 remove_watcher() i=4 2024-02-16T00:12:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.993+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783677013328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.994+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94783677013328] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.994+0000 7f627e522800 20 remove_watcher() i=5 2024-02-16T00:12:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.994+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783677017776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.995+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94783677017776] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.995+0000 7f627e522800 20 remove_watcher() i=6 2024-02-16T00:12:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.995+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783677019792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56348b6b9080 con 0x7f6274014070 2024-02-16T00:12:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94783677019792] v29'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6270066040 con 0x7f6274014070 2024-02-16T00:12:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 20 remove_watcher() i=7 2024-02-16T00:12:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6274014070 msgr2=0x7f627403d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f6274014070 0x7f627403d7d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b6506e0 msgr2=0x56348b652ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b6506e0 0x56348b652ba0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b654fd0 msgr2=0x56348b6573c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b654fd0 0x56348b6573c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56348b659ca0 msgr2=0x56348b65c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56348b659ca0 0x56348b65c160 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61440367e0 msgr2=0x7f6144038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61440367e0 0x7f6144038ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56348b621db0 tx=0x7f626c042000 comp rx=0 tx=0).stop 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 msgr2=0x56348b644990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f6279ab6640 1 -- 172.21.15.42:0/1446561358 reap_dead start 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b644990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6274016750 tx=0x7f627404bf80 comp rx=0 tx=0).stop 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 shutdown_connections 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 --2- 172.21.15.42:0/1446561358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b63da80 0x56348b644990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 >> 172.21.15.42:0/1446561358 conn(0x56348b639d50 msgr2=0x56348b6373b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 shutdown_connections 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.996+0000 7f627e522800 1 -- 172.21.15.42:0/1446561358 wait complete. 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6154036790 msgr2=0x7f6154038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6154036790 0x7f6154038c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56348b61d0e0 tx=0x7f626c04a920 comp rx=0 tx=0).stop 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 msgr2=0x56348b630bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 0x56348b630bb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x56348b61d070 tx=0x7f6274018830 comp rx=0 tx=0).stop 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 shutdown_connections 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6154036790 0x7f6154038c50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/3730397979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b630790 0x56348b630bb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 >> 172.21.15.42:0/3730397979 conn(0x56348b624830 msgr2=0x56348b624c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 shutdown_connections 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/3730397979 wait complete. 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b51c3f0 msgr2=0x56348b61c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b51c3f0 0x56348b61c740 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b61ef50 msgr2=0x56348b621340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b61ef50 0x56348b621340 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6160036790 msgr2=0x7f6160038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6160036790 0x7f6160038c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6270054000 tx=0x7f627004e000 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 msgr2=0x56348b6159b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b6159b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f626c004000 tx=0x7f626c000bc0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 shutdown_connections 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56348b61ef50 0x56348b621340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x56348b51c3f0 0x56348b61c740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6160036790 0x7f6160038c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 --2- 172.21.15.42:0/1723636824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56348b51a8b0 0x56348b6159b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 >> 172.21.15.42:0/1723636824 conn(0x56348b5164f0 msgr2=0x56348b608460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 shutdown_connections 2024-02-16T00:12:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:27.997+0000 7f627e522800 1 -- 172.21.15.42:0/1723636824 wait complete. 2024-02-16T00:12:33.008 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-02-16T00:12:33.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-02-16T00:12:33.009 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-02-16T00:12:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.058 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.056+0000 7f9057b40800 1 Processor -- start 2024-02-16T00:12:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.056+0000 7f9057b40800 1 -- start start 2024-02-16T00:12:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.056+0000 7f9057b40800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559bec216020 0x559bec216440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.056+0000 7f9057b40800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559bec160bb0 con 0x559bec217280 2024-02-16T00:12:33.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.056+0000 7f9057b40800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x559bec118450 con 0x559bec216020 2024-02-16T00:12:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.057+0000 7f9053844640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559bec216020 0x559bec216440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.057+0000 7f9053043640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x559bec217280 0x559bec217700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33738/0 (socket says 172.21.15.42:33738) 2024-02-16T00:12:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.057+0000 7f9053844640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x559bec216020 0x559bec216440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56118/0 (socket says 172.21.15.42:56118) 2024-02-16T00:12:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.057+0000 7f9053043640 1 -- 172.21.15.42:0/3832320377 learned_addr learned my addr 172.21.15.42:0/3832320377 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.057+0000 7f9053844640 1 -- 172.21.15.42:0/3832320377 >> v1:172.21.15.2:6789/0 conn(0x559bec217280 legacy=0x559bec217700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.057+0000 7f9053844640 1 -- 172.21.15.42:0/3832320377 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bec216b10 con 0x559bec216020 2024-02-16T00:12:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.059+0000 7f9053844640 1 --2- 172.21.15.42:0/3832320377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec216440 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9044005fd0 tx=0x7f904401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37b809c1485c663 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.059+0000 7f9052842640 1 -- 172.21.15.42:0/3832320377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9044052560 con 0x559bec216020 2024-02-16T00:12:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9052842640 1 -- 172.21.15.42:0/3832320377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90440526c0 con 0x559bec216020 2024-02-16T00:12:33.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9052842640 1 -- 172.21.15.42:0/3832320377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90440529e0 con 0x559bec216020 2024-02-16T00:12:33.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 -- 172.21.15.42:0/3832320377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 msgr2=0x559bec216440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 --2- 172.21.15.42:0/3832320377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec216440 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9044005fd0 tx=0x7f904401cb90 comp rx=0 tx=0).stop 2024-02-16T00:12:33.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 -- 172.21.15.42:0/3832320377 shutdown_connections 2024-02-16T00:12:33.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 --2- 172.21.15.42:0/3832320377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec216440 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 -- 172.21.15.42:0/3832320377 >> 172.21.15.42:0/3832320377 conn(0x559bec2115c0 msgr2=0x559bec2139e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 -- 172.21.15.42:0/3832320377 shutdown_connections 2024-02-16T00:12:33.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.060+0000 7f9057b40800 1 -- 172.21.15.42:0/3832320377 wait complete. 2024-02-16T00:12:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.074+0000 7f9057b40800 1 Processor -- start 2024-02-16T00:12:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.074+0000 7f9057b40800 1 -- start start 2024-02-16T00:12:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.074+0000 7f9057b40800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec306330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.074+0000 7f9057b40800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bec115980 con 0x559bec216020 2024-02-16T00:12:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.074+0000 7f9053844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec306330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f9053844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec306330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56128/0 (socket says 172.21.15.42:56128) 2024-02-16T00:12:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f9053844640 1 -- 172.21.15.42:0/2010150844 learned_addr learned my addr 172.21.15.42:0/2010150844 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f9053844640 1 -- 172.21.15.42:0/2010150844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904400a100 con 0x559bec216020 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f9053844640 1 --2- 172.21.15.42:0/2010150844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec306330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9044054040 tx=0x7f904404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf115dadbdf8418a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f8f41e0b640 1 -- 172.21.15.42:0/2010150844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9044052960 con 0x559bec216020 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f8f41e0b640 1 -- 172.21.15.42:0/2010150844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9044052ac0 con 0x559bec216020 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.075+0000 7f8f41e0b640 1 -- 172.21.15.42:0/2010150844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9044052d80 con 0x559bec216020 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 -- 172.21.15.42:0/2010150844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 msgr2=0x559bec306330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 --2- 172.21.15.42:0/2010150844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec306330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9044054040 tx=0x7f904404c000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 -- 172.21.15.42:0/2010150844 shutdown_connections 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 --2- 172.21.15.42:0/2010150844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec306330 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 -- 172.21.15.42:0/2010150844 >> 172.21.15.42:0/2010150844 conn(0x559bec2115c0 msgr2=0x559bec301c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 -- 172.21.15.42:0/2010150844 shutdown_connections 2024-02-16T00:12:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 -- 172.21.15.42:0/2010150844 wait complete. 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 Processor -- start 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.076+0000 7f9057b40800 1 -- start start 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.077+0000 7f9057b40800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec18b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.077+0000 7f9057b40800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bec111160 con 0x559bec216020 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.077+0000 7f9053844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec18b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.077+0000 7f9053844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec18b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56144/0 (socket says 172.21.15.42:56144) 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.077+0000 7f9053844640 1 -- 172.21.15.42:0/3452307691 learned_addr learned my addr 172.21.15.42:0/3452307691 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.077+0000 7f9053844640 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904404e070 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.078+0000 7f9053844640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec18b050 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f904401d2c0 tx=0x7f9044003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.078+0000 7f8f3bfff640 1 -- 172.21.15.42:0/3452307691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904405cc30 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.078+0000 7f8f3bfff640 1 -- 172.21.15.42:0/3452307691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904405cd90 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.078+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559bec189740 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.078+0000 7f8f3bfff640 1 -- 172.21.15.42:0/3452307691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9044066580 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.078+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bec189c20 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f8f3bfff640 1 -- 172.21.15.42:0/3452307691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9044066730 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f8f3bfff640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f3c036790 0x7f8f3c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f8f3bfff640 1 -- 172.21.15.42:0/3452307691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f904408e0f0 con 0x559bec216020 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f9053043640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f3c036790 0x7f8f3c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec217280 0x559bec316c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec18a3a0 con 0x559bec217280 2024-02-16T00:12:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.079+0000 7f9054045640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec217280 0x559bec316c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9053043640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f3c036790 0x7f8f3c038c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9048000f60 tx=0x7f90480012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9054045640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec217280 0x559bec316c40 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9054045640 1 -- 172.21.15.42:0/3452307691 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f904c0083e0 con 0x559bec217280 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3171f0 con 0x559bec217280 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9054045640 1 -- 172.21.15.42:0/3452307691 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f904c0083e0 con 0x559bec217280 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec318f90 0x559bec31b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.080+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec31ba80 con 0x559bec318f90 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.081+0000 7f9053844640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec318f90 0x559bec31b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.081+0000 7f9053844640 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec318f90 0x559bec31b380 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.081+0000 7f9053844640 1 -- 172.21.15.42:0/3452307691 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f9044077070 con 0x559bec318f90 2024-02-16T00:12:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.081+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec317f10 con 0x559bec217280 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9054045640 1 -- 172.21.15.42:0/3452307691 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f904c0083e0 con 0x559bec217280 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec318300 con 0x559bec217280 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9054045640 1 -- 172.21.15.42:0/3452307691 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f904c0083e0 con 0x559bec217280 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9057b40800 1 Processor -- start 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9057b40800 1 -- start start 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9057b40800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 0x559bec32ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.082+0000 7f9057b40800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bec0b3e80 con 0x559bec32a7f0 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f9054045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 0x559bec32ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f9054045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 0x559bec32ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56160/0 (socket says 172.21.15.42:56160) 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f9054045640 1 -- 172.21.15.42:0/4048455417 learned_addr learned my addr 172.21.15.42:0/4048455417 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f9054045640 1 -- 172.21.15.42:0/4048455417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bec32b150 con 0x559bec32a7f0 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f9054045640 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 0x559bec32ac10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x559bec18ad90 tx=0x7f904c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f8f397fa640 1 -- 172.21.15.42:0/4048455417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904c00f040 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f8f397fa640 1 -- 172.21.15.42:0/4048455417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c007d00 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559bec32bbc0 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.083+0000 7f8f397fa640 1 -- 172.21.15.42:0/4048455417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904c019420 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.084+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bec32c080 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.084+0000 7f8f397fa640 1 -- 172.21.15.42:0/4048455417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f904c019580 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.084+0000 7f8f397fa640 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f2c0367e0 0x7f8f2c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f8f397fa640 1 -- 172.21.15.42:0/4048455417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f904c04e100 con 0x559bec32a7f0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9053844640 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f2c0367e0 0x7f8f2c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9057b40800 1 Processor -- start 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9057b40800 1 -- start start 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9053844640 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f2c0367e0 0x7f8f2c038ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x559bec189f30 tx=0x7f9044083040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9057b40800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec337ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9057b40800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bec0895d0 con 0x559bec337ab0 2024-02-16T00:12:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9054045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec337ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9054045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec337ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56166/0 (socket says 172.21.15.42:56166) 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.085+0000 7f9054045640 1 -- 172.21.15.42:0/3098505504 learned_addr learned my addr 172.21.15.42:0/3098505504 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f9054045640 1 -- 172.21.15.42:0/3098505504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bec3384a0 con 0x559bec337ab0 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f9054045640 1 --2- 172.21.15.42:0/3098505504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec337ed0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f904c04e070 tx=0x7f904c014a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bc5e8f78da1d3f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f8f32ffd640 1 -- 172.21.15.42:0/3098505504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904c0184e0 con 0x559bec337ab0 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f8f32ffd640 1 -- 172.21.15.42:0/3098505504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c040ac0 con 0x559bec337ab0 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f8f32ffd640 1 -- 172.21.15.42:0/3098505504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904c040d60 con 0x559bec337ab0 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f9057b40800 1 -- 172.21.15.42:0/3098505504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 msgr2=0x559bec337ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.086+0000 7f9057b40800 1 --2- 172.21.15.42:0/3098505504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec337ed0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f904c04e070 tx=0x7f904c014a70 comp rx=0 tx=0).stop 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 -- 172.21.15.42:0/3098505504 shutdown_connections 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 --2- 172.21.15.42:0/3098505504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec337ed0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 -- 172.21.15.42:0/3098505504 >> 172.21.15.42:0/3098505504 conn(0x559bec333dd0 msgr2=0x559bec331e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 -- 172.21.15.42:0/3098505504 shutdown_connections 2024-02-16T00:12:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 -- 172.21.15.42:0/3098505504 wait complete. 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 Processor -- start 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 -- start start 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec33ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9057b40800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bec33f010 con 0x559bec337ab0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9054045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec33ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9054045640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec33ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56170/0 (socket says 172.21.15.42:56170) 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.087+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 learned_addr learned my addr 172.21.15.42:0/3400150943 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bec32c080 con 0x559bec337ab0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f9054045640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec33ead0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f904c04b2a0 tx=0x7f904c04c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f8f317fa640 1 -- 172.21.15.42:0/3400150943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904c045040 con 0x559bec337ab0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f8f317fa640 1 -- 172.21.15.42:0/3400150943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c019a90 con 0x559bec337ab0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559bec33f210 con 0x559bec337ab0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f8f317fa640 1 -- 172.21.15.42:0/3400150943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904c019d30 con 0x559bec337ab0 2024-02-16T00:12:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.088+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bec33f670 con 0x559bec337ab0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.089+0000 7f8f317fa640 1 -- 172.21.15.42:0/3400150943 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f904c032070 con 0x559bec337ab0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.089+0000 7f8f317fa640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f1c0367e0 0x7f8f1c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f8f317fa640 1 -- 172.21.15.42:0/3400150943 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f904c036d80 con 0x559bec337ab0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f9053844640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f1c0367e0 0x7f8f1c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec34a7b0 0x559bec34cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec34d3c0 con 0x559bec34a7b0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f9053844640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f1c0367e0 0x7f8f1c038ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f904405cab0 tx=0x7f904408f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.090+0000 7f9053043640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec34a7b0 0x559bec34cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9053043640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec34a7b0 0x559bec34cc70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 realm 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec349c10 con 0x559bec34a7b0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec34de40 con 0x559bec34a7b0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.091+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec34e6c0 con 0x559bec34a7b0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec34f0a0 0x559bec351490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9054045640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec34f0a0 0x559bec351490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9054045640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec34f0a0 0x559bec351490 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 20 searching for the correct realm 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559bec353e30 0x559bec3562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.092+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3569c0 con 0x559bec353e30 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.093+0000 7f9053844640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559bec353e30 0x559bec3562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.093+0000 7f9053844640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559bec353e30 0x559bec3562f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.093+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.093+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3569c0 con 0x559bec34f0a0 2024-02-16T00:12:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.094+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.094+0000 7f9054045640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f904c047070 0x7f904c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.094+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.094+0000 7f9053043640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f904c047070 0x7f904c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.094+0000 7f9053043640 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f904c047070 0x7f904c040350 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.095+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.095+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.095+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.095+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.095+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.095+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.096+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.096+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.096+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.096+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.096+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.096+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.097+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.097+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.097+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.097+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.097+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.097+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.098+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.099+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.100+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f904c031030 con 0x559bec34f0a0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.101+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.102+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.102+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.102+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.102+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec353e30 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.102+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.102+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x7f904c047070 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34a7b0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec351b60 con 0x559bec34f0a0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.103+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec352250 con 0x559bec34a7b0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec352600 con 0x559bec34a7b0 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3529e0 con 0x559bec34a7b0 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 zone default found 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 4 Realm: () 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 zonegroup default 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.104+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec356e00 con 0x7f904c047070 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec358c80 con 0x559bec353e30 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec358fe0 con 0x559bec353e30 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 started sync module instance, tier type = 2024-02-16T00:12:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.105+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec358250 con 0x559bec34f0a0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.106+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.106+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94128171222880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec358250 con 0x559bec34f0a0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.106+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3599d0 con 0x559bec34a7b0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.107+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94128171222880] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.108+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.108+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94128171226288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec358250 con 0x559bec34a7b0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.108+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35a390 con 0x559bec353e30 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.109+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94128171226288] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.109+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.109+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94128171220400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3581d0 con 0x559bec353e30 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.109+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35b1f0 con 0x559bec34f0a0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.110+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94128171220400] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.110+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.111+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94128171232592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35b610 con 0x559bec34f0a0 2024-02-16T00:12:33.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.111+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35bf80 con 0x559bec34a7b0 2024-02-16T00:12:33.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.112+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.112+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94128171232592] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.112+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94128171233648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35bf80 con 0x559bec34a7b0 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.112+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35ca20 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.113+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94128171233648] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.113+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.113+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94128171238656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35bf80 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.113+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35d420 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.114+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94128171238656] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.114+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.114+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94128171241280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35d600 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.114+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35de00 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.115+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94128171241280] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.115+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.115+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94128171243008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35e1b0 con 0x7f904c047070 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=0 2024-02-16T00:12:33.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=1 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=2 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=3 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=4 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=5 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=6 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94128171243008] v29'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 20 add_watcher() i=7 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.116+0000 7f9057b40800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.117+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec361340 con 0x559bec34a7b0 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.117+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.117+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94128171244064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35e600 con 0x559bec34a7b0 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94128171244064] v29'234 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f8f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f9057b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f9057b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f9057b40800 5 note: GC not initialized 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f8f08fe1640 20 reqs_thread_entry: start 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.118+0000 7f9057b40800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 20 Filter name: none 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f8e827fc640 20 reqs_thread_entry: start 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec393370 con 0x559bec34a7b0 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:12:33.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.119+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec395890 con 0x7f904c047070 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.121+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call] v29'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.121+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec395890 con 0x7f904c047070 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.122+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(64 usage.10 [call] v29'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.122+0000 7f8f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.122+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94128171244064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec347620 con 0x559bec34a7b0 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.123+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94128171244064] v29'235 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.124+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94128171222880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35da20 con 0x559bec34f0a0 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.125+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94128171222880] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.125+0000 7f9057b40800 20 remove_watcher() i=0 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.125+0000 7f9057b40800 2 removed watcher, disabling cache 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.125+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94128171226288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec358740 con 0x559bec34a7b0 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.126+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94128171226288] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.126+0000 7f9057b40800 20 remove_watcher() i=1 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.126+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94128171220400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec3594b0 con 0x559bec353e30 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.127+0000 7f9053844640 1 -- 172.21.15.42:0/3400150943 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94128171220400] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9044077070 con 0x559bec353e30 2024-02-16T00:12:33.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.127+0000 7f9057b40800 20 remove_watcher() i=2 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.127+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94128171232592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec357db0 con 0x559bec34f0a0 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.128+0000 7f9054045640 1 -- 172.21.15.42:0/3400150943 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94128171232592] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f904c064080 con 0x559bec34f0a0 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.128+0000 7f9057b40800 20 remove_watcher() i=3 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.128+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94128171233648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec357db0 con 0x559bec34a7b0 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.129+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94128171233648] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x559bec34a7b0 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.129+0000 7f9057b40800 20 remove_watcher() i=4 2024-02-16T00:12:33.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.129+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94128171238656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec357db0 con 0x7f904c047070 2024-02-16T00:12:33.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.130+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94128171238656] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.130+0000 7f9057b40800 20 remove_watcher() i=5 2024-02-16T00:12:33.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.130+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94128171241280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec357db0 con 0x7f904c047070 2024-02-16T00:12:33.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.132+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94128171241280] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.132+0000 7f9057b40800 20 remove_watcher() i=6 2024-02-16T00:12:33.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.132+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94128171243008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559bec35cf40 con 0x7f904c047070 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94128171243008] v29'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9048006070 con 0x7f904c047070 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 20 remove_watcher() i=7 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f904c047070 msgr2=0x7f904c040350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f904c047070 0x7f904c040350 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec34a7b0 msgr2=0x559bec34cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec34a7b0 0x559bec34cc70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec34f0a0 msgr2=0x559bec351490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec34f0a0 0x559bec351490 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559bec353e30 msgr2=0x559bec3562f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x559bec353e30 0x559bec3562f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f1c0367e0 msgr2=0x7f8f1c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f1c0367e0 0x7f8f1c038ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f904405cab0 tx=0x7f904408f000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 msgr2=0x559bec33ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/3400150943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec337ab0 0x559bec33ead0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f904c04b2a0 tx=0x7f904c04c310 comp rx=0 tx=0).stop 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 reap_dead start 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9053043640 1 -- 172.21.15.42:0/3400150943 reap_dead start 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 shutdown_connections 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 >> 172.21.15.42:0/3400150943 conn(0x559bec333dd0 msgr2=0x559bec331430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 shutdown_connections 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/3400150943 wait complete. 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f2c0367e0 msgr2=0x7f8f2c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f2c0367e0 0x7f8f2c038ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x559bec189f30 tx=0x7f9044083040 comp rx=0 tx=0).stop 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 msgr2=0x559bec32ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.133+0000 7f9057b40800 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 0x559bec32ac10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x559bec18ad90 tx=0x7f904c00aec0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 shutdown_connections 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f2c0367e0 0x7f8f2c038ca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/4048455417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec32a7f0 0x559bec32ac10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 >> 172.21.15.42:0/4048455417 conn(0x559bec31e890 msgr2=0x559bec31ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 shutdown_connections 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/4048455417 wait complete. 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec217280 msgr2=0x559bec316c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec217280 0x559bec316c40 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec318f90 msgr2=0x559bec31b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec318f90 0x559bec31b380 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f3c036790 msgr2=0x7f8f3c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f3c036790 0x7f8f3c038c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9048000f60 tx=0x7f90480012b0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 msgr2=0x559bec18b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec18b050 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f904401d2c0 tx=0x7f9044003330 comp rx=0 tx=0).stop 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 shutdown_connections 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x559bec318f90 0x559bec31b380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x559bec217280 0x559bec316c40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8f3c036790 0x7f8f3c038c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 --2- 172.21.15.42:0/3452307691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559bec216020 0x559bec18b050 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 >> 172.21.15.42:0/3452307691 conn(0x559bec2115c0 msgr2=0x559bec304d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 shutdown_connections 2024-02-16T00:12:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.134+0000 7f9057b40800 1 -- 172.21.15.42:0/3452307691 wait complete. 2024-02-16T00:12:33.145 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-16T00:12:33.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-16T00:12:33.146 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-16T00:12:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.186+0000 7f62e96e4800 1 Processor -- start 2024-02-16T00:12:33.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.186+0000 7f62e96e4800 1 -- start start 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.186+0000 7f62e96e4800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563813f1de70 0x563813f1e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.186+0000 7f62e96e4800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563813e69bb0 con 0x563813f1f0d0 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.186+0000 7f62e96e4800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x563813e21450 con 0x563813f1de70 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.187+0000 7f62e71e3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563813f1de70 0x563813f1e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.187+0000 7f62e71e3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x563813f1de70 0x563813f1e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56178/0 (socket says 172.21.15.42:56178) 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.187+0000 7f62e71e3640 1 -- 172.21.15.42:0/216322710 learned_addr learned my addr 172.21.15.42:0/216322710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.187+0000 7f62e69e2640 1 --1- 172.21.15.42:0/216322710 >> v1:172.21.15.2:6789/0 conn(0x563813f1f0d0 0x563813f1f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33750/0 (socket says 172.21.15.42:33750) 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.187+0000 7f62e71e3640 1 -- 172.21.15.42:0/216322710 >> v1:172.21.15.2:6789/0 conn(0x563813f1f0d0 legacy=0x563813f1f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.187+0000 7f62e71e3640 1 -- 172.21.15.42:0/216322710 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563813f1e960 con 0x563813f1de70 2024-02-16T00:12:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e71e3640 1 --2- 172.21.15.42:0/216322710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563813f1e290 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f62d800a520 tx=0x7f62d801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412d17d0ea39dd38 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e61e1640 1 -- 172.21.15.42:0/216322710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d8052570 con 0x563813f1de70 2024-02-16T00:12:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e61e1640 1 -- 172.21.15.42:0/216322710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80526d0 con 0x563813f1de70 2024-02-16T00:12:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e61e1640 1 -- 172.21.15.42:0/216322710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d8052990 con 0x563813f1de70 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 -- 172.21.15.42:0/216322710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 msgr2=0x563813f1e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 --2- 172.21.15.42:0/216322710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563813f1e290 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f62d800a520 tx=0x7f62d801cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 -- 172.21.15.42:0/216322710 shutdown_connections 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 --2- 172.21.15.42:0/216322710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563813f1e290 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 -- 172.21.15.42:0/216322710 >> 172.21.15.42:0/216322710 conn(0x563813f194d0 msgr2=0x563813f1b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 -- 172.21.15.42:0/216322710 shutdown_connections 2024-02-16T00:12:33.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.189+0000 7f62e96e4800 1 -- 172.21.15.42:0/216322710 wait complete. 2024-02-16T00:12:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e96e4800 1 Processor -- start 2024-02-16T00:12:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e96e4800 1 -- start start 2024-02-16T00:12:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e96e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x56381400e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e96e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563813e1e980 con 0x563813f1de70 2024-02-16T00:12:33.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e71e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x56381400e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e71e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x56381400e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56194/0 (socket says 172.21.15.42:56194) 2024-02-16T00:12:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.201+0000 7f62e71e3640 1 -- 172.21.15.42:0/926852909 learned_addr learned my addr 172.21.15.42:0/926852909 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.202+0000 7f62e71e3640 1 -- 172.21.15.42:0/926852909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8005de0 con 0x563813f1de70 2024-02-16T00:12:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.202+0000 7f62e71e3640 1 --2- 172.21.15.42:0/926852909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x56381400e220 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f62d801cf20 tx=0x7f62d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b8382681ffbbc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.202+0000 7f61d560a640 1 -- 172.21.15.42:0/926852909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d805f070 con 0x563813f1de70 2024-02-16T00:12:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.202+0000 7f61d560a640 1 -- 172.21.15.42:0/926852909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8052840 con 0x563813f1de70 2024-02-16T00:12:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.202+0000 7f61d560a640 1 -- 172.21.15.42:0/926852909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d8052b20 con 0x563813f1de70 2024-02-16T00:12:33.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- 172.21.15.42:0/926852909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 msgr2=0x56381400e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 --2- 172.21.15.42:0/926852909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x56381400e220 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f62d801cf20 tx=0x7f62d804c000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- 172.21.15.42:0/926852909 shutdown_connections 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 --2- 172.21.15.42:0/926852909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x56381400e220 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- 172.21.15.42:0/926852909 >> 172.21.15.42:0/926852909 conn(0x563813f194d0 msgr2=0x563814009b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- 172.21.15.42:0/926852909 shutdown_connections 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- 172.21.15.42:0/926852909 wait complete. 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 Processor -- start 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- start start 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563814014640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.203+0000 7f62e96e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563813e1a160 con 0x563813f1de70 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e71e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563814014640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e71e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563814014640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56196/0 (socket says 172.21.15.42:56196) 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e71e3640 1 -- 172.21.15.42:0/3194790602 learned_addr learned my addr 172.21.15.42:0/3194790602 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e71e3640 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d804e070 con 0x563813f1de70 2024-02-16T00:12:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e71e3640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563814014640 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f62d8000c00 tx=0x7f62d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f61d3e07640 1 -- 172.21.15.42:0/3194790602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d805a490 con 0x563813f1de70 2024-02-16T00:12:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f61d3e07640 1 -- 172.21.15.42:0/3194790602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d805a5f0 con 0x563813f1de70 2024-02-16T00:12:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563814014b80 con 0x563813f1de70 2024-02-16T00:12:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f61d3e07640 1 -- 172.21.15.42:0/3194790602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d805a8d0 con 0x563813f1de70 2024-02-16T00:12:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.204+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638140150c0 con 0x563813f1de70 2024-02-16T00:12:33.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.205+0000 7f61d3e07640 1 -- 172.21.15.42:0/3194790602 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f62d805aa80 con 0x563813f1de70 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.205+0000 7f61d3e07640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61cc0367e0 0x7f61cc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.205+0000 7f61d3e07640 1 -- 172.21.15.42:0/3194790602 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f62d808f4f0 con 0x563813f1de70 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e69e2640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61cc0367e0 0x7f61cc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563813f1f0d0 0x56381401b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381401b840 con 0x563813f1f0d0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e79e4640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563813f1f0d0 0x56381401b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e69e2640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61cc0367e0 0x7f61cc038ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000f60 tx=0x7f62dc001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e79e4640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563813f1f0d0 0x56381401b300 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e79e4640 1 -- 172.21.15.42:0/3194790602 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563813f1f0d0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.206+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381401bc20 con 0x563813f1f0d0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e79e4640 1 -- 172.21.15.42:0/3194790602 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62e000a4a0 con 0x563813f1f0d0 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56381401d9e0 0x56381401fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140204a0 con 0x56381401d9e0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e71e3640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56381401d9e0 0x56381401fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e71e3640 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56381401d9e0 0x56381401fdd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e71e3640 1 -- 172.21.15.42:0/3194790602 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f62d8073070 con 0x56381401d9e0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.207+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381401c960 con 0x563813f1f0d0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e79e4640 1 -- 172.21.15.42:0/3194790602 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62e000a4a0 con 0x563813f1f0d0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381401cd70 con 0x563813f1f0d0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e79e4640 1 -- 172.21.15.42:0/3194790602 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f62e000a4a0 con 0x563813f1f0d0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e96e4800 1 Processor -- start 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e96e4800 1 -- start start 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e96e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 0x56381402f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.208+0000 7f62e96e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563813dbce80 con 0x56381402f260 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.209+0000 7f62e79e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 0x56381402f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.209+0000 7f62e79e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 0x56381402f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56204/0 (socket says 172.21.15.42:56204) 2024-02-16T00:12:33.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.209+0000 7f62e79e4640 1 -- 172.21.15.42:0/1843004026 learned_addr learned my addr 172.21.15.42:0/1843004026 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.209+0000 7f62e79e4640 1 -- 172.21.15.42:0/1843004026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56381402fbc0 con 0x56381402f260 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.209+0000 7f62e79e4640 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 0x56381402f680 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x563814015a40 tx=0x7f62e0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f61d1602640 1 -- 172.21.15.42:0/1843004026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62e001d070 con 0x56381402f260 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f61d1602640 1 -- 172.21.15.42:0/1843004026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e00182e0 con 0x56381402f260 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563814030630 con 0x56381402f260 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f61d1602640 1 -- 172.21.15.42:0/1843004026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62e00145a0 con 0x56381402f260 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563814030af0 con 0x56381402f260 2024-02-16T00:12:33.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f61d1602640 1 -- 172.21.15.42:0/1843004026 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f62e0020020 con 0x56381402f260 2024-02-16T00:12:33.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.210+0000 7f61d1602640 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61c0036790 0x7f61c0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f61d1602640 1 -- 172.21.15.42:0/1843004026 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f62e004dd00 con 0x56381402f260 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e71e3640 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61c0036790 0x7f61c0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e96e4800 1 Processor -- start 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e96e4800 1 -- start start 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e71e3640 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61c0036790 0x7f61c0038c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x563814018970 tx=0x7f62d808d700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e96e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x56381403c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e96e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563813d925d0 con 0x56381403c550 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e79e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x56381403c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e79e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x56381403c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56214/0 (socket says 172.21.15.42:56214) 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.211+0000 7f62e79e4640 1 -- 172.21.15.42:0/631357803 learned_addr learned my addr 172.21.15.42:0/631357803 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e79e4640 1 -- 172.21.15.42:0/631357803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56381403cf40 con 0x56381403c550 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e79e4640 1 --2- 172.21.15.42:0/631357803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x56381403c970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f62e004bfc0 tx=0x7f62e0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393d4a4068b73628 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f61caffd640 1 -- 172.21.15.42:0/631357803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62e0016570 con 0x56381403c550 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f61caffd640 1 -- 172.21.15.42:0/631357803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0014ad0 con 0x56381403c550 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f61caffd640 1 -- 172.21.15.42:0/631357803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62e002b350 con 0x56381403c550 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 -- 172.21.15.42:0/631357803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 msgr2=0x56381403c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 --2- 172.21.15.42:0/631357803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x56381403c970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f62e004bfc0 tx=0x7f62e0011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 -- 172.21.15.42:0/631357803 shutdown_connections 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 --2- 172.21.15.42:0/631357803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x56381403c970 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 -- 172.21.15.42:0/631357803 >> 172.21.15.42:0/631357803 conn(0x563814038820 msgr2=0x563814036880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 -- 172.21.15.42:0/631357803 shutdown_connections 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.212+0000 7f62e96e4800 1 -- 172.21.15.42:0/631357803 wait complete. 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e96e4800 1 Processor -- start 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e96e4800 1 -- start start 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e96e4800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x5638140478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e96e4800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563814047e20 con 0x56381403c550 2024-02-16T00:12:33.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e79e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x5638140478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e79e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x5638140478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56228/0 (socket says 172.21.15.42:56228) 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.213+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 learned_addr learned my addr 172.21.15.42:0/1861709547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563814030af0 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f62e79e4640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x5638140478e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f62e003e040 tx=0x7f62e004bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f61c97fa640 1 -- 172.21.15.42:0/1861709547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62e0014c40 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f61c97fa640 1 -- 172.21.15.42:0/1861709547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e004d640 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f61c97fa640 1 -- 172.21.15.42:0/1861709547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62e004d900 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563814048020 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.214+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563814048480 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f61c97fa640 1 -- 172.21.15.42:0/1861709547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f62e0022740 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f61c97fa640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61b00367e0 0x7f61b0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f61c97fa640 1 -- 172.21.15.42:0/1861709547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f62e0037d50 con 0x56381403c550 2024-02-16T00:12:33.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f62e71e3640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61b00367e0 0x7f61b0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5638140534b0 0x563814055950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140560a0 con 0x5638140534b0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f62e69e2640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5638140534b0 0x563814055950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.215+0000 7f62e71e3640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61b00367e0 0x7f61b0038ca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f62d808d830 tx=0x7f62d808b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e69e2640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5638140534b0 0x563814055950 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 realm 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140529d0 con 0x5638140534b0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:33.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814056b20 con 0x5638140534b0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814057030 con 0x5638140534b0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.216+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563814057de0 0x56381405a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e79e4640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563814057de0 0x56381405a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e79e4640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563814057de0 0x56381405a1d0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e96e4800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e96e4800 20 searching for the correct realm 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56381405c730 0x56381405ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405f2c0 con 0x56381405c730 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.217+0000 7f62e71e3640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56381405c730 0x56381405ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.218+0000 7f62e71e3640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56381405c730 0x56381405ebf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.218+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.218+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405f2c0 con 0x563814057de0 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.218+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.218+0000 7f62e79e4640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f62e0014070 0x7f62e002d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.218+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.219+0000 7f62e69e2640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f62e0014070 0x7f62e002d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.219+0000 7f62e69e2640 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f62e0014070 0x7f62e002d460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.219+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.219+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.220+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.221+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.222+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.223+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.224+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.225+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.225+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.225+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.225+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.225+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.225+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x56381405c730 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x7f62e0014070 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.226+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x5638140534b0 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405a750 con 0x563814057de0 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405b050 con 0x5638140534b0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405b400 con 0x5638140534b0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.227+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405b7e0 con 0x5638140534b0 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 zone default found 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 4 Realm: () 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 zonegroup default 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381405f700 con 0x7f62e0014070 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814061580 con 0x56381405c730 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140618e0 con 0x56381405c730 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.228+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.229+0000 7f62e96e4800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.229+0000 7f62e96e4800 20 started sync module instance, tier type = 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.229+0000 7f62e96e4800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.229+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814060b50 con 0x563814057de0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.230+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.230+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94798854098688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814060b50 con 0x563814057de0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.230+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140622c0 con 0x5638140534b0 2024-02-16T00:12:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.231+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94798854098688] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.231+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.231+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94798854102496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814060b50 con 0x5638140534b0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.231+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814062d40 con 0x56381405c730 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.232+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94798854102496] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.232+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.232+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94798854096560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814060ad0 con 0x56381405c730 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.232+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814063ba0 con 0x563814057de0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.233+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.233+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94798854096560] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.233+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94798854108928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814063fc0 con 0x563814057de0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.233+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814064930 con 0x5638140534b0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.234+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94798854108928] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.234+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.234+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94798854112880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814063fc0 con 0x5638140534b0 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.234+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140653b0 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.236+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.236+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94798854114992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814065370 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.236+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814066330 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.236+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94798854112880] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.237+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94798854114992] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.237+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.237+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94798854118992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814065550 con 0x7f62e0014070 2024-02-16T00:12:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.237+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814066b80 con 0x7f62e0014070 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94798854118992] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94798854109984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814065550 con 0x7f62e0014070 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=0 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=1 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=2 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=3 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=4 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=5 2024-02-16T00:12:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.238+0000 7f62e96e4800 20 add_watcher() i=6 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.239+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94798854109984] v29'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.239+0000 7f62e96e4800 20 add_watcher() i=7 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.239+0000 7f62e96e4800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.239+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381406a0b0 con 0x5638140534b0 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.239+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.239+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94798854122464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140674e0 con 0x5638140534b0 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.240+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94798854122464] v29'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f619dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 5 note: GC not initialized 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f619cfe1640 20 reqs_thread_entry: start 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 20 Filter name: none 2024-02-16T00:12:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f61167fc640 20 reqs_thread_entry: start 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.241+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381409b7c0 con 0x5638140534b0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.242+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.242+0000 7f62e96e4800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.242+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381409b7c0 con 0x7f62e0014070 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.242+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.243+0000 7f619dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.243+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94798854122464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381409b7c0 con 0x5638140534b0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.244+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94798854122464] v29'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.244+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94798854098688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381409b7c0 con 0x563814057de0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.245+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94798854098688] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.245+0000 7f62e96e4800 20 remove_watcher() i=0 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.245+0000 7f62e96e4800 2 removed watcher, disabling cache 2024-02-16T00:12:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.245+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94798854102496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381409b7c0 con 0x5638140534b0 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.246+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94798854102496] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.246+0000 7f62e96e4800 20 remove_watcher() i=1 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.246+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94798854096560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56381409b7c0 con 0x56381405c730 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.247+0000 7f62e71e3640 1 -- 172.21.15.42:0/1861709547 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94798854096560] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d8073070 con 0x56381405c730 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.247+0000 7f62e96e4800 20 remove_watcher() i=2 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.247+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94798854108928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814061de0 con 0x563814057de0 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.248+0000 7f62e79e4640 1 -- 172.21.15.42:0/1861709547 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94798854108928] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62e000a4a0 con 0x563814057de0 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.248+0000 7f62e96e4800 20 remove_watcher() i=3 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.248+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94798854112880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5638140606b0 con 0x5638140534b0 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.249+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94798854112880] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x5638140534b0 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.249+0000 7f62e96e4800 20 remove_watcher() i=4 2024-02-16T00:12:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.249+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94798854114992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814063700 con 0x7f62e0014070 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.250+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94798854114992] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.250+0000 7f62e96e4800 20 remove_watcher() i=5 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.250+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94798854118992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814061de0 con 0x7f62e0014070 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.251+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94798854118992] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.251+0000 7f62e96e4800 20 remove_watcher() i=6 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.251+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94798854109984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563814064670 con 0x7f62e0014070 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.252+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94798854109984] v29'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62dc00f610 con 0x7f62e0014070 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.252+0000 7f62e96e4800 20 remove_watcher() i=7 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f62e0014070 msgr2=0x7f62e002d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f62e0014070 0x7f62e002d460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5638140534b0 msgr2=0x563814055950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5638140534b0 0x563814055950 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563814057de0 msgr2=0x56381405a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x563814057de0 0x56381405a1d0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56381405c730 msgr2=0x56381405ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x56381405c730 0x56381405ebf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61b00367e0 msgr2=0x7f61b0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61b00367e0 0x7f61b0038ca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f62d808d830 tx=0x7f62d808b000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 msgr2=0x5638140478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x5638140478e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f62e003e040 tx=0x7f62e004bf50 comp rx=0 tx=0).stop 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e69e2640 1 -- 172.21.15.42:0/1861709547 reap_dead start 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 shutdown_connections 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1861709547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381403c550 0x5638140478e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 >> 172.21.15.42:0/1861709547 conn(0x563814038820 msgr2=0x563814035e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 shutdown_connections 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1861709547 wait complete. 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61c0036790 msgr2=0x7f61c0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61c0036790 0x7f61c0038c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x563814018970 tx=0x7f62d808d700 comp rx=0 tx=0).stop 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 msgr2=0x56381402f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 0x56381402f680 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x563814015a40 tx=0x7f62e0018830 comp rx=0 tx=0).stop 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 shutdown_connections 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61c0036790 0x7f61c0038c50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 --2- 172.21.15.42:0/1843004026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56381402f260 0x56381402f680 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 >> 172.21.15.42:0/1843004026 conn(0x563814023300 msgr2=0x563814023700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 shutdown_connections 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.253+0000 7f62e96e4800 1 -- 172.21.15.42:0/1843004026 wait complete. 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563813f1f0d0 msgr2=0x56381401b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563813f1f0d0 0x56381401b300 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56381401d9e0 msgr2=0x56381401fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56381401d9e0 0x56381401fdd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61cc0367e0 msgr2=0x7f61cc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61cc0367e0 0x7f61cc038ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000f60 tx=0x7f62dc001370 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 msgr2=0x563814014640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563814014640 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f62d8000c00 tx=0x7f62d8002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 shutdown_connections 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x56381401d9e0 0x56381401fdd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x563813f1f0d0 0x56381401b300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f61cc0367e0 0x7f61cc038ca0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 --2- 172.21.15.42:0/3194790602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563813f1de70 0x563814014640 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 >> 172.21.15.42:0/3194790602 conn(0x563813f194d0 msgr2=0x5638140083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 shutdown_connections 2024-02-16T00:12:33.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.254+0000 7f62e96e4800 1 -- 172.21.15.42:0/3194790602 wait complete. 2024-02-16T00:12:33.265 INFO:teuthology.orchestra.run.smithi042.stdout:{"entries":[],"summary":[]} 2024-02-16T00:12:33.265 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-16T00:12:33.265 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-16T00:12:33.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-16T00:12:33.265 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-02-16T00:12:33.349 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.349 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.347+0000 7f2c4e726800 1 Processor -- start 2024-02-16T00:12:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.347+0000 7f2c4e726800 1 -- start start 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.347+0000 7f2c4e726800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c7a3bdb5b0 0x55c7a3bdd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.347+0000 7f2c4e726800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c7a3b21ba0 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.347+0000 7f2c4e726800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c7a3ad9450 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.348+0000 7f2c49c2c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c7a3bdb5b0 0x55c7a3bdd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.348+0000 7f2c49c2c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c7a3bdb5b0 0x55c7a3bdd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56242/0 (socket says 172.21.15.42:56242) 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.348+0000 7f2c4a42d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55c7a3bd7aa0 0x55c7a3bd9e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33764/0 (socket says 172.21.15.42:33764) 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.348+0000 7f2c49c2c640 1 -- 172.21.15.42:0/1934897688 learned_addr learned my addr 172.21.15.42:0/1934897688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.348+0000 7f2c49c2c640 1 -- 172.21.15.42:0/1934897688 >> v1:172.21.15.2:6789/0 conn(0x55c7a3bd7aa0 legacy=0x55c7a3bd9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.348+0000 7f2c49c2c640 1 -- 172.21.15.42:0/1934897688 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a3bdeef0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.350+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/1934897688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bdb5b0 0x55c7a3bdd9a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000a520 tx=0x7f2c4001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4642ce5c7f2273f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.350+0000 7f2c4942b640 1 -- 172.21.15.42:0/1934897688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c40052570 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.350+0000 7f2c4942b640 1 -- 172.21.15.42:0/1934897688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400526d0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.350+0000 7f2c4942b640 1 -- 172.21.15.42:0/1934897688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c40052990 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.350+0000 7f2c4e726800 1 -- 172.21.15.42:0/1934897688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bdb5b0 msgr2=0x55c7a3bdd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.350+0000 7f2c4e726800 1 --2- 172.21.15.42:0/1934897688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bdb5b0 0x55c7a3bdd9a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000a520 tx=0x7f2c4001cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.351+0000 7f2c4e726800 1 -- 172.21.15.42:0/1934897688 shutdown_connections 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.351+0000 7f2c4e726800 1 --2- 172.21.15.42:0/1934897688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bdb5b0 0x55c7a3bdd9a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.351+0000 7f2c4e726800 1 -- 172.21.15.42:0/1934897688 >> 172.21.15.42:0/1934897688 conn(0x55c7a3bd14f0 msgr2=0x55c7a3bd3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.351+0000 7f2c4e726800 1 -- 172.21.15.42:0/1934897688 shutdown_connections 2024-02-16T00:12:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.351+0000 7f2c4e726800 1 -- 172.21.15.42:0/1934897688 wait complete. 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4e726800 1 Processor -- start 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4e726800 1 -- start start 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4e726800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cc6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4e726800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3ad6980 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4a42d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cc6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4a42d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cc6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56254/0 (socket says 172.21.15.42:56254) 2024-02-16T00:12:33.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.362+0000 7f2c4a42d640 1 -- 172.21.15.42:0/810010144 learned_addr learned my addr 172.21.15.42:0/810010144 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.363+0000 7f2c4a42d640 1 -- 172.21.15.42:0/810010144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40005de0 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.363+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/810010144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cc6fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c006f70 tx=0x7f2c3c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf74aa0a0ac53e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.363+0000 7f2b38608640 1 -- 172.21.15.42:0/810010144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c3c006320 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.363+0000 7f2b38608640 1 -- 172.21.15.42:0/810010144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c013420 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.363+0000 7f2b38608640 1 -- 172.21.15.42:0/810010144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c3c013740 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- 172.21.15.42:0/810010144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 msgr2=0x55c7a3cc6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 --2- 172.21.15.42:0/810010144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cc6fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c006f70 tx=0x7f2c3c001930 comp rx=0 tx=0).stop 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- 172.21.15.42:0/810010144 shutdown_connections 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 --2- 172.21.15.42:0/810010144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cc6fb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- 172.21.15.42:0/810010144 >> 172.21.15.42:0/810010144 conn(0x55c7a3bd14f0 msgr2=0x55c7a3cc28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- 172.21.15.42:0/810010144 shutdown_connections 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- 172.21.15.42:0/810010144 wait complete. 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 Processor -- start 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- start start 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.364+0000 7f2c4e726800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3ad2160 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4a42d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4a42d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56264/0 (socket says 172.21.15.42:56264) 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2850042846 learned_addr learned my addr 172.21.15.42:0/2850042846 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a3b21ba0 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cce690 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55c7a3cc7d40 tx=0x7f2c3c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2b36e05640 1 -- 172.21.15.42:0/2850042846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c3c023030 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2b36e05640 1 -- 172.21.15.42:0/2850042846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c003790 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7a3ccebd0 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2b36e05640 1 -- 172.21.15.42:0/2850042846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c3c003a30 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.365+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7a3ccf0b0 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.366+0000 7f2b36e05640 1 -- 172.21.15.42:0/2850042846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2c3c026070 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.366+0000 7f2b36e05640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b30036790 0x7f2b30038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2b36e05640 1 -- 172.21.15.42:0/2850042846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f2c3c024070 con 0x55c7a3bd7aa0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b30036790 0x7f2b30038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3bdb5b0 0x55c7a3cd5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3cd59c0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3bdb5b0 0x55c7a3cd5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b30036790 0x7f2b30038c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c40054000 tx=0x7f2c4004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3bdb5b0 0x55c7a3cd5380 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2850042846 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2c440083e0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.367+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3cd2a10 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2850042846 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2c440083e0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3cd7c00 0x55c7a3cd9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3cda6e0 con 0x55c7a3cd7c00 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3cd7c00 0x55c7a3cd9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3cd7c00 0x55c7a3cd9ff0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2850042846 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3cd7c00 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.368+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3cd6b80 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2850042846 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2c440083e0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3cd6f70 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2850042846 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2c440083e0 con 0x55c7a3bdb5b0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4e726800 1 Processor -- start 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4e726800 1 -- start start 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4e726800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 0x55c7a3ce98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.369+0000 7f2c4e726800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3a74e80 con 0x55c7a3ce94b0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4ac2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 0x55c7a3ce98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4ac2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 0x55c7a3ce98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56278/0 (socket says 172.21.15.42:56278) 2024-02-16T00:12:33.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/1309580460 learned_addr learned my addr 172.21.15.42:0/1309580460 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/1309580460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a3ce9e10 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 0x55c7a3ce98d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x55c7a3ccf260 tx=0x7f2c4400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2b2ffff640 1 -- 172.21.15.42:0/1309580460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c4400f040 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2b2ffff640 1 -- 172.21.15.42:0/1309580460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44007d00 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7a3cea880 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2b2ffff640 1 -- 172.21.15.42:0/1309580460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c44019420 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.370+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7a3cead40 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.371+0000 7f2b2ffff640 1 -- 172.21.15.42:0/1309580460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2c440195d0 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.371+0000 7f2b2ffff640 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b24036790 0x7f2b24038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.371+0000 7f2b2ffff640 1 -- 172.21.15.42:0/1309580460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f2c4404e180 con 0x55c7a3ce94b0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.371+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b24036790 0x7f2b24038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4e726800 1 Processor -- start 2024-02-16T00:12:33.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4e726800 1 -- start start 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b24036790 0x7f2b24038c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55c7a3cd5dc0 tx=0x7f2c3c028ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4e726800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cf6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4e726800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3a4a5d0 con 0x55c7a3cf66d0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4ac2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cf6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4ac2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cf6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56282/0 (socket says 172.21.15.42:56282) 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2473479949 learned_addr learned my addr 172.21.15.42:0/2473479949 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.372+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2473479949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a3cf70c0 con 0x55c7a3cf66d0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2473479949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cf6af0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2c4404c400 tx=0x7f2c44015800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e110ca65a6702ad6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2b2dffb640 1 -- 172.21.15.42:0/2473479949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c44017e00 con 0x55c7a3cf66d0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2b2dffb640 1 -- 172.21.15.42:0/2473479949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440183b0 con 0x55c7a3cf66d0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2b2dffb640 1 -- 172.21.15.42:0/2473479949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c44019c50 con 0x55c7a3cf66d0 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 -- 172.21.15.42:0/2473479949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 msgr2=0x55c7a3cf6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2473479949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cf6af0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2c4404c400 tx=0x7f2c44015800 comp rx=0 tx=0).stop 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 -- 172.21.15.42:0/2473479949 shutdown_connections 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2473479949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cf6af0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 -- 172.21.15.42:0/2473479949 >> 172.21.15.42:0/2473479949 conn(0x55c7a3cf29a0 msgr2=0x55c7a3cf0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 -- 172.21.15.42:0/2473479949 shutdown_connections 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 -- 172.21.15.42:0/2473479949 wait complete. 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.373+0000 7f2c4e726800 1 Processor -- start 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4e726800 1 -- start start 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4e726800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cfd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4e726800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3cfdb20 con 0x55c7a3cf66d0 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4ac2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cfd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4ac2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cfd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56288/0 (socket says 172.21.15.42:56288) 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 learned_addr learned my addr 172.21.15.42:0/2485902893 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a3cead40 con 0x55c7a3cf66d0 2024-02-16T00:12:33.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.374+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cfd5e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2c4404e0f0 tx=0x7f2c4404c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.375+0000 7f2b1bfff640 1 -- 172.21.15.42:0/2485902893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c44030070 con 0x55c7a3cf66d0 2024-02-16T00:12:33.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.375+0000 7f2b1bfff640 1 -- 172.21.15.42:0/2485902893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440173b0 con 0x55c7a3cf66d0 2024-02-16T00:12:33.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.375+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7a3cfdd20 con 0x55c7a3cf66d0 2024-02-16T00:12:33.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.375+0000 7f2b1bfff640 1 -- 172.21.15.42:0/2485902893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c4404c810 con 0x55c7a3cf66d0 2024-02-16T00:12:33.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.375+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7a3cfe180 con 0x55c7a3cf66d0 2024-02-16T00:12:33.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.375+0000 7f2b1bfff640 1 -- 172.21.15.42:0/2485902893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2c4403b250 con 0x55c7a3cf66d0 2024-02-16T00:12:33.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2b1bfff640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b140367e0 0x7f2b14038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2b1bfff640 1 -- 172.21.15.42:0/2485902893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f2c44036020 con 0x55c7a3cf66d0 2024-02-16T00:12:33.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b140367e0 0x7f2b14038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3d09340 0x55c7a3d0b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d0bf50 con 0x55c7a3d09340 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b140367e0 0x7f2b14038ca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c029ca0 tx=0x7f2c3c031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3d09340 0x55c7a3d0b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.376+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3d09340 0x55c7a3d0b800 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 realm 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d0c2e0 con 0x55c7a3d09340 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d0cae0 con 0x55c7a3d09340 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d0ce40 con 0x55c7a3d09340 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3d0db50 0x55c7a3d0ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.377+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d10550 con 0x55c7a3d0db50 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3d0db50 0x55c7a3d0ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3d0db50 0x55c7a3d0ff40 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4e726800 20 searching for the correct realm 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c7a3d12820 0x55c7a3d14ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.378+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c7a3d12820 0x55c7a3d14ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.379+0000 7f2c4a42d640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c7a3d12820 0x55c7a3d14ce0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.379+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.379+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.379+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.379+0000 7f2c4ac2e640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2c44047070 0x7f2c44047670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.379+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.380+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2c44047070 0x7f2c44047670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.380+0000 7f2c49c2c640 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2c44047070 0x7f2c44047670 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.380+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.380+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.380+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.380+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.381+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.382+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.382+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.382+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.382+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.382+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.382+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.383+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.384+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c44032070 con 0x55c7a3d0db50 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.385+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.386+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.386+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.386+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.386+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.386+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.386+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d12820 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x7f2c44047070 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.387+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d09340 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d153b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d11d80 con 0x55c7a3d09340 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d10d10 con 0x55c7a3d09340 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.388+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d11600 con 0x55c7a3d09340 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 zone default found 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 4 Realm: () 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 zonegroup default 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d15c90 con 0x7f2c44047070 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d176a0 con 0x55c7a3d12820 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.389+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d17b00 con 0x55c7a3d12820 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.390+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.390+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.390+0000 7f2c4e726800 20 started sync module instance, tier type = 2024-02-16T00:12:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.390+0000 7f2c4e726800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.390+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d16c40 con 0x55c7a3d0db50 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.391+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.391+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94315935265072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d17f20 con 0x55c7a3d0db50 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.391+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d18720 con 0x55c7a3d09340 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.392+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94315935265072] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.392+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.392+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94315935268640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d187e0 con 0x55c7a3d09340 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.392+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d19150 con 0x55c7a3d12820 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.393+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94315935268640] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.393+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.393+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94315935269696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d18760 con 0x55c7a3d12820 2024-02-16T00:12:33.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.393+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d19ec0 con 0x55c7a3d0db50 2024-02-16T00:12:33.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.394+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.394+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94315935275424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1a750 con 0x55c7a3d0db50 2024-02-16T00:12:33.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.394+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1b200 con 0x55c7a3d09340 2024-02-16T00:12:33.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.394+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94315935269696] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.395+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94315935275424] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.395+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.395+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94315935280384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1b1c0 con 0x55c7a3d09340 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.395+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1ba50 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.397+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.397+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94315935282528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1be20 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.397+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1c660 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.397+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94315935280384] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.397+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94315935282528] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.398+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.398+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94315935274240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1be60 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.398+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1cce0 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(58 notify.7 [create] v29'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94315935287360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1d100 con 0x7f2c44047070 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=0 2024-02-16T00:12:33.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=1 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=2 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=3 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=4 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=5 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94315935274240] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.399+0000 7f2c4e726800 20 add_watcher() i=6 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.400+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94315935287360] v29'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.400+0000 7f2c4e726800 20 add_watcher() i=7 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.400+0000 7f2c4e726800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.400+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d20130 con 0x55c7a3d09340 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.400+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.400+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94315935288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1d600 con 0x55c7a3d09340 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.401+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94315935288416] v29'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.401+0000 7f2b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.401+0000 7f2c4e726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.401+0000 7f2c4e726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.401+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d289a0 con 0x55c7a3d09340 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.403+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'60 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.403+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d29010 con 0x7f2c44047070 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.404+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.404+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d29430 con 0x55c7a3d12820 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.405+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.405+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d29e00 con 0x55c7a3d09340 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.406+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'239 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.406+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d248a0 con 0x55c7a3d0db50 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.406+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'80 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.407+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d248a0 con 0x55c7a3d12820 2024-02-16T00:12:33.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.407+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'61 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.407+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2afe0 con 0x55c7a3d09340 2024-02-16T00:12:33.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.409+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.409+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d26a10 con 0x7f2c44047070 2024-02-16T00:12:33.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.410+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'56 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.410+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d26a10 con 0x55c7a3d0db50 2024-02-16T00:12:33.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.411+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.411+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d26a10 con 0x55c7a3d12820 2024-02-16T00:12:33.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.411+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.412+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2bd20 con 0x55c7a3d0db50 2024-02-16T00:12:33.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.412+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'81 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.412+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2c250 con 0x7f2c44047070 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.414+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.414+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2c250 con 0x55c7a3d0db50 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.414+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.414+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2c390 con 0x7f2c44047070 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.416+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'67 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.416+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2c1c0 con 0x55c7a3d09340 2024-02-16T00:12:33.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.416+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'240 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.417+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2c1c0 con 0x55c7a3d12820 2024-02-16T00:12:33.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.418+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.418+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25e40 con 0x55c7a3d0db50 2024-02-16T00:12:33.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.418+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'82 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.419+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25e40 con 0x55c7a3d12820 2024-02-16T00:12:33.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.419+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'40 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.420+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25e40 con 0x55c7a3d09340 2024-02-16T00:12:33.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.421+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.421+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25e40 con 0x55c7a3d09340 2024-02-16T00:12:33.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.422+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'241 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.422+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25e40 con 0x55c7a3d12820 2024-02-16T00:12:33.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.423+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.423+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25e40 con 0x55c7a3d0db50 2024-02-16T00:12:33.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.424+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'46 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.424+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25c20 con 0x55c7a3d12820 2024-02-16T00:12:33.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.425+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.425+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25c20 con 0x55c7a3d12820 2024-02-16T00:12:33.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.426+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'46 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.426+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25c20 con 0x55c7a3d12820 2024-02-16T00:12:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.426+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.426+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25c20 con 0x55c7a3d12820 2024-02-16T00:12:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.427+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'62 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.427+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25c20 con 0x7f2c44047070 2024-02-16T00:12:33.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.429+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.429+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25df0 con 0x55c7a3d12820 2024-02-16T00:12:33.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.430+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'40 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.430+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25840 con 0x7f2c44047070 2024-02-16T00:12:33.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.431+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'57 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.431+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25840 con 0x55c7a3d12820 2024-02-16T00:12:33.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.432+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.432+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25840 con 0x7f2c44047070 2024-02-16T00:12:33.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.433+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'68 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.433+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d25840 con 0x55c7a3d0db50 2024-02-16T00:12:33.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'35 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2a7b7fe640 20 reqs_thread_entry: start 2024-02-16T00:12:33.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:33.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 20 Filter name: none 2024-02-16T00:12:33.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2a797fa640 20 reqs_thread_entry: start 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d2a230 con 0x55c7a3d09340 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.435+0000 7f2c4e726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d58610 con 0x55c7a3d0db50 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 : miss 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:96 8.1f 8:f96b6191:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d58440 con 0x55c7a3d0db50 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(96 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 info.flags=0x17 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 to cache LRU end 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.436+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:97 4.21 4:875594a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5920 con 0x7f2c44047070 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.437+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(97 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0 [call out=85b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.437+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:98 4.25 4:a749f064:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5920 con 0x55c7a3d12820 2024-02-16T00:12:33.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.437+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(98 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.437+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:99 4.1b 4:db16977c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5960 con 0x55c7a3d0db50 2024-02-16T00:12:33.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(99 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:100 4.2f 4:f6be751c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5960 con 0x55c7a3d09340 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(100 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:101 4.11 4:8b3d2172:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x7f2c44047070 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(101 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 [call out=425b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c4e726800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.438+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:102 4.5 4:a3bf9fd1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x55c7a3d12820 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.439+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(102 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.439+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:103 4.3f 4:fef723d3:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x55c7a3d0db50 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.439+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(103 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.439+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:104 4.0 4:0160c085:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x55c7a3d12820 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.439+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(104 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.439+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:105 4.1 4:8172e22c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x55c7a3d0db50 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.440+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(105 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.440+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:106 4.17 4:ebbd7ab8:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x7f2c44047070 2024-02-16T00:12:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.440+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(106 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.440+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:107 4.c 4:32b5834b:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5980 con 0x55c7a3d09340 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.440+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(107 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 20 get_obj_state: octx=0x7f2c40052a80 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c7a3dd3968 s->prefetch_data=0 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:108 3.3as0 3:5e0492fc:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd48a0 con 0x55c7a3d0db50 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== osd_op_reply(108 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 10 manifest: total_size = 6 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 20 get_obj_state: setting s->obj_tag to 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7222922280699180002 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 20 get_obj_state: octx=0x7f2c40052a80 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c7a3dd3968 s->prefetch_data=0 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 20 prepare_atomic_modification: state is not atomic. state=0x55c7a3dd3968 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 20 bucket index object: :.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 2024-02-16T00:12:33.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.441+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:109 4.11 4:8b3d2172:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5210 con 0x7f2c44047070 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.442+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(109 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 [stat,call,call] v29'10 uv10 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.442+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:110 3.3as0 3:5e0492fc:::5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd5210 con 0x55c7a3d0db50 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(110 5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7_15f6f8dc036519d7fe15b39338f6e5db [call] v29'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:111 4.11 4:8b3d2172:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d5cb00 con 0x7f2c44047070 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 20 list_objects_ordered: starting attempt 1 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:112 4.21 4:875594a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d5e410 con 0x7f2c44047070 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:113 4.25 4:a749f064:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d60cc0 con 0x55c7a3d12820 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:114 4.1b 4:db16977c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d5e410 con 0x55c7a3d0db50 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:115 4.2f 4:f6be751c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d65740 con 0x55c7a3d09340 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:116 4.11 4:8b3d2172:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d68440 con 0x7f2c44047070 2024-02-16T00:12:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:117 4.5 4:a3bf9fd1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d6ad80 con 0x55c7a3d12820 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:118 4.3f 4:fef723d3:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d6db80 con 0x55c7a3d0db50 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:119 4.0 4:0160c085:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d705c0 con 0x55c7a3d12820 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:120 4.1 4:8172e22c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d733f0 con 0x55c7a3d0db50 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:121 4.17 4:ebbd7ab8:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d761d0 con 0x7f2c44047070 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:122 4.c 4:32b5834b:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d733f0 con 0x55c7a3d09340 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(113 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(114 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(112 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0 [call out=85b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(120 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(115 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.444+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(118 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(122 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(121 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(117 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(119 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(111 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 [stat,call,call] v29'11 uv11 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2b2d7fa640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(116 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7])"; uploads.size()=0; is_truncated=0 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:123 4.21 4:875594a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d733f0 con 0x7f2c44047070 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:124 4.25 4:a749f064:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d6ad80 con 0x55c7a3d12820 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:125 4.1b 4:db16977c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d733f0 con 0x55c7a3d0db50 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:126 4.2f 4:f6be751c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d72db0 con 0x55c7a3d09340 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.445+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:127 4.11 4:8b3d2172:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d6ad80 con 0x7f2c44047070 2024-02-16T00:12:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:128 4.5 4:a3bf9fd1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d733f0 con 0x55c7a3d12820 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:129 4.3f 4:fef723d3:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d72db0 con 0x55c7a3d0db50 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:130 4.0 4:0160c085:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d6ad80 con 0x55c7a3d12820 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:131 4.1 4:8172e22c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d6a900 con 0x55c7a3d0db50 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:132 4.17 4:ebbd7ab8:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d75c90 con 0x7f2c44047070 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:133 4.c 4:32b5834b:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d61830 con 0x55c7a3d09340 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(124 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(123 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0 [call out=85b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(128 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(127 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(130 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(126 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 31 ==== osd_op_reply(125 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 32 ==== osd_op_reply(129 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 33 ==== osd_op_reply(131 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(133 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(132 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.446+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd4bb0 con 0x55c7a3d0db50 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 34 ==== osd_op_reply(134 foo.buckets [call] v29'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd4bb0 con 0x55c7a3d0db50 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 35 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94315935596096 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd4bb0 con 0x7f2c44047070 2024-02-16T00:12:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== watch-notify(notify (1) cookie 94315935274240 notify 124554051615 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f2c40085040 con 0x7f2c44047070 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2b2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94315935274240 notifier 4775 bl.length()=149 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(136 notify.6 [notify cookie 94315935596096 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.448+0000 7f2b2d7fa640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2a80003310 con 0x7f2c44047070 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.449+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.449+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== watch-notify(notify_complete (2) cookie 94315935596096 notify 124554051615 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2c4007a040 con 0x7f2c44047070 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.449+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd4bb0 con 0x55c7a3d0db50 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 36 ==== osd_op_reply(138 myfoo [call,call,delete] v29'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2c4e726800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 from cache 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7, ofs0, ns] 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:139 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94315935531952 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd4bb0 con 0x55c7a3d0db50 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 37 ==== watch-notify(notify (1) cookie 94315935265072 notify 124554051624 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55c7a3cfe180 con 0x55c7a3d0db50 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2b2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051624 cookie 94315935265072 notifier 4775 bl.length()=206 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2b2d7fa640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2a80003310 con 0x55c7a3d0db50 2024-02-16T00:12:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.450+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 38 ==== osd_op_reply(139 notify.0 [notify cookie 94315935531952 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.451+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 39 ==== watch-notify(notify_complete (2) cookie 94315935531952 notify 124554051624 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2c4403a070 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.451+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 40 ==== osd_op_reply(140 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.451+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:141 8.1f 8:f96b6191:root::.bucket.meta.myfoo%3a5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3dd4bb0 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 41 ==== osd_op_reply(141 .bucket.meta.myfoo:5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 [call,call,delete] v29'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:142 4.21 4:875594a0:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d67e40 con 0x7f2c44047070 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:143 4.25 4:a749f064:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d12820 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:144 4.1b 4:db16977c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d76b20 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:145 4.2f 4:f6be751c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d76ec0 con 0x55c7a3d09340 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:146 4.11 4:8b3d2172:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x7f2c44047070 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 4.5 4:a3bf9fd1:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d77260 con 0x55c7a3d12820 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:148 4.3f 4:fef723d3:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d76b20 con 0x55c7a3d0db50 2024-02-16T00:12:33.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.452+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:149 4.0 4:0160c085:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d76ec0 con 0x55c7a3d12820 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.453+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:150 4.1 4:8172e22c:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d77260 con 0x55c7a3d0db50 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.453+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(142 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.0 [delete] v29'14 uv14 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.453+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 42 ==== osd_op_reply(144 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.2 [delete] v29'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:151 4.17 4:ebbd7ab8:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d76ec0 con 0x7f2c44047070 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:152 4.c 4:32b5834b:::.dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d76b20 con 0x55c7a3d09340 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(143 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.1 [delete] v29'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 43 ==== osd_op_reply(148 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.6 [delete] v29'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(149 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.7 [delete] v29'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(147 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.5 [delete] v29'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(145 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.3 [delete] v29'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 44 ==== osd_op_reply(150 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.8 [delete] v29'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.454+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(146 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.4 [delete] v29'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(152 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.10 [delete] v29'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(151 .dir.5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7.9 [delete] v29'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 : miss 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:153 6.1b 6:d8915188:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d12820 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(153 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 info.flags=0x0 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 10 adding default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 to cache LRU end 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 10 removing default.rgw.log++pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 from cache 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7, ofs0, ns] 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.455+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 94315936041904 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x7f2c44047070 2024-02-16T00:12:33.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== watch-notify(notify (1) cookie 94315935287360 notify 124554051616 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f2c4007a040 con 0x7f2c44047070 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2b2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051616 cookie 94315935287360 notifier 4775 bl.length()=203 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2b2d7fa640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2a800032b0 con 0x7f2c44047070 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== osd_op_reply(154 notify.7 [notify cookie 94315936041904 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== watch-notify(notify_complete (2) cookie 94315936041904 notify 124554051616 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c7a3bdeef0 con 0x7f2c44047070 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.456+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:156 6.1b 6:d8915188:::pubsub..bucket.myfoo%2f5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d12820 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.457+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(156 pubsub..bucket.myfoo/5de38a36-95ca-4489-8960-85088a4cd7b6.4222.7 [delete] v29'31 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.457+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d0db50 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 45 ==== osd_op_reply(157 foo.buckets [call] v29'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4e726800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94315936041904 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d0db50 2024-02-16T00:12:33.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 46 ==== watch-notify(notify (1) cookie 94315935275424 notify 124554051625 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f2c4403a070 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2b2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051625 cookie 94315935275424 notifier 4775 bl.length()=170 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2b2dffb640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2b10003d50 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 47 ==== osd_op_reply(158 notify.3 [notify cookie 94315936041904 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.458+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 48 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.459+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 49 ==== watch-notify(notify_complete (2) cookie 94315936041904 notify 124554051625 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c7a3cfdd20 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.459+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x7f2c44047070 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v29'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4e726800 10 removing email index: foo@foo.com 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94315936041904 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 50 ==== watch-notify(notify (1) cookie 94315935275424 notify 124554051626 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x55c7a3cfdd20 con 0x55c7a3d0db50 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2b2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051626 cookie 94315935275424 notifier 4775 bl.length()=162 2024-02-16T00:12:33.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2b2d7fa640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2a800032b0 con 0x55c7a3d0db50 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 51 ==== osd_op_reply(161 notify.3 [notify cookie 94315936041904 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 52 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 53 ==== watch-notify(notify_complete (2) cookie 94315936041904 notify 124554051626 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c7a3cead40 con 0x55c7a3d0db50 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.460+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d09340 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.461+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(163 foo@foo.com [delete] v29'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.461+0000 7f2c4e726800 10 removing user buckets index 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.461+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.461+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94315936041904 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x7f2c44047070 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== watch-notify(notify (1) cookie 94315935282528 notify 124554051617 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55c7a3bdeef0 con 0x7f2c44047070 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2b2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051617 cookie 94315935282528 notifier 4775 bl.length()=160 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 46 ==== osd_op_reply(164 notify.5 [notify cookie 94315936041904 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2b2dffb640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2b10003d50 con 0x7f2c44047070 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 47 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 48 ==== watch-notify(notify_complete (2) cookie 94315936041904 notify 124554051617 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2c4004e070 con 0x7f2c44047070 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.462+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d0db50 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 54 ==== osd_op_reply(166 foo.buckets [delete] v29'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2c4e726800 10 removing user index: foo 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2c4e726800 10 removing default.rgw.meta+users.uid+foo from cache 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2c4e726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94315936041904 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d78880 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== watch-notify(notify (1) cookie 94315935280384 notify 124554051602 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f2c4004e070 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.463+0000 7f2b2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94315935280384 notifier 4775 bl.length()=152 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.464+0000 7f2b2d7fa640 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2a800032b0 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.464+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(167 notify.4 [notify cookie 94315936041904 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.464+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.464+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 41 ==== watch-notify(notify_complete (2) cookie 94315936041904 notify 124554051602 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2c40097420 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.464+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d787b0 con 0x55c7a3d09340 2024-02-16T00:12:33.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.465+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 42 ==== osd_op_reply(169 foo [call,call,delete] v29'19 uv19 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.466+0000 7f2b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.466+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94315935288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d67e00 con 0x55c7a3d09340 2024-02-16T00:12:33.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.467+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 43 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94315935288416] v29'242 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.467+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94315935265072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1cc60 con 0x55c7a3d0db50 2024-02-16T00:12:33.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.468+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 55 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94315935265072] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.468+0000 7f2c4e726800 20 remove_watcher() i=0 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.468+0000 7f2c4e726800 2 removed watcher, disabling cache 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.468+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94315935268640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1cc60 con 0x55c7a3d09340 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.469+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 44 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94315935268640] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.469+0000 7f2c4e726800 20 remove_watcher() i=1 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.469+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94315935269696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d17f20 con 0x55c7a3d12820 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.470+0000 7f2c4a42d640 1 -- 172.21.15.42:0/2485902893 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94315935269696] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c3c029990 con 0x55c7a3d12820 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.470+0000 7f2c4e726800 20 remove_watcher() i=2 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.470+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94315935275424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1cc60 con 0x55c7a3d0db50 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.471+0000 7f2c4ac2e640 1 -- 172.21.15.42:0/2485902893 <== osd.2 v2:172.21.15.42:6808/1288904824 56 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94315935275424] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c44062080 con 0x55c7a3d0db50 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.471+0000 7f2c4e726800 20 remove_watcher() i=3 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.471+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94315935280384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1cc60 con 0x55c7a3d09340 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.472+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.1 v2:172.21.15.42:6800/2950936693 45 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94315935280384] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x55c7a3d09340 2024-02-16T00:12:33.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.472+0000 7f2c4e726800 20 remove_watcher() i=4 2024-02-16T00:12:33.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.472+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94315935282528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1ad00 con 0x7f2c44047070 2024-02-16T00:12:33.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.473+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 49 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94315935282528] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.473+0000 7f2c4e726800 20 remove_watcher() i=5 2024-02-16T00:12:33.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.473+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94315935274240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1cc60 con 0x7f2c44047070 2024-02-16T00:12:33.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.474+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 50 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94315935274240] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.474+0000 7f2c4e726800 20 remove_watcher() i=6 2024-02-16T00:12:33.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.474+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94315935287360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c7a3d1b560 con 0x7f2c44047070 2024-02-16T00:12:33.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.475+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 <== osd.0 v2:172.21.15.2:6800/1783370926 51 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94315935287360] v29'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2c40052b00 con 0x7f2c44047070 2024-02-16T00:12:33.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.475+0000 7f2c4e726800 20 remove_watcher() i=7 2024-02-16T00:12:33.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2c44047070 msgr2=0x7f2c44047670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f2c44047070 0x7f2c44047670 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3d09340 msgr2=0x55c7a3d0b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3d09340 0x55c7a3d0b800 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3d0db50 msgr2=0x55c7a3d0ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3d0db50 0x55c7a3d0ff40 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c7a3d12820 msgr2=0x55c7a3d14ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55c7a3d12820 0x55c7a3d14ce0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b140367e0 msgr2=0x7f2b14038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b140367e0 0x7f2b14038ca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c029ca0 tx=0x7f2c3c031000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 msgr2=0x55c7a3cfd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cfd5e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2c4404e0f0 tx=0x7f2c4404c390 comp rx=0 tx=0).stop 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c49c2c640 1 -- 172.21.15.42:0/2485902893 reap_dead start 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 shutdown_connections 2024-02-16T00:12:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2485902893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3cf66d0 0x55c7a3cfd5e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 >> 172.21.15.42:0/2485902893 conn(0x55c7a3cf29a0 msgr2=0x55c7a3cf0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 shutdown_connections 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/2485902893 wait complete. 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b24036790 msgr2=0x7f2b24038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b24036790 0x7f2b24038c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55c7a3cd5dc0 tx=0x7f2c3c028ef0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 msgr2=0x55c7a3ce98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 0x55c7a3ce98d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x55c7a3ccf260 tx=0x7f2c4400aea0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 shutdown_connections 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b24036790 0x7f2b24038c50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 --2- 172.21.15.42:0/1309580460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3ce94b0 0x55c7a3ce98d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 >> 172.21.15.42:0/1309580460 conn(0x55c7a3cdd580 msgr2=0x55c7a3cdd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 shutdown_connections 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.476+0000 7f2c4e726800 1 -- 172.21.15.42:0/1309580460 wait complete. 2024-02-16T00:12:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3bdb5b0 msgr2=0x55c7a3cd5380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3bdb5b0 0x55c7a3cd5380 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3cd7c00 msgr2=0x55c7a3cd9ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3cd7c00 0x55c7a3cd9ff0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b30036790 msgr2=0x7f2b30038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b30036790 0x7f2b30038c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c40054000 tx=0x7f2c4004e000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 msgr2=0x55c7a3cce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cce690 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55c7a3cc7d40 tx=0x7f2c3c000f40 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 shutdown_connections 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c7a3cd7c00 0x55c7a3cd9ff0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c7a3bdb5b0 0x55c7a3cd5380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f2b30036790 0x7f2b30038c50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 --2- 172.21.15.42:0/2850042846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7a3bd7aa0 0x55c7a3cce690 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 >> 172.21.15.42:0/2850042846 conn(0x55c7a3bd14f0 msgr2=0x55c7a3cc1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 shutdown_connections 2024-02-16T00:12:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.477+0000 7f2c4e726800 1 -- 172.21.15.42:0/2850042846 wait complete. 2024-02-16T00:12:33.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T00:12:33.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T00:12:33.488 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T00:12:33.570 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.570 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f008c531800 1 Processor -- start 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f008c531800 1 -- start start 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f008c531800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564c3a7e2a00 0x564c3a7e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f008c531800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564c3a72cbb0 con 0x564c3a7e5330 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f008c531800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x564c3a6e4450 con 0x564c3a7e2a00 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f00882f2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564c3a7e2a00 0x564c3a7e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f0087af1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564c3a7e5330 0x564c3a7e7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33768/0 (socket says 172.21.15.42:33768) 2024-02-16T00:12:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.568+0000 7f0087af1640 1 -- 172.21.15.42:0/2506625938 learned_addr learned my addr 172.21.15.42:0/2506625938 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:33.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.569+0000 7f00882f2640 1 -- 172.21.15.42:0/2506625938 >> v1:172.21.15.2:6789/0 conn(0x564c3a7e5330 legacy=0x564c3a7e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.569+0000 7f00882f2640 1 -- 172.21.15.42:0/2506625938 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3a7e9e50 con 0x564c3a7e2a00 2024-02-16T00:12:33.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.571+0000 7f00882f2640 1 --2- 172.21.15.42:0/2506625938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a7e4df0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f007800a470 tx=0x7f007801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e62c21b11e81ff server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.571+0000 7f00872f0640 1 -- 172.21.15.42:0/2506625938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0078052570 con 0x564c3a7e2a00 2024-02-16T00:12:33.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.571+0000 7f00872f0640 1 -- 172.21.15.42:0/2506625938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780526d0 con 0x564c3a7e2a00 2024-02-16T00:12:33.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.571+0000 7f00872f0640 1 -- 172.21.15.42:0/2506625938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0078052990 con 0x564c3a7e2a00 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 -- 172.21.15.42:0/2506625938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 msgr2=0x564c3a7e4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 --2- 172.21.15.42:0/2506625938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a7e4df0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f007800a470 tx=0x7f007801cd60 comp rx=0 tx=0).stop 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 -- 172.21.15.42:0/2506625938 shutdown_connections 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 --2- 172.21.15.42:0/2506625938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a7e4df0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 -- 172.21.15.42:0/2506625938 >> 172.21.15.42:0/2506625938 conn(0x564c3a7dc4d0 msgr2=0x564c3a7de8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 -- 172.21.15.42:0/2506625938 shutdown_connections 2024-02-16T00:12:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.572+0000 7f008c531800 1 -- 172.21.15.42:0/2506625938 wait complete. 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.583+0000 7f008c531800 1 Processor -- start 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.583+0000 7f008c531800 1 -- start start 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.583+0000 7f008c531800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.583+0000 7f008c531800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3a6e1980 con 0x564c3a7e2a00 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7f00882f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7f00882f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56296/0 (socket says 172.21.15.42:56296) 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7f00882f2640 1 -- 172.21.15.42:0/2085819629 learned_addr learned my addr 172.21.15.42:0/2085819629 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7f00882f2640 1 -- 172.21.15.42:0/2085819629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078005d20 con 0x564c3a7e2a00 2024-02-16T00:12:33.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7f00882f2640 1 --2- 172.21.15.42:0/2085819629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d1fd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0078055040 tx=0x7f007804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3002ea095e9b37cb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7eff7660c640 1 -- 172.21.15.42:0/2085819629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f007800a180 con 0x564c3a7e2a00 2024-02-16T00:12:33.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7eff7660c640 1 -- 172.21.15.42:0/2085819629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007800a2e0 con 0x564c3a7e2a00 2024-02-16T00:12:33.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.584+0000 7eff7660c640 1 -- 172.21.15.42:0/2085819629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00780529b0 con 0x564c3a7e2a00 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 -- 172.21.15.42:0/2085819629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 msgr2=0x564c3a8d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 --2- 172.21.15.42:0/2085819629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d1fd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0078055040 tx=0x7f007804c000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 -- 172.21.15.42:0/2085819629 shutdown_connections 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 --2- 172.21.15.42:0/2085819629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d1fd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 -- 172.21.15.42:0/2085819629 >> 172.21.15.42:0/2085819629 conn(0x564c3a7dc4d0 msgr2=0x564c3a8cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 -- 172.21.15.42:0/2085819629 shutdown_connections 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 -- 172.21.15.42:0/2085819629 wait complete. 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 Processor -- start 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 -- start start 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.585+0000 7f008c531800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f008c531800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3a6dd160 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f00882f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f00882f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56312/0 (socket says 172.21.15.42:56312) 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f00882f2640 1 -- 172.21.15.42:0/3220390376 learned_addr learned my addr 172.21.15.42:0/3220390376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f00882f2640 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3a7e9e50 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f00882f2640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d9580 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0078005870 tx=0x7f0078002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7eff74e09640 1 -- 172.21.15.42:0/3220390376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f007806a070 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7eff74e09640 1 -- 172.21.15.42:0/3220390376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007805d550 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7eff74e09640 1 -- 172.21.15.42:0/3220390376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f007805d7f0 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c3a8d9ac0 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.586+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c3a8d9fa0 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.587+0000 7eff74e09640 1 -- 172.21.15.42:0/3220390376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f007805d950 con 0x564c3a7e2a00 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.587+0000 7eff74e09640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff70036790 0x7eff70038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.587+0000 7eff74e09640 1 -- 172.21.15.42:0/3220390376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f007808dc50 con 0x564c3a7e2a00 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f0087af1640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff70036790 0x7eff70038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a7e5330 0x564c3a8e0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a8e0840 con 0x564c3a7e5330 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f0088af3640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a7e5330 0x564c3a8e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f0087af1640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff70036790 0x7eff70038c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f60 tx=0x7f007c0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f0088af3640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a7e5330 0x564c3a8e0270 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f0088af3640 1 -- 172.21.15.42:0/3220390376 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a7e5330 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.588+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a8dd920 con 0x564c3a7e5330 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f0088af3640 1 -- 172.21.15.42:0/3220390376 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a7e5330 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a8e2a80 0x564c3a8e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a8e5540 con 0x564c3a8e2a80 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f00882f2640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a8e2a80 0x564c3a8e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f00882f2640 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a8e2a80 0x564c3a8e4e70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f00882f2640 1 -- 172.21.15.42:0/3220390376 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0078059040 con 0x564c3a8e2a80 2024-02-16T00:12:33.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.589+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a8e1a00 con 0x564c3a7e5330 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f0088af3640 1 -- 172.21.15.42:0/3220390376 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a7e5330 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a8e1e10 con 0x564c3a7e5330 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f0088af3640 1 -- 172.21.15.42:0/3220390376 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a7e5330 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f008c531800 1 Processor -- start 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f008c531800 1 -- start start 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f008c531800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 0x564c3a8f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.590+0000 7f008c531800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3a67fe80 con 0x564c3a8f4330 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7f0088af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 0x564c3a8f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7f0088af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 0x564c3a8f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56318/0 (socket says 172.21.15.42:56318) 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7f0088af3640 1 -- 172.21.15.42:0/825596304 learned_addr learned my addr 172.21.15.42:0/825596304 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7f0088af3640 1 -- 172.21.15.42:0/825596304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3a8f4c90 con 0x564c3a8f4330 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7f0088af3640 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 0x564c3a8f4750 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x564c3a8e0ba0 tx=0x7f0080018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7eff6dffb640 1 -- 172.21.15.42:0/825596304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f008001d070 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7eff6dffb640 1 -- 172.21.15.42:0/825596304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800182e0 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c3a8f5700 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.591+0000 7eff6dffb640 1 -- 172.21.15.42:0/825596304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00800145e0 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.592+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c3a8f5bc0 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.592+0000 7eff6dffb640 1 -- 172.21.15.42:0/825596304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0080020020 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.592+0000 7eff6dffb640 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff600367e0 0x7eff60038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.592+0000 7eff6dffb640 1 -- 172.21.15.42:0/825596304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f008004dd70 con 0x564c3a8f4330 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.592+0000 7f00882f2640 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff600367e0 0x7eff60038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f008c531800 1 Processor -- start 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f008c531800 1 -- start start 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f00882f2640 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff600367e0 0x7eff60038ca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x564c3a8e0c10 tx=0x7f007805c600 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f008c531800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a901990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f008c531800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3a6555d0 con 0x564c3a901570 2024-02-16T00:12:33.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f0088af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a901990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f0088af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a901990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56328/0 (socket says 172.21.15.42:56328) 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f0088af3640 1 -- 172.21.15.42:0/3717069522 learned_addr learned my addr 172.21.15.42:0/3717069522 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.593+0000 7f0088af3640 1 -- 172.21.15.42:0/3717069522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3a901f60 con 0x564c3a901570 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f0088af3640 1 --2- 172.21.15.42:0/3717069522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a901990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f008004c020 tx=0x7f0080011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a675e0fe7295f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7eff677fe640 1 -- 172.21.15.42:0/3717069522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f008004d070 con 0x564c3a901570 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7eff677fe640 1 -- 172.21.15.42:0/3717069522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080016440 con 0x564c3a901570 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7eff677fe640 1 -- 172.21.15.42:0/3717069522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080014b10 con 0x564c3a901570 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 -- 172.21.15.42:0/3717069522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 msgr2=0x564c3a901990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 --2- 172.21.15.42:0/3717069522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a901990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f008004c020 tx=0x7f0080011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 -- 172.21.15.42:0/3717069522 shutdown_connections 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 --2- 172.21.15.42:0/3717069522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a901990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 -- 172.21.15.42:0/3717069522 >> 172.21.15.42:0/3717069522 conn(0x564c3a8fd8d0 msgr2=0x564c3a8fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 -- 172.21.15.42:0/3717069522 shutdown_connections 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.594+0000 7f008c531800 1 -- 172.21.15.42:0/3717069522 wait complete. 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f008c531800 1 Processor -- start 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f008c531800 1 -- start start 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f008c531800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a9084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f008c531800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3a9089e0 con 0x564c3a901570 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f0088af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a9084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f0088af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a9084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56334/0 (socket says 172.21.15.42:56334) 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 learned_addr learned my addr 172.21.15.42:0/3800459498 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3a8f5bc0 con 0x564c3a901570 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.595+0000 7f0088af3640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a9084a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f008004bf50 tx=0x7f008004bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7eff65ffb640 1 -- 172.21.15.42:0/3800459498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080032070 con 0x564c3a901570 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7eff65ffb640 1 -- 172.21.15.42:0/3800459498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800116f0 con 0x564c3a901570 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7eff65ffb640 1 -- 172.21.15.42:0/3800459498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00800133b0 con 0x564c3a901570 2024-02-16T00:12:33.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c3a908be0 con 0x564c3a901570 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c3a909040 con 0x564c3a901570 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7eff65ffb640 1 -- 172.21.15.42:0/3800459498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0080013510 con 0x564c3a901570 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7eff65ffb640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff580367e0 0x7eff58038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.596+0000 7eff65ffb640 1 -- 172.21.15.42:0/3800459498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0080037d40 con 0x564c3a901570 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f00882f2640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff580367e0 0x7eff58038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a914170 0x564c3a916630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a916d80 con 0x564c3a914170 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f0087af1640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a914170 0x564c3a916630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f00882f2640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff580367e0 0x7eff58038ca0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f007805cfd0 tx=0x7f0078092000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f0087af1640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a914170 0x564c3a916630 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 20 realm 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.597+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a913690 con 0x564c3a914170 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a917800 con 0x564c3a914170 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a917d10 con 0x564c3a914170 2024-02-16T00:12:33.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a918ac0 0x564c3a91aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.598+0000 7f0088af3640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a918ac0 0x564c3a91aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f0088af3640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a918ac0 0x564c3a91aeb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f008c531800 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f008c531800 20 searching for the correct realm 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564c3a91d410 0x564c3a91f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91ff80 con 0x564c3a91d410 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f00882f2640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564c3a91d410 0x564c3a91f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.599+0000 7f00882f2640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564c3a91d410 0x564c3a91f8b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.600+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.600+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91ff80 con 0x564c3a918ac0 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.600+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.600+0000 7f0088af3640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0080014070 0x7f00800176b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.600+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.600+0000 7f0087af1640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0080014070 0x7f00800176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.601+0000 7f0087af1640 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0080014070 0x7f00800176b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.601+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.601+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.601+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.601+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.602+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.603+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.604+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.605+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.606+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.607+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.607+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.607+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.607+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.607+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.607+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.608+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.608+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a91d410 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.608+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.608+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x7f0080014070 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.608+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.608+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a914170 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91b430 con 0x564c3a918ac0 2024-02-16T00:12:33.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91bd30 con 0x564c3a914170 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.609+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91c0e0 con 0x564c3a914170 2024-02-16T00:12:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a91c4c0 con 0x564c3a914170 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 zone default found 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 4 Realm: () 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 zonegroup default 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a9203c0 con 0x7f0080014070 2024-02-16T00:12:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.610+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a922240 con 0x564c3a91d410 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a9225a0 con 0x564c3a91d410 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 20 started sync module instance, tier type = 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.611+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a921680 con 0x564c3a918ac0 2024-02-16T00:12:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.612+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.612+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94885400154896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a921ed0 con 0x564c3a918ac0 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.612+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a922f90 con 0x564c3a914170 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.613+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94885400154896] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.614+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.614+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94885400160880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a923340 con 0x564c3a914170 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.614+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a923d40 con 0x564c3a91d410 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.615+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.615+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94885400164416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a924580 con 0x564c3a91d410 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.615+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a925020 con 0x564c3a918ac0 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.615+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94885400160880] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.616+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94885400164416] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.616+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.616+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94885400169216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a9240a0 con 0x564c3a918ac0 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.616+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a925a10 con 0x564c3a914170 2024-02-16T00:12:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.617+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94885400169216] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.617+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.617+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94885400156720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a925a10 con 0x564c3a914170 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.617+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a926380 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.618+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94885400156720] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.618+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.618+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94885400174784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a925a10 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.618+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a926d80 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.619+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94885400174784] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.619+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.619+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94885400176800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a926f60 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.619+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a927760 con 0x7f0080014070 2024-02-16T00:12:33.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(58 notify.7 [create] v29'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94885400176800] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94885400179008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a925630 con 0x7f0080014070 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=0 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=1 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=2 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=3 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=4 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=5 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.620+0000 7f008c531800 20 add_watcher() i=6 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.621+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94885400179008] v29'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.621+0000 7f008c531800 20 add_watcher() i=7 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.621+0000 7f008c531800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.621+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a92acd0 con 0x564c3a914170 2024-02-16T00:12:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.621+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.622+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94885400180128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a928000 con 0x564c3a914170 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.622+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94885400180128] v29'243 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7eff3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 5 note: GC not initialized 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7eff3d7e2640 20 reqs_thread_entry: start 2024-02-16T00:12:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 20 Filter name: none 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7efeaeffd640 20 reqs_thread_entry: start 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 20 rados->read ofs=0 len=0 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a95c780 con 0x564c3a914170 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.623+0000 7f008c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:could not fetch user info: no user info saved 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.624+0000 7eff3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.624+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94885400180128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a95c740 con 0x564c3a914170 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.625+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94885400180128] v29'244 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.625+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94885400154896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a95c740 con 0x564c3a918ac0 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.626+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94885400154896] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.626+0000 7f008c531800 20 remove_watcher() i=0 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.626+0000 7f008c531800 2 removed watcher, disabling cache 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.626+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94885400160880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a95c740 con 0x564c3a914170 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.627+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94885400160880] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.627+0000 7f008c531800 20 remove_watcher() i=1 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.627+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94885400164416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a95c740 con 0x564c3a91d410 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.628+0000 7f00882f2640 1 -- 172.21.15.42:0/3800459498 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94885400164416] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00780a4040 con 0x564c3a91d410 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.628+0000 7f008c531800 20 remove_watcher() i=2 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.628+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94885400169216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a921310 con 0x564c3a918ac0 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.629+0000 7f0088af3640 1 -- 172.21.15.42:0/3800459498 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94885400169216] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f008000a4a0 con 0x564c3a918ac0 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.629+0000 7f008c531800 20 remove_watcher() i=3 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.629+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94885400156720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a921310 con 0x564c3a914170 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.630+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94885400156720] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x564c3a914170 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.631+0000 7f008c531800 20 remove_watcher() i=4 2024-02-16T00:12:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.631+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94885400174784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a921310 con 0x7f0080014070 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.632+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94885400174784] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.632+0000 7f008c531800 20 remove_watcher() i=5 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.632+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94885400176800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a9260c0 con 0x7f0080014070 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.633+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94885400176800] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.633+0000 7f008c531800 20 remove_watcher() i=6 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.633+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94885400179008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564c3a921310 con 0x7f0080014070 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94885400179008] v29'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c006070 con 0x7f0080014070 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 20 remove_watcher() i=7 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0080014070 msgr2=0x7f00800176b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f0080014070 0x7f00800176b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a914170 msgr2=0x564c3a916630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a914170 0x564c3a916630 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a918ac0 msgr2=0x564c3a91aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a918ac0 0x564c3a91aeb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564c3a91d410 msgr2=0x564c3a91f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x564c3a91d410 0x564c3a91f8b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff580367e0 msgr2=0x7eff58038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff580367e0 0x7eff58038ca0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f007805cfd0 tx=0x7f0078092000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 msgr2=0x564c3a9084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a9084a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f008004bf50 tx=0x7f008004bf80 comp rx=0 tx=0).stop 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f0087af1640 1 -- 172.21.15.42:0/3800459498 reap_dead start 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 shutdown_connections 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/3800459498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a901570 0x564c3a9084a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 >> 172.21.15.42:0/3800459498 conn(0x564c3a8fd8d0 msgr2=0x564c3a8faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 shutdown_connections 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/3800459498 wait complete. 2024-02-16T00:12:33.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff600367e0 msgr2=0x7eff60038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff600367e0 0x7eff60038ca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x564c3a8e0c10 tx=0x7f007805c600 comp rx=0 tx=0).stop 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 msgr2=0x564c3a8f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 0x564c3a8f4750 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x564c3a8e0ba0 tx=0x7f0080018830 comp rx=0 tx=0).stop 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 shutdown_connections 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff600367e0 0x7eff60038ca0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 --2- 172.21.15.42:0/825596304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a8f4330 0x564c3a8f4750 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 >> 172.21.15.42:0/825596304 conn(0x564c3a8e83d0 msgr2=0x564c3a8e87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 shutdown_connections 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.634+0000 7f008c531800 1 -- 172.21.15.42:0/825596304 wait complete. 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a7e5330 msgr2=0x564c3a8e0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a7e5330 0x564c3a8e0270 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a8e2a80 msgr2=0x564c3a8e4e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a8e2a80 0x564c3a8e4e70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff70036790 msgr2=0x7eff70038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff70036790 0x7eff70038c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f60 tx=0x7f007c0012b0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 msgr2=0x564c3a8d9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d9580 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0078005870 tx=0x7f0078002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 shutdown_connections 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564c3a8e2a80 0x564c3a8e4e70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564c3a7e5330 0x564c3a8e0270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7eff70036790 0x7eff70038c50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 --2- 172.21.15.42:0/3220390376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c3a7e2a00 0x564c3a8d9580 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 >> 172.21.15.42:0/3220390376 conn(0x564c3a7dc4d0 msgr2=0x564c3a8cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 shutdown_connections 2024-02-16T00:12:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.635+0000 7f008c531800 1 -- 172.21.15.42:0/3220390376 wait complete. 2024-02-16T00:12:33.647 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-16T00:12:33.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-02-16T00:12:33.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-02-16T00:12:33.648 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-02-16T00:12:33.728 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.728 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.726+0000 7f73a352d800 1 Processor -- start 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.726+0000 7f73a352d800 1 -- start start 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.726+0000 7f73a352d800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5633660dcf20 0x563366171f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.726+0000 7f73a352d800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5633660b3bb0 con 0x5633660de300 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.726+0000 7f73a352d800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x56336606b450 con 0x5633660dcf20 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.727+0000 7f739ea33640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5633660dcf20 0x563366171f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.727+0000 7f739ea33640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5633660dcf20 0x563366171f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56342/0 (socket says 172.21.15.42:56342) 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.727+0000 7f739ea33640 1 -- 172.21.15.42:0/4104329280 learned_addr learned my addr 172.21.15.42:0/4104329280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.727+0000 7f739f234640 1 --1- 172.21.15.42:0/4104329280 >> v1:172.21.15.2:6789/0 conn(0x5633660de300 0x5633660dc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33772/0 (socket says 172.21.15.42:33772) 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.727+0000 7f739ea33640 1 -- 172.21.15.42:0/4104329280 >> v1:172.21.15.2:6789/0 conn(0x5633660de300 legacy=0x5633660dc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.727+0000 7f739ea33640 1 -- 172.21.15.42:0/4104329280 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633660dd490 con 0x5633660dcf20 2024-02-16T00:12:33.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.729+0000 7f739ea33640 1 --2- 172.21.15.42:0/4104329280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366171f40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f738800a520 tx=0x7f738801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcef4bc591205ed server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.729+0000 7f739e232640 1 -- 172.21.15.42:0/4104329280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7388052570 con 0x5633660dcf20 2024-02-16T00:12:33.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.729+0000 7f739e232640 1 -- 172.21.15.42:0/4104329280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73880526d0 con 0x5633660dcf20 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.729+0000 7f739e232640 1 -- 172.21.15.42:0/4104329280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7388052990 con 0x5633660dcf20 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 -- 172.21.15.42:0/4104329280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 msgr2=0x563366171f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 --2- 172.21.15.42:0/4104329280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366171f40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f738800a520 tx=0x7f738801cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 -- 172.21.15.42:0/4104329280 shutdown_connections 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 --2- 172.21.15.42:0/4104329280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366171f40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 -- 172.21.15.42:0/4104329280 >> 172.21.15.42:0/4104329280 conn(0x563366164660 msgr2=0x563366166a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 -- 172.21.15.42:0/4104329280 shutdown_connections 2024-02-16T00:12:33.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.730+0000 7f73a352d800 1 -- 172.21.15.42:0/4104329280 wait complete. 2024-02-16T00:12:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f73a352d800 1 Processor -- start 2024-02-16T00:12:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f73a352d800 1 -- start start 2024-02-16T00:12:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f73a352d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x56336625b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f73a352d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563366068980 con 0x5633660dcf20 2024-02-16T00:12:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f739f234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x56336625b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f739f234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x56336625b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56354/0 (socket says 172.21.15.42:56354) 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f739f234640 1 -- 172.21.15.42:0/2022166984 learned_addr learned my addr 172.21.15.42:0/2022166984 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f739f234640 1 -- 172.21.15.42:0/2022166984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388005de0 con 0x5633660dcf20 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.742+0000 7f739f234640 1 --2- 172.21.15.42:0/2022166984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x56336625b3d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7390006f60 tx=0x7f7390006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56f5fefb04cf6cc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f728d60a640 1 -- 172.21.15.42:0/2022166984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7390013420 con 0x5633660dcf20 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f728d60a640 1 -- 172.21.15.42:0/2022166984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73900135a0 con 0x5633660dcf20 2024-02-16T00:12:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f728d60a640 1 -- 172.21.15.42:0/2022166984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73900138c0 con 0x5633660dcf20 2024-02-16T00:12:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 -- 172.21.15.42:0/2022166984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 msgr2=0x56336625b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 --2- 172.21.15.42:0/2022166984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x56336625b3d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7390006f60 tx=0x7f7390006f90 comp rx=0 tx=0).stop 2024-02-16T00:12:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 -- 172.21.15.42:0/2022166984 shutdown_connections 2024-02-16T00:12:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 --2- 172.21.15.42:0/2022166984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x56336625b3d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 -- 172.21.15.42:0/2022166984 >> 172.21.15.42:0/2022166984 conn(0x563366164660 msgr2=0x563366256cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 -- 172.21.15.42:0/2022166984 shutdown_connections 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.743+0000 7f73a352d800 1 -- 172.21.15.42:0/2022166984 wait complete. 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f73a352d800 1 Processor -- start 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f73a352d800 1 -- start start 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f73a352d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366262ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f73a352d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563366064160 con 0x5633660dcf20 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f739f234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366262ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f739f234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366262ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56358/0 (socket says 172.21.15.42:56358) 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f739f234640 1 -- 172.21.15.42:0/2026895287 learned_addr learned my addr 172.21.15.42:0/2026895287 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.744+0000 7f739f234640 1 -- 172.21.15.42:0/2026895287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633660b3bb0 con 0x5633660dcf20 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f739f234640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366262ae0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7390007fd0 tx=0x7f7390000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f728be07640 1 -- 172.21.15.42:0/2026895287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73900067e0 con 0x5633660dcf20 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f728be07640 1 -- 172.21.15.42:0/2026895287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7390004a40 con 0x5633660dcf20 2024-02-16T00:12:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563366263020 con 0x5633660dcf20 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f728be07640 1 -- 172.21.15.42:0/2026895287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7390004d60 con 0x5633660dcf20 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563366263500 con 0x5633660dcf20 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f73a352d800 1 Processor -- start 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.745+0000 7f73a352d800 1 -- start start 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f73a352d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366270260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f73a352d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563366006e80 con 0x56336626fe40 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f728be07640 1 -- 172.21.15.42:0/2026895287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f739001e420 con 0x5633660dcf20 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f728be07640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7284036790 0x7f7284038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739fa35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366270260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f728be07640 1 -- 172.21.15.42:0/2026895287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f739004c050 con 0x5633660dcf20 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739fa35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366270260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56360/0 (socket says 172.21.15.42:56360) 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739fa35640 1 -- 172.21.15.42:0/2105466330 learned_addr learned my addr 172.21.15.42:0/2105466330 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739f234640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7284036790 0x7f7284038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739fa35640 1 -- 172.21.15.42:0/2105466330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633662707a0 con 0x56336626fe40 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739f234640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7284036790 0x7f7284038c50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7390011ff0 tx=0x7f7390011f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.746+0000 7f739fa35640 1 --2- 172.21.15.42:0/2105466330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366270260 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f739800a400 tx=0x7f739800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4507ca84f0e3e6da server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f7289e03640 1 -- 172.21.15.42:0/2105466330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73980087e0 con 0x56336626fe40 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f7289e03640 1 -- 172.21.15.42:0/2105466330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398008960 con 0x56336626fe40 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f7289e03640 1 -- 172.21.15.42:0/2105466330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7398008c80 con 0x56336626fe40 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 -- 172.21.15.42:0/2105466330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 msgr2=0x563366270260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 --2- 172.21.15.42:0/2105466330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366270260 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f739800a400 tx=0x7f739800a8c0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 -- 172.21.15.42:0/2105466330 shutdown_connections 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 --2- 172.21.15.42:0/2105466330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366270260 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 -- 172.21.15.42:0/2105466330 >> 172.21.15.42:0/2105466330 conn(0x5633660de300 msgr2=0x56336626c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 -- 172.21.15.42:0/2105466330 shutdown_connections 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 -- 172.21.15.42:0/2105466330 wait complete. 2024-02-16T00:12:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 Processor -- start 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.747+0000 7f73a352d800 1 -- start start 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f73a352d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366276c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f73a352d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563365fdc5d0 con 0x56336626fe40 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f739fa35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366276c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f739fa35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366276c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56366/0 (socket says 172.21.15.42:56366) 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f739fa35640 1 -- 172.21.15.42:0/202702983 learned_addr learned my addr 172.21.15.42:0/202702983 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f739fa35640 1 -- 172.21.15.42:0/202702983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7398005c90 con 0x56336626fe40 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f739fa35640 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366276c50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f739800c010 tx=0x7f7398002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f727bfff640 1 -- 172.21.15.42:0/202702983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7398013a80 con 0x56336626fe40 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f727bfff640 1 -- 172.21.15.42:0/202702983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398013be0 con 0x56336626fe40 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563366277190 con 0x56336626fe40 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.748+0000 7f727bfff640 1 -- 172.21.15.42:0/202702983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f739801e420 con 0x56336626fe40 2024-02-16T00:12:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.749+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563366277590 con 0x56336626fe40 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.749+0000 7f727bfff640 1 -- 172.21.15.42:0/202702983 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f739801e580 con 0x56336626fe40 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.749+0000 7f727bfff640 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f72800367e0 0x7f7280038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.749+0000 7f727bfff640 1 -- 172.21.15.42:0/202702983 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f739804c430 con 0x56336626fe40 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f739ea33640 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f72800367e0 0x7f7280038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f73a352d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f73a352d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f73a352d800 1 Processor -- start 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f73a352d800 1 -- start start 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f739ea33640 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f72800367e0 0x7f7280038ca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7388054000 tx=0x7f738804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f73a352d800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 0x563366295910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f73a352d800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563366295e50 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f739f234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 0x563366295910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f739f234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 0x563366295910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56382/0 (socket says 172.21.15.42:56382) 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.750+0000 7f739f234640 1 -- 172.21.15.42:0/2723865477 learned_addr learned my addr 172.21.15.42:0/2723865477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f739f234640 1 -- 172.21.15.42:0/2723865477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563366295f90 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f739f234640 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 0x563366295910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7390010fd0 tx=0x7f739004a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f71effff640 1 -- 172.21.15.42:0/2723865477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73900123c0 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f71effff640 1 -- 172.21.15.42:0/2723865477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7390036070 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633662968c0 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f71effff640 1 -- 172.21.15.42:0/2723865477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7390011710 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.751+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563366296d80 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f71effff640 1 -- 172.21.15.42:0/2723865477 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7390044020 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f71effff640 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f71e00367e0 0x7f71e0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f71effff640 1 -- 172.21.15.42:0/2723865477 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7390048d30 con 0x5633662954f0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f739ea33640 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f71e00367e0 0x7f71e0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f71edffb640 20 reqs_thread_entry: start 2024-02-16T00:12:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633662a2430 0x5633662a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f739ea33640 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f71e00367e0 0x7f71e0038ca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73880526a0 tx=0x7f7388005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633662a4d60 con 0x5633662a2430 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.752+0000 7f739fa35640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633662a2430 0x5633662a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.753+0000 7f739fa35640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633662a2430 0x5633662a4820 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.753+0000 7f739fa35640 1 -- 172.21.15.42:0/2026895287 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7398024070 con 0x5633662a2430 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.753+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633662a6ab0 0x5633662a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.753+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:2 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633662a9570 con 0x5633662a6ab0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.753+0000 7f739f234640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633662a6ab0 0x5633662a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.754+0000 7f739f234640 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633662a6ab0 0x5633662a8ea0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.754+0000 7f739f234640 1 -- 172.21.15.42:0/2026895287 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(2 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7390024070 con 0x5633662a6ab0 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f72800367e0 msgr2=0x7f7280038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f72800367e0 0x7f7280038ca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7388054000 tx=0x7f738804e000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 msgr2=0x563366276c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366276c50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f739800c010 tx=0x7f7398002ff0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 shutdown_connections 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f72800367e0 0x7f7280038ca0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/202702983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56336626fe40 0x563366276c50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 >> 172.21.15.42:0/202702983 conn(0x5633660de300 msgr2=0x563366269f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 shutdown_connections 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/202702983 wait complete. 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f71e00367e0 msgr2=0x7f71e0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f71e00367e0 0x7f71e0038ca0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73880526a0 tx=0x7f7388005ac0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 msgr2=0x563366295910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 0x563366295910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7390010fd0 tx=0x7f739004a320 comp rx=0 tx=0).stop 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 shutdown_connections 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f71e00367e0 0x7f71e0038ca0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/2723865477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633662954f0 0x563366295910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 >> 172.21.15.42:0/2723865477 conn(0x563366169630 msgr2=0x56336616a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 shutdown_connections 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2723865477 wait complete. 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633662a2430 msgr2=0x5633662a4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633662a2430 0x5633662a4820 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633662a6ab0 msgr2=0x5633662a8ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.755+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633662a6ab0 0x5633662a8ea0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7284036790 msgr2=0x7f7284038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7284036790 0x7f7284038c50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7390011ff0 tx=0x7f7390011f60 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 msgr2=0x563366262ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366262ae0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7390007fd0 tx=0x7f7390000f40 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 shutdown_connections 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5633662a6ab0 0x5633662a8ea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5633662a2430 0x5633662a4820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7284036790 0x7f7284038c50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 --2- 172.21.15.42:0/2026895287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5633660dcf20 0x563366262ae0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 >> 172.21.15.42:0/2026895287 conn(0x563366164660 msgr2=0x563366259dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 shutdown_connections 2024-02-16T00:12:33.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.756+0000 7f73a352d800 1 -- 172.21.15.42:0/2026895287 wait complete. 2024-02-16T00:12:33.766 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T00:12:33.767 DEBUG:tasks.util.rgw: json result: {'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T00:12:33.767 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-02-16T00:12:33.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-02-16T00:12:33.767 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-02-16T00:12:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.846 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.844+0000 7f4db7131800 1 Processor -- start 2024-02-16T00:12:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.844+0000 7f4db7131800 1 -- start start 2024-02-16T00:12:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.844+0000 7f4db7131800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cc61d7ae60 0x55cc61d7b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.844+0000 7f4db7131800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cc61cc6ba0 con 0x55cc61d7c0c0 2024-02-16T00:12:33.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.844+0000 7f4db7131800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cc61c7e450 con 0x55cc61d7ae60 2024-02-16T00:12:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.845+0000 7f4db2e67640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cc61d7ae60 0x55cc61d7b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.845+0000 7f4db2e67640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55cc61d7ae60 0x55cc61d7b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56388/0 (socket says 172.21.15.42:56388) 2024-02-16T00:12:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.845+0000 7f4db2e67640 1 -- 172.21.15.42:0/3168121229 learned_addr learned my addr 172.21.15.42:0/3168121229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.845+0000 7f4db2e67640 1 -- 172.21.15.42:0/3168121229 >> v1:172.21.15.2:6789/0 conn(0x55cc61d7c0c0 legacy=0x55cc61d7c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.845+0000 7f4db2e67640 1 -- 172.21.15.42:0/3168121229 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc61d7b950 con 0x55cc61d7ae60 2024-02-16T00:12:33.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.847+0000 7f4db2e67640 1 --2- 172.21.15.42:0/3168121229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61d7b280 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4da400a520 tx=0x7f4da401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6494b4852b5decdc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.847+0000 7f4db1e65640 1 -- 172.21.15.42:0/3168121229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da4052570 con 0x55cc61d7ae60 2024-02-16T00:12:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.847+0000 7f4db1e65640 1 -- 172.21.15.42:0/3168121229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40526d0 con 0x55cc61d7ae60 2024-02-16T00:12:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.847+0000 7f4db1e65640 1 -- 172.21.15.42:0/3168121229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da4052990 con 0x55cc61d7ae60 2024-02-16T00:12:33.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 -- 172.21.15.42:0/3168121229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 msgr2=0x55cc61d7b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 --2- 172.21.15.42:0/3168121229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61d7b280 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4da400a520 tx=0x7f4da401cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 -- 172.21.15.42:0/3168121229 shutdown_connections 2024-02-16T00:12:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 --2- 172.21.15.42:0/3168121229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61d7b280 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 -- 172.21.15.42:0/3168121229 >> 172.21.15.42:0/3168121229 conn(0x55cc61d764c0 msgr2=0x55cc61d788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 -- 172.21.15.42:0/3168121229 shutdown_connections 2024-02-16T00:12:33.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.848+0000 7f4db7131800 1 -- 172.21.15.42:0/3168121229 wait complete. 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.859+0000 7f4db7131800 1 Processor -- start 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.859+0000 7f4db7131800 1 -- start start 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.859+0000 7f4db7131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61ceef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.859+0000 7f4db7131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc61c7b980 con 0x55cc61d7ae60 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61ceef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61ceef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56398/0 (socket says 172.21.15.42:56398) 2024-02-16T00:12:33.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4db2e67640 1 -- 172.21.15.42:0/4180349802 learned_addr learned my addr 172.21.15.42:0/4180349802 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4db2e67640 1 -- 172.21.15.42:0/4180349802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4005de0 con 0x55cc61d7ae60 2024-02-16T00:12:33.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4db2e67640 1 --2- 172.21.15.42:0/4180349802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61ceef20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4da401cf20 tx=0x7f4da404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991b5737bf8b46c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4ca0e09640 1 -- 172.21.15.42:0/4180349802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da4052840 con 0x55cc61d7ae60 2024-02-16T00:12:33.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4ca0e09640 1 -- 172.21.15.42:0/4180349802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40529a0 con 0x55cc61d7ae60 2024-02-16T00:12:33.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.860+0000 7f4ca0e09640 1 -- 172.21.15.42:0/4180349802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da4052c80 con 0x55cc61d7ae60 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 -- 172.21.15.42:0/4180349802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 msgr2=0x55cc61ceef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 --2- 172.21.15.42:0/4180349802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61ceef20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4da401cf20 tx=0x7f4da404c000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 -- 172.21.15.42:0/4180349802 shutdown_connections 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 --2- 172.21.15.42:0/4180349802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61ceef20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 -- 172.21.15.42:0/4180349802 >> 172.21.15.42:0/4180349802 conn(0x55cc61d764c0 msgr2=0x55cc61e66b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 -- 172.21.15.42:0/4180349802 shutdown_connections 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 -- 172.21.15.42:0/4180349802 wait complete. 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 Processor -- start 2024-02-16T00:12:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.861+0000 7f4db7131800 1 -- start start 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db7131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61e73860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db7131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc61c77160 con 0x55cc61d7ae60 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61e73860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61e73860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56400/0 (socket says 172.21.15.42:56400) 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 learned_addr learned my addr 172.21.15.42:0/1586810255 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da404e070 con 0x55cc61d7ae60 2024-02-16T00:12:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.862+0000 7f4db2e67640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61e73860 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4da401ceb0 tx=0x7f4da4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.863+0000 7f4c9f606640 1 -- 172.21.15.42:0/1586810255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da406c070 con 0x55cc61d7ae60 2024-02-16T00:12:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.863+0000 7f4c9f606640 1 -- 172.21.15.42:0/1586810255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da405d5b0 con 0x55cc61d7ae60 2024-02-16T00:12:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.863+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc61e73da0 con 0x55cc61d7ae60 2024-02-16T00:12:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.863+0000 7f4c9f606640 1 -- 172.21.15.42:0/1586810255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da405d850 con 0x55cc61d7ae60 2024-02-16T00:12:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.863+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc61e742e0 con 0x55cc61d7ae60 2024-02-16T00:12:33.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db7131800 1 Processor -- start 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db7131800 1 -- start start 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db7131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e6aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db7131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc61c19e80 con 0x55cc61e6caa0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db3668640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e6aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db3668640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e6aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56404/0 (socket says 172.21.15.42:56404) 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db3668640 1 -- 172.21.15.42:0/3607771019 learned_addr learned my addr 172.21.15.42:0/3607771019 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db3668640 1 -- 172.21.15.42:0/3607771019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc61e6b530 con 0x55cc61e6caa0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.864+0000 7f4db3668640 1 --2- 172.21.15.42:0/3607771019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e6aff0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00a430 tx=0x7f4dac00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89d0feebc91b93d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4c9d602640 1 -- 172.21.15.42:0/3607771019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dac001650 con 0x55cc61e6caa0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4c9d602640 1 -- 172.21.15.42:0/3607771019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac0017d0 con 0x55cc61e6caa0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4c9d602640 1 -- 172.21.15.42:0/3607771019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dac001ab0 con 0x55cc61e6caa0 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4db7131800 1 -- 172.21.15.42:0/3607771019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 msgr2=0x55cc61e6aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4db7131800 1 --2- 172.21.15.42:0/3607771019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e6aff0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00a430 tx=0x7f4dac00a8f0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4c9f606640 1 -- 172.21.15.42:0/1586810255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4da4059040 con 0x55cc61d7ae60 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4db7131800 1 -- 172.21.15.42:0/3607771019 shutdown_connections 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4db7131800 1 --2- 172.21.15.42:0/3607771019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e6aff0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4db7131800 1 -- 172.21.15.42:0/3607771019 >> 172.21.15.42:0/3607771019 conn(0x55cc61d7c0c0 msgr2=0x55cc61e7d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.865+0000 7f4db7131800 1 -- 172.21.15.42:0/3607771019 shutdown_connections 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db7131800 1 -- 172.21.15.42:0/3607771019 wait complete. 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4c9f606640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c98036830 0x7f4c98038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4c9f606640 1 -- 172.21.15.42:0/1586810255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f4da408d6a0 con 0x55cc61d7ae60 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db7131800 1 Processor -- start 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db2666640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c98036830 0x7f4c98038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db7131800 1 -- start start 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db7131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e89d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db7131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc61bef5d0 con 0x55cc61e6caa0 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db2666640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c98036830 0x7f4c98038cf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55cc61e7cb90 tx=0x7f4da8001310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e89d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e89d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56412/0 (socket says 172.21.15.42:56412) 2024-02-16T00:12:33.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.866+0000 7f4db2e67640 1 -- 172.21.15.42:0/2183578801 learned_addr learned my addr 172.21.15.42:0/2183578801 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4db2e67640 1 -- 172.21.15.42:0/2183578801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac00a0e0 con 0x55cc61e6caa0 2024-02-16T00:12:33.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4db2e67640 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e89d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4da4005250 tx=0x7f4da405cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4c977fe640 1 -- 172.21.15.42:0/2183578801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da40047d0 con 0x55cc61e6caa0 2024-02-16T00:12:33.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4c977fe640 1 -- 172.21.15.42:0/2183578801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da408bbb0 con 0x55cc61e6caa0 2024-02-16T00:12:33.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4c977fe640 1 -- 172.21.15.42:0/2183578801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da408be90 con 0x55cc61e6caa0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc61e8a320 con 0x55cc61e6caa0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.867+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc61e8a7e0 con 0x55cc61e6caa0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.868+0000 7f4c977fe640 1 -- 172.21.15.42:0/2183578801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4da408d9d0 con 0x55cc61e6caa0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.868+0000 7f4c977fe640 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c8c036740 0x7f4c8c038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.868+0000 7f4c977fe640 1 -- 172.21.15.42:0/2183578801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f4da4089d40 con 0x55cc61e6caa0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.868+0000 7f4db7131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.868+0000 7f4db7131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.868+0000 7f4db2666640 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c8c036740 0x7f4c8c038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db7131800 1 Processor -- start 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db7131800 1 -- start start 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db2666640 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c8c036740 0x7f4c8c038c00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4da8003f10 tx=0x7f4da8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db7131800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 0x55cc61ea4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db7131800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc61ea4da0 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 0x55cc61ea4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db2e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 0x55cc61ea4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56426/0 (socket says 172.21.15.42:56426) 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db2e67640 1 -- 172.21.15.42:0/335417194 learned_addr learned my addr 172.21.15.42:0/335417194 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.869+0000 7f4db2e67640 1 -- 172.21.15.42:0/335417194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc61ea4ee0 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.870+0000 7f4db2e67640 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 0x55cc61ea4860 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4da405adc0 tx=0x7f4da405aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.870+0000 7f4c72ffd640 1 -- 172.21.15.42:0/335417194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da4071370 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.870+0000 7f4c72ffd640 1 -- 172.21.15.42:0/335417194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40786e0 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.870+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc61ea4da0 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.870+0000 7f4c72ffd640 1 -- 172.21.15.42:0/335417194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da4078980 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.870+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc61ea4da0 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4c72ffd640 1 -- 172.21.15.42:0/335417194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4da4055a50 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4c72ffd640 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bec0367e0 0x7f4bec038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4c72ffd640 1 -- 172.21.15.42:0/335417194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f4da40a1d20 con 0x55cc61ea4440 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4db2666640 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bec0367e0 0x7f4bec038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4c70ff9640 20 reqs_thread_entry: start 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cc61e77770 0x55cc61eb3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb37f0 con 0x55cc61e77770 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4db2666640 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bec0367e0 0x7f4bec038ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4da800ba40 tx=0x7f4da8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.871+0000 7f4db3668640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cc61e77770 0x55cc61eb3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db3668640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cc61e77770 0x55cc61eb3220 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb3c30 con 0x55cc61e77770 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cc61eb59f0 0x55cc61eb7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8480 con 0x55cc61eb59f0 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.872+0000 7f4db2e67640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cc61eb59f0 0x55cc61eb7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.873+0000 7f4db2e67640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cc61eb59f0 0x55cc61eb7de0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.873+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.873+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61ebe770 con 0x55cc61e77770 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.873+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:NOTICE: set zone's realm_id= 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.873+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cc61ec48d0 0x55cc61ebfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.873+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.874+0000 7f4db2666640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cc61ec48d0 0x55cc61ebfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.874+0000 7f4db2666640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cc61ec48d0 0x55cc61ebfd70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.874+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(5 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.874+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.875+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.875+0000 7f4db2e67640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4da407a060 0x7f4da404b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.875+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.875+0000 7f4db3668640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4da407a060 0x7f4da404b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.875+0000 7f4db3668640 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4da407a060 0x7f4da404b850 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.876+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(14 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.877+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.878+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.878+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.878+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.878+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.878+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(17 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.878+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.879+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(25 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.880+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.881+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61ec48d0 2024-02-16T00:12:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.882+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da802b040 con 0x55cc61ec48d0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db2666640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x7f4da407a060 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dac001bc0 con 0x7f4da407a060 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61e77770 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(35 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8fa0 con 0x55cc61eb59f0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(36 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.883+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61ec27a0 con 0x55cc61e77770 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.884+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.884+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:38 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61eb8850 con 0x55cc61eb59f0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.884+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(38 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.884+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:39 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [create,call version.set in=58b,writefull 0~1037 in=1037b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61ebdb30 con 0x55cc61eb59f0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.885+0000 7f4db2e67640 1 -- 172.21.15.42:0/1586810255 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(39 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [create,call,writefull 0~1037] v29'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4da404b100 con 0x55cc61eb59f0 2024-02-16T00:12:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.885+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61ec4170 con 0x55cc61e77770 2024-02-16T00:12:33.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.887+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v29'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.887+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cc61ebb3c0 con 0x55cc61e77770 2024-02-16T00:12:33.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v29'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f4dac001bc0 con 0x55cc61e77770 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c8c036740 msgr2=0x7f4c8c038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c8c036740 0x7f4c8c038c00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4da8003f10 tx=0x7f4da8006000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 msgr2=0x55cc61e89d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e89d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4da4005250 tx=0x7f4da405cf90 comp rx=0 tx=0).stop 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 shutdown_connections 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c8c036740 0x7f4c8c038c00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 --2- 172.21.15.42:0/2183578801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61e6caa0 0x55cc61e89d80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.888+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 >> 172.21.15.42:0/2183578801 conn(0x55cc61d7c0c0 msgr2=0x55cc61e7ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 shutdown_connections 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/2183578801 wait complete. 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bec0367e0 msgr2=0x7f4bec038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bec0367e0 0x7f4bec038ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4da800ba40 tx=0x7f4da8010000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 msgr2=0x55cc61ea4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 0x55cc61ea4860 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4da405adc0 tx=0x7f4da405aeb0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 shutdown_connections 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4bec0367e0 0x7f4bec038ca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/335417194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61ea4440 0x55cc61ea4860 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 >> 172.21.15.42:0/335417194 conn(0x55cc61e99050 msgr2=0x55cc61e99a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 shutdown_connections 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/335417194 wait complete. 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4da407a060 msgr2=0x7f4da404b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f4da407a060 0x7f4da404b850 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cc61e77770 msgr2=0x55cc61eb3220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55cc61e77770 0x55cc61eb3220 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cc61eb59f0 msgr2=0x55cc61eb7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55cc61eb59f0 0x55cc61eb7de0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cc61ec48d0 msgr2=0x55cc61ebfd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x55cc61ec48d0 0x55cc61ebfd70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c98036830 msgr2=0x7f4c98038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4c98036830 0x7f4c98038cf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55cc61e7cb90 tx=0x7f4da8001310 comp rx=0 tx=0).stop 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 msgr2=0x55cc61e73860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db3668640 1 -- 172.21.15.42:0/1586810255 reap_dead start 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61e73860 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4da401ceb0 tx=0x7f4da4002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 shutdown_connections 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 --2- 172.21.15.42:0/1586810255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc61d7ae60 0x55cc61e73860 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.889+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 >> 172.21.15.42:0/1586810255 conn(0x55cc61d764c0 msgr2=0x55cc61e653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.890+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 shutdown_connections 2024-02-16T00:12:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.890+0000 7f4db7131800 1 -- 172.21.15.42:0/1586810255 wait complete. 2024-02-16T00:12:33.900 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T00:12:33.900 DEBUG:tasks.util.rgw: json result: {'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T00:12:33.900 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-02-16T00:12:33.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-02-16T00:12:33.903 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-02-16T00:12:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:33.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.978+0000 7f3987616800 1 Processor -- start 2024-02-16T00:12:33.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.978+0000 7f3987616800 1 -- start start 2024-02-16T00:12:33.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.978+0000 7f3987616800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564edd3439f0 0x564edd345de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.978+0000 7f3987616800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564edd28dba0 con 0x564edd346320 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.978+0000 7f3987616800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x564edd245450 con 0x564edd3439f0 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.979+0000 7f3982d61640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564edd3439f0 0x564edd345de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.979+0000 7f3982d61640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564edd3439f0 0x564edd345de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56436/0 (socket says 172.21.15.42:56436) 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.979+0000 7f3982d61640 1 -- 172.21.15.42:0/1253905989 learned_addr learned my addr 172.21.15.42:0/1253905989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.979+0000 7f3982560640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564edd346320 0x564edd348710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33794/0 (socket says 172.21.15.42:33794) 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.979+0000 7f3982d61640 1 -- 172.21.15.42:0/1253905989 >> v1:172.21.15.2:6789/0 conn(0x564edd346320 legacy=0x564edd348710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.979+0000 7f3982d61640 1 -- 172.21.15.42:0/1253905989 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564edd34ae40 con 0x564edd3439f0 2024-02-16T00:12:33.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3982d61640 1 --2- 172.21.15.42:0/1253905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd345de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3974005fd0 tx=0x7f397401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd87ab2f35d399d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3981d5f640 1 -- 172.21.15.42:0/1253905989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3974052540 con 0x564edd3439f0 2024-02-16T00:12:33.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3981d5f640 1 -- 172.21.15.42:0/1253905989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39740526a0 con 0x564edd3439f0 2024-02-16T00:12:33.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3981d5f640 1 -- 172.21.15.42:0/1253905989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39740529c0 con 0x564edd3439f0 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 -- 172.21.15.42:0/1253905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 msgr2=0x564edd345de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 --2- 172.21.15.42:0/1253905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd345de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3974005fd0 tx=0x7f397401cc50 comp rx=0 tx=0).stop 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 -- 172.21.15.42:0/1253905989 shutdown_connections 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 --2- 172.21.15.42:0/1253905989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd345de0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 -- 172.21.15.42:0/1253905989 >> 172.21.15.42:0/1253905989 conn(0x564edd33d4c0 msgr2=0x564edd33f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 -- 172.21.15.42:0/1253905989 shutdown_connections 2024-02-16T00:12:33.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.981+0000 7f3987616800 1 -- 172.21.15.42:0/1253905989 wait complete. 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3987616800 1 Processor -- start 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3987616800 1 -- start start 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3987616800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd432f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3987616800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edd242980 con 0x564edd3439f0 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3982d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd432f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3982d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd432f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56440/0 (socket says 172.21.15.42:56440) 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.993+0000 7f3982d61640 1 -- 172.21.15.42:0/139632544 learned_addr learned my addr 172.21.15.42:0/139632544 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:33.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.994+0000 7f3982d61640 1 -- 172.21.15.42:0/139632544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397400a1c0 con 0x564edd3439f0 2024-02-16T00:12:33.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.994+0000 7f3982d61640 1 --2- 172.21.15.42:0/139632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd432f50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3974007000 tx=0x7f397404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687c6efb60c47a9f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:33.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.994+0000 7f3870e09640 1 -- 172.21.15.42:0/139632544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3974052940 con 0x564edd3439f0 2024-02-16T00:12:33.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.994+0000 7f3870e09640 1 -- 172.21.15.42:0/139632544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397405d420 con 0x564edd3439f0 2024-02-16T00:12:33.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.994+0000 7f3870e09640 1 -- 172.21.15.42:0/139632544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397405d700 con 0x564edd3439f0 2024-02-16T00:12:33.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 -- 172.21.15.42:0/139632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 msgr2=0x564edd432f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:33.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 --2- 172.21.15.42:0/139632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd432f50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3974007000 tx=0x7f397404c000 comp rx=0 tx=0).stop 2024-02-16T00:12:33.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 -- 172.21.15.42:0/139632544 shutdown_connections 2024-02-16T00:12:33.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 --2- 172.21.15.42:0/139632544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd432f50 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:33.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 -- 172.21.15.42:0/139632544 >> 172.21.15.42:0/139632544 conn(0x564edd33d4c0 msgr2=0x564edd42e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:33.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 -- 172.21.15.42:0/139632544 shutdown_connections 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 -- 172.21.15.42:0/139632544 wait complete. 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 Processor -- start 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.995+0000 7f3987616800 1 -- start start 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3987616800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd43a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3987616800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edd23e160 con 0x564edd3439f0 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3982d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd43a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3982d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd43a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56454/0 (socket says 172.21.15.42:56454) 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3982d61640 1 -- 172.21.15.42:0/1856285348 learned_addr learned my addr 172.21.15.42:0/1856285348 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3982d61640 1 -- 172.21.15.42:0/1856285348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564edd34ae40 con 0x564edd3439f0 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.996+0000 7f3982d61640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd43a500 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3974000f80 tx=0x7f3974003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f386f606640 1 -- 172.21.15.42:0/1856285348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397405dca0 con 0x564edd3439f0 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f386f606640 1 -- 172.21.15.42:0/1856285348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397405de00 con 0x564edd3439f0 2024-02-16T00:12:34.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564edd43aa40 con 0x564edd3439f0 2024-02-16T00:12:34.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f386f606640 1 -- 172.21.15.42:0/1856285348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3974071590 con 0x564edd3439f0 2024-02-16T00:12:34.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564edd43af80 con 0x564edd3439f0 2024-02-16T00:12:34.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f3987616800 1 Processor -- start 2024-02-16T00:12:34.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f3987616800 1 -- start start 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f3987616800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd3419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.997+0000 7f3987616800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edd1e0e80 con 0x564edd343460 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f386f606640 1 -- 172.21.15.42:0/1856285348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f397407a440 con 0x564edd3439f0 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3983562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd3419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3983562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd3419b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56470/0 (socket says 172.21.15.42:56470) 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3983562640 1 -- 172.21.15.42:0/4091828567 learned_addr learned my addr 172.21.15.42:0/4091828567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f386f606640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3868036790 0x7f3868038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f386f606640 1 -- 172.21.15.42:0/1856285348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f397408e960 con 0x564edd3439f0 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3982d61640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3868036790 0x7f3868038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3983562640 1 -- 172.21.15.42:0/4091828567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564edd341ef0 con 0x564edd343460 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3983562640 1 --2- 172.21.15.42:0/4091828567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd3419b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f397c00a400 tx=0x7f397c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1b2c31bb7be12e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f3982d61640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3868036790 0x7f3868038c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3974052b70 tx=0x7f39740525d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f386d602640 1 -- 172.21.15.42:0/4091828567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397c0087e0 con 0x564edd343460 2024-02-16T00:12:34.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f386d602640 1 -- 172.21.15.42:0/4091828567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c008960 con 0x564edd343460 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.998+0000 7f386d602640 1 -- 172.21.15.42:0/4091828567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397c008c80 con 0x564edd343460 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- 172.21.15.42:0/4091828567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 msgr2=0x564edd3419b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 --2- 172.21.15.42:0/4091828567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd3419b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f397c00a400 tx=0x7f397c00a8c0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- 172.21.15.42:0/4091828567 shutdown_connections 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 --2- 172.21.15.42:0/4091828567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd3419b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- 172.21.15.42:0/4091828567 >> 172.21.15.42:0/4091828567 conn(0x564edd346320 msgr2=0x564edd444360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- 172.21.15.42:0/4091828567 shutdown_connections 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- 172.21.15.42:0/4091828567 wait complete. 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 Processor -- start 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- start start 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd450a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:33.999+0000 7f3987616800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edd1b65d0 con 0x564edd343460 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3983562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd450a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3983562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd450a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56472/0 (socket says 172.21.15.42:56472) 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3983562640 1 -- 172.21.15.42:0/2579652217 learned_addr learned my addr 172.21.15.42:0/2579652217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3983562640 1 -- 172.21.15.42:0/2579652217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c005c90 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3983562640 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd450a80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f397c010000 tx=0x7f397c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f38677fe640 1 -- 172.21.15.42:0/2579652217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397c013800 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f38677fe640 1 -- 172.21.15.42:0/2579652217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c013960 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f38677fe640 1 -- 172.21.15.42:0/2579652217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397c013c00 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564edd450fc0 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.000+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564edd451480 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.001+0000 7f38677fe640 1 -- 172.21.15.42:0/2579652217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f397c01e420 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.001+0000 7f38677fe640 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f385c036830 0x7f385c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.001+0000 7f38677fe640 1 -- 172.21.15.42:0/2579652217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f397c04c170 con 0x564edd343460 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.001+0000 7f3987616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.001+0000 7f3987616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.001+0000 7f3982560640 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f385c036830 0x7f385c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3987616800 1 Processor -- start 2024-02-16T00:12:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3987616800 1 -- start start 2024-02-16T00:12:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3982560640 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f385c036830 0x7f385c038cf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3978000f60 tx=0x7f39780012f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3987616800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 0x564edd46b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3987616800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edd46b8e0 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3982d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 0x564edd46b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3982d61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 0x564edd46b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56476/0 (socket says 172.21.15.42:56476) 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.002+0000 7f3982d61640 1 -- 172.21.15.42:0/667010163 learned_addr learned my addr 172.21.15.42:0/667010163 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3982d61640 1 -- 172.21.15.42:0/667010163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564edd46ba20 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3982d61640 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 0x564edd46b3a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f397408cd30 tx=0x7f3974073ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3842ffd640 1 -- 172.21.15.42:0/667010163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397408b070 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3842ffd640 1 -- 172.21.15.42:0/667010163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974065560 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564edd46c350 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3842ffd640 1 -- 172.21.15.42:0/667010163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f397405c380 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.003+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564edd46c350 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3842ffd640 1 -- 172.21.15.42:0/667010163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f39740703e0 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3842ffd640 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f37bc036790 0x7f37bc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3842ffd640 1 -- 172.21.15.42:0/667010163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f397408ce40 con 0x564edd46af80 2024-02-16T00:12:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3982560640 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f37bc036790 0x7f37bc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3840ff9640 20 reqs_thread_entry: start 2024-02-16T00:12:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564edd477d50 0x564edd47a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564edd47a680 con 0x564edd477d50 2024-02-16T00:12:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3982560640 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f37bc036790 0x7f37bc038c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3978001ed0 tx=0x7f397800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.004+0000 7f3983562640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564edd477d50 0x564edd47a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3983562640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564edd477d50 0x564edd47a140 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3983562640 1 -- 172.21.15.42:0/1856285348 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f397c024070 con 0x564edd477d50 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564edd47aa40 con 0x564edd477d50 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3983562640 1 -- 172.21.15.42:0/1856285348 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f397c024070 con 0x564edd477d50 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564edd47c800 0x564edd47ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564edd47f290 con 0x564edd47c800 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.005+0000 7f3982d61640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564edd47c800 0x564edd47ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.006+0000 7f3982d61640 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564edd47c800 0x564edd47ebf0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.006+0000 7f3982d61640 1 -- 172.21.15.42:0/1856285348 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~1037 out=1037b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7f3974094070 con 0x564edd47c800 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f385c036830 msgr2=0x7f385c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f385c036830 0x7f385c038cf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3978000f60 tx=0x7f39780012f0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 msgr2=0x564edd450a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd450a80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f397c010000 tx=0x7f397c002ff0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 shutdown_connections 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f385c036830 0x7f385c038cf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/2579652217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd343460 0x564edd450a80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 >> 172.21.15.42:0/2579652217 conn(0x564edd346320 msgr2=0x564edd4419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 shutdown_connections 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/2579652217 wait complete. 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f37bc036790 msgr2=0x7f37bc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f37bc036790 0x7f37bc038c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3978001ed0 tx=0x7f397800f000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 msgr2=0x564edd46b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 0x564edd46b3a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f397408cd30 tx=0x7f3974073ee0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 shutdown_connections 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f37bc036790 0x7f37bc038c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/667010163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd46af80 0x564edd46b3a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 >> 172.21.15.42:0/667010163 conn(0x564edd45fb90 msgr2=0x564edd460600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 shutdown_connections 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/667010163 wait complete. 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564edd477d50 msgr2=0x564edd47a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564edd477d50 0x564edd47a140 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564edd47c800 msgr2=0x564edd47ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564edd47c800 0x564edd47ebf0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3868036790 msgr2=0x7f3868038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3868036790 0x7f3868038c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3974052b70 tx=0x7f39740525d0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 msgr2=0x564edd43a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd43a500 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3974000f80 tx=0x7f3974003330 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 shutdown_connections 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x564edd47c800 0x564edd47ebf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564edd477d50 0x564edd47a140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f3868036790 0x7f3868038c50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 --2- 172.21.15.42:0/1856285348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564edd3439f0 0x564edd43a500 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 >> 172.21.15.42:0/1856285348 conn(0x564edd33d4c0 msgr2=0x564edd42d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.007+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 shutdown_connections 2024-02-16T00:12:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.008+0000 7f3987616800 1 -- 172.21.15.42:0/1856285348 wait complete. 2024-02-16T00:12:34.019 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T00:12:34.020 DEBUG:tasks.util.rgw: json result: {'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T00:12:34.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T00:12:34.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T00:12:34.020 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-16T00:12:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.101+0000 7fc5b0d1f800 1 Processor -- start 2024-02-16T00:12:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.101+0000 7fc5b0d1f800 1 -- start start 2024-02-16T00:12:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.101+0000 7fc5b0d1f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555e6708fb40 0x555e67091f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.101+0000 7fc5b0d1f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555e66fd9c50 con 0x555e67092470 2024-02-16T00:12:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.101+0000 7fc5b0d1f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x555e66f91450 con 0x555e6708fb40 2024-02-16T00:12:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.102+0000 7fc5ac9ec640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555e6708fb40 0x555e67091f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.102+0000 7fc5ac9ec640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x555e6708fb40 0x555e67091f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56480/0 (socket says 172.21.15.42:56480) 2024-02-16T00:12:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.102+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/4200328586 learned_addr learned my addr 172.21.15.42:0/4200328586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.102+0000 7fc5ac1eb640 1 --1- 172.21.15.42:0/4200328586 >> v1:172.21.15.2:6789/0 conn(0x555e67092470 0x555e67094860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33804/0 (socket says 172.21.15.42:33804) 2024-02-16T00:12:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.102+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/4200328586 >> v1:172.21.15.2:6789/0 conn(0x555e67092470 legacy=0x555e67094860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.102+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/4200328586 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e67096f90 con 0x555e6708fb40 2024-02-16T00:12:34.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.104+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/4200328586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e67091f30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc59c005fd0 tx=0x7fc59c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503e70d6a5cbba69 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.104+0000 7fc5ab9ea640 1 -- 172.21.15.42:0/4200328586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c052540 con 0x555e6708fb40 2024-02-16T00:12:34.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.104+0000 7fc5ab9ea640 1 -- 172.21.15.42:0/4200328586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c0526a0 con 0x555e6708fb40 2024-02-16T00:12:34.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.104+0000 7fc5ab9ea640 1 -- 172.21.15.42:0/4200328586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c0529c0 con 0x555e6708fb40 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/4200328586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 msgr2=0x555e67091f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/4200328586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e67091f30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc59c005fd0 tx=0x7fc59c01cc50 comp rx=0 tx=0).stop 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/4200328586 shutdown_connections 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/4200328586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e67091f30 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/4200328586 >> 172.21.15.42:0/4200328586 conn(0x555e67089590 msgr2=0x555e6708b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/4200328586 shutdown_connections 2024-02-16T00:12:34.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.105+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/4200328586 wait complete. 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.116+0000 7fc5b0d1f800 1 Processor -- start 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.116+0000 7fc5b0d1f800 1 -- start start 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.116+0000 7fc5b0d1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e6717f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.116+0000 7fc5b0d1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e66f8e980 con 0x555e6708fb40 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.116+0000 7fc5ac9ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e6717f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc5ac9ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e6717f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56484/0 (socket says 172.21.15.42:56484) 2024-02-16T00:12:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/3135010826 learned_addr learned my addr 172.21.15.42:0/3135010826 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/3135010826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c00a1c0 con 0x555e6708fb40 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/3135010826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e6717f000 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc59c007000 tx=0x7fc59c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1857ae23e7a8252 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc49ae0d640 1 -- 172.21.15.42:0/3135010826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c052940 con 0x555e6708fb40 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc49ae0d640 1 -- 172.21.15.42:0/3135010826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c05d420 con 0x555e6708fb40 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.117+0000 7fc49ae0d640 1 -- 172.21.15.42:0/3135010826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c05d700 con 0x555e6708fb40 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/3135010826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 msgr2=0x555e6717f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/3135010826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e6717f000 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc59c007000 tx=0x7fc59c04c000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/3135010826 shutdown_connections 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/3135010826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708fb40 0x555e6717f000 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/3135010826 >> 172.21.15.42:0/3135010826 conn(0x555e67089590 msgr2=0x555e6717a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/3135010826 shutdown_connections 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/3135010826 wait complete. 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 Processor -- start 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- start start 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 0x555e67186860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.118+0000 7fc5b0d1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e66f8a160 con 0x555e67092470 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5ac9ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 0x555e67186860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5ac9ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 0x555e67186860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56490/0 (socket says 172.21.15.42:56490) 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/2142826367 learned_addr learned my addr 172.21.15.42:0/2142826367 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/2142826367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e67096f90 con 0x555e67092470 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 0x555e67186860 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc59c000f80 tx=0x7fc59c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc49960a640 1 -- 172.21.15.42:0/2142826367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c05dad0 con 0x555e67092470 2024-02-16T00:12:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc49960a640 1 -- 172.21.15.42:0/2142826367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c05dc30 con 0x555e67092470 2024-02-16T00:12:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc49960a640 1 -- 172.21.15.42:0/2142826367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c071440 con 0x555e67092470 2024-02-16T00:12:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555e67186da0 con 0x555e67092470 2024-02-16T00:12:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.119+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e671872e0 con 0x555e67092470 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5b0d1f800 1 Processor -- start 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5b0d1f800 1 -- start start 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5b0d1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6708f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5b0d1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e66f2ce80 con 0x555e6708f110 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc49960a640 1 -- 172.21.15.42:0/2142826367 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc59c07a440 con 0x555e67092470 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5ad1ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6708f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5ad1ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6708f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56500/0 (socket says 172.21.15.42:56500) 2024-02-16T00:12:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.120+0000 7fc5ad1ed640 1 -- 172.21.15.42:0/2005399420 learned_addr learned my addr 172.21.15.42:0/2005399420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc49960a640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc494036790 0x7fc494038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc49960a640 1 -- 172.21.15.42:0/2142826367 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc59c08e7e0 con 0x555e67092470 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5ad1ed640 1 -- 172.21.15.42:0/2005399420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e6708d930 con 0x555e6708f110 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc494036790 0x7fc494038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5ad1ed640 1 --2- 172.21.15.42:0/2005399420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6708f530 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400a400 tx=0x7fc5a400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537c1d60a4ed0dd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc494036790 0x7fc494038c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc59c05f040 tx=0x7fc59c05def0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc492ffd640 1 -- 172.21.15.42:0/2005399420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5a40087e0 con 0x555e6708f110 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc492ffd640 1 -- 172.21.15.42:0/2005399420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4008960 con 0x555e6708f110 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc492ffd640 1 -- 172.21.15.42:0/2005399420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5a4008c80 con 0x555e6708f110 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2005399420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 msgr2=0x555e6708f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2005399420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6708f530 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400a400 tx=0x7fc5a400a8c0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2005399420 shutdown_connections 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2005399420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6708f530 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.121+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2005399420 >> 172.21.15.42:0/2005399420 conn(0x555e67190610 msgr2=0x555e6718e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2005399420 shutdown_connections 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2005399420 wait complete. 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5b0d1f800 1 Processor -- start 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5b0d1f800 1 -- start start 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5b0d1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6719d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5b0d1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e66f025d0 con 0x555e6708f110 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5ad1ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6719d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5ad1ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6719d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56506/0 (socket says 172.21.15.42:56506) 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.122+0000 7fc5ad1ed640 1 -- 172.21.15.42:0/1231998661 learned_addr learned my addr 172.21.15.42:0/1231998661 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc5ad1ed640 1 -- 172.21.15.42:0/1231998661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4005c90 con 0x555e6708f110 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc5ad1ed640 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6719d120 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4010000 tx=0x7fc5a4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc4917fa640 1 -- 172.21.15.42:0/1231998661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5a4008780 con 0x555e6708f110 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc4917fa640 1 -- 172.21.15.42:0/1231998661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40139a0 con 0x555e6708f110 2024-02-16T00:12:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc4917fa640 1 -- 172.21.15.42:0/1231998661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5a4013c80 con 0x555e6708f110 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555e6719d660 con 0x555e6708f110 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.123+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e6719db20 con 0x555e6708f110 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc4917fa640 1 -- 172.21.15.42:0/1231998661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc5a401e420 con 0x555e6708f110 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc4917fa640 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc484036790 0x7fc484038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc5b0d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc5b0d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc4917fa640 1 -- 172.21.15.42:0/1231998661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc5a404c230 con 0x555e6708f110 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc5ac1eb640 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc484036790 0x7fc484038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc5b0d1f800 1 Processor -- start 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.124+0000 7fc5b0d1f800 1 -- start start 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5ac1eb640 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc484036790 0x7fc484038c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x555e6718fb20 tx=0x7fc5a0001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5b0d1f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 0x555e671b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5b0d1f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e671b7fa0 con 0x555e671b7640 2024-02-16T00:12:34.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5ac9ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 0x555e671b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5ac9ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 0x555e671b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56514/0 (socket says 172.21.15.42:56514) 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/1455014392 learned_addr learned my addr 172.21.15.42:0/1455014392 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/1455014392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e671b80e0 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.125+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 0x555e671b7a60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc59c08cb90 tx=0x7fc59c051d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.126+0000 7fc4717e2640 1 -- 172.21.15.42:0/1455014392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c07f040 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.126+0000 7fc4717e2640 1 -- 172.21.15.42:0/1455014392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c08ec20 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.126+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555e671b8a10 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.126+0000 7fc4717e2640 1 -- 172.21.15.42:0/1455014392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc59c070a80 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.126+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e671b8a10 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.126+0000 7fc4717e2640 1 -- 172.21.15.42:0/1455014392 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc59c0703e0 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc4717e2640 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc3e8036830 0x7fc3e8038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc4717e2640 1 -- 172.21.15.42:0/1455014392 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fc59c097d10 con 0x555e671b7640 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc5ac1eb640 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc3e8036830 0x7fc3e8038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc3f2ffd640 20 reqs_thread_entry: start 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555e671c4410 0x555e671c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x555e671c6d40 con 0x555e671c4410 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc5ac1eb640 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc3e8036830 0x7fc3e8038cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0000f60 tx=0x7fc5a000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc5ad1ed640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555e671c4410 0x555e671c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.127+0000 7fc5ad1ed640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555e671c4410 0x555e671c6800 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5ad1ed640 1 -- 172.21.15.42:0/2142826367 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc5a4024070 con 0x555e671c4410 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555e671c8a90 0x555e671cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:2 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x555e671cb550 con 0x555e671c8a90 2024-02-16T00:12:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555e671c8a90 0x555e671cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5ac9ec640 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555e671c8a90 0x555e671cae80 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/2142826367 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(2 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~1037 out=1037b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7fc59c0a7450 con 0x555e671c8a90 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.128+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x555e671d0990 con 0x555e671c8a90 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.129+0000 7fc5ac9ec640 1 -- 172.21.15.42:0/2142826367 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [stat,call,call,writefull 0~875] v29'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7fc59c0a7040 con 0x555e671c8a90 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc484036790 msgr2=0x7fc484038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc484036790 0x7fc484038c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x555e6718fb20 tx=0x7fc5a0001320 comp rx=0 tx=0).stop 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 msgr2=0x555e6719d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6719d120 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4010000 tx=0x7fc5a4002ff0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 shutdown_connections 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc484036790 0x7fc484038c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1231998661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e6708f110 0x555e6719d120 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 >> 172.21.15.42:0/1231998661 conn(0x555e67190610 msgr2=0x555e6718dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 shutdown_connections 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.130+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1231998661 wait complete. 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc3e8036830 msgr2=0x7fc3e8038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc3e8036830 0x7fc3e8038cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0000f60 tx=0x7fc5a000f000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 msgr2=0x555e671b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 0x555e671b7a60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc59c08cb90 tx=0x7fc59c051d00 comp rx=0 tx=0).stop 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 shutdown_connections 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc3e8036830 0x7fc3e8038cf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/1455014392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e671b7640 0x555e671b7a60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 >> 172.21.15.42:0/1455014392 conn(0x555e671ac290 msgr2=0x555e671accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 shutdown_connections 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/1455014392 wait complete. 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555e671c4410 msgr2=0x555e671c6800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555e671c4410 0x555e671c6800 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555e671c8a90 msgr2=0x555e671cae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555e671c8a90 0x555e671cae80 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc494036790 msgr2=0x7fc494038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc494036790 0x7fc494038c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc59c05f040 tx=0x7fc59c05def0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 msgr2=0x555e67186860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 0x555e67186860 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc59c000f80 tx=0x7fc59c003330 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 shutdown_connections 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x555e671c8a90 0x555e671cae80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x555e671c4410 0x555e671c6800 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fc494036790 0x7fc494038c50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 --2- 172.21.15.42:0/2142826367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555e67092470 0x555e67186860 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 >> 172.21.15.42:0/2142826367 conn(0x555e67089590 msgr2=0x555e67179180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 shutdown_connections 2024-02-16T00:12:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.131+0000 7fc5b0d1f800 1 -- 172.21.15.42:0/2142826367 wait complete. 2024-02-16T00:12:34.142 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T00:12:34.142 DEBUG:tasks.util.rgw: json result: {'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T00:12:34.142 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-02-16T00:12:34.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-02-16T00:12:34.143 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-02-16T00:12:34.182 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:34.183 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.180+0000 7f6ff0733800 1 Processor -- start 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6ff0733800 1 -- start start 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6ff0733800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ee6da654a0 0x55ee6da67890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6ff0733800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ee6d9abba0 con 0x55ee6da61010 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6ff0733800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ee6d963450 con 0x55ee6da654a0 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6febc66640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ee6da654a0 0x55ee6da67890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6febc66640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55ee6da654a0 0x55ee6da67890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56528/0 (socket says 172.21.15.42:56528) 2024-02-16T00:12:34.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6febc66640 1 -- 172.21.15.42:0/2333183895 learned_addr learned my addr 172.21.15.42:0/2333183895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6fec467640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x55ee6da61010 0x55ee6da61430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33820/0 (socket says 172.21.15.42:33820) 2024-02-16T00:12:34.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6febc66640 1 -- 172.21.15.42:0/2333183895 >> v1:172.21.15.2:6789/0 conn(0x55ee6da61010 legacy=0x55ee6da61430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.181+0000 7f6febc66640 1 -- 172.21.15.42:0/2333183895 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee6da68ec0 con 0x55ee6da654a0 2024-02-16T00:12:34.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.183+0000 7f6febc66640 1 --2- 172.21.15.42:0/2333183895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da654a0 0x55ee6da67890 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000a520 tx=0x7f6fe001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc32d8ac8b96494f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.183+0000 7f6feb465640 1 -- 172.21.15.42:0/2333183895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fe0052570 con 0x55ee6da654a0 2024-02-16T00:12:34.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6feb465640 1 -- 172.21.15.42:0/2333183895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe00526d0 con 0x55ee6da654a0 2024-02-16T00:12:34.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6feb465640 1 -- 172.21.15.42:0/2333183895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fe0052990 con 0x55ee6da654a0 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 -- 172.21.15.42:0/2333183895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da654a0 msgr2=0x55ee6da67890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2333183895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da654a0 0x55ee6da67890 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000a520 tx=0x7f6fe001cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 -- 172.21.15.42:0/2333183895 shutdown_connections 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2333183895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da654a0 0x55ee6da67890 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 -- 172.21.15.42:0/2333183895 >> 172.21.15.42:0/2333183895 conn(0x55ee6da5c5b0 msgr2=0x55ee6da5e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 -- 172.21.15.42:0/2333183895 shutdown_connections 2024-02-16T00:12:34.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.184+0000 7f6ff0733800 1 -- 172.21.15.42:0/2333183895 wait complete. 2024-02-16T00:12:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.195+0000 7f6ff0733800 1 Processor -- start 2024-02-16T00:12:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.195+0000 7f6ff0733800 1 -- start start 2024-02-16T00:12:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6ff0733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db50fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6ff0733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6d960980 con 0x55ee6da61010 2024-02-16T00:12:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6fec467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db50fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6fec467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db50fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56532/0 (socket says 172.21.15.42:56532) 2024-02-16T00:12:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6fec467640 1 -- 172.21.15.42:0/880638026 learned_addr learned my addr 172.21.15.42:0/880638026 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6fec467640 1 -- 172.21.15.42:0/880638026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0005de0 con 0x55ee6da61010 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.196+0000 7f6fec467640 1 --2- 172.21.15.42:0/880638026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db50fa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc001cb0 tx=0x7f6fdc00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca046f0e2a1fa3c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6eda60c640 1 -- 172.21.15.42:0/880638026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc014070 con 0x55ee6da61010 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6eda60c640 1 -- 172.21.15.42:0/880638026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00f450 con 0x55ee6da61010 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6eda60c640 1 -- 172.21.15.42:0/880638026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc00f750 con 0x55ee6da61010 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 -- 172.21.15.42:0/880638026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 msgr2=0x55ee6db50fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 --2- 172.21.15.42:0/880638026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db50fa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc001cb0 tx=0x7f6fdc00b600 comp rx=0 tx=0).stop 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 -- 172.21.15.42:0/880638026 shutdown_connections 2024-02-16T00:12:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 --2- 172.21.15.42:0/880638026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db50fa0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 -- 172.21.15.42:0/880638026 >> 172.21.15.42:0/880638026 conn(0x55ee6da5c5b0 msgr2=0x55ee6db4c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 -- 172.21.15.42:0/880638026 shutdown_connections 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.197+0000 7f6ff0733800 1 -- 172.21.15.42:0/880638026 wait complete. 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6ff0733800 1 Processor -- start 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6ff0733800 1 -- start start 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6ff0733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6ff0733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6d95c160 con 0x55ee6da61010 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6fec467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6fec467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56548/0 (socket says 172.21.15.42:56548) 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6fec467640 1 -- 172.21.15.42:0/2402045904 learned_addr learned my addr 172.21.15.42:0/2402045904 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.198+0000 7f6fec467640 1 -- 172.21.15.42:0/2402045904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee6d9abba0 con 0x55ee6da61010 2024-02-16T00:12:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6fec467640 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db586b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc004000 tx=0x7f6fdc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ed8e09640 1 -- 172.21.15.42:0/2402045904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc014050 con 0x55ee6da61010 2024-02-16T00:12:34.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ed8e09640 1 -- 172.21.15.42:0/2402045904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc01b850 con 0x55ee6da61010 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ee6db58bf0 con 0x55ee6da61010 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ed8e09640 1 -- 172.21.15.42:0/2402045904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc01baf0 con 0x55ee6da61010 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee6db590d0 con 0x55ee6da61010 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ff0733800 1 Processor -- start 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.199+0000 7f6ff0733800 1 -- start start 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6ff0733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db65e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6ff0733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6d8fee80 con 0x55ee6db65a10 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6ed8e09640 1 -- 172.21.15.42:0/2402045904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6fdc022020 con 0x55ee6da61010 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fecc68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db65e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fecc68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db65e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56564/0 (socket says 172.21.15.42:56564) 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6ed8e09640 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ed4036790 0x7f6ed4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fecc68640 1 -- 172.21.15.42:0/3619686608 learned_addr learned my addr 172.21.15.42:0/3619686608 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6ed8e09640 1 -- 172.21.15.42:0/2402045904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6fdc008030 con 0x55ee6da61010 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fec467640 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ed4036790 0x7f6ed4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fecc68640 1 -- 172.21.15.42:0/3619686608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee6db66370 con 0x55ee6db65a10 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fec467640 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ed4036790 0x7f6ed4038c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc04a3f0 tx=0x7f6fdc018ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.200+0000 7f6fecc68640 1 --2- 172.21.15.42:0/3619686608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db65e30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400a430 tx=0x7f6fe400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cceb30a095e19294 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ed27fc640 1 -- 172.21.15.42:0/3619686608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4001650 con 0x55ee6db65a10 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ed27fc640 1 -- 172.21.15.42:0/3619686608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe40017d0 con 0x55ee6db65a10 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ed27fc640 1 -- 172.21.15.42:0/3619686608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4001ab0 con 0x55ee6db65a10 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 -- 172.21.15.42:0/3619686608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 msgr2=0x55ee6db65e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 --2- 172.21.15.42:0/3619686608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db65e30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400a430 tx=0x7f6fe400a8f0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 -- 172.21.15.42:0/3619686608 shutdown_connections 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 --2- 172.21.15.42:0/3619686608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db65e30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 -- 172.21.15.42:0/3619686608 >> 172.21.15.42:0/3619686608 conn(0x55ee6da654a0 msgr2=0x55ee6db624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 -- 172.21.15.42:0/3619686608 shutdown_connections 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 -- 172.21.15.42:0/3619686608 wait complete. 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 Processor -- start 2024-02-16T00:12:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.201+0000 7f6ff0733800 1 -- start start 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6ff0733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db6ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6ff0733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6d8d45d0 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6fecc68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db6ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6fecc68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db6ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56574/0 (socket says 172.21.15.42:56574) 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6fecc68640 1 -- 172.21.15.42:0/967391882 learned_addr learned my addr 172.21.15.42:0/967391882 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6fecc68640 1 -- 172.21.15.42:0/967391882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe400a0e0 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6fecc68640 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db6ca40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000f80 tx=0x7f6fe4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6ed0ff9640 1 -- 172.21.15.42:0/967391882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4010a40 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.202+0000 7f6ed0ff9640 1 -- 172.21.15.42:0/967391882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4010ba0 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.203+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ee6db6cf80 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.203+0000 7f6ed0ff9640 1 -- 172.21.15.42:0/967391882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4010e80 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.203+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee6db6d3e0 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.203+0000 7f6ed0ff9640 1 -- 172.21.15.42:0/967391882 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6fe4017070 con 0x55ee6db65a10 2024-02-16T00:12:34.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.203+0000 7f6ed0ff9640 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ec40367e0 0x7f6ec4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ed0ff9640 1 -- 172.21.15.42:0/967391882 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6fe404bf80 con 0x55ee6db65a10 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6febc66640 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ec40367e0 0x7f6ec4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ff0733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ff0733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ff0733800 1 Processor -- start 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6febc66640 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ec40367e0 0x7f6ec4038ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0054000 tx=0x7f6fe004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ff0733800 1 -- start start 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ff0733800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 0x55ee6db87310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6ff0733800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6db87850 con 0x55ee6db86ef0 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6fec467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 0x55ee6db87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6fec467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 0x55ee6db87310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56584/0 (socket says 172.21.15.42:56584) 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.204+0000 7f6fec467640 1 -- 172.21.15.42:0/20095878 learned_addr learned my addr 172.21.15.42:0/20095878 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6fec467640 1 -- 172.21.15.42:0/20095878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee6db87990 con 0x55ee6db86ef0 2024-02-16T00:12:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6fec467640 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 0x55ee6db87310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00ff10 tx=0x7f6fdc04ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6eb0fe1640 1 -- 172.21.15.42:0/20095878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc034070 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6eb0fe1640 1 -- 172.21.15.42:0/20095878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc019e30 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ee6db882c0 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6eb0fe1640 1 -- 172.21.15.42:0/20095878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc0249c0 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.205+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee6db88780 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6eb0fe1640 1 -- 172.21.15.42:0/20095878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6fdc01c440 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6eb0fe1640 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6e240367e0 0x7f6e24038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6eb0fe1640 1 -- 172.21.15.42:0/20095878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f6fdc046d50 con 0x55ee6db86ef0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6febc66640 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6e240367e0 0x7f6e24038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6e527fc640 20 reqs_thread_entry: start 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ee6db93fa0 0x55ee6db96390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ee6db968d0 con 0x55ee6db93fa0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.206+0000 7f6febc66640 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6e240367e0 0x7f6e24038ca0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00526a0 tx=0x7f6fe0005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.207+0000 7f6fecc68640 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ee6db93fa0 0x55ee6db96390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.207+0000 7f6fecc68640 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ee6db93fa0 0x55ee6db96390 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.207+0000 7f6fecc68640 1 -- 172.21.15.42:0/2402045904 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fe401b390 con 0x55ee6db93fa0 2024-02-16T00:12:34.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.207+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ee6db96d50 con 0x55ee6db93fa0 2024-02-16T00:12:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.207+0000 7f6fecc68640 1 -- 172.21.15.42:0/2402045904 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fe401b390 con 0x55ee6db93fa0 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.207+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ee6db98280 con 0x55ee6db93fa0 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6fecc68640 1 -- 172.21.15.42:0/2402045904 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6fe401b390 con 0x55ee6db93fa0 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ec40367e0 msgr2=0x7f6ec4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ec40367e0 0x7f6ec4038ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0054000 tx=0x7f6fe004e000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 msgr2=0x55ee6db6ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db6ca40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000f80 tx=0x7f6fe4003370 comp rx=0 tx=0).stop 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 shutdown_connections 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ec40367e0 0x7f6ec4038ca0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 --2- 172.21.15.42:0/967391882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db65a10 0x55ee6db6ca40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 >> 172.21.15.42:0/967391882 conn(0x55ee6da654a0 msgr2=0x55ee6db5faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 shutdown_connections 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.208+0000 7f6ff0733800 1 -- 172.21.15.42:0/967391882 wait complete. 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6e240367e0 msgr2=0x7f6e24038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6e240367e0 0x7f6e24038ca0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00526a0 tx=0x7f6fe0005ac0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 msgr2=0x55ee6db87310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 0x55ee6db87310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00ff10 tx=0x7f6fdc04ab80 comp rx=0 tx=0).stop 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 shutdown_connections 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6e240367e0 0x7f6e24038ca0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/20095878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6db86ef0 0x55ee6db87310 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 >> 172.21.15.42:0/20095878 conn(0x55ee6db7bb20 msgr2=0x55ee6db7c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 shutdown_connections 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/20095878 wait complete. 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ee6db93fa0 msgr2=0x55ee6db96390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ee6db93fa0 0x55ee6db96390 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ed4036790 msgr2=0x7f6ed4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ed4036790 0x7f6ed4038c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc04a3f0 tx=0x7f6fdc018ef0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 msgr2=0x55ee6db586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db586b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc004000 tx=0x7f6fdc000bc0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 shutdown_connections 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55ee6db93fa0 0x55ee6db96390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6ed4036790 0x7f6ed4038c50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 --2- 172.21.15.42:0/2402045904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ee6da61010 0x55ee6db586b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 >> 172.21.15.42:0/2402045904 conn(0x55ee6da5c5b0 msgr2=0x55ee6db4f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 shutdown_connections 2024-02-16T00:12:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.209+0000 7f6ff0733800 1 -- 172.21.15.42:0/2402045904 wait complete. 2024-02-16T00:12:34.221 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"7d041155-908e-42d6-a32d-d2f504649d95","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"5de38a36-95ca-4489-8960-85088a4cd7b6","zones":[{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-02-16T00:12:34.221 DEBUG:tasks.util.rgw: json result: {'id': '7d041155-908e-42d6-a32d-d2f504649d95', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'zones': [{'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-02-16T00:12:34.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-16T00:12:34.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-16T00:12:34.222 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-02-16T00:12:34.307 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:34.308 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:34.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f8293816800 1 Processor -- start 2024-02-16T00:12:34.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f8293816800 1 -- start start 2024-02-16T00:12:34.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f8293816800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564529ec1950 0x564529ec1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f8293816800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564529e0dbc0 con 0x564529ec22b0 2024-02-16T00:12:34.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f8293816800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x564529dc5450 con 0x564529ec1950 2024-02-16T00:12:34.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f828ee9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564529ec1950 0x564529ec1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f828e69c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x564529ec22b0 0x564529ec2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33822/0 (socket says 172.21.15.42:33822) 2024-02-16T00:12:34.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f828ee9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x564529ec1950 0x564529ec1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56600/0 (socket says 172.21.15.42:56600) 2024-02-16T00:12:34.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f828e69c640 1 -- 172.21.15.42:0/2918042672 learned_addr learned my addr 172.21.15.42:0/2918042672 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-02-16T00:12:34.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f828ee9d640 1 -- 172.21.15.42:0/2918042672 >> v1:172.21.15.2:6789/0 conn(0x564529ec22b0 legacy=0x564529ec2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.306+0000 7f828ee9d640 1 -- 172.21.15.42:0/2918042672 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564529e36440 con 0x564529ec1950 2024-02-16T00:12:34.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.308+0000 7f828ee9d640 1 --2- 172.21.15.42:0/2918042672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529ec1d70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8280005fd0 tx=0x7f828001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbecf0d291d68d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.308+0000 7f828de9b640 1 -- 172.21.15.42:0/2918042672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280052560 con 0x564529ec1950 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.308+0000 7f828de9b640 1 -- 172.21.15.42:0/2918042672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800526c0 con 0x564529ec1950 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.308+0000 7f828de9b640 1 -- 172.21.15.42:0/2918042672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82800529e0 con 0x564529ec1950 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 -- 172.21.15.42:0/2918042672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 msgr2=0x564529ec1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 --2- 172.21.15.42:0/2918042672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529ec1d70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8280005fd0 tx=0x7f828001cb90 comp rx=0 tx=0).stop 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 -- 172.21.15.42:0/2918042672 shutdown_connections 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 --2- 172.21.15.42:0/2918042672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529ec1d70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 -- 172.21.15.42:0/2918042672 >> 172.21.15.42:0/2918042672 conn(0x564529ebd5b0 msgr2=0x564529ebf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 -- 172.21.15.42:0/2918042672 shutdown_connections 2024-02-16T00:12:34.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.309+0000 7f8293816800 1 -- 172.21.15.42:0/2918042672 wait complete. 2024-02-16T00:12:34.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.320+0000 7f8293816800 1 Processor -- start 2024-02-16T00:12:34.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.320+0000 7f8293816800 1 -- start start 2024-02-16T00:12:34.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.320+0000 7f8293816800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fb52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.321+0000 7f8293816800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564529dc2980 con 0x564529ec1950 2024-02-16T00:12:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.321+0000 7f828ee9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fb52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.321+0000 7f828ee9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fb52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56606/0 (socket says 172.21.15.42:56606) 2024-02-16T00:12:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.321+0000 7f828ee9d640 1 -- 172.21.15.42:0/45818360 learned_addr learned my addr 172.21.15.42:0/45818360 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.321+0000 7f828ee9d640 1 -- 172.21.15.42:0/45818360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828000a100 con 0x564529ec1950 2024-02-16T00:12:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.321+0000 7f828ee9d640 1 --2- 172.21.15.42:0/45818360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fb52d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f828000a3f0 tx=0x7f828004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7dc0b37ff84d89 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f817ce09640 1 -- 172.21.15.42:0/45818360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280052960 con 0x564529ec1950 2024-02-16T00:12:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f817ce09640 1 -- 172.21.15.42:0/45818360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280052c10 con 0x564529ec1950 2024-02-16T00:12:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f817ce09640 1 -- 172.21.15.42:0/45818360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f828005c430 con 0x564529ec1950 2024-02-16T00:12:34.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 -- 172.21.15.42:0/45818360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 msgr2=0x564529fb52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 --2- 172.21.15.42:0/45818360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fb52d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f828000a3f0 tx=0x7f828004c000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 -- 172.21.15.42:0/45818360 shutdown_connections 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 --2- 172.21.15.42:0/45818360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fb52d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 -- 172.21.15.42:0/45818360 >> 172.21.15.42:0/45818360 conn(0x564529ebd5b0 msgr2=0x564529fb0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 -- 172.21.15.42:0/45818360 shutdown_connections 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.322+0000 7f8293816800 1 -- 172.21.15.42:0/45818360 wait complete. 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f8293816800 1 Processor -- start 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f8293816800 1 -- start start 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f8293816800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fbc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f8293816800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564529dbe160 con 0x564529ec1950 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f828ee9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fbc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f828ee9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fbc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56608/0 (socket says 172.21.15.42:56608) 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.323+0000 7f828ee9d640 1 -- 172.21.15.42:0/3967215843 learned_addr learned my addr 172.21.15.42:0/3967215843 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f828ee9d640 1 -- 172.21.15.42:0/3967215843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564529e36440 con 0x564529ec1950 2024-02-16T00:12:34.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f828ee9d640 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fbc7d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8280000f80 tx=0x7f8280003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f817b606640 1 -- 172.21.15.42:0/3967215843 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f828005c430 con 0x564529ec1950 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f817b606640 1 -- 172.21.15.42:0/3967215843 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280071440 con 0x564529ec1950 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f817b606640 1 -- 172.21.15.42:0/3967215843 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280071700 con 0x564529ec1950 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564529fbcd10 con 0x564529ec1950 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.324+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564529fbd1f0 con 0x564529ec1950 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f8293816800 1 Processor -- start 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f8293816800 1 -- start start 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f8293816800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fc9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f8293816800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564529d60e80 con 0x564529fc9bd0 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f817b606640 1 -- 172.21.15.42:0/3967215843 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f828007a440 con 0x564529ec1950 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f828f69e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fc9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f817b606640 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8174036790 0x7f8174038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f828f69e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fc9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56612/0 (socket says 172.21.15.42:56612) 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f828f69e640 1 -- 172.21.15.42:0/4247761537 learned_addr learned my addr 172.21.15.42:0/4247761537 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f817b606640 1 -- 172.21.15.42:0/3967215843 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f828008ebc0 con 0x564529ec1950 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f828ee9d640 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8174036790 0x7f8174038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f828f69e640 1 -- 172.21.15.42:0/4247761537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564529fca530 con 0x564529fc9bd0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.325+0000 7f828ee9d640 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8174036790 0x7f8174038c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82800658e0 tx=0x7f8280065720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f828f69e640 1 --2- 172.21.15.42:0/4247761537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fc9ff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f828800a400 tx=0x7f828800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81021c3ddf11f226 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8179602640 1 -- 172.21.15.42:0/4247761537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82880087e0 con 0x564529fc9bd0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8179602640 1 -- 172.21.15.42:0/4247761537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288008960 con 0x564529fc9bd0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8179602640 1 -- 172.21.15.42:0/4247761537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8288008c80 con 0x564529fc9bd0 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 -- 172.21.15.42:0/4247761537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 msgr2=0x564529fc9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 --2- 172.21.15.42:0/4247761537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fc9ff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f828800a400 tx=0x7f828800a8c0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 -- 172.21.15.42:0/4247761537 shutdown_connections 2024-02-16T00:12:34.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 --2- 172.21.15.42:0/4247761537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fc9ff0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 -- 172.21.15.42:0/4247761537 >> 172.21.15.42:0/4247761537 conn(0x564529ec22b0 msgr2=0x564529fc6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 -- 172.21.15.42:0/4247761537 shutdown_connections 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 -- 172.21.15.42:0/4247761537 wait complete. 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.326+0000 7f8293816800 1 Processor -- start 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f8293816800 1 -- start start 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f8293816800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fd0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f8293816800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564529d365d0 con 0x564529fc9bd0 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f828f69e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fd0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f828f69e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fd0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56614/0 (socket says 172.21.15.42:56614) 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f828f69e640 1 -- 172.21.15.42:0/561891838 learned_addr learned my addr 172.21.15.42:0/561891838 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f828f69e640 1 -- 172.21.15.42:0/561891838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288005c90 con 0x564529fc9bd0 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.327+0000 7f828f69e640 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fd0c00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x564529fca980 tx=0x7f8288002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.328+0000 7f81737fe640 1 -- 172.21.15.42:0/561891838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8288013800 con 0x564529fc9bd0 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.328+0000 7f81737fe640 1 -- 172.21.15.42:0/561891838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288013960 con 0x564529fc9bd0 2024-02-16T00:12:34.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.328+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564529fd1140 con 0x564529fc9bd0 2024-02-16T00:12:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.328+0000 7f81737fe640 1 -- 172.21.15.42:0/561891838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8288013c00 con 0x564529fc9bd0 2024-02-16T00:12:34.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.328+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564529fd1600 con 0x564529fc9bd0 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f81737fe640 1 -- 172.21.15.42:0/561891838 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f828801e420 con 0x564529fc9bd0 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f8293816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f8293816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f81737fe640 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8168036790 0x7f8168038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f81737fe640 1 -- 172.21.15.42:0/561891838 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f828804c1d0 con 0x564529fc9bd0 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f828e69c640 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8168036790 0x7f8168038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f8293816800 1 Processor -- start 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f8293816800 1 -- start start 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f8293816800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 0x564529feb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f8293816800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x564529feba60 con 0x564529feb100 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f828e69c640 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8168036790 0x7f8168038c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8284000f60 tx=0x7f8284001230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.329+0000 7f828ee9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 0x564529feb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f828ee9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 0x564529feb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56622/0 (socket says 172.21.15.42:56622) 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f828ee9d640 1 -- 172.21.15.42:0/2714843606 learned_addr learned my addr 172.21.15.42:0/2714843606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f828ee9d640 1 -- 172.21.15.42:0/2714843606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564529febba0 con 0x564529feb100 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f828ee9d640 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 0x564529feb520 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f828005cef0 tx=0x7f82800653a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f814effd640 1 -- 172.21.15.42:0/2714843606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f828008a030 con 0x564529feb100 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f814effd640 1 -- 172.21.15.42:0/2714843606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828007f070 con 0x564529feb100 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564529fec4d0 con 0x564529feb100 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f814effd640 1 -- 172.21.15.42:0/2714843606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280051530 con 0x564529feb100 2024-02-16T00:12:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.330+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564529fec4d0 con 0x564529feb100 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.331+0000 7f814effd640 1 -- 172.21.15.42:0/2714843606 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f828007a6f0 con 0x564529feb100 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.331+0000 7f814effd640 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f80c8036790 0x7f80c8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.331+0000 7f814effd640 1 -- 172.21.15.42:0/2714843606 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f8280097d00 con 0x564529feb100 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.331+0000 7f828e69c640 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f80c8036790 0x7f80c8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.331+0000 7f814cff9640 20 reqs_thread_entry: start 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f828e69c640 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f80c8036790 0x7f80c8038c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8284001ed0 tx=0x7f828400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564529ff7ed0 0x564529ffa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564529ffa870 con 0x564529ff7ed0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f828f69e640 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564529ff7ed0 0x564529ffa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f828f69e640 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564529ff7ed0 0x564529ffa2c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f828f69e640 1 -- 172.21.15.42:0/3967215843 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8288024070 con 0x564529ff7ed0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.332+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564529ffc080 con 0x564529ff7ed0 2024-02-16T00:12:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.333+0000 7f828f69e640 1 -- 172.21.15.42:0/3967215843 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8288024070 con 0x564529ff7ed0 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.333+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56452a0009d0 con 0x564529ff7ed0 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.334+0000 7f828f69e640 1 -- 172.21.15.42:0/3967215843 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [stat,call,call,writefull 0~421] v29'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f8288024070 con 0x564529ff7ed0 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8168036790 msgr2=0x7f8168038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8168036790 0x7f8168038c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8284000f60 tx=0x7f8284001230 comp rx=0 tx=0).stop 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 msgr2=0x564529fd0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fd0c00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x564529fca980 tx=0x7f8288002ff0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 shutdown_connections 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8168036790 0x7f8168038c50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/561891838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529fc9bd0 0x564529fd0c00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 >> 172.21.15.42:0/561891838 conn(0x564529ec22b0 msgr2=0x564529fc3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 shutdown_connections 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/561891838 wait complete. 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f80c8036790 msgr2=0x7f80c8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f80c8036790 0x7f80c8038c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8284001ed0 tx=0x7f828400f000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 msgr2=0x564529feb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 0x564529feb520 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f828005cef0 tx=0x7f82800653a0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 shutdown_connections 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f80c8036790 0x7f80c8038c50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 --2- 172.21.15.42:0/2714843606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529feb100 0x564529feb520 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 >> 172.21.15.42:0/2714843606 conn(0x564529fdfdf0 msgr2=0x564529fe0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 shutdown_connections 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.335+0000 7f8293816800 1 -- 172.21.15.42:0/2714843606 wait complete. 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564529ff7ed0 msgr2=0x564529ffa2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564529ff7ed0 0x564529ffa2c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8174036790 msgr2=0x7f8174038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8174036790 0x7f8174038c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82800658e0 tx=0x7f8280065720 comp rx=0 tx=0).stop 2024-02-16T00:12:34.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 msgr2=0x564529fbc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fbc7d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8280000f80 tx=0x7f8280003330 comp rx=0 tx=0).stop 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 shutdown_connections 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x564529ff7ed0 0x564529ffa2c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8174036790 0x7f8174038c50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 --2- 172.21.15.42:0/3967215843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564529ec1950 0x564529fbc7d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 >> 172.21.15.42:0/3967215843 conn(0x564529ebd5b0 msgr2=0x564529faf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 shutdown_connections 2024-02-16T00:12:34.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.336+0000 7f8293816800 1 -- 172.21.15.42:0/3967215843 wait complete. 2024-02-16T00:12:34.346 INFO:teuthology.orchestra.run.smithi042.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-02-16T00:12:34.346 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-02-16T00:12:34.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-16T00:12:34.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-16T00:12:34.347 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-02-16T00:12:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.393+0000 7f0c81416800 1 Processor -- start 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.393+0000 7f0c81416800 1 -- start start 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.393+0000 7f0c81416800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c4a964f960 0x55c4a964fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.393+0000 7f0c81416800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c4a959bbd0 con 0x55c4a96502c0 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.393+0000 7f0c81416800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c4a9553450 con 0x55c4a964f960 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.394+0000 7f0c7ca84640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c4a964f960 0x55c4a964fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.394+0000 7f0c7ca84640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x55c4a964f960 0x55c4a964fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56626/0 (socket says 172.21.15.42:56626) 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.394+0000 7f0c7ca84640 1 -- 172.21.15.42:0/3935784190 learned_addr learned my addr 172.21.15.42:0/3935784190 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.394+0000 7f0c7c283640 1 --1- 172.21.15.42:0/3935784190 >> v1:172.21.15.2:6789/0 conn(0x55c4a96502c0 0x55c4a9650770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33828/0 (socket says 172.21.15.42:33828) 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.394+0000 7f0c7ca84640 1 -- 172.21.15.42:0/3935784190 >> v1:172.21.15.2:6789/0 conn(0x55c4a96502c0 legacy=0x55c4a9650770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.394+0000 7f0c7ca84640 1 -- 172.21.15.42:0/3935784190 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4a95c4450 con 0x55c4a964f960 2024-02-16T00:12:34.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/3935784190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a964fd80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00a520 tx=0x7f0c6c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7e3f0d6ac49085 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c7ba82640 1 -- 172.21.15.42:0/3935784190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c052570 con 0x55c4a964f960 2024-02-16T00:12:34.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c7ba82640 1 -- 172.21.15.42:0/3935784190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c0526d0 con 0x55c4a964f960 2024-02-16T00:12:34.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c7ba82640 1 -- 172.21.15.42:0/3935784190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c052990 con 0x55c4a964f960 2024-02-16T00:12:34.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 -- 172.21.15.42:0/3935784190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 msgr2=0x55c4a964fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 --2- 172.21.15.42:0/3935784190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a964fd80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00a520 tx=0x7f0c6c01cee0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 -- 172.21.15.42:0/3935784190 shutdown_connections 2024-02-16T00:12:34.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 --2- 172.21.15.42:0/3935784190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a964fd80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 -- 172.21.15.42:0/3935784190 >> 172.21.15.42:0/3935784190 conn(0x55c4a964b5c0 msgr2=0x55c4a964d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 -- 172.21.15.42:0/3935784190 shutdown_connections 2024-02-16T00:12:34.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.396+0000 7f0c81416800 1 -- 172.21.15.42:0/3935784190 wait complete. 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c81416800 1 Processor -- start 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c81416800 1 -- start start 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c81416800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a97432e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c81416800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4a9550980 con 0x55c4a964f960 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c7ca84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a97432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c7ca84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a97432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56640/0 (socket says 172.21.15.42:56640) 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.408+0000 7f0c7ca84640 1 -- 172.21.15.42:0/1424660694 learned_addr learned my addr 172.21.15.42:0/1424660694 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.409+0000 7f0c7ca84640 1 -- 172.21.15.42:0/1424660694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c005de0 con 0x55c4a964f960 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.409+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/1424660694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a97432e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c01cf20 tx=0x7f0c6c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6fd9e11ed57aa9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.409+0000 7f0b6ae0d640 1 -- 172.21.15.42:0/1424660694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c052840 con 0x55c4a964f960 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.409+0000 7f0b6ae0d640 1 -- 172.21.15.42:0/1424660694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c0529a0 con 0x55c4a964f960 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.409+0000 7f0b6ae0d640 1 -- 172.21.15.42:0/1424660694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c052c80 con 0x55c4a964f960 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- 172.21.15.42:0/1424660694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 msgr2=0x55c4a97432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 --2- 172.21.15.42:0/1424660694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a97432e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c01cf20 tx=0x7f0c6c04c000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- 172.21.15.42:0/1424660694 shutdown_connections 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 --2- 172.21.15.42:0/1424660694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a97432e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- 172.21.15.42:0/1424660694 >> 172.21.15.42:0/1424660694 conn(0x55c4a964b5c0 msgr2=0x55c4a973ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- 172.21.15.42:0/1424660694 shutdown_connections 2024-02-16T00:12:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- 172.21.15.42:0/1424660694 wait complete. 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 Processor -- start 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- start start 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a974a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c81416800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4a954c160 con 0x55c4a964f960 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c7ca84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a974a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c7ca84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a974a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56654/0 (socket says 172.21.15.42:56654) 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.410+0000 7f0c7ca84640 1 -- 172.21.15.42:0/712200407 learned_addr learned my addr 172.21.15.42:0/712200407 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0c7ca84640 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4a95c4450 con 0x55c4a964f960 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a974a830 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c01ceb0 tx=0x7f0c6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0b6960a640 1 -- 172.21.15.42:0/712200407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c06c070 con 0x55c4a964f960 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0b6960a640 1 -- 172.21.15.42:0/712200407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c05d7c0 con 0x55c4a964f960 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4a974ad70 con 0x55c4a964f960 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0b6960a640 1 -- 172.21.15.42:0/712200407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c05da60 con 0x55c4a964f960 2024-02-16T00:12:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.411+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4a974b2b0 con 0x55c4a964f960 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c81416800 1 Processor -- start 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c81416800 1 -- start start 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0b6960a640 1 -- 172.21.15.42:0/712200407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0c6c059040 con 0x55c4a964f960 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c81416800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a9758060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c81416800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4a94eee80 con 0x55c4a9757c40 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0b6960a640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b640367e0 0x7f0b64038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0b6960a640 1 -- 172.21.15.42:0/712200407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0c6c08d9d0 con 0x55c4a964f960 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c7d285640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a9758060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c7d285640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a9758060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56664/0 (socket says 172.21.15.42:56664) 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c7d285640 1 -- 172.21.15.42:0/2573159794 learned_addr learned my addr 172.21.15.42:0/2573159794 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b640367e0 0x7f0b64038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.412+0000 7f0c7d285640 1 -- 172.21.15.42:0/2573159794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4a97585a0 con 0x55c4a9757c40 2024-02-16T00:12:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b640367e0 0x7f0b64038ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c005930 tx=0x7f0c6c05df40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c7d285640 1 --2- 172.21.15.42:0/2573159794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a9758060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400a430 tx=0x7f0c7400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63b65a59231da74 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0b62ffd640 1 -- 172.21.15.42:0/2573159794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74001650 con 0x55c4a9757c40 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0b62ffd640 1 -- 172.21.15.42:0/2573159794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c740017d0 con 0x55c4a9757c40 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0b62ffd640 1 -- 172.21.15.42:0/2573159794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74001ab0 con 0x55c4a9757c40 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 -- 172.21.15.42:0/2573159794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 msgr2=0x55c4a9758060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 --2- 172.21.15.42:0/2573159794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a9758060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400a430 tx=0x7f0c7400a8f0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 -- 172.21.15.42:0/2573159794 shutdown_connections 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 --2- 172.21.15.42:0/2573159794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a9758060 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 -- 172.21.15.42:0/2573159794 >> 172.21.15.42:0/2573159794 conn(0x55c4a96502c0 msgr2=0x55c4a97546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 -- 172.21.15.42:0/2573159794 shutdown_connections 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.413+0000 7f0c81416800 1 -- 172.21.15.42:0/2573159794 wait complete. 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c81416800 1 Processor -- start 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c81416800 1 -- start start 2024-02-16T00:12:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c81416800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a975ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c81416800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4a94c45d0 con 0x55c4a9757c40 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c7d285640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a975ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c7d285640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a975ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56680/0 (socket says 172.21.15.42:56680) 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c7d285640 1 -- 172.21.15.42:0/3310934615 learned_addr learned my addr 172.21.15.42:0/3310934615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.414+0000 7f0c7d285640 1 -- 172.21.15.42:0/3310934615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7400a0e0 con 0x55c4a9757c40 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.415+0000 7f0c7d285640 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a975ec70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000f80 tx=0x7f0c74003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.415+0000 7f0b617fa640 1 -- 172.21.15.42:0/3310934615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74010a40 con 0x55c4a9757c40 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.415+0000 7f0b617fa640 1 -- 172.21.15.42:0/3310934615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c74010ba0 con 0x55c4a9757c40 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.415+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4a975f1b0 con 0x55c4a9757c40 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.415+0000 7f0b617fa640 1 -- 172.21.15.42:0/3310934615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c74010e80 con 0x55c4a9757c40 2024-02-16T00:12:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.415+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4a975f610 con 0x55c4a9757c40 2024-02-16T00:12:34.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0b617fa640 1 -- 172.21.15.42:0/3310934615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0c74017070 con 0x55c4a9757c40 2024-02-16T00:12:34.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c81416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:34.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c81416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0b617fa640 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b540367e0 0x7f0b54038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0b617fa640 1 -- 172.21.15.42:0/3310934615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0c7404bf80 con 0x55c4a9757c40 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c7c283640 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b540367e0 0x7f0b54038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c81416800 1 Processor -- start 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c81416800 1 -- start start 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c81416800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 0x55c4a9779520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c81416800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4a9779a60 con 0x55c4a9779100 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.416+0000 7f0c7c283640 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b540367e0 0x7f0b54038ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c70000f60 tx=0x7f0c700012f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.417+0000 7f0c7ca84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 0x55c4a9779520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.417+0000 7f0c7ca84640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 0x55c4a9779520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56690/0 (socket says 172.21.15.42:56690) 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.417+0000 7f0c7ca84640 1 -- 172.21.15.42:0/476966331 learned_addr learned my addr 172.21.15.42:0/476966331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.417+0000 7f0c7ca84640 1 -- 172.21.15.42:0/476966331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4a9779ba0 con 0x55c4a9779100 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.417+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 0x55c4a9779520 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c008370 tx=0x7f0c6c05dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.417+0000 7f0b417e2640 1 -- 172.21.15.42:0/476966331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c0793b0 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.418+0000 7f0b417e2640 1 -- 172.21.15.42:0/476966331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c078360 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.418+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4a977a520 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.418+0000 7f0b417e2640 1 -- 172.21.15.42:0/476966331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c079a50 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.418+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4a977a9e0 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.418+0000 7f0b417e2640 1 -- 172.21.15.42:0/476966331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0c6c06f370 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.418+0000 7f0b417e2640 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0ab4036790 0x7f0ab4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0b417e2640 1 -- 172.21.15.42:0/476966331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f0c6c097d60 con 0x55c4a9779100 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0c7c283640 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0ab4036790 0x7f0ab4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0ac2ffd640 20 reqs_thread_entry: start 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c4a9786090 0x55c4a9788480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4a9788a30 con 0x55c4a9786090 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0c7c283640 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0ab4036790 0x7f0ab4038c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0c70001ed0 tx=0x7f0c7000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0c7d285640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c4a9786090 0x55c4a9788480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.419+0000 7f0c7d285640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c4a9786090 0x55c4a9788480 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c7d285640 1 -- 172.21.15.42:0/712200407 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c7401b390 con 0x55c4a9786090 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c4a978a7a0 0x55c4a978cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:2 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4a978d260 con 0x55c4a978a7a0 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c4a978a7a0 0x55c4a978cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c7ca84640 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c4a978a7a0 0x55c4a978cb90 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c7ca84640 1 -- 172.21.15.42:0/712200407 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(2 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~875 out=875b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0c6c08d720 con 0x55c4a978a7a0 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.420+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4a9789720 con 0x55c4a9786090 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0c7d285640 1 -- 172.21.15.42:0/712200407 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c7401b390 con 0x55c4a9786090 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4a9789ad0 con 0x55c4a9786090 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0c7d285640 1 -- 172.21.15.42:0/712200407 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0c7401b390 con 0x55c4a9786090 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4a9789f20 con 0x55c4a9786090 2024-02-16T00:12:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0c7d285640 1 -- 172.21.15.42:0/712200407 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f0c7401b390 con 0x55c4a9786090 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55c4a974e880 con 0x55c4a9757c40 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.421+0000 7f0b617fa640 1 -- 172.21.15.42:0/3310934615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c7404a380 con 0x55c4a9757c40 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.422+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:6 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~922 in=922b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4a97931f0 con 0x55c4a978a7a0 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c7ca84640 1 -- 172.21.15.42:0/712200407 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(6 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [stat,call,call,writefull 0~922] v29'5 uv5 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f0c6c08d720 con 0x55c4a978a7a0 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b540367e0 msgr2=0x7f0b54038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b540367e0 0x7f0b54038ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c70000f60 tx=0x7f0c700012f0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 msgr2=0x55c4a975ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a975ec70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000f80 tx=0x7f0c74003370 comp rx=0 tx=0).stop 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 shutdown_connections 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b540367e0 0x7f0b54038ca0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 --2- 172.21.15.42:0/3310934615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9757c40 0x55c4a975ec70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.423+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 >> 172.21.15.42:0/3310934615 conn(0x55c4a96502c0 msgr2=0x55c4a9751d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 shutdown_connections 2024-02-16T00:12:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/3310934615 wait complete. 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0ab4036790 msgr2=0x7f0ab4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0ab4036790 0x7f0ab4038c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0c70001ed0 tx=0x7f0c7000f000 comp rx=0 tx=0).stop 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 msgr2=0x55c4a9779520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 0x55c4a9779520 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c008370 tx=0x7f0c6c05dc90 comp rx=0 tx=0).stop 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 shutdown_connections 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0ab4036790 0x7f0ab4038c50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/476966331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a9779100 0x55c4a9779520 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 >> 172.21.15.42:0/476966331 conn(0x55c4a976de10 msgr2=0x55c4a976e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 shutdown_connections 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/476966331 wait complete. 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c4a9786090 msgr2=0x55c4a9788480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c4a9786090 0x55c4a9788480 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c4a978a7a0 msgr2=0x55c4a978cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c4a978a7a0 0x55c4a978cb90 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b640367e0 msgr2=0x7f0b64038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b640367e0 0x7f0b64038ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c005930 tx=0x7f0c6c05df40 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 msgr2=0x55c4a974a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a974a830 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c01ceb0 tx=0x7f0c6c002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 shutdown_connections 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x55c4a978a7a0 0x55c4a978cb90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x55c4a9786090 0x55c4a9788480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0b640367e0 0x7f0b64038ca0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 --2- 172.21.15.42:0/712200407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4a964f960 0x55c4a974a830 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 >> 172.21.15.42:0/712200407 conn(0x55c4a964b5c0 msgr2=0x55c4a973d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 shutdown_connections 2024-02-16T00:12:34.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:34.424+0000 7f0c81416800 1 -- 172.21.15.42:0/712200407 wait complete. 2024-02-16T00:12:34.436 INFO:teuthology.orchestra.run.smithi042.stdout:{"id":"5de38a36-95ca-4489-8960-85088a4cd7b6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T00:12:34.437 DEBUG:tasks.util.rgw: json result: {'id': '5de38a36-95ca-4489-8960-85088a4cd7b6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T00:12:34.439 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000007379f9e6cc253077-0065cea872-4222-default4222-default-default 2024-02-16T00:12:34.687 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=01b03f98347d428d83dd3a220d139b94 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_fddf34c14d11a944c077fae4b86a8722d85c0772/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000007379f9e6cc253077-0065cea872-4222-default4222-default-default 2024-02-16T00:12:34.689 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-16T00:12:34.708 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-16T00:12:34.708 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:12:34.711 INFO:tasks.rgw.client.0.smithi042.stdout:2024-02-16T00:12:34.707+0000 7fbe06ff2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36731) UID: 0 2024-02-16T00:12:34.711 INFO:tasks.rgw.client.0.smithi042.stdout:2024-02-16T00:12:34.707+0000 7fbe0a84b880 -1 shutting down 2024-02-16T00:12:34.791 INFO:tasks.rgw.client.0:Stopped 2024-02-16T00:12:34.791 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-16T00:12:34.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/vault-root-token 2024-02-16T00:12:34.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-02-16T00:12:34.980 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-16T00:12:34.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-16T00:12:34.981 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-16T00:12:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-02-16T00:12:35.062 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T00:12:35.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb96d80f800 1 Processor -- start 2024-02-16T00:12:35.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb96d80f800 1 -- start start 2024-02-16T00:12:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb96d80f800 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5648cdc8be70 0x5648cdc8c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb96d80f800 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5648cdbd7bb0 con 0x5648cdc8d0d0 2024-02-16T00:12:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb96d80f800 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x5648cdb8f450 con 0x5648cdc8be70 2024-02-16T00:12:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb968e72640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5648cdc8be70 0x5648cdc8c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb968e72640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x5648cdc8be70 0x5648cdc8c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56702/0 (socket says 172.21.15.42:56702) 2024-02-16T00:12:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb968e72640 1 -- 172.21.15.42:0/1650991583 learned_addr learned my addr 172.21.15.42:0/1650991583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:35.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb968671640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x5648cdc8d0d0 0x5648cdc8d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.42:33840/0 (socket says 172.21.15.42:33840) 2024-02-16T00:12:35.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.060+0000 7fb968e72640 1 -- 172.21.15.42:0/1650991583 >> v1:172.21.15.2:6789/0 conn(0x5648cdc8d0d0 legacy=0x5648cdc8d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.061+0000 7fb968e72640 1 -- 172.21.15.42:0/1650991583 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648cdc8c960 con 0x5648cdc8be70 2024-02-16T00:12:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.062+0000 7fb968e72640 1 --2- 172.21.15.42:0/1650991583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdc8c290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb95800a6b0 tx=0x7fb95801eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312b037f3939b571 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb967e70640 1 -- 172.21.15.42:0/1650991583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb95800a200 con 0x5648cdc8be70 2024-02-16T00:12:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb967e70640 1 -- 172.21.15.42:0/1650991583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800a360 con 0x5648cdc8be70 2024-02-16T00:12:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb967e70640 1 -- 172.21.15.42:0/1650991583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9580086e0 con 0x5648cdc8be70 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 -- 172.21.15.42:0/1650991583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 msgr2=0x5648cdc8c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1650991583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdc8c290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb95800a6b0 tx=0x7fb95801eda0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 -- 172.21.15.42:0/1650991583 shutdown_connections 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1650991583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdc8c290 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 -- 172.21.15.42:0/1650991583 >> 172.21.15.42:0/1650991583 conn(0x5648cdc874d0 msgr2=0x5648cdc898f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 -- 172.21.15.42:0/1650991583 shutdown_connections 2024-02-16T00:12:35.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.063+0000 7fb96d80f800 1 -- 172.21.15.42:0/1650991583 wait complete. 2024-02-16T00:12:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.074+0000 7fb96d80f800 1 Processor -- start 2024-02-16T00:12:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.074+0000 7fb96d80f800 1 -- start start 2024-02-16T00:12:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.075+0000 7fb96d80f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd7f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.075+0000 7fb96d80f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648cdb8c980 con 0x5648cdc8be70 2024-02-16T00:12:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.075+0000 7fb968e72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd7f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.075+0000 7fb968e72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd7f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56712/0 (socket says 172.21.15.42:56712) 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.075+0000 7fb968e72640 1 -- 172.21.15.42:0/1582603743 learned_addr learned my addr 172.21.15.42:0/1582603743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.075+0000 7fb968e72640 1 -- 172.21.15.42:0/1582603743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958005de0 con 0x5648cdc8be70 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb968e72640 1 --2- 172.21.15.42:0/1582603743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd7f5c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb95801f610 tx=0x7fb95804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceadda1eb4e20cce server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb856e0d640 1 -- 172.21.15.42:0/1582603743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb95800a200 con 0x5648cdc8be70 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb856e0d640 1 -- 172.21.15.42:0/1582603743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb958008910 con 0x5648cdc8be70 2024-02-16T00:12:35.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb856e0d640 1 -- 172.21.15.42:0/1582603743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb958008c10 con 0x5648cdc8be70 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb96d80f800 1 -- 172.21.15.42:0/1582603743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 msgr2=0x5648cdd7f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1582603743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd7f5c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb95801f610 tx=0x7fb95804e000 comp rx=0 tx=0).stop 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb96d80f800 1 -- 172.21.15.42:0/1582603743 shutdown_connections 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1582603743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd7f5c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.076+0000 7fb96d80f800 1 -- 172.21.15.42:0/1582603743 >> 172.21.15.42:0/1582603743 conn(0x5648cdc874d0 msgr2=0x5648cdd76ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb96d80f800 1 -- 172.21.15.42:0/1582603743 shutdown_connections 2024-02-16T00:12:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb96d80f800 1 -- 172.21.15.42:0/1582603743 wait complete. 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb96d80f800 1 Processor -- start 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb96d80f800 1 -- start start 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb96d80f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd86b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb96d80f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648cdb88160 con 0x5648cdc8be70 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb968e72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd86b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb968e72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd86b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56726/0 (socket says 172.21.15.42:56726) 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.077+0000 7fb968e72640 1 -- 172.21.15.42:0/3870840853 learned_addr learned my addr 172.21.15.42:0/3870840853 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:35.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb968e72640 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958050070 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb968e72640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd86b70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb958005400 tx=0x7fb958002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb85560a640 1 -- 172.21.15.42:0/3870840853 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb958008cf0 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648cdd870b0 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb85560a640 1 -- 172.21.15.42:0/3870840853 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95806c070 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb85560a640 1 -- 172.21.15.42:0/3870840853 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb958008050 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.078+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648cdd875f0 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb85560a640 1 -- 172.21.15.42:0/3870840853 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb958005020 con 0x5648cdc8be70 2024-02-16T00:12:35.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb85560a640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb850036790 0x7fb850038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb85560a640 1 -- 172.21.15.42:0/3870840853 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fb95808dd60 con 0x5648cdc8be70 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb968671640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb850036790 0x7fb850038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cdc8d0d0 0x5648cdd8d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdd8dd20 con 0x5648cdc8d0d0 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.079+0000 7fb969673640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cdc8d0d0 0x5648cdd8d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb968671640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb850036790 0x7fb850038c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000f60 tx=0x7fb95c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb969673640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cdc8d0d0 0x5648cdd8d7e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb969673640 1 -- 172.21.15.42:0/3870840853 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cdc8d0d0 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdd8aee0 con 0x5648cdc8d0d0 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb969673640 1 -- 172.21.15.42:0/3870840853 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cdc8d0d0 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cdd8ff30 0x5648cdd92320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:3 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdd929c0 con 0x5648cdd8ff30 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.080+0000 7fb968e72640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cdd8ff30 0x5648cdd92320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.081+0000 7fb968e72640 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cdd8ff30 0x5648cdd92320 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.081+0000 7fb968e72640 1 -- 172.21.15.42:0/3870840853 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(3 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [call out=48b,read 0~922 out=922b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+970 (crc 0 0 0) 0x7fb958064020 con 0x5648cdd8ff30 2024-02-16T00:12:35.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.081+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdd8ef70 con 0x5648cdc8d0d0 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.081+0000 7fb969673640 1 -- 172.21.15.42:0/3870840853 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cdc8d0d0 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.081+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:5 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdd8f380 con 0x5648cdc8d0d0 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.081+0000 7fb969673640 1 -- 172.21.15.42:0/3870840853 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(5 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cdc8d0d0 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb96d80f800 1 Processor -- start 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb96d80f800 1 -- start start 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb96d80f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 0x5648cdda1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb96d80f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648cdb2ae80 con 0x5648cdda1510 2024-02-16T00:12:35.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb969673640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 0x5648cdda1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb969673640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 0x5648cdda1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56728/0 (socket says 172.21.15.42:56728) 2024-02-16T00:12:35.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.082+0000 7fb969673640 1 -- 172.21.15.42:0/1208351290 learned_addr learned my addr 172.21.15.42:0/1208351290 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb969673640 1 -- 172.21.15.42:0/1208351290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648cdda1e70 con 0x5648cdda1510 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb969673640 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 0x5648cdda1930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x5648cdd87930 tx=0x7fb960018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb84e7fc640 1 -- 172.21.15.42:0/1208351290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb96001d070 con 0x5648cdda1510 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb84e7fc640 1 -- 172.21.15.42:0/1208351290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960014450 con 0x5648cdda1510 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb84e7fc640 1 -- 172.21.15.42:0/1208351290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb960014730 con 0x5648cdda1510 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648cdda28e0 con 0x5648cdda1510 2024-02-16T00:12:35.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.083+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648cdda2da0 con 0x5648cdda1510 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb84e7fc640 1 -- 172.21.15.42:0/1208351290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb960020020 con 0x5648cdda1510 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb84e7fc640 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb8400367e0 0x7fb840038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb84e7fc640 1 -- 172.21.15.42:0/1208351290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fb96004de10 con 0x5648cdda1510 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb968e72640 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb8400367e0 0x7fb840038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb96d80f800 1 Processor -- start 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb96d80f800 1 -- start start 2024-02-16T00:12:35.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb968e72640 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb8400367e0 0x7fb840038ca0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5648cdd8b290 tx=0x7fb958054f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb96d80f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddaeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.084+0000 7fb96d80f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648cdb005d0 con 0x5648cddae740 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb969673640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddaeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb969673640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddaeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56730/0 (socket says 172.21.15.42:56730) 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb969673640 1 -- 172.21.15.42:0/2778894066 learned_addr learned my addr 172.21.15.42:0/2778894066 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb969673640 1 -- 172.21.15.42:0/2778894066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648cddaf130 con 0x5648cddae740 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb969673640 1 --2- 172.21.15.42:0/2778894066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddaeb60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb96004c150 tx=0x7fb960011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedc94df4bf4dc32 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb83ffff640 1 -- 172.21.15.42:0/2778894066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb960016440 con 0x5648cddae740 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb83ffff640 1 -- 172.21.15.42:0/2778894066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600165a0 con 0x5648cddae740 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.085+0000 7fb83ffff640 1 -- 172.21.15.42:0/2778894066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb960014d60 con 0x5648cddae740 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- 172.21.15.42:0/2778894066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 msgr2=0x5648cddaeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 --2- 172.21.15.42:0/2778894066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddaeb60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb96004c150 tx=0x7fb960011f20 comp rx=0 tx=0).stop 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- 172.21.15.42:0/2778894066 shutdown_connections 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 --2- 172.21.15.42:0/2778894066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddaeb60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- 172.21.15.42:0/2778894066 >> 172.21.15.42:0/2778894066 conn(0x5648cddaaa10 msgr2=0x5648cdda8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- 172.21.15.42:0/2778894066 shutdown_connections 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- 172.21.15.42:0/2778894066 wait complete. 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 Processor -- start 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- start start 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddb56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb96d80f800 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648cddb5bf0 con 0x5648cddae740 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb969673640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddb56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb969673640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddb56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.42:56746/0 (socket says 172.21.15.42:56746) 2024-02-16T00:12:35.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.086+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 learned_addr learned my addr 172.21.15.42:0/3906229741 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648cdda2da0 con 0x5648cddae740 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb969673640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddb56b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb960013a20 tx=0x7fb960005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb83e7fc640 1 -- 172.21.15.42:0/3906229741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb960014950 con 0x5648cddae740 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb83e7fc640 1 -- 172.21.15.42:0/3906229741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96002be80 con 0x5648cddae740 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648cddb5df0 con 0x5648cddae740 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb83e7fc640 1 -- 172.21.15.42:0/3906229741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb960022860 con 0x5648cddae740 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.087+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648cddb62b0 con 0x5648cddae740 2024-02-16T00:12:35.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.088+0000 7fb83e7fc640 1 -- 172.21.15.42:0/3906229741 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb9600229c0 con 0x5648cddae740 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.088+0000 7fb83e7fc640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb834036790 0x7fb834038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.088+0000 7fb83e7fc640 1 -- 172.21.15.42:0/3906229741 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fb960038d10 con 0x5648cddae740 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.088+0000 7fb968e72640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb834036790 0x7fb834038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cddc12d0 0x5648cddc3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc3ee0 con 0x5648cddc12d0 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb968671640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cddc12d0 0x5648cddc3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb968e72640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb834036790 0x7fb834038c50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb958054e80 tx=0x7fb95808f070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb968671640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cddc12d0 0x5648cddc3790 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 20 realm 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.089+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc0730 con 0x5648cddc12d0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc4960 con 0x5648cddc12d0 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc51e0 con 0x5648cddc12d0 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cddc5bc0 0x5648cddc7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:5 5.1b 5:dec71365:::zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc86b0 con 0x5648cddc5bc0 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb969673640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cddc5bc0 0x5648cddc7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.090+0000 7fb969673640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cddc5bc0 0x5648cddc7fb0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== osd_op_reply(5 zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 [read 0~922 out=922b] v0'0 uv5 ondisk = 0) v8 ==== 190+0+922 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb96d80f800 20 rados_obj.operate() r=0 bl.length=922 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb96d80f800 20 searching for the correct realm 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648cddca720 0x5648cddccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcd2b0 con 0x5648cddca720 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb968e72640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648cddca720 0x5648cddccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.091+0000 7fb968e72640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648cddca720 0x5648cddccbe0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.092+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.092+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcd2b0 con 0x5648cddc5bc0 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.092+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.092+0000 7fb969673640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb960037020 0x7fb96001b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.092+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.092+0000 7fb968671640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb960037020 0x7fb96001b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb960037020 0x7fb96001b810 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.093+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.094+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.094+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.094+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.094+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.094+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.094+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=112b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.095+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.096+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.097+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 7 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.098+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.099+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 8 ==== osd_op_reply(33 [pgnls start_epoch 29 out=107b] v29'5 uv5 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddca720 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x7fb960037020 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc12d0 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.100+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb96004a030 con 0x5648cddc5bc0 2024-02-16T00:12:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 9 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 RGWRados::pool_iterate: got zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 RGWRados::pool_iterate: got zone_info.5de38a36-95ca-4489-8960-85088a4cd7b6 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc8b40 con 0x5648cddc12d0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc8ef0 con 0x5648cddc12d0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:40 5.12 5:4ff88532:::zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddc92d0 con 0x5648cddc12d0 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.101+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 15 ==== osd_op_reply(40 zonegroup_info.7d041155-908e-42d6-a32d-d2f504649d95 [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados_obj.operate() r=0 bl.length=421 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 zone default found 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 4 Realm: () 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 4 ZoneGroup: default (7d041155-908e-42d6-a32d-d2f504649d95) 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 4 Zone: default (5de38a36-95ca-4489-8960-85088a4cd7b6) 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 zonegroup default 2024-02-16T00:12:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcd6f0 con 0x7fb960037020 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcf570 con 0x5648cddca720 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados->read ofs=0 len=0 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcf8d0 con 0x5648cddca720 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.102+0000 7fb96d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.103+0000 7fb96d80f800 20 started sync module instance, tier type = 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.103+0000 7fb96d80f800 20 started zone id=5de38a36-95ca-4489-8960-85088a4cd7b6 (name=default) with tier type = 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.103+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddceaf0 con 0x5648cddc5bc0 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.104+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 10 ==== osd_op_reply(44 notify.0 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.104+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94870691442688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddceaf0 con 0x5648cddc5bc0 2024-02-16T00:12:35.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.104+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd0300 con 0x5648cddc12d0 2024-02-16T00:12:35.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.105+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94870691442688] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.105+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 16 ==== osd_op_reply(46 notify.1 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.105+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94870691446272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd0300 con 0x5648cddc12d0 2024-02-16T00:12:35.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.105+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd0da0 con 0x5648cddca720 2024-02-16T00:12:35.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.106+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94870691446272] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.106+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 12 ==== osd_op_reply(48 notify.2 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.106+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94870691448960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd1150 con 0x5648cddca720 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.106+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd1b30 con 0x5648cddc5bc0 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.107+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 12 ==== osd_op_reply(50 notify.3 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.107+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94870691452496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd23f0 con 0x5648cddc5bc0 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.107+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd2e90 con 0x5648cddc12d0 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.108+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94870691448960] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.108+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94870691452496] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.109+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 18 ==== osd_op_reply(52 notify.4 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.109+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94870691457392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd2e50 con 0x5648cddc12d0 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.109+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd36e0 con 0x7fb960037020 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.110+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94870691457392] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.110+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 9 ==== osd_op_reply(54 notify.5 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.110+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94870691440208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd2e50 con 0x7fb960037020 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.110+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd3d80 con 0x7fb960037020 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.111+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94870691440208] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.111+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 11 ==== osd_op_reply(56 notify.6 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.111+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94870691461216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd3d40 con 0x7fb960037020 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.111+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd4750 con 0x7fb960037020 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94870691461216] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 13 ==== osd_op_reply(58 notify.7 [create] v29'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94870691459568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd4750 con 0x7fb960037020 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=0 2024-02-16T00:12:35.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=1 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=2 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=3 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=4 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=5 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.112+0000 7fb96d80f800 20 add_watcher() i=6 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.113+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94870691459568] v29'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.113+0000 7fb96d80f800 20 add_watcher() i=7 2024-02-16T00:12:35.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.113+0000 7fb96d80f800 2 all 8 watchers are set, enabling cache 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.113+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd7c90 con 0x5648cddc12d0 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.114+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.114+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94870691463744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd5010 con 0x5648cddc12d0 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.114+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94870691463744] v29'246 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.115+0000 7fb81efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.115+0000 7fb96d80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.115+0000 7fb96d80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T00:12:35.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.115+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde0820 con 0x5648cddc12d0 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.116+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'61 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.116+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde0e10 con 0x7fb960037020 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.117+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.117+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde1340 con 0x5648cddca720 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.118+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.118+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde1d10 con 0x5648cddc12d0 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.119+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'247 uv172 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.119+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde1d10 con 0x5648cddc5bc0 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.120+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'83 uv59 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.120+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde22a0 con 0x5648cddca720 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.121+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'63 uv48 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.121+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde2c70 con 0x5648cddc12d0 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.122+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.122+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde2c70 con 0x7fb960037020 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.123+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'58 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.124+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde2d00 con 0x5648cddc5bc0 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.125+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.125+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde3230 con 0x5648cddca720 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.126+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.126+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde3760 con 0x5648cddc5bc0 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.126+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'84 uv61 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.126+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde3c90 con 0x7fb960037020 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.128+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.128+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde3c90 con 0x5648cddc5bc0 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.129+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.129+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4130 con 0x7fb960037020 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.130+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'69 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.130+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4130 con 0x5648cddc12d0 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.131+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'248 uv168 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.131+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4130 con 0x5648cddca720 2024-02-16T00:12:35.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.133+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'77 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.133+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4130 con 0x5648cddc5bc0 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.134+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'85 uv57 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.134+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde42b0 con 0x5648cddca720 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.135+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'41 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.135+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde42b0 con 0x5648cddc12d0 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.136+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'38 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.136+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4250 con 0x5648cddc12d0 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.137+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'249 uv170 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.137+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde41c0 con 0x5648cddca720 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.138+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'78 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.138+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddc5bc0 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.139+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'47 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.139+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddca720 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.140+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.140+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddca720 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.141+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'47 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.141+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddca720 2024-02-16T00:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.142+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.142+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddca720 2024-02-16T00:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.143+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'64 uv46 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.143+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x7fb960037020 2024-02-16T00:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.144+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.144+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddca720 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.145+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'42 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.145+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x7fb960037020 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.146+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'59 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.146+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddca720 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.147+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'79 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.147+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x7fb960037020 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.148+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'70 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.148+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cdde4780 con 0x5648cddc5bc0 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.149+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'36 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.150+0000 7fb81dfe3640 20 reqs_thread_entry: start 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.150+0000 7fb96d80f800 20 init_complete bucket index max shards: 11 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.150+0000 7fb96d80f800 20 Filter name: none 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.150+0000 7fb78f7fe640 20 reqs_thread_entry: start 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.150+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.150+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:94 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 28 ==== osd_op_reply(94 gc.14 [call] v29'250 uv250 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:95 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 29 ==== osd_op_reply(95 gc.14 [call out=15b] v0'0 uv250 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:96 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 30 ==== osd_op_reply(96 gc.14 [call out=24b] v0'0 uv250 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:97 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.151+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 31 ==== osd_op_reply(97 gc.14 [call out=15b] v0'0 uv250 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.152+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.152+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:98 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.152+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 32 ==== osd_op_reply(98 gc.14 [call out=15b] v0'0 uv250 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.152+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.152+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:99 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.153+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 33 ==== osd_op_reply(99 gc.14 [call] v29'251 uv251 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.153+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.153+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:100 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.154+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 26 ==== osd_op_reply(100 gc.15 [call] v29'80 uv80 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.154+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:101 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.154+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 27 ==== osd_op_reply(101 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.154+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.154+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:102 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 28 ==== osd_op_reply(102 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:103 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 29 ==== osd_op_reply(103 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:104 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 30 ==== osd_op_reply(104 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.155+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:105 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.156+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 31 ==== osd_op_reply(105 gc.15 [call] v29'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.156+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.156+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:106 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 21 ==== osd_op_reply(106 gc.16 [call] v29'86 uv86 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:107 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 22 ==== osd_op_reply(107 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:108 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 23 ==== osd_op_reply(108 gc.16 [call out=24b] v0'0 uv86 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.157+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:109 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.158+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 24 ==== osd_op_reply(109 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.158+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.158+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:110 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.158+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 25 ==== osd_op_reply(110 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.158+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.158+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:111 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.159+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 26 ==== osd_op_reply(111 gc.16 [call] v29'87 uv87 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.159+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.159+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:112 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.160+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 32 ==== osd_op_reply(112 gc.17 [call] v29'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.160+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:113 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.160+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 33 ==== osd_op_reply(113 gc.17 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.160+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.160+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:114 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 34 ==== osd_op_reply(114 gc.17 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:115 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 35 ==== osd_op_reply(115 gc.17 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:116 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 36 ==== osd_op_reply(116 gc.17 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.161+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:117 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.162+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 37 ==== osd_op_reply(117 gc.17 [call] v29'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.162+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.162+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:118 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.163+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 34 ==== osd_op_reply(118 gc.18 [call] v29'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.163+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:119 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 35 ==== osd_op_reply(119 gc.18 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:120 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 36 ==== osd_op_reply(120 gc.18 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:121 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 37 ==== osd_op_reply(121 gc.18 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:122 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 38 ==== osd_op_reply(122 gc.18 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.164+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:123 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.165+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 39 ==== osd_op_reply(123 gc.18 [call] v29'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.165+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-16T00:12:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.165+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:124 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.166+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 40 ==== osd_op_reply(124 gc.19 [call] v29'252 uv252 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.166+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:125 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 41 ==== osd_op_reply(125 gc.19 [call out=15b] v0'0 uv252 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:126 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 42 ==== osd_op_reply(126 gc.19 [call out=24b] v0'0 uv252 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:127 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 43 ==== osd_op_reply(127 gc.19 [call out=15b] v0'0 uv252 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:128 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 44 ==== osd_op_reply(128 gc.19 [call out=15b] v0'0 uv252 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.167+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:129 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.168+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 45 ==== osd_op_reply(129 gc.19 [call] v29'253 uv253 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.168+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.168+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:130 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.169+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 38 ==== osd_op_reply(130 gc.20 [call] v29'82 uv82 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.169+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:131 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 39 ==== osd_op_reply(131 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:132 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 40 ==== osd_op_reply(132 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:133 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 41 ==== osd_op_reply(133 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:134 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 42 ==== osd_op_reply(134 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.170+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:135 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.171+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 43 ==== osd_op_reply(135 gc.20 [call] v29'83 uv83 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.171+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.171+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:136 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.172+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 27 ==== osd_op_reply(136 gc.21 [call] v29'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.172+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:137 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 28 ==== osd_op_reply(137 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:138 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 29 ==== osd_op_reply(138 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:139 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 30 ==== osd_op_reply(139 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:140 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 31 ==== osd_op_reply(140 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.173+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:141 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.174+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 32 ==== osd_op_reply(141 gc.21 [call] v29'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.174+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-16T00:12:35.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.174+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:142 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.175+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 44 ==== osd_op_reply(142 gc.22 [call] v29'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.175+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:143 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.175+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 45 ==== osd_op_reply(143 gc.22 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.175+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.175+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:144 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 46 ==== osd_op_reply(144 gc.22 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:145 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 47 ==== osd_op_reply(145 gc.22 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:146 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 48 ==== osd_op_reply(146 gc.22 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.176+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:147 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.177+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 49 ==== osd_op_reply(147 gc.22 [call] v29'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.177+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.177+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:148 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.178+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 50 ==== osd_op_reply(148 gc.23 [call] v29'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.178+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:149 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.178+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 51 ==== osd_op_reply(149 gc.23 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.178+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.178+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:150 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.178+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 52 ==== osd_op_reply(150 gc.23 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:151 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 53 ==== osd_op_reply(151 gc.23 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:152 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 54 ==== osd_op_reply(152 gc.23 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.179+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:153 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.180+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 55 ==== osd_op_reply(153 gc.23 [call] v29'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.180+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.180+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:154 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.181+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 56 ==== osd_op_reply(154 gc.24 [call] v29'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.181+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:155 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.181+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 57 ==== osd_op_reply(155 gc.24 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.181+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.181+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:156 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 58 ==== osd_op_reply(156 gc.24 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:157 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 59 ==== osd_op_reply(157 gc.24 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:158 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 60 ==== osd_op_reply(158 gc.24 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.182+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:159 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.183+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 61 ==== osd_op_reply(159 gc.24 [call] v29'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.183+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.183+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:160 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 62 ==== osd_op_reply(160 gc.25 [call] v29'65 uv65 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:161 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 63 ==== osd_op_reply(161 gc.25 [call out=15b] v0'0 uv65 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:162 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 64 ==== osd_op_reply(162 gc.25 [call out=24b] v0'0 uv65 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.184+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:163 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.185+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 65 ==== osd_op_reply(163 gc.25 [call out=15b] v0'0 uv65 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.185+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.185+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:164 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.185+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 66 ==== osd_op_reply(164 gc.25 [call out=15b] v0'0 uv65 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.185+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.185+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:165 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.186+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 67 ==== osd_op_reply(165 gc.25 [call] v29'66 uv66 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.186+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.186+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:166 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.187+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 22 ==== osd_op_reply(166 gc.26 [call] v29'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.187+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:167 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.187+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 23 ==== osd_op_reply(167 gc.26 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:168 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 24 ==== osd_op_reply(168 gc.26 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:169 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 25 ==== osd_op_reply(169 gc.26 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:170 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.188+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 26 ==== osd_op_reply(170 gc.26 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.189+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.189+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:171 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.190+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 27 ==== osd_op_reply(171 gc.26 [call] v29'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.190+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.190+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:172 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.190+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 68 ==== osd_op_reply(172 gc.27 [call] v29'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:173 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 69 ==== osd_op_reply(173 gc.27 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:174 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 70 ==== osd_op_reply(174 gc.27 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 71 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 72 ==== osd_op_reply(176 gc.27 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.191+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.192+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 73 ==== osd_op_reply(177 gc.27 [call] v29'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.192+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.192+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 28 ==== osd_op_reply(178 gc.28 [call] v29'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 29 ==== osd_op_reply(179 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 30 ==== osd_op_reply(180 gc.28 [call out=24b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:181 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 31 ==== osd_op_reply(181 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.194+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:182 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.195+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 32 ==== osd_op_reply(182 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.195+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.195+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:183 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.196+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 33 ==== osd_op_reply(183 gc.28 [call] v29'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.196+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-16T00:12:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.196+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:184 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 74 ==== osd_op_reply(184 gc.29 [call] v29'84 uv84 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:185 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 75 ==== osd_op_reply(185 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:186 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 76 ==== osd_op_reply(186 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:187 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.197+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 77 ==== osd_op_reply(187 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.198+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.198+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:188 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.198+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 78 ==== osd_op_reply(188 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.198+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.198+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:189 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.199+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 79 ==== osd_op_reply(189 gc.29 [call] v29'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.199+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.199+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:190 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 34 ==== osd_op_reply(190 gc.30 [call] v29'71 uv71 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:191 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 35 ==== osd_op_reply(191 gc.30 [call out=15b] v0'0 uv71 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:192 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 36 ==== osd_op_reply(192 gc.30 [call out=24b] v0'0 uv71 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.200+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:193 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.201+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 37 ==== osd_op_reply(193 gc.30 [call out=15b] v0'0 uv71 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.201+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.201+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:194 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.201+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 38 ==== osd_op_reply(194 gc.30 [call out=15b] v0'0 uv71 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.201+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.201+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:195 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.202+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 39 ==== osd_op_reply(195 gc.30 [call] v29'72 uv72 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.202+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.202+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:196 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 33 ==== osd_op_reply(196 gc.31 [call] v29'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:197 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 34 ==== osd_op_reply(197 gc.31 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:198 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 35 ==== osd_op_reply(198 gc.31 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:199 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 36 ==== osd_op_reply(199 gc.31 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.204+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:200 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.205+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 37 ==== osd_op_reply(200 gc.31 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.205+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.205+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:201 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.206+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 38 ==== osd_op_reply(201 gc.31 [call] v29'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.206+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.206+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:202 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 46 ==== osd_op_reply(202 gc.0 [call] v29'62 uv62 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:203 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 47 ==== osd_op_reply(203 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:204 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 48 ==== osd_op_reply(204 gc.0 [call out=24b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.207+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.208+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 49 ==== osd_op_reply(205 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.208+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.208+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:206 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.208+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 50 ==== osd_op_reply(206 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.208+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.208+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:207 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.209+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 51 ==== osd_op_reply(207 gc.0 [call] v29'63 uv63 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.209+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.209+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:208 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.210+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 40 ==== osd_op_reply(208 gc.1 [call] v29'38 uv38 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.210+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:209 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.210+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 41 ==== osd_op_reply(209 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:210 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 42 ==== osd_op_reply(210 gc.1 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:211 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 43 ==== osd_op_reply(211 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:212 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 44 ==== osd_op_reply(212 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.211+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:213 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.212+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 45 ==== osd_op_reply(213 gc.1 [call] v29'39 uv39 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.212+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.212+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:214 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.213+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 80 ==== osd_op_reply(214 gc.2 [call] v29'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.213+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:215 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 81 ==== osd_op_reply(215 gc.2 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:216 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 82 ==== osd_op_reply(216 gc.2 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:217 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 83 ==== osd_op_reply(217 gc.2 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:218 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 84 ==== osd_op_reply(218 gc.2 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.214+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.215+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:219 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.215+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 85 ==== osd_op_reply(219 gc.2 [call] v29'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.215+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.215+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:220 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.216+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 52 ==== osd_op_reply(220 gc.3 [call] v29'254 uv254 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.216+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:221 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 53 ==== osd_op_reply(221 gc.3 [call out=15b] v0'0 uv254 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:222 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 54 ==== osd_op_reply(222 gc.3 [call out=24b] v0'0 uv254 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:223 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 55 ==== osd_op_reply(223 gc.3 [call out=15b] v0'0 uv254 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:224 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 56 ==== osd_op_reply(224 gc.3 [call out=15b] v0'0 uv254 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.217+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:225 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.218+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 57 ==== osd_op_reply(225 gc.3 [call] v29'255 uv255 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.218+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.218+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:226 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.219+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 39 ==== osd_op_reply(226 gc.4 [call] v29'88 uv88 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.219+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:227 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 40 ==== osd_op_reply(227 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:228 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 41 ==== osd_op_reply(228 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:229 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 42 ==== osd_op_reply(229 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:230 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 43 ==== osd_op_reply(230 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.220+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:231 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.221+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 44 ==== osd_op_reply(231 gc.4 [call] v29'89 uv89 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.221+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-16T00:12:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.221+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:232 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.222+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 86 ==== osd_op_reply(232 gc.5 [call] v29'67 uv67 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.222+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:233 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.222+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 87 ==== osd_op_reply(233 gc.5 [call out=15b] v0'0 uv67 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.222+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:234 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 88 ==== osd_op_reply(234 gc.5 [call out=24b] v0'0 uv67 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:235 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 89 ==== osd_op_reply(235 gc.5 [call out=15b] v0'0 uv67 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:236 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 90 ==== osd_op_reply(236 gc.5 [call out=15b] v0'0 uv67 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.223+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:237 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.224+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 91 ==== osd_op_reply(237 gc.5 [call] v29'68 uv68 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.224+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-16T00:12:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.224+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 58 ==== osd_op_reply(238 gc.6 [call] v29'38 uv38 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 59 ==== osd_op_reply(239 gc.6 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:240 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 60 ==== osd_op_reply(240 gc.6 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:241 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 61 ==== osd_op_reply(241 gc.6 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.226+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:242 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.227+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 62 ==== osd_op_reply(242 gc.6 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.227+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.227+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:243 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc12d0 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.228+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 63 ==== osd_op_reply(243 gc.6 [call] v29'39 uv39 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.228+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.228+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.229+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 46 ==== osd_op_reply(244 gc.7 [call] v29'62 uv62 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.229+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.229+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 47 ==== osd_op_reply(245 gc.7 [call out=15b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.229+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.229+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:246 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 48 ==== osd_op_reply(246 gc.7 [call out=24b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:247 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 49 ==== osd_op_reply(247 gc.7 [call out=15b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:248 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 50 ==== osd_op_reply(248 gc.7 [call out=15b] v0'0 uv62 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.230+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:249 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.231+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 51 ==== osd_op_reply(249 gc.7 [call] v29'63 uv63 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.231+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.231+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.232+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 45 ==== osd_op_reply(250 gc.8 [call] v29'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.232+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.232+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 46 ==== osd_op_reply(251 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.232+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.232+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:252 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 47 ==== osd_op_reply(252 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:253 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 48 ==== osd_op_reply(253 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:254 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 49 ==== osd_op_reply(254 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.233+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:255 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.234+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 50 ==== osd_op_reply(255 gc.8 [call] v29'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.234+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-16T00:12:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.234+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.235+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 92 ==== osd_op_reply(256 gc.9 [call] v29'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.235+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.235+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 93 ==== osd_op_reply(257 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.235+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.235+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:258 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 94 ==== osd_op_reply(258 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:259 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 95 ==== osd_op_reply(259 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:260 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 96 ==== osd_op_reply(260 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.236+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:261 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddca720 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.237+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 97 ==== osd_op_reply(261 gc.9 [call] v29'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.237+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-16T00:12:35.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.237+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 51 ==== osd_op_reply(262 gc.10 [call] v29'90 uv90 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 52 ==== osd_op_reply(263 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:264 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 53 ==== osd_op_reply(264 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.238+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:265 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.239+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 54 ==== osd_op_reply(265 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.239+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.239+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:266 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.239+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 55 ==== osd_op_reply(266 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.239+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.239+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:267 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.240+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 56 ==== osd_op_reply(267 gc.10 [call] v29'91 uv91 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.240+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-16T00:12:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.240+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.241+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 52 ==== osd_op_reply(268 gc.11 [call] v29'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.241+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.241+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 53 ==== osd_op_reply(269 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.241+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.241+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:270 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.242+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 54 ==== osd_op_reply(270 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.242+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:271 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.242+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 55 ==== osd_op_reply(271 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.242+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.242+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:272 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.243+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 56 ==== osd_op_reply(272 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.243+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.243+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:273 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.244+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 57 ==== osd_op_reply(273 gc.11 [call] v29'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.244+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.244+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 57 ==== osd_op_reply(274 gc.12 [call] v29'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 58 ==== osd_op_reply(275 gc.12 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:276 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 59 ==== osd_op_reply(276 gc.12 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:277 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 60 ==== osd_op_reply(277 gc.12 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.245+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:278 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.246+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 61 ==== osd_op_reply(278 gc.12 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.246+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.246+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:279 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x5648cddc5bc0 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.247+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 62 ==== osd_op_reply(279 gc.12 [call] v29'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.247+0000 7fb96d80f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.247+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 58 ==== osd_op_reply(280 gc.13 [call] v29'73 uv73 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 59 ==== osd_op_reply(281 gc.13 [call out=15b] v0'0 uv73 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:282 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 60 ==== osd_op_reply(282 gc.13 [call out=24b] v0'0 uv73 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.248+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:283 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.249+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 61 ==== osd_op_reply(283 gc.13 [call out=15b] v0'0 uv73 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.249+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.249+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:284 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.249+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 62 ==== osd_op_reply(284 gc.13 [call out=15b] v0'0 uv73 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.249+0000 7fb96d80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.249+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:285 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddde1d0 con 0x7fb960037020 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.250+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 63 ==== osd_op_reply(285 gc.13 [call] v29'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.251+0000 7fb81efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T00:12:35.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.251+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94870691463744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddddbc0 con 0x5648cddc12d0 2024-02-16T00:12:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.252+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 64 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94870691463744] v29'256 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.252+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94870691442688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd4240 con 0x5648cddc5bc0 2024-02-16T00:12:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.253+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 63 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94870691442688] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.253+0000 7fb96d80f800 20 remove_watcher() i=0 2024-02-16T00:12:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.253+0000 7fb96d80f800 2 removed watcher, disabling cache 2024-02-16T00:12:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.253+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94870691446272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcf000 con 0x5648cddc12d0 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.254+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 65 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94870691446272] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.254+0000 7fb96d80f800 20 remove_watcher() i=1 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.254+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94870691448960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcfe00 con 0x5648cddca720 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.255+0000 7fb968e72640 1 -- 172.21.15.42:0/3906229741 <== osd.3 v2:172.21.15.42:6810/474355007 98 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94870691448960] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb958064020 con 0x5648cddca720 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.255+0000 7fb96d80f800 20 remove_watcher() i=2 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.255+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94870691452496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddcfe00 con 0x5648cddc5bc0 2024-02-16T00:12:35.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.256+0000 7fb969673640 1 -- 172.21.15.42:0/3906229741 <== osd.2 v2:172.21.15.42:6808/1288904824 64 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94870691452496] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb96000a4a0 con 0x5648cddc5bc0 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.256+0000 7fb96d80f800 20 remove_watcher() i=3 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.256+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94870691457392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd1650 con 0x5648cddc12d0 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.257+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.1 v2:172.21.15.42:6800/2950936693 66 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94870691457392] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x5648cddc12d0 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.257+0000 7fb96d80f800 20 remove_watcher() i=4 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.257+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94870691440208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd2970 con 0x7fb960037020 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.258+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 64 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94870691440208] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.258+0000 7fb96d80f800 20 remove_watcher() i=5 2024-02-16T00:12:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.258+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94870691461216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd1650 con 0x7fb960037020 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.259+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 65 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94870691461216] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.259+0000 7fb96d80f800 20 remove_watcher() i=6 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.259+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94870691459568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5648cddd3860 con 0x7fb960037020 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 <== osd.0 v2:172.21.15.2:6800/1783370926 66 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94870691459568] v29'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb95c00f610 con 0x7fb960037020 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 20 remove_watcher() i=7 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb960037020 msgr2=0x7fb96001b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7fb960037020 0x7fb96001b810 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cddc12d0 msgr2=0x5648cddc3790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cddc12d0 0x5648cddc3790 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cddc5bc0 msgr2=0x5648cddc7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cddc5bc0 0x5648cddc7fb0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648cddca720 msgr2=0x5648cddccbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x5648cddca720 0x5648cddccbe0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb834036790 msgr2=0x7fb834038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.260+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb834036790 0x7fb834038c50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb958054e80 tx=0x7fb95808f070 comp rx=0 tx=0).stop 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb968671640 1 -- 172.21.15.42:0/3906229741 reap_dead start 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 msgr2=0x5648cddb56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddb56b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb960013a20 tx=0x7fb960005a40 comp rx=0 tx=0).stop 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 shutdown_connections 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3906229741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cddae740 0x5648cddb56b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 >> 172.21.15.42:0/3906229741 conn(0x5648cddaaa10 msgr2=0x5648cdda8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 shutdown_connections 2024-02-16T00:12:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3906229741 wait complete. 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb8400367e0 msgr2=0x7fb840038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb8400367e0 0x7fb840038ca0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5648cdd8b290 tx=0x7fb958054f90 comp rx=0 tx=0).stop 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 msgr2=0x5648cdda1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 0x5648cdda1930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x5648cdd87930 tx=0x7fb960018830 comp rx=0 tx=0).stop 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 shutdown_connections 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb8400367e0 0x7fb840038ca0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/1208351290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdda1510 0x5648cdda1930 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 >> 172.21.15.42:0/1208351290 conn(0x7fb95807b000 msgr2=0x5648cdd95970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 shutdown_connections 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/1208351290 wait complete. 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cdc8d0d0 msgr2=0x5648cdd8d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cdc8d0d0 0x5648cdd8d7e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cdd8ff30 msgr2=0x5648cdd92320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cdd8ff30 0x5648cdd92320 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.261+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb850036790 msgr2=0x7fb850038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb850036790 0x7fb850038c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000f60 tx=0x7fb95c001370 comp rx=0 tx=0).stop 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 msgr2=0x5648cdd86b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd86b70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb958005400 tx=0x7fb958002fb0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 shutdown_connections 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x5648cdd8ff30 0x5648cdd92320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x5648cdc8d0d0 0x5648cdd8d7e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb850036790 0x7fb850038c50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 --2- 172.21.15.42:0/3870840853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648cdc8be70 0x5648cdd86b70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 >> 172.21.15.42:0/3870840853 conn(0x5648cdc874d0 msgr2=0x5648cdd75330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 shutdown_connections 2024-02-16T00:12:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-02-16T00:12:35.262+0000 7fb96d80f800 1 -- 172.21.15.42:0/3870840853 wait complete. 2024-02-16T00:12:35.286 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-16T00:12:35.310 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-16T00:12:35.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:12:35.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651c55d640 1 Processor -- start 2024-02-16T00:12:35.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651c55d640 1 -- start start 2024-02-16T00:12:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651c55d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f651412dcb0 0x7f65141300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651c55d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6514095270 con 0x7f65140956a0 2024-02-16T00:12:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651c55d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6514096190 con 0x7f651412dcb0 2024-02-16T00:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651a2f9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f65140956a0 0x7f6514095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60620/0 (socket says 172.21.15.2:60620) 2024-02-16T00:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f651a2f9640 1 -- 172.21.15.2:0/1224674307 learned_addr learned my addr 172.21.15.2:0/1224674307 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f6519af8640 1 --2- 172.21.15.2:0/1224674307 >> v2:172.21.15.2:3300/0 conn(0x7f651412dcb0 0x7f65141300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.415+0000 7f65192f7640 1 -- 172.21.15.2:0/1224674307 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737248475 0 0) 0x7f6514095270 con 0x7f65140956a0 2024-02-16T00:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.416+0000 7f65192f7640 1 -- 172.21.15.2:0/1224674307 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64fc003520 con 0x7f65140956a0 2024-02-16T00:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.416+0000 7f6519af8640 1 -- 172.21.15.2:0/1224674307 >> v1:172.21.15.2:6789/0 conn(0x7f65140956a0 legacy=0x7f6514095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.416+0000 7f6519af8640 1 -- 172.21.15.2:0/1224674307 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140954a0 con 0x7f651412dcb0 2024-02-16T00:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.416+0000 7f6519af8640 1 --2- 172.21.15.2:0/1224674307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f651412dcb0 0x7f65141300a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6508009720 tx=0x7f650802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb654a618061e39 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.416+0000 7f65192f7640 1 -- 172.21.15.2:0/1224674307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650802e070 con 0x7f651412dcb0 2024-02-16T00:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f65192f7640 1 -- 172.21.15.2:0/1224674307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080316d0 con 0x7f651412dcb0 2024-02-16T00:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f65192f7640 1 -- 172.21.15.2:0/1224674307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6508031990 con 0x7f651412dcb0 2024-02-16T00:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 -- 172.21.15.2:0/1224674307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f651412dcb0 msgr2=0x7f65141300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 --2- 172.21.15.2:0/1224674307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f651412dcb0 0x7f65141300a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6508009720 tx=0x7f650802b840 comp rx=0 tx=0).stop 2024-02-16T00:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 -- 172.21.15.2:0/1224674307 shutdown_connections 2024-02-16T00:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 --2- 172.21.15.2:0/1224674307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f651412dcb0 0x7f65141300a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 -- 172.21.15.2:0/1224674307 >> 172.21.15.2:0/1224674307 conn(0x7f651409a300 msgr2=0x7f651409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 -- 172.21.15.2:0/1224674307 shutdown_connections 2024-02-16T00:12:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.417+0000 7f651c55d640 1 -- 172.21.15.2:0/1224674307 wait complete. 2024-02-16T00:12:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651c55d640 1 Processor -- start 2024-02-16T00:12:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651c55d640 1 -- start start 2024-02-16T00:12:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651c55d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 0x7f65141c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651c55d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6514071eb0 con 0x7f65140956a0 2024-02-16T00:12:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651a2f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 0x7f65141c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651a2f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 0x7f65141c06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38410/0 (socket says 172.21.15.2:38410) 2024-02-16T00:12:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.418+0000 7f651a2f9640 1 -- 172.21.15.2:0/1077703617 learned_addr learned my addr 172.21.15.2:0/1077703617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f651a2f9640 1 -- 172.21.15.2:0/1077703617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6508009400 con 0x7f65140956a0 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f651a2f9640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 0x7f65141c06a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f650400c390 tx=0x7f650400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504005c10 con 0x7f65140956a0 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504005d70 con 0x7f65140956a0 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651412d8d0 con 0x7f65140956a0 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504007220 con 0x7f65140956a0 2024-02-16T00:12:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.419+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6514128840 con 0x7f65140956a0 2024-02-16T00:12:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.420+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6504007380 con 0x7f65140956a0 2024-02-16T00:12:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.420+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65140717d0 con 0x7f65140956a0 2024-02-16T00:12:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.420+0000 7f6512ffd640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6500037ef0 0x7f650003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.420+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f650404a9b0 con 0x7f65140956a0 2024-02-16T00:12:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.420+0000 7f6519af8640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6500037ef0 0x7f650003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.421+0000 7f6519af8640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6500037ef0 0x7f650003a3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6508036000 tx=0x7f6508008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.425+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6504019dc0 con 0x7f65140956a0 2024-02-16T00:12:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.599+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f651406c2e0 con 0x7f6500037ef0 2024-02-16T00:12:35.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.617+0000 7f6512ffd640 1 -- 172.21.15.2:0/1077703617 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673172 (secure 0 0 0) 0x7f6508031b40 con 0x7f6500037ef0 2024-02-16T00:12:35.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:12:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:12:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6500037ef0 msgr2=0x7f650003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6500037ef0 0x7f650003a3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6508036000 tx=0x7f6508008030 comp rx=0 tx=0).stop 2024-02-16T00:12:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 msgr2=0x7f65141c06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 0x7f65141c06a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f650400c390 tx=0x7f650400c850 comp rx=0 tx=0).stop 2024-02-16T00:12:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 shutdown_connections 2024-02-16T00:12:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6500037ef0 0x7f650003a3b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 --2- 172.21.15.2:0/1077703617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65140956a0 0x7f65141c06a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 >> 172.21.15.2:0/1077703617 conn(0x7f651409a300 msgr2=0x7f6514127c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 shutdown_connections 2024-02-16T00:12:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.621+0000 7f651c55d640 1 -- 172.21.15.2:0/1077703617 wait complete. 2024-02-16T00:12:35.639 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-02-16T00:12:33.696265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600935,"num_objects":261,"num_object_clones":0,"num_object_copies":524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1591,"num_write_kb":31915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3690,"ondisk_log_size":3690,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148280,"kb_used_data":2776,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339080,"statfs":{"total":386547056640,"available":386395217920,"internally_reserved":0,"allocated":2842624,"data_stored":1742827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":527,"num_objects":15,"num_object_clones":0,"num_object_copies":31,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":392,"num_read_kb":383,"num_write":113,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003471"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842072+0000","last_change":"2024-02-16T00:11:02.804024+0000","last_active":"2024-02-16T00:11:50.842072+0000","last_peered":"2024-02-16T00:11:50.842072+0000","last_clean":"2024-02-16T00:11:50.842072+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:11:50.842072+0000","last_undegraded":"2024-02-16T00:11:50.842072+0000","last_fullsized":"2024-02-16T00:11:50.842072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848062+0000","last_change":"2024-02-16T00:11:04.803215+0000","last_active":"2024-02-16T00:11:50.848062+0000","last_peered":"2024-02-16T00:11:50.848062+0000","last_clean":"2024-02-16T00:11:50.848062+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:11:50.848062+0000","last_undegraded":"2024-02-16T00:11:50.848062+0000","last_fullsized":"2024-02-16T00:11:50.848062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:23.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830974+0000","last_change":"2024-02-16T00:11:02.797595+0000","last_active":"2024-02-16T00:11:51.830974+0000","last_peered":"2024-02-16T00:11:51.830974+0000","last_clean":"2024-02-16T00:11:51.830974+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:11:51.830974+0000","last_undegraded":"2024-02-16T00:11:51.830974+0000","last_fullsized":"2024-02-16T00:11:51.830974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840747+0000","last_change":"2024-02-16T00:11:04.803831+0000","last_active":"2024-02-16T00:11:50.840747+0000","last_peered":"2024-02-16T00:11:50.840747+0000","last_clean":"2024-02-16T00:11:50.840747+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:11:50.840747+0000","last_undegraded":"2024-02-16T00:11:50.840747+0000","last_fullsized":"2024-02-16T00:11:50.840747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.330427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845795+0000","last_change":"2024-02-16T00:11:02.815592+0000","last_active":"2024-02-16T00:11:50.845795+0000","last_peered":"2024-02-16T00:11:50.845795+0000","last_clean":"2024-02-16T00:11:50.845795+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:11:50.845795+0000","last_undegraded":"2024-02-16T00:11:50.845795+0000","last_fullsized":"2024-02-16T00:11:50.845795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:21.438654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840544+0000","last_change":"2024-02-16T00:11:04.807406+0000","last_active":"2024-02-16T00:11:50.840544+0000","last_peered":"2024-02-16T00:11:50.840544+0000","last_clean":"2024-02-16T00:11:50.840544+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:11:50.840544+0000","last_undegraded":"2024-02-16T00:11:50.840544+0000","last_fullsized":"2024-02-16T00:11:50.840544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:41.270560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843729+0000","last_change":"2024-02-16T00:11:02.818929+0000","last_active":"2024-02-16T00:11:50.843729+0000","last_peered":"2024-02-16T00:11:50.843729+0000","last_clean":"2024-02-16T00:11:50.843729+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:11:50.843729+0000","last_undegraded":"2024-02-16T00:11:50.843729+0000","last_fullsized":"2024-02-16T00:11:50.843729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'7","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322677+0000","last_change":"2024-02-16T00:11:04.807900+0000","last_active":"2024-02-16T00:12:27.322677+0000","last_peered":"2024-02-16T00:12:27.322677+0000","last_clean":"2024-02-16T00:12:27.322677+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:12:27.322677+0000","last_undegraded":"2024-02-16T00:12:27.322677+0000","last_fullsized":"2024-02-16T00:12:27.322677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:18.898214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841183+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:11:50.841183+0000","last_peered":"2024-02-16T00:11:50.841183+0000","last_clean":"2024-02-16T00:11:50.841183+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:11:50.841183+0000","last_undegraded":"2024-02-16T00:11:50.841183+0000","last_fullsized":"2024-02-16T00:11:50.841183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:24.007843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846803+0000","last_change":"2024-02-16T00:11:04.797530+0000","last_active":"2024-02-16T00:11:50.846803+0000","last_peered":"2024-02-16T00:11:50.846803+0000","last_clean":"2024-02-16T00:11:50.846803+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:11:50.846803+0000","last_undegraded":"2024-02-16T00:11:50.846803+0000","last_fullsized":"2024-02-16T00:11:50.846803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:39:54.175731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842977+0000","last_change":"2024-02-16T00:11:02.803398+0000","last_active":"2024-02-16T00:11:50.842977+0000","last_peered":"2024-02-16T00:11:50.842977+0000","last_clean":"2024-02-16T00:11:50.842977+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:11:50.842977+0000","last_undegraded":"2024-02-16T00:11:50.842977+0000","last_fullsized":"2024-02-16T00:11:50.842977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844846+0000","last_change":"2024-02-16T00:11:04.809182+0000","last_active":"2024-02-16T00:11:50.844846+0000","last_peered":"2024-02-16T00:11:50.844846+0000","last_clean":"2024-02-16T00:11:50.844846+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:11:50.844846+0000","last_undegraded":"2024-02-16T00:11:50.844846+0000","last_fullsized":"2024-02-16T00:11:50.844846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:55.430651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840324+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:11:50.840324+0000","last_peered":"2024-02-16T00:11:50.840324+0000","last_clean":"2024-02-16T00:11:50.840324+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:11:50.840324+0000","last_undegraded":"2024-02-16T00:11:50.840324+0000","last_fullsized":"2024-02-16T00:11:50.840324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:28:12.323667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843211+0000","last_change":"2024-02-16T00:11:04.798579+0000","last_active":"2024-02-16T00:11:50.843211+0000","last_peered":"2024-02-16T00:11:50.843211+0000","last_clean":"2024-02-16T00:11:50.843211+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:11:50.843211+0000","last_undegraded":"2024-02-16T00:11:50.843211+0000","last_fullsized":"2024-02-16T00:11:50.843211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828879+0000","last_change":"2024-02-16T00:11:02.808083+0000","last_active":"2024-02-16T00:11:51.828879+0000","last_peered":"2024-02-16T00:11:51.828879+0000","last_clean":"2024-02-16T00:11:51.828879+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:11:51.828879+0000","last_undegraded":"2024-02-16T00:11:51.828879+0000","last_fullsized":"2024-02-16T00:11:51.828879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841901+0000","last_change":"2024-02-16T00:11:04.808709+0000","last_active":"2024-02-16T00:11:50.841901+0000","last_peered":"2024-02-16T00:11:50.841901+0000","last_clean":"2024-02-16T00:11:50.841901+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:11:50.841901+0000","last_undegraded":"2024-02-16T00:11:50.841901+0000","last_fullsized":"2024-02-16T00:11:50.841901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840576+0000","last_change":"2024-02-16T00:11:04.807676+0000","last_active":"2024-02-16T00:11:50.840576+0000","last_peered":"2024-02-16T00:11:50.840576+0000","last_clean":"2024-02-16T00:11:50.840576+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:11:50.840576+0000","last_undegraded":"2024-02-16T00:11:50.840576+0000","last_fullsized":"2024-02-16T00:11:50.840576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:13.340758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849691+0000","last_change":"2024-02-16T00:11:02.820441+0000","last_active":"2024-02-16T00:11:50.849691+0000","last_peered":"2024-02-16T00:11:50.849691+0000","last_clean":"2024-02-16T00:11:50.849691+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:11:50.849691+0000","last_undegraded":"2024-02-16T00:11:50.849691+0000","last_fullsized":"2024-02-16T00:11:50.849691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847661+0000","last_change":"2024-02-16T00:11:04.798908+0000","last_active":"2024-02-16T00:11:50.847661+0000","last_peered":"2024-02-16T00:11:50.847661+0000","last_clean":"2024-02-16T00:11:50.847661+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:11:50.847661+0000","last_undegraded":"2024-02-16T00:11:50.847661+0000","last_fullsized":"2024-02-16T00:11:50.847661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843030+0000","last_change":"2024-02-16T00:11:02.817331+0000","last_active":"2024-02-16T00:11:50.843030+0000","last_peered":"2024-02-16T00:11:50.843030+0000","last_clean":"2024-02-16T00:11:50.843030+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:11:50.843030+0000","last_undegraded":"2024-02-16T00:11:50.843030+0000","last_fullsized":"2024-02-16T00:11:50.843030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848232+0000","last_change":"2024-02-16T00:11:04.803702+0000","last_active":"2024-02-16T00:11:50.848232+0000","last_peered":"2024-02-16T00:11:50.848232+0000","last_clean":"2024-02-16T00:11:50.848232+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:11:50.848232+0000","last_undegraded":"2024-02-16T00:11:50.848232+0000","last_fullsized":"2024-02-16T00:11:50.848232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:03.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847158+0000","last_change":"2024-02-16T00:11:02.810700+0000","last_active":"2024-02-16T00:11:50.847158+0000","last_peered":"2024-02-16T00:11:50.847158+0000","last_clean":"2024-02-16T00:11:50.847158+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:11:50.847158+0000","last_undegraded":"2024-02-16T00:11:50.847158+0000","last_fullsized":"2024-02-16T00:11:50.847158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830790+0000","last_change":"2024-02-16T00:11:04.810242+0000","last_active":"2024-02-16T00:11:51.830790+0000","last_peered":"2024-02-16T00:11:51.830790+0000","last_clean":"2024-02-16T00:11:51.830790+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:11:51.830790+0000","last_undegraded":"2024-02-16T00:11:51.830790+0000","last_fullsized":"2024-02-16T00:11:51.830790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847357+0000","last_change":"2024-02-16T00:11:02.825186+0000","last_active":"2024-02-16T00:11:50.847357+0000","last_peered":"2024-02-16T00:11:50.847357+0000","last_clean":"2024-02-16T00:11:50.847357+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:11:50.847357+0000","last_undegraded":"2024-02-16T00:11:50.847357+0000","last_fullsized":"2024-02-16T00:11:50.847357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969995+0000","last_change":"2024-02-16T00:11:04.812055+0000","last_active":"2024-02-16T00:12:27.969995+0000","last_peered":"2024-02-16T00:12:27.969995+0000","last_clean":"2024-02-16T00:12:27.969995+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:12:27.969995+0000","last_undegraded":"2024-02-16T00:12:27.969995+0000","last_fullsized":"2024-02-16T00:12:27.969995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830403+0000","last_change":"2024-02-16T00:11:02.797860+0000","last_active":"2024-02-16T00:11:51.830403+0000","last_peered":"2024-02-16T00:11:51.830403+0000","last_clean":"2024-02-16T00:11:51.830403+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:11:51.830403+0000","last_undegraded":"2024-02-16T00:11:51.830403+0000","last_fullsized":"2024-02-16T00:11:51.830403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969670+0000","last_change":"2024-02-16T00:11:04.797835+0000","last_active":"2024-02-16T00:12:27.969670+0000","last_peered":"2024-02-16T00:12:27.969670+0000","last_clean":"2024-02-16T00:12:27.969670+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:12:27.969670+0000","last_undegraded":"2024-02-16T00:12:27.969670+0000","last_fullsized":"2024-02-16T00:12:27.969670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:17.940025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840296+0000","last_change":"2024-02-16T00:11:02.817356+0000","last_active":"2024-02-16T00:11:50.840296+0000","last_peered":"2024-02-16T00:11:50.840296+0000","last_clean":"2024-02-16T00:11:50.840296+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:11:50.840296+0000","last_undegraded":"2024-02-16T00:11:50.840296+0000","last_fullsized":"2024-02-16T00:11:50.840296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:36:34.654920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'18","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.169123+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:22.169123+0000","last_peered":"2024-02-16T00:12:22.169123+0000","last_clean":"2024-02-16T00:12:22.169123+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:22.169123+0000","last_undegraded":"2024-02-16T00:12:22.169123+0000","last_fullsized":"2024-02-16T00:12:22.169123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:34.754053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":130,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842557+0000","last_change":"2024-02-16T00:11:04.804063+0000","last_active":"2024-02-16T00:11:50.842557+0000","last_peered":"2024-02-16T00:11:50.842557+0000","last_clean":"2024-02-16T00:11:50.842557+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:11:50.842557+0000","last_undegraded":"2024-02-16T00:11:50.842557+0000","last_fullsized":"2024-02-16T00:11:50.842557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:41.137481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840923+0000","last_change":"2024-02-16T00:11:02.823865+0000","last_active":"2024-02-16T00:11:50.840923+0000","last_peered":"2024-02-16T00:11:50.840923+0000","last_clean":"2024-02-16T00:11:50.840923+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:11:50.840923+0000","last_undegraded":"2024-02-16T00:11:50.840923+0000","last_fullsized":"2024-02-16T00:11:50.840923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.696986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844686+0000","last_change":"2024-02-16T00:11:06.805693+0000","last_active":"2024-02-16T00:11:50.844686+0000","last_peered":"2024-02-16T00:11:50.844686+0000","last_clean":"2024-02-16T00:11:50.844686+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:11:50.844686+0000","last_undegraded":"2024-02-16T00:11:50.844686+0000","last_fullsized":"2024-02-16T00:11:50.844686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:26.998512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'39","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.746531+0000","last_change":"2024-02-16T00:11:08.812405+0000","last_active":"2024-02-16T00:12:27.746531+0000","last_peered":"2024-02-16T00:12:27.746531+0000","last_clean":"2024-02-16T00:12:27.746531+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:27.746531+0000","last_undegraded":"2024-02-16T00:12:27.746531+0000","last_fullsized":"2024-02-16T00:12:27.746531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:52.688126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849593+0000","last_change":"2024-02-16T00:11:10.827632+0000","last_active":"2024-02-16T00:11:50.849593+0000","last_peered":"2024-02-16T00:11:50.849593+0000","last_clean":"2024-02-16T00:11:50.849593+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:11:50.849593+0000","last_undegraded":"2024-02-16T00:11:50.849593+0000","last_fullsized":"2024-02-16T00:11:50.849593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:33.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.281521+0000","last_change":"2024-02-16T00:11:12.835250+0000","last_active":"2024-02-16T00:12:22.281521+0000","last_peered":"2024-02-16T00:12:22.281521+0000","last_clean":"2024-02-16T00:12:22.281521+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:12:22.281521+0000","last_undegraded":"2024-02-16T00:12:22.281521+0000","last_fullsized":"2024-02-16T00:12:22.281521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:33.641560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845318+0000","last_change":"2024-02-16T00:11:04.811172+0000","last_active":"2024-02-16T00:11:50.845318+0000","last_peered":"2024-02-16T00:11:50.845318+0000","last_clean":"2024-02-16T00:11:50.845318+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:11:50.845318+0000","last_undegraded":"2024-02-16T00:11:50.845318+0000","last_fullsized":"2024-02-16T00:11:50.845318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:25.462988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842875+0000","last_change":"2024-02-16T00:11:02.817929+0000","last_active":"2024-02-16T00:11:50.842875+0000","last_peered":"2024-02-16T00:11:50.842875+0000","last_clean":"2024-02-16T00:11:50.842875+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:11:50.842875+0000","last_undegraded":"2024-02-16T00:11:50.842875+0000","last_fullsized":"2024-02-16T00:11:50.842875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829901+0000","last_change":"2024-02-16T00:11:06.803389+0000","last_active":"2024-02-16T00:11:51.829901+0000","last_peered":"2024-02-16T00:11:51.829901+0000","last_clean":"2024-02-16T00:11:51.829901+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:11:51.829901+0000","last_undegraded":"2024-02-16T00:11:51.829901+0000","last_fullsized":"2024-02-16T00:11:51.829901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:31.755567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'12","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848533+0000","last_change":"2024-02-16T00:11:08.813382+0000","last_active":"2024-02-16T00:11:50.848533+0000","last_peered":"2024-02-16T00:11:50.848533+0000","last_clean":"2024-02-16T00:11:50.848533+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:11:50.848533+0000","last_undegraded":"2024-02-16T00:11:50.848533+0000","last_fullsized":"2024-02-16T00:11:50.848533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:56.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848536+0000","last_change":"2024-02-16T00:11:10.823836+0000","last_active":"2024-02-16T00:11:50.848536+0000","last_peered":"2024-02-16T00:11:50.848536+0000","last_clean":"2024-02-16T00:11:50.848536+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:11:50.848536+0000","last_undegraded":"2024-02-16T00:11:50.848536+0000","last_fullsized":"2024-02-16T00:11:50.848536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:15.575681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828823+0000","last_change":"2024-02-16T00:11:12.828416+0000","last_active":"2024-02-16T00:11:51.828823+0000","last_peered":"2024-02-16T00:11:51.828823+0000","last_clean":"2024-02-16T00:11:51.828823+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:11:51.828823+0000","last_undegraded":"2024-02-16T00:11:51.828823+0000","last_fullsized":"2024-02-16T00:11:51.828823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:38.040980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844918+0000","last_change":"2024-02-16T00:11:04.803967+0000","last_active":"2024-02-16T00:11:50.844918+0000","last_peered":"2024-02-16T00:11:50.844918+0000","last_clean":"2024-02-16T00:11:50.844918+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:11:50.844918+0000","last_undegraded":"2024-02-16T00:11:50.844918+0000","last_fullsized":"2024-02-16T00:11:50.844918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:24.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839683+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:11:50.839683+0000","last_peered":"2024-02-16T00:11:50.839683+0000","last_clean":"2024-02-16T00:11:50.839683+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:11:50.839683+0000","last_undegraded":"2024-02-16T00:11:50.839683+0000","last_fullsized":"2024-02-16T00:11:50.839683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:20.668173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831728+0000","last_change":"2024-02-16T00:11:06.804875+0000","last_active":"2024-02-16T00:11:51.831728+0000","last_peered":"2024-02-16T00:11:51.831728+0000","last_clean":"2024-02-16T00:11:51.831728+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:11:51.831728+0000","last_undegraded":"2024-02-16T00:11:51.831728+0000","last_fullsized":"2024-02-16T00:11:51.831728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:38.469870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845030+0000","last_change":"2024-02-16T00:11:08.813640+0000","last_active":"2024-02-16T00:11:50.845030+0000","last_peered":"2024-02-16T00:11:50.845030+0000","last_clean":"2024-02-16T00:11:50.845030+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:11:50.845030+0000","last_undegraded":"2024-02-16T00:11:50.845030+0000","last_fullsized":"2024-02-16T00:11:50.845030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:39.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'227","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.982139+0000","last_change":"2024-02-16T00:11:10.830884+0000","last_active":"2024-02-16T00:12:27.982139+0000","last_peered":"2024-02-16T00:12:27.982139+0000","last_clean":"2024-02-16T00:12:27.982139+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:12:27.982139+0000","last_undegraded":"2024-02-16T00:12:27.982139+0000","last_fullsized":"2024-02-16T00:12:27.982139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:17:51.160171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845460+0000","last_change":"2024-02-16T00:11:12.821286+0000","last_active":"2024-02-16T00:11:50.845460+0000","last_peered":"2024-02-16T00:11:50.845460+0000","last_clean":"2024-02-16T00:11:50.845460+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:11:50.845460+0000","last_undegraded":"2024-02-16T00:11:50.845460+0000","last_fullsized":"2024-02-16T00:11:50.845460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831859+0000","last_change":"2024-02-16T00:11:04.803520+0000","last_active":"2024-02-16T00:11:51.831859+0000","last_peered":"2024-02-16T00:11:51.831859+0000","last_clean":"2024-02-16T00:11:51.831859+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:11:51.831859+0000","last_undegraded":"2024-02-16T00:11:51.831859+0000","last_fullsized":"2024-02-16T00:11:51.831859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:30:00.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847693+0000","last_change":"2024-02-16T00:11:02.820879+0000","last_active":"2024-02-16T00:11:50.847693+0000","last_peered":"2024-02-16T00:11:50.847693+0000","last_clean":"2024-02-16T00:11:50.847693+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:11:50.847693+0000","last_undegraded":"2024-02-16T00:11:50.847693+0000","last_fullsized":"2024-02-16T00:11:50.847693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845158+0000","last_change":"2024-02-16T00:11:06.807048+0000","last_active":"2024-02-16T00:11:50.845158+0000","last_peered":"2024-02-16T00:11:50.845158+0000","last_clean":"2024-02-16T00:11:50.845158+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:11:50.845158+0000","last_undegraded":"2024-02-16T00:11:50.845158+0000","last_fullsized":"2024-02-16T00:11:50.845158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:20:58.481322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'33","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.741434+0000","last_change":"2024-02-16T00:11:08.815411+0000","last_active":"2024-02-16T00:12:27.741434+0000","last_peered":"2024-02-16T00:12:27.741434+0000","last_clean":"2024-02-16T00:12:27.741434+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:27.741434+0000","last_undegraded":"2024-02-16T00:12:27.741434+0000","last_fullsized":"2024-02-16T00:12:27.741434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:52.985555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'227","reported_seq":301,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.984132+0000","last_change":"2024-02-16T00:11:10.820344+0000","last_active":"2024-02-16T00:12:27.984132+0000","last_peered":"2024-02-16T00:12:27.984132+0000","last_clean":"2024-02-16T00:12:27.984132+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:27.984132+0000","last_undegraded":"2024-02-16T00:12:27.984132+0000","last_fullsized":"2024-02-16T00:12:27.984132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:56.315714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.856376+0000","last_change":"2024-02-16T00:11:50.855956+0000","last_active":"2024-02-16T00:11:50.856376+0000","last_peered":"2024-02-16T00:11:50.856376+0000","last_clean":"2024-02-16T00:11:50.856376+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:11:50.856376+0000","last_undegraded":"2024-02-16T00:11:50.856376+0000","last_fullsized":"2024-02-16T00:11:50.856376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:18.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842241+0000","last_change":"2024-02-16T00:11:02.805831+0000","last_active":"2024-02-16T00:11:50.842241+0000","last_peered":"2024-02-16T00:11:50.842241+0000","last_clean":"2024-02-16T00:11:50.842241+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:11:50.842241+0000","last_undegraded":"2024-02-16T00:11:50.842241+0000","last_fullsized":"2024-02-16T00:11:50.842241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846785+0000","last_change":"2024-02-16T00:11:06.809760+0000","last_active":"2024-02-16T00:11:50.846785+0000","last_peered":"2024-02-16T00:11:50.846785+0000","last_clean":"2024-02-16T00:11:50.846785+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:11:50.846785+0000","last_undegraded":"2024-02-16T00:11:50.846785+0000","last_fullsized":"2024-02-16T00:11:50.846785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:40.171212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'45","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.750561+0000","last_change":"2024-02-16T00:11:08.816208+0000","last_active":"2024-02-16T00:12:27.750561+0000","last_peered":"2024-02-16T00:12:27.750561+0000","last_clean":"2024-02-16T00:12:27.750561+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:27.750561+0000","last_undegraded":"2024-02-16T00:12:27.750561+0000","last_fullsized":"2024-02-16T00:12:27.750561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:19.358580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830203+0000","last_change":"2024-02-16T00:11:10.820589+0000","last_active":"2024-02-16T00:11:51.830203+0000","last_peered":"2024-02-16T00:11:51.830203+0000","last_clean":"2024-02-16T00:11:51.830203+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:11:51.830203+0000","last_undegraded":"2024-02-16T00:11:51.830203+0000","last_fullsized":"2024-02-16T00:11:51.830203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:25.136505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.761548+0000","last_change":"2024-02-16T00:11:12.824309+0000","last_active":"2024-02-16T00:12:27.761548+0000","last_peered":"2024-02-16T00:12:27.761548+0000","last_clean":"2024-02-16T00:12:27.761548+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:27.761548+0000","last_undegraded":"2024-02-16T00:12:27.761548+0000","last_fullsized":"2024-02-16T00:12:27.761548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:56.872128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322700+0000","last_change":"2024-02-16T00:11:04.797488+0000","last_active":"2024-02-16T00:12:27.322700+0000","last_peered":"2024-02-16T00:12:27.322700+0000","last_clean":"2024-02-16T00:12:27.322700+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:12:27.322700+0000","last_undegraded":"2024-02-16T00:12:27.322700+0000","last_fullsized":"2024-02-16T00:12:27.322700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.964166+0000","last_change":"2024-02-16T00:11:02.815325+0000","last_active":"2024-02-16T00:12:27.964166+0000","last_peered":"2024-02-16T00:12:27.964166+0000","last_clean":"2024-02-16T00:12:27.964166+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:12:27.964166+0000","last_undegraded":"2024-02-16T00:12:27.964166+0000","last_fullsized":"2024-02-16T00:12:27.964166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829007+0000","last_change":"2024-02-16T00:11:06.808903+0000","last_active":"2024-02-16T00:11:51.829007+0000","last_peered":"2024-02-16T00:11:51.829007+0000","last_clean":"2024-02-16T00:11:51.829007+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:11:51.829007+0000","last_undegraded":"2024-02-16T00:11:51.829007+0000","last_fullsized":"2024-02-16T00:11:51.829007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:23.224863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'33","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.730921+0000","last_change":"2024-02-16T00:11:08.810670+0000","last_active":"2024-02-16T00:12:27.730921+0000","last_peered":"2024-02-16T00:12:27.730921+0000","last_clean":"2024-02-16T00:12:27.730921+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:27.730921+0000","last_undegraded":"2024-02-16T00:12:27.730921+0000","last_fullsized":"2024-02-16T00:12:27.730921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:33.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828968+0000","last_change":"2024-02-16T00:11:10.819436+0000","last_active":"2024-02-16T00:11:51.828968+0000","last_peered":"2024-02-16T00:11:51.828968+0000","last_clean":"2024-02-16T00:11:51.828968+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:11:51.828968+0000","last_undegraded":"2024-02-16T00:11:51.828968+0000","last_fullsized":"2024-02-16T00:11:51.828968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:12.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.170900+0000","last_change":"2024-02-16T00:11:12.828694+0000","last_active":"2024-02-16T00:12:22.170900+0000","last_peered":"2024-02-16T00:12:22.170900+0000","last_clean":"2024-02-16T00:12:22.170900+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:12:22.170900+0000","last_undegraded":"2024-02-16T00:12:22.170900+0000","last_fullsized":"2024-02-16T00:12:22.170900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:38.040980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:04.809981+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:10.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.325660+0000","last_change":"2024-02-16T00:11:02.815569+0000","last_active":"2024-02-16T00:12:27.325660+0000","last_peered":"2024-02-16T00:12:27.325660+0000","last_clean":"2024-02-16T00:12:27.325660+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:12:27.325660+0000","last_undegraded":"2024-02-16T00:12:27.325660+0000","last_fullsized":"2024-02-16T00:12:27.325660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:29.570326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831033+0000","last_change":"2024-02-16T00:11:06.806202+0000","last_active":"2024-02-16T00:11:51.831033+0000","last_peered":"2024-02-16T00:11:51.831033+0000","last_clean":"2024-02-16T00:11:51.831033+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:11:51.831033+0000","last_undegraded":"2024-02-16T00:11:51.831033+0000","last_fullsized":"2024-02-16T00:11:51.831033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:08.925296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.752552+0000","last_change":"2024-02-16T00:11:08.813417+0000","last_active":"2024-02-16T00:12:27.752552+0000","last_peered":"2024-02-16T00:12:27.752552+0000","last_clean":"2024-02-16T00:12:27.752552+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:27.752552+0000","last_undegraded":"2024-02-16T00:12:27.752552+0000","last_fullsized":"2024-02-16T00:12:27.752552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:05.893569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'227","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.979245+0000","last_change":"2024-02-16T00:11:10.816060+0000","last_active":"2024-02-16T00:12:27.979245+0000","last_peered":"2024-02-16T00:12:27.979245+0000","last_clean":"2024-02-16T00:12:27.979245+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:27.979245+0000","last_undegraded":"2024-02-16T00:12:27.979245+0000","last_fullsized":"2024-02-16T00:12:27.979245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:59.417398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830309+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:11:51.830309+0000","last_peered":"2024-02-16T00:11:51.830309+0000","last_clean":"2024-02-16T00:11:51.830309+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:11:51.830309+0000","last_undegraded":"2024-02-16T00:11:51.830309+0000","last_fullsized":"2024-02-16T00:11:51.830309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:09.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844394+0000","last_change":"2024-02-16T00:11:04.799023+0000","last_active":"2024-02-16T00:11:50.844394+0000","last_peered":"2024-02-16T00:11:50.844394+0000","last_clean":"2024-02-16T00:11:50.844394+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:11:50.844394+0000","last_undegraded":"2024-02-16T00:11:50.844394+0000","last_fullsized":"2024-02-16T00:11:50.844394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842185+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:11:50.842185+0000","last_peered":"2024-02-16T00:11:50.842185+0000","last_clean":"2024-02-16T00:11:50.842185+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:11:50.842185+0000","last_undegraded":"2024-02-16T00:11:50.842185+0000","last_fullsized":"2024-02-16T00:11:50.842185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:37.649958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829559+0000","last_change":"2024-02-16T00:11:06.808902+0000","last_active":"2024-02-16T00:11:51.829559+0000","last_peered":"2024-02-16T00:11:51.829559+0000","last_clean":"2024-02-16T00:11:51.829559+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:11:51.829559+0000","last_undegraded":"2024-02-16T00:11:51.829559+0000","last_fullsized":"2024-02-16T00:11:51.829559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:38.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'60","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.931523+0000","last_change":"2024-02-16T00:11:08.819445+0000","last_active":"2024-02-16T00:12:27.931523+0000","last_peered":"2024-02-16T00:12:27.931523+0000","last_clean":"2024-02-16T00:12:27.931523+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:12:27.931523+0000","last_undegraded":"2024-02-16T00:12:27.931523+0000","last_fullsized":"2024-02-16T00:12:27.931523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:16:44.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828688+0000","last_change":"2024-02-16T00:11:10.822009+0000","last_active":"2024-02-16T00:11:51.828688+0000","last_peered":"2024-02-16T00:11:51.828688+0000","last_clean":"2024-02-16T00:11:51.828688+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:11:51.828688+0000","last_undegraded":"2024-02-16T00:11:51.828688+0000","last_fullsized":"2024-02-16T00:11:51.828688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:44.750899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831504+0000","last_change":"2024-02-16T00:11:12.823579+0000","last_active":"2024-02-16T00:11:51.831504+0000","last_peered":"2024-02-16T00:11:51.831504+0000","last_clean":"2024-02-16T00:11:51.831504+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:11:51.831504+0000","last_undegraded":"2024-02-16T00:11:51.831504+0000","last_fullsized":"2024-02-16T00:11:51.831504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:37.304684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'7","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846908+0000","last_change":"2024-02-16T00:11:04.812522+0000","last_active":"2024-02-16T00:11:50.846908+0000","last_peered":"2024-02-16T00:11:50.846908+0000","last_clean":"2024-02-16T00:11:50.846908+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:11:50.846908+0000","last_undegraded":"2024-02-16T00:11:50.846908+0000","last_fullsized":"2024-02-16T00:11:50.846908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:33.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829755+0000","last_change":"2024-02-16T00:11:02.807400+0000","last_active":"2024-02-16T00:11:51.829755+0000","last_peered":"2024-02-16T00:11:51.829755+0000","last_clean":"2024-02-16T00:11:51.829755+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:11:51.829755+0000","last_undegraded":"2024-02-16T00:11:51.829755+0000","last_fullsized":"2024-02-16T00:11:51.829755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841646+0000","last_change":"2024-02-16T00:11:06.807251+0000","last_active":"2024-02-16T00:11:50.841646+0000","last_peered":"2024-02-16T00:11:50.841646+0000","last_clean":"2024-02-16T00:11:50.841646+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:11:50.841646+0000","last_undegraded":"2024-02-16T00:11:50.841646+0000","last_fullsized":"2024-02-16T00:11:50.841646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:25.708356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.734945+0000","last_change":"2024-02-16T00:11:08.809691+0000","last_active":"2024-02-16T00:12:27.734945+0000","last_peered":"2024-02-16T00:12:27.734945+0000","last_clean":"2024-02-16T00:12:27.734945+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:27.734945+0000","last_undegraded":"2024-02-16T00:12:27.734945+0000","last_fullsized":"2024-02-16T00:12:27.734945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:46:18.694281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843496+0000","last_change":"2024-02-16T00:11:10.830170+0000","last_active":"2024-02-16T00:11:50.843496+0000","last_peered":"2024-02-16T00:11:50.843496+0000","last_clean":"2024-02-16T00:11:50.843496+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:11:50.843496+0000","last_undegraded":"2024-02-16T00:11:50.843496+0000","last_fullsized":"2024-02-16T00:11:50.843496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:27:37.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839182+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:11:50.839182+0000","last_peered":"2024-02-16T00:11:50.839182+0000","last_clean":"2024-02-16T00:11:50.839182+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:11:50.839182+0000","last_undegraded":"2024-02-16T00:11:50.839182+0000","last_fullsized":"2024-02-16T00:11:50.839182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:22.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.852536+0000","last_change":"2024-02-16T00:11:50.852046+0000","last_active":"2024-02-16T00:11:50.852536+0000","last_peered":"2024-02-16T00:11:50.852536+0000","last_clean":"2024-02-16T00:11:50.852536+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:11:50.852536+0000","last_undegraded":"2024-02-16T00:11:50.852536+0000","last_fullsized":"2024-02-16T00:11:50.852536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:25.615122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840650+0000","last_change":"2024-02-16T00:11:02.816016+0000","last_active":"2024-02-16T00:11:50.840650+0000","last_peered":"2024-02-16T00:11:50.840650+0000","last_clean":"2024-02-16T00:11:50.840650+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:11:50.840650+0000","last_undegraded":"2024-02-16T00:11:50.840650+0000","last_fullsized":"2024-02-16T00:11:50.840650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:32.229010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849166+0000","last_change":"2024-02-16T00:11:50.848461+0000","last_active":"2024-02-16T00:11:50.849166+0000","last_peered":"2024-02-16T00:11:50.849166+0000","last_clean":"2024-02-16T00:11:50.849166+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:11:50.849166+0000","last_undegraded":"2024-02-16T00:11:50.849166+0000","last_fullsized":"2024-02-16T00:11:50.849166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:15.203256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'34","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.760607+0000","last_change":"2024-02-16T00:11:08.812821+0000","last_active":"2024-02-16T00:12:27.760607+0000","last_peered":"2024-02-16T00:12:27.760607+0000","last_clean":"2024-02-16T00:12:27.760607+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:27.760607+0000","last_undegraded":"2024-02-16T00:12:27.760607+0000","last_fullsized":"2024-02-16T00:12:27.760607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:10.931565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'227","reported_seq":311,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.972488+0000","last_change":"2024-02-16T00:11:10.825189+0000","last_active":"2024-02-16T00:12:27.972488+0000","last_peered":"2024-02-16T00:12:27.972488+0000","last_clean":"2024-02-16T00:12:27.972488+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:27.972488+0000","last_undegraded":"2024-02-16T00:12:27.972488+0000","last_fullsized":"2024-02-16T00:12:27.972488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:30.694754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.981440+0000","last_change":"2024-02-16T00:11:12.826412+0000","last_active":"2024-02-16T00:12:27.981440+0000","last_peered":"2024-02-16T00:12:27.981440+0000","last_clean":"2024-02-16T00:12:27.981440+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:12:27.981440+0000","last_undegraded":"2024-02-16T00:12:27.981440+0000","last_fullsized":"2024-02-16T00:12:27.981440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:03.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969839+0000","last_change":"2024-02-16T00:11:51.834792+0000","last_active":"2024-02-16T00:12:27.969839+0000","last_peered":"2024-02-16T00:12:27.969839+0000","last_clean":"2024-02-16T00:12:27.969839+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:12:27.969839+0000","last_undegraded":"2024-02-16T00:12:27.969839+0000","last_fullsized":"2024-02-16T00:12:27.969839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:46.509649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840852+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:11:50.840852+0000","last_peered":"2024-02-16T00:11:50.840852+0000","last_clean":"2024-02-16T00:11:50.840852+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:11:50.840852+0000","last_undegraded":"2024-02-16T00:11:50.840852+0000","last_fullsized":"2024-02-16T00:11:50.840852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:54:39.901674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"20'2","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.901446+0000","last_change":"2024-02-16T00:11:06.803378+0000","last_active":"2024-02-16T00:12:27.901446+0000","last_peered":"2024-02-16T00:12:27.901446+0000","last_clean":"2024-02-16T00:12:27.901446+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:27.901446+0000","last_undegraded":"2024-02-16T00:12:27.901446+0000","last_fullsized":"2024-02-16T00:12:27.901446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:37.017382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":303,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844009+0000","last_change":"2024-02-16T00:11:08.818315+0000","last_active":"2024-02-16T00:11:50.844009+0000","last_peered":"2024-02-16T00:11:50.844009+0000","last_clean":"2024-02-16T00:11:50.844009+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:11:50.844009+0000","last_undegraded":"2024-02-16T00:11:50.844009+0000","last_fullsized":"2024-02-16T00:11:50.844009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:40.931409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'227","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.920410+0000","last_change":"2024-02-16T00:11:10.821163+0000","last_active":"2024-02-16T00:12:27.920410+0000","last_peered":"2024-02-16T00:12:27.920410+0000","last_clean":"2024-02-16T00:12:27.920410+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:27.920410+0000","last_undegraded":"2024-02-16T00:12:27.920410+0000","last_fullsized":"2024-02-16T00:12:27.920410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:56.315714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842725+0000","last_change":"2024-02-16T00:11:12.820915+0000","last_active":"2024-02-16T00:11:50.842725+0000","last_peered":"2024-02-16T00:11:50.842725+0000","last_clean":"2024-02-16T00:11:50.842725+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:11:50.842725+0000","last_undegraded":"2024-02-16T00:11:50.842725+0000","last_fullsized":"2024-02-16T00:11:50.842725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:11.680317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849986+0000","last_change":"2024-02-16T00:11:04.814579+0000","last_active":"2024-02-16T00:11:50.849986+0000","last_peered":"2024-02-16T00:11:50.849986+0000","last_clean":"2024-02-16T00:11:50.849986+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:11:50.849986+0000","last_undegraded":"2024-02-16T00:11:50.849986+0000","last_fullsized":"2024-02-16T00:11:50.849986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:37.972099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839956+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:11:50.839956+0000","last_peered":"2024-02-16T00:11:50.839956+0000","last_clean":"2024-02-16T00:11:50.839956+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:11:50.839956+0000","last_undegraded":"2024-02-16T00:11:50.839956+0000","last_fullsized":"2024-02-16T00:11:50.839956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:08.196608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844331+0000","last_change":"2024-02-16T00:11:06.805637+0000","last_active":"2024-02-16T00:11:50.844331+0000","last_peered":"2024-02-16T00:11:50.844331+0000","last_clean":"2024-02-16T00:11:50.844331+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:11:50.844331+0000","last_undegraded":"2024-02-16T00:11:50.844331+0000","last_fullsized":"2024-02-16T00:11:50.844331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:23.532869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.747601+0000","last_change":"2024-02-16T00:11:08.817066+0000","last_active":"2024-02-16T00:12:27.747601+0000","last_peered":"2024-02-16T00:12:27.747601+0000","last_clean":"2024-02-16T00:12:27.747601+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:27.747601+0000","last_undegraded":"2024-02-16T00:12:27.747601+0000","last_fullsized":"2024-02-16T00:12:27.747601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:44.502136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844840+0000","last_change":"2024-02-16T00:11:10.820822+0000","last_active":"2024-02-16T00:11:50.844840+0000","last_peered":"2024-02-16T00:11:50.844840+0000","last_clean":"2024-02-16T00:11:50.844840+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:11:50.844840+0000","last_undegraded":"2024-02-16T00:11:50.844840+0000","last_fullsized":"2024-02-16T00:11:50.844840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.483261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'1","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847448+0000","last_change":"2024-02-16T00:11:12.820426+0000","last_active":"2024-02-16T00:11:50.847448+0000","last_peered":"2024-02-16T00:11:50.847448+0000","last_clean":"2024-02-16T00:11:50.847448+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:11:50.847448+0000","last_undegraded":"2024-02-16T00:11:50.847448+0000","last_fullsized":"2024-02-16T00:11:50.847448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:56.437107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845695+0000","last_change":"2024-02-16T00:11:04.815286+0000","last_active":"2024-02-16T00:11:50.845695+0000","last_peered":"2024-02-16T00:11:50.845695+0000","last_clean":"2024-02-16T00:11:50.845695+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:11:50.845695+0000","last_undegraded":"2024-02-16T00:11:50.845695+0000","last_fullsized":"2024-02-16T00:11:50.845695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:52.351458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847560+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:11:50.847560+0000","last_peered":"2024-02-16T00:11:50.847560+0000","last_clean":"2024-02-16T00:11:50.847560+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:11:50.847560+0000","last_undegraded":"2024-02-16T00:11:50.847560+0000","last_fullsized":"2024-02-16T00:11:50.847560+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:26.862794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841297+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:11:50.841297+0000","last_peered":"2024-02-16T00:11:50.841297+0000","last_clean":"2024-02-16T00:11:50.841297+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:11:50.841297+0000","last_undegraded":"2024-02-16T00:11:50.841297+0000","last_fullsized":"2024-02-16T00:11:50.841297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:10.324975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840128+0000","last_change":"2024-02-16T00:11:02.823633+0000","last_active":"2024-02-16T00:11:50.840128+0000","last_peered":"2024-02-16T00:11:50.840128+0000","last_clean":"2024-02-16T00:11:50.840128+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:11:50.840128+0000","last_undegraded":"2024-02-16T00:11:50.840128+0000","last_fullsized":"2024-02-16T00:11:50.840128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:29:58.094211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847007+0000","last_change":"2024-02-16T00:11:06.802815+0000","last_active":"2024-02-16T00:11:50.847007+0000","last_peered":"2024-02-16T00:11:50.847007+0000","last_clean":"2024-02-16T00:11:50.847007+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:11:50.847007+0000","last_undegraded":"2024-02-16T00:11:50.847007+0000","last_fullsized":"2024-02-16T00:11:50.847007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:15.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'73","reported_seq":147,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.947431+0000","last_change":"2024-02-16T00:11:08.812650+0000","last_active":"2024-02-16T00:12:27.947431+0000","last_peered":"2024-02-16T00:12:27.947431+0000","last_clean":"2024-02-16T00:12:27.947431+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:27.947431+0000","last_undegraded":"2024-02-16T00:12:27.947431+0000","last_fullsized":"2024-02-16T00:12:27.947431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:00:12.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830451+0000","last_change":"2024-02-16T00:11:10.819778+0000","last_active":"2024-02-16T00:11:51.830451+0000","last_peered":"2024-02-16T00:11:51.830451+0000","last_clean":"2024-02-16T00:11:51.830451+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:11:51.830451+0000","last_undegraded":"2024-02-16T00:11:51.830451+0000","last_fullsized":"2024-02-16T00:11:51.830451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:02.494032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'45","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.971644+0000","last_change":"2024-02-16T00:11:12.817529+0000","last_active":"2024-02-16T00:12:27.971644+0000","last_peered":"2024-02-16T00:12:27.971644+0000","last_clean":"2024-02-16T00:12:27.971644+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:27.971644+0000","last_undegraded":"2024-02-16T00:12:27.971644+0000","last_fullsized":"2024-02-16T00:12:27.971644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:41.761693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":88,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969783+0000","last_change":"2024-02-16T00:11:04.805947+0000","last_active":"2024-02-16T00:12:27.969783+0000","last_peered":"2024-02-16T00:12:27.969783+0000","last_clean":"2024-02-16T00:12:27.969783+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:12:27.969783+0000","last_undegraded":"2024-02-16T00:12:27.969783+0000","last_fullsized":"2024-02-16T00:12:27.969783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:40.488305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839459+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:11:50.839459+0000","last_peered":"2024-02-16T00:11:50.839459+0000","last_clean":"2024-02-16T00:11:50.839459+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:11:50.839459+0000","last_undegraded":"2024-02-16T00:11:50.839459+0000","last_fullsized":"2024-02-16T00:11:50.839459+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:37.927052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828737+0000","last_change":"2024-02-16T00:11:02.808396+0000","last_active":"2024-02-16T00:11:51.828737+0000","last_peered":"2024-02-16T00:11:51.828737+0000","last_clean":"2024-02-16T00:11:51.828737+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:11:51.828737+0000","last_undegraded":"2024-02-16T00:11:51.828737+0000","last_fullsized":"2024-02-16T00:11:51.828737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849902+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:11:50.849902+0000","last_peered":"2024-02-16T00:11:50.849902+0000","last_clean":"2024-02-16T00:11:50.849902+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:11:50.849902+0000","last_undegraded":"2024-02-16T00:11:50.849902+0000","last_fullsized":"2024-02-16T00:11:50.849902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:55:08.909122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'233","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.946306+0000","last_change":"2024-02-16T00:11:08.816886+0000","last_active":"2024-02-16T00:12:27.946306+0000","last_peered":"2024-02-16T00:12:27.946306+0000","last_clean":"2024-02-16T00:12:27.946306+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:27.946306+0000","last_undegraded":"2024-02-16T00:12:27.946306+0000","last_fullsized":"2024-02-16T00:12:27.946306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:28.688312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":312,"num_read_kb":296,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844070+0000","last_change":"2024-02-16T00:11:10.830058+0000","last_active":"2024-02-16T00:11:50.844070+0000","last_peered":"2024-02-16T00:11:50.844070+0000","last_clean":"2024-02-16T00:11:50.844070+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:11:50.844070+0000","last_undegraded":"2024-02-16T00:11:50.844070+0000","last_fullsized":"2024-02-16T00:11:50.844070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:08:24.925584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.291221+0000","last_change":"2024-02-16T00:11:12.828339+0000","last_active":"2024-02-16T00:12:22.291221+0000","last_peered":"2024-02-16T00:12:22.291221+0000","last_clean":"2024-02-16T00:12:22.291221+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:12:22.291221+0000","last_undegraded":"2024-02-16T00:12:22.291221+0000","last_fullsized":"2024-02-16T00:12:22.291221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:03.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831761+0000","last_change":"2024-02-16T00:11:04.803584+0000","last_active":"2024-02-16T00:11:51.831761+0000","last_peered":"2024-02-16T00:11:51.831761+0000","last_clean":"2024-02-16T00:11:51.831761+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:11:51.831761+0000","last_undegraded":"2024-02-16T00:11:51.831761+0000","last_fullsized":"2024-02-16T00:11:51.831761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:39.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841090+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:11:50.841090+0000","last_peered":"2024-02-16T00:11:50.841090+0000","last_clean":"2024-02-16T00:11:50.841090+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:11:50.841090+0000","last_undegraded":"2024-02-16T00:11:50.841090+0000","last_fullsized":"2024-02-16T00:11:50.841090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:55.484965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828521+0000","last_change":"2024-02-16T00:11:02.802061+0000","last_active":"2024-02-16T00:11:51.828521+0000","last_peered":"2024-02-16T00:11:51.828521+0000","last_clean":"2024-02-16T00:11:51.828521+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:11:51.828521+0000","last_undegraded":"2024-02-16T00:11:51.828521+0000","last_fullsized":"2024-02-16T00:11:51.828521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841761+0000","last_change":"2024-02-16T00:11:06.803264+0000","last_active":"2024-02-16T00:11:50.841761+0000","last_peered":"2024-02-16T00:11:50.841761+0000","last_clean":"2024-02-16T00:11:50.841761+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:11:50.841761+0000","last_undegraded":"2024-02-16T00:11:50.841761+0000","last_fullsized":"2024-02-16T00:11:50.841761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:36.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'15","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:21.868923+0000","last_change":"2024-02-16T00:11:08.817972+0000","last_active":"2024-02-16T00:12:21.868923+0000","last_peered":"2024-02-16T00:12:21.868923+0000","last_clean":"2024-02-16T00:12:21.868923+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:21.868923+0000","last_undegraded":"2024-02-16T00:12:21.868923+0000","last_fullsized":"2024-02-16T00:12:21.868923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:40.476138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831062+0000","last_change":"2024-02-16T00:11:10.819489+0000","last_active":"2024-02-16T00:11:51.831062+0000","last_peered":"2024-02-16T00:11:51.831062+0000","last_clean":"2024-02-16T00:11:51.831062+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:11:51.831062+0000","last_undegraded":"2024-02-16T00:11:51.831062+0000","last_fullsized":"2024-02-16T00:11:51.831062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:33.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840050+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:11:50.840050+0000","last_peered":"2024-02-16T00:11:50.840050+0000","last_clean":"2024-02-16T00:11:50.840050+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:11:50.840050+0000","last_undegraded":"2024-02-16T00:11:50.840050+0000","last_fullsized":"2024-02-16T00:11:50.840050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:49.996094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831944+0000","last_change":"2024-02-16T00:11:04.801512+0000","last_active":"2024-02-16T00:11:51.831944+0000","last_peered":"2024-02-16T00:11:51.831944+0000","last_clean":"2024-02-16T00:11:51.831944+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:11:51.831944+0000","last_undegraded":"2024-02-16T00:11:51.831944+0000","last_fullsized":"2024-02-16T00:11:51.831944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:17.940025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839890+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:11:50.839890+0000","last_peered":"2024-02-16T00:11:50.839890+0000","last_clean":"2024-02-16T00:11:50.839890+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:11:50.839890+0000","last_undegraded":"2024-02-16T00:11:50.839890+0000","last_fullsized":"2024-02-16T00:11:50.839890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:16.627592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844174+0000","last_change":"2024-02-16T00:11:02.811825+0000","last_active":"2024-02-16T00:11:50.844174+0000","last_peered":"2024-02-16T00:11:50.844174+0000","last_clean":"2024-02-16T00:11:50.844174+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:11:50.844174+0000","last_undegraded":"2024-02-16T00:11:50.844174+0000","last_fullsized":"2024-02-16T00:11:50.844174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.851641+0000","last_change":"2024-02-16T00:11:50.851092+0000","last_active":"2024-02-16T00:11:50.851641+0000","last_peered":"2024-02-16T00:11:50.851641+0000","last_clean":"2024-02-16T00:11:50.851641+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:11:50.851641+0000","last_undegraded":"2024-02-16T00:11:50.851641+0000","last_fullsized":"2024-02-16T00:11:50.851641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:28.735178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842255+0000","last_change":"2024-02-16T00:11:08.813441+0000","last_active":"2024-02-16T00:11:50.842255+0000","last_peered":"2024-02-16T00:11:50.842255+0000","last_clean":"2024-02-16T00:11:50.842255+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:11:50.842255+0000","last_undegraded":"2024-02-16T00:11:50.842255+0000","last_fullsized":"2024-02-16T00:11:50.842255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:25.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843784+0000","last_change":"2024-02-16T00:11:10.829728+0000","last_active":"2024-02-16T00:11:50.843784+0000","last_peered":"2024-02-16T00:11:50.843784+0000","last_clean":"2024-02-16T00:11:50.843784+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:11:50.843784+0000","last_undegraded":"2024-02-16T00:11:50.843784+0000","last_fullsized":"2024-02-16T00:11:50.843784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:38.430913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848729+0000","last_change":"2024-02-16T00:11:12.835325+0000","last_active":"2024-02-16T00:11:50.848729+0000","last_peered":"2024-02-16T00:11:50.848729+0000","last_clean":"2024-02-16T00:11:50.848729+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:11:50.848729+0000","last_undegraded":"2024-02-16T00:11:50.848729+0000","last_fullsized":"2024-02-16T00:11:50.848729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:54.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621964+0000","last_change":"2024-02-16T00:11:04.814208+0000","last_active":"2024-02-16T00:12:27.621964+0000","last_peered":"2024-02-16T00:12:27.621964+0000","last_clean":"2024-02-16T00:12:27.621964+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:12:27.621964+0000","last_undegraded":"2024-02-16T00:12:27.621964+0000","last_fullsized":"2024-02-16T00:12:27.621964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:31.576677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841417+0000","last_change":"2024-02-16T00:11:02.805928+0000","last_active":"2024-02-16T00:11:50.841417+0000","last_peered":"2024-02-16T00:11:50.841417+0000","last_clean":"2024-02-16T00:11:50.841417+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:11:50.841417+0000","last_undegraded":"2024-02-16T00:11:50.841417+0000","last_fullsized":"2024-02-16T00:11:50.841417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.827694+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:11:51.827694+0000","last_peered":"2024-02-16T00:11:51.827694+0000","last_clean":"2024-02-16T00:11:51.827694+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:11:51.827694+0000","last_undegraded":"2024-02-16T00:11:51.827694+0000","last_fullsized":"2024-02-16T00:11:51.827694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:57:56.387943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830614+0000","last_change":"2024-02-16T00:11:06.809081+0000","last_active":"2024-02-16T00:11:51.830614+0000","last_peered":"2024-02-16T00:11:51.830614+0000","last_clean":"2024-02-16T00:11:51.830614+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:11:51.830614+0000","last_undegraded":"2024-02-16T00:11:51.830614+0000","last_fullsized":"2024-02-16T00:11:51.830614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:37.382506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'66","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.940166+0000","last_change":"2024-02-16T00:11:08.812931+0000","last_active":"2024-02-16T00:12:27.940166+0000","last_peered":"2024-02-16T00:12:27.940166+0000","last_clean":"2024-02-16T00:12:27.940166+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:27.940166+0000","last_undegraded":"2024-02-16T00:12:27.940166+0000","last_fullsized":"2024-02-16T00:12:27.940166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:59.444482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":62,"num_write":36,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842114+0000","last_change":"2024-02-16T00:11:10.824976+0000","last_active":"2024-02-16T00:11:50.842114+0000","last_peered":"2024-02-16T00:11:50.842114+0000","last_clean":"2024-02-16T00:11:50.842114+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:11:50.842114+0000","last_undegraded":"2024-02-16T00:11:50.842114+0000","last_fullsized":"2024-02-16T00:11:50.842114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:01.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.959184+0000","last_change":"2024-02-16T00:11:12.822048+0000","last_active":"2024-02-16T00:12:27.959184+0000","last_peered":"2024-02-16T00:12:27.959184+0000","last_clean":"2024-02-16T00:12:27.959184+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:12:27.959184+0000","last_undegraded":"2024-02-16T00:12:27.959184+0000","last_fullsized":"2024-02-16T00:12:27.959184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:58.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846988+0000","last_change":"2024-02-16T00:11:04.814786+0000","last_active":"2024-02-16T00:11:50.846988+0000","last_peered":"2024-02-16T00:11:50.846988+0000","last_clean":"2024-02-16T00:11:50.846988+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:11:50.846988+0000","last_undegraded":"2024-02-16T00:11:50.846988+0000","last_fullsized":"2024-02-16T00:11:50.846988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:31.456911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831382+0000","last_change":"2024-02-16T00:11:02.801240+0000","last_active":"2024-02-16T00:11:51.831382+0000","last_peered":"2024-02-16T00:11:51.831382+0000","last_clean":"2024-02-16T00:11:51.831382+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:11:51.831382+0000","last_undegraded":"2024-02-16T00:11:51.831382+0000","last_fullsized":"2024-02-16T00:11:51.831382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:37.663185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844947+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:11:50.844947+0000","last_peered":"2024-02-16T00:11:50.844947+0000","last_clean":"2024-02-16T00:11:50.844947+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:11:50.844947+0000","last_undegraded":"2024-02-16T00:11:50.844947+0000","last_fullsized":"2024-02-16T00:11:50.844947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:11:13.167891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839692+0000","last_change":"2024-02-16T00:11:06.807321+0000","last_active":"2024-02-16T00:11:50.839692+0000","last_peered":"2024-02-16T00:11:50.839692+0000","last_clean":"2024-02-16T00:11:50.839692+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:11:50.839692+0000","last_undegraded":"2024-02-16T00:11:50.839692+0000","last_fullsized":"2024-02-16T00:11:50.839692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:40.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846822+0000","last_change":"2024-02-16T00:11:08.816902+0000","last_active":"2024-02-16T00:11:50.846822+0000","last_peered":"2024-02-16T00:11:50.846822+0000","last_clean":"2024-02-16T00:11:50.846822+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:11:50.846822+0000","last_undegraded":"2024-02-16T00:11:50.846822+0000","last_fullsized":"2024-02-16T00:11:50.846822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:28.706934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'227","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.917167+0000","last_change":"2024-02-16T00:11:10.824584+0000","last_active":"2024-02-16T00:12:27.917167+0000","last_peered":"2024-02-16T00:12:27.917167+0000","last_clean":"2024-02-16T00:12:27.917167+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:27.917167+0000","last_undegraded":"2024-02-16T00:12:27.917167+0000","last_fullsized":"2024-02-16T00:12:27.917167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:12.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842453+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:11:50.842453+0000","last_peered":"2024-02-16T00:11:50.842453+0000","last_clean":"2024-02-16T00:11:50.842453+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:11:50.842453+0000","last_undegraded":"2024-02-16T00:11:50.842453+0000","last_fullsized":"2024-02-16T00:11:50.842453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:56:43.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322612+0000","last_change":"2024-02-16T00:11:04.813783+0000","last_active":"2024-02-16T00:12:27.322612+0000","last_peered":"2024-02-16T00:12:27.322612+0000","last_clean":"2024-02-16T00:12:27.322612+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:27.322612+0000","last_undegraded":"2024-02-16T00:12:27.322612+0000","last_fullsized":"2024-02-16T00:12:27.322612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:00.990043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844350+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:11:50.844350+0000","last_peered":"2024-02-16T00:11:50.844350+0000","last_clean":"2024-02-16T00:11:50.844350+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:11:50.844350+0000","last_undegraded":"2024-02-16T00:11:50.844350+0000","last_fullsized":"2024-02-16T00:11:50.844350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:43.805420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828194+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:11:51.828194+0000","last_peered":"2024-02-16T00:11:51.828194+0000","last_clean":"2024-02-16T00:11:51.828194+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:11:51.828194+0000","last_undegraded":"2024-02-16T00:11:51.828194+0000","last_fullsized":"2024-02-16T00:11:51.828194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:33:37.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840930+0000","last_change":"2024-02-16T00:11:06.808524+0000","last_active":"2024-02-16T00:11:50.840930+0000","last_peered":"2024-02-16T00:11:50.840930+0000","last_clean":"2024-02-16T00:11:50.840930+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:11:50.840930+0000","last_undegraded":"2024-02-16T00:11:50.840930+0000","last_fullsized":"2024-02-16T00:11:50.840930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:29.788383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840440+0000","last_change":"2024-02-16T00:11:08.814729+0000","last_active":"2024-02-16T00:11:50.840440+0000","last_peered":"2024-02-16T00:11:50.840440+0000","last_clean":"2024-02-16T00:11:50.840440+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:11:50.840440+0000","last_undegraded":"2024-02-16T00:11:50.840440+0000","last_fullsized":"2024-02-16T00:11:50.840440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:46.912652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'227","reported_seq":293,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.986360+0000","last_change":"2024-02-16T00:11:10.820590+0000","last_active":"2024-02-16T00:12:27.986360+0000","last_peered":"2024-02-16T00:12:27.986360+0000","last_clean":"2024-02-16T00:12:27.986360+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:27.986360+0000","last_undegraded":"2024-02-16T00:12:27.986360+0000","last_fullsized":"2024-02-16T00:12:27.986360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:31.011223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.278591+0000","last_change":"2024-02-16T00:11:12.832931+0000","last_active":"2024-02-16T00:12:22.278591+0000","last_peered":"2024-02-16T00:12:22.278591+0000","last_clean":"2024-02-16T00:12:22.278591+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:12:22.278591+0000","last_undegraded":"2024-02-16T00:12:22.278591+0000","last_fullsized":"2024-02-16T00:12:22.278591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:26.736188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'5","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841657+0000","last_change":"2024-02-16T00:11:04.809323+0000","last_active":"2024-02-16T00:11:50.841657+0000","last_peered":"2024-02-16T00:11:50.841657+0000","last_clean":"2024-02-16T00:11:50.841657+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:11:50.841657+0000","last_undegraded":"2024-02-16T00:11:50.841657+0000","last_fullsized":"2024-02-16T00:11:50.841657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:15.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849396+0000","last_change":"2024-02-16T00:11:02.796859+0000","last_active":"2024-02-16T00:11:50.849396+0000","last_peered":"2024-02-16T00:11:50.849396+0000","last_clean":"2024-02-16T00:11:50.849396+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:11:50.849396+0000","last_undegraded":"2024-02-16T00:11:50.849396+0000","last_fullsized":"2024-02-16T00:11:50.849396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843629+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:11:50.843629+0000","last_peered":"2024-02-16T00:11:50.843629+0000","last_clean":"2024-02-16T00:11:50.843629+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:11:50.843629+0000","last_undegraded":"2024-02-16T00:11:50.843629+0000","last_fullsized":"2024-02-16T00:11:50.843629+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:06.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840367+0000","last_change":"2024-02-16T00:11:06.809592+0000","last_active":"2024-02-16T00:11:50.840367+0000","last_peered":"2024-02-16T00:11:50.840367+0000","last_clean":"2024-02-16T00:11:50.840367+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:11:50.840367+0000","last_undegraded":"2024-02-16T00:11:50.840367+0000","last_fullsized":"2024-02-16T00:11:50.840367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:52.303003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'79","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.936693+0000","last_change":"2024-02-16T00:11:08.813647+0000","last_active":"2024-02-16T00:12:27.936693+0000","last_peered":"2024-02-16T00:12:27.936693+0000","last_clean":"2024-02-16T00:12:27.936693+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:27.936693+0000","last_undegraded":"2024-02-16T00:12:27.936693+0000","last_fullsized":"2024-02-16T00:12:27.936693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:57.678721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829880+0000","last_change":"2024-02-16T00:11:10.825204+0000","last_active":"2024-02-16T00:11:51.829880+0000","last_peered":"2024-02-16T00:11:51.829880+0000","last_clean":"2024-02-16T00:11:51.829880+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:11:51.829880+0000","last_undegraded":"2024-02-16T00:11:51.829880+0000","last_fullsized":"2024-02-16T00:11:51.829880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:27.545580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845913+0000","last_change":"2024-02-16T00:11:12.825945+0000","last_active":"2024-02-16T00:11:50.845913+0000","last_peered":"2024-02-16T00:11:50.845913+0000","last_clean":"2024-02-16T00:11:50.845913+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:11:50.845913+0000","last_undegraded":"2024-02-16T00:11:50.845913+0000","last_fullsized":"2024-02-16T00:11:50.845913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:01.423563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841448+0000","last_change":"2024-02-16T00:11:12.826512+0000","last_active":"2024-02-16T00:11:50.841448+0000","last_peered":"2024-02-16T00:11:50.841448+0000","last_clean":"2024-02-16T00:11:50.841448+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:11:50.841448+0000","last_undegraded":"2024-02-16T00:11:50.841448+0000","last_fullsized":"2024-02-16T00:11:50.841448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:14.444046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969541+0000","last_change":"2024-02-16T00:11:04.810868+0000","last_active":"2024-02-16T00:12:27.969541+0000","last_peered":"2024-02-16T00:12:27.969541+0000","last_clean":"2024-02-16T00:12:27.969541+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:12:27.969541+0000","last_undegraded":"2024-02-16T00:12:27.969541+0000","last_fullsized":"2024-02-16T00:12:27.969541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842296+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:11:50.842296+0000","last_peered":"2024-02-16T00:11:50.842296+0000","last_clean":"2024-02-16T00:11:50.842296+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:11:50.842296+0000","last_undegraded":"2024-02-16T00:11:50.842296+0000","last_fullsized":"2024-02-16T00:11:50.842296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:24.599977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"20'1","reported_seq":180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.892821+0000","last_change":"2024-02-16T00:11:06.804629+0000","last_active":"2024-02-16T00:12:27.892821+0000","last_peered":"2024-02-16T00:12:27.892821+0000","last_clean":"2024-02-16T00:12:27.892821+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:27.892821+0000","last_undegraded":"2024-02-16T00:12:27.892821+0000","last_fullsized":"2024-02-16T00:12:27.892821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:33.337990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.751643+0000","last_change":"2024-02-16T00:11:08.817056+0000","last_active":"2024-02-16T00:12:27.751643+0000","last_peered":"2024-02-16T00:12:27.751643+0000","last_clean":"2024-02-16T00:12:27.751643+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:12:27.751643+0000","last_undegraded":"2024-02-16T00:12:27.751643+0000","last_fullsized":"2024-02-16T00:12:27.751643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:14.319677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840209+0000","last_change":"2024-02-16T00:11:10.831264+0000","last_active":"2024-02-16T00:11:50.840209+0000","last_peered":"2024-02-16T00:11:50.840209+0000","last_clean":"2024-02-16T00:11:50.840209+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:11:50.840209+0000","last_undegraded":"2024-02-16T00:11:50.840209+0000","last_fullsized":"2024-02-16T00:11:50.840209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:09:54.744331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830002+0000","last_change":"2024-02-16T00:11:12.819458+0000","last_active":"2024-02-16T00:11:51.830002+0000","last_peered":"2024-02-16T00:11:51.830002+0000","last_clean":"2024-02-16T00:11:51.830002+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:11:51.830002+0000","last_undegraded":"2024-02-16T00:11:51.830002+0000","last_fullsized":"2024-02-16T00:11:51.830002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:18.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.857998+0000","last_change":"2024-02-16T00:11:50.857588+0000","last_active":"2024-02-16T00:11:50.857998+0000","last_peered":"2024-02-16T00:11:50.857998+0000","last_clean":"2024-02-16T00:11:50.857998+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:11:50.857998+0000","last_undegraded":"2024-02-16T00:11:50.857998+0000","last_fullsized":"2024-02-16T00:11:50.857998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:48.410669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841539+0000","last_change":"2024-02-16T00:11:02.805825+0000","last_active":"2024-02-16T00:11:50.841539+0000","last_peered":"2024-02-16T00:11:50.841539+0000","last_clean":"2024-02-16T00:11:50.841539+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:11:50.841539+0000","last_undegraded":"2024-02-16T00:11:50.841539+0000","last_fullsized":"2024-02-16T00:11:50.841539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841830+0000","last_change":"2024-02-16T00:11:06.809728+0000","last_active":"2024-02-16T00:11:50.841830+0000","last_peered":"2024-02-16T00:11:50.841830+0000","last_clean":"2024-02-16T00:11:50.841830+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:11:50.841830+0000","last_undegraded":"2024-02-16T00:11:50.841830+0000","last_fullsized":"2024-02-16T00:11:50.841830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:21.123795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:21.104435+0000","last_change":"2024-02-16T00:11:08.813746+0000","last_active":"2024-02-16T00:12:21.104435+0000","last_peered":"2024-02-16T00:12:21.104435+0000","last_clean":"2024-02-16T00:12:21.104435+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:21.104435+0000","last_undegraded":"2024-02-16T00:12:21.104435+0000","last_fullsized":"2024-02-16T00:12:21.104435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:22.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841313+0000","last_change":"2024-02-16T00:11:10.820413+0000","last_active":"2024-02-16T00:11:50.841313+0000","last_peered":"2024-02-16T00:11:50.841313+0000","last_clean":"2024-02-16T00:11:50.841313+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:11:50.841313+0000","last_undegraded":"2024-02-16T00:11:50.841313+0000","last_fullsized":"2024-02-16T00:11:50.841313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:24.918488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830024+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830024+0000","last_peered":"2024-02-16T00:11:51.830024+0000","last_clean":"2024-02-16T00:11:51.830024+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830024+0000","last_undegraded":"2024-02-16T00:11:51.830024+0000","last_fullsized":"2024-02-16T00:11:51.830024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:38:14.345034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829576+0000","last_change":"2024-02-16T00:11:04.801132+0000","last_active":"2024-02-16T00:11:51.829576+0000","last_peered":"2024-02-16T00:11:51.829576+0000","last_clean":"2024-02-16T00:11:51.829576+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:11:51.829576+0000","last_undegraded":"2024-02-16T00:11:51.829576+0000","last_fullsized":"2024-02-16T00:11:51.829576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842111+0000","last_change":"2024-02-16T00:11:02.815585+0000","last_active":"2024-02-16T00:11:50.842111+0000","last_peered":"2024-02-16T00:11:50.842111+0000","last_clean":"2024-02-16T00:11:50.842111+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:11:50.842111+0000","last_undegraded":"2024-02-16T00:11:50.842111+0000","last_fullsized":"2024-02-16T00:11:50.842111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843904+0000","last_change":"2024-02-16T00:11:06.809635+0000","last_active":"2024-02-16T00:11:50.843904+0000","last_peered":"2024-02-16T00:11:50.843904+0000","last_clean":"2024-02-16T00:11:50.843904+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:11:50.843904+0000","last_undegraded":"2024-02-16T00:11:50.843904+0000","last_fullsized":"2024-02-16T00:11:50.843904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:49.818734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'31","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.740457+0000","last_change":"2024-02-16T00:11:08.810350+0000","last_active":"2024-02-16T00:12:27.740457+0000","last_peered":"2024-02-16T00:12:27.740457+0000","last_clean":"2024-02-16T00:12:27.740457+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:27.740457+0000","last_undegraded":"2024-02-16T00:12:27.740457+0000","last_fullsized":"2024-02-16T00:12:27.740457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:45.445581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":47,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847684+0000","last_change":"2024-02-16T00:11:10.823987+0000","last_active":"2024-02-16T00:11:50.847684+0000","last_peered":"2024-02-16T00:11:50.847684+0000","last_clean":"2024-02-16T00:11:50.847684+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:11:50.847684+0000","last_undegraded":"2024-02-16T00:11:50.847684+0000","last_fullsized":"2024-02-16T00:11:50.847684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:59.417398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844306+0000","last_change":"2024-02-16T00:11:12.831687+0000","last_active":"2024-02-16T00:11:50.844306+0000","last_peered":"2024-02-16T00:11:50.844306+0000","last_clean":"2024-02-16T00:11:50.844306+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:11:50.844306+0000","last_undegraded":"2024-02-16T00:11:50.844306+0000","last_fullsized":"2024-02-16T00:11:50.844306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839554+0000","last_change":"2024-02-16T00:11:04.812864+0000","last_active":"2024-02-16T00:11:50.839554+0000","last_peered":"2024-02-16T00:11:50.839554+0000","last_clean":"2024-02-16T00:11:50.839554+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:11:50.839554+0000","last_undegraded":"2024-02-16T00:11:50.839554+0000","last_fullsized":"2024-02-16T00:11:50.839554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:35.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849446+0000","last_change":"2024-02-16T00:11:02.814174+0000","last_active":"2024-02-16T00:11:50.849446+0000","last_peered":"2024-02-16T00:11:50.849446+0000","last_clean":"2024-02-16T00:11:50.849446+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:11:50.849446+0000","last_undegraded":"2024-02-16T00:11:50.849446+0000","last_fullsized":"2024-02-16T00:11:50.849446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839547+0000","last_change":"2024-02-16T00:11:06.803159+0000","last_active":"2024-02-16T00:11:50.839547+0000","last_peered":"2024-02-16T00:11:50.839547+0000","last_clean":"2024-02-16T00:11:50.839547+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:11:50.839547+0000","last_undegraded":"2024-02-16T00:11:50.839547+0000","last_fullsized":"2024-02-16T00:11:50.839547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:11.562971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'27","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.737030+0000","last_change":"2024-02-16T00:11:08.812960+0000","last_active":"2024-02-16T00:12:27.737030+0000","last_peered":"2024-02-16T00:12:27.737030+0000","last_clean":"2024-02-16T00:12:27.737030+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:27.737030+0000","last_undegraded":"2024-02-16T00:12:27.737030+0000","last_fullsized":"2024-02-16T00:12:27.737030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:42.177481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843134+0000","last_change":"2024-02-16T00:11:10.819766+0000","last_active":"2024-02-16T00:11:50.843134+0000","last_peered":"2024-02-16T00:11:50.843134+0000","last_clean":"2024-02-16T00:11:50.843134+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:11:50.843134+0000","last_undegraded":"2024-02-16T00:11:50.843134+0000","last_fullsized":"2024-02-16T00:11:50.843134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:47.452023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977793+0000","last_change":"2024-02-16T00:11:04.799979+0000","last_active":"2024-02-16T00:12:27.977793+0000","last_peered":"2024-02-16T00:12:27.977793+0000","last_clean":"2024-02-16T00:12:27.977793+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:12:27.977793+0000","last_undegraded":"2024-02-16T00:12:27.977793+0000","last_fullsized":"2024-02-16T00:12:27.977793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.383827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839552+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:11:50.839552+0000","last_peered":"2024-02-16T00:11:50.839552+0000","last_clean":"2024-02-16T00:11:50.839552+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:11:50.839552+0000","last_undegraded":"2024-02-16T00:11:50.839552+0000","last_fullsized":"2024-02-16T00:11:50.839552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:56.621924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831788+0000","last_change":"2024-02-16T00:11:06.807366+0000","last_active":"2024-02-16T00:11:51.831788+0000","last_peered":"2024-02-16T00:11:51.831788+0000","last_clean":"2024-02-16T00:11:51.831788+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:11:51.831788+0000","last_undegraded":"2024-02-16T00:11:51.831788+0000","last_fullsized":"2024-02-16T00:11:51.831788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:55.672453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'55","reported_seq":116,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.933680+0000","last_change":"2024-02-16T00:11:08.813592+0000","last_active":"2024-02-16T00:12:27.933680+0000","last_peered":"2024-02-16T00:12:27.933680+0000","last_clean":"2024-02-16T00:12:27.933680+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:27.933680+0000","last_undegraded":"2024-02-16T00:12:27.933680+0000","last_fullsized":"2024-02-16T00:12:27.933680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:13.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:10.819573+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:15.314264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.975742+0000","last_change":"2024-02-16T00:11:12.826496+0000","last_active":"2024-02-16T00:12:27.975742+0000","last_peered":"2024-02-16T00:12:27.975742+0000","last_clean":"2024-02-16T00:12:27.975742+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:12:27.975742+0000","last_undegraded":"2024-02-16T00:12:27.975742+0000","last_fullsized":"2024-02-16T00:12:27.975742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:43.107611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831550+0000","last_change":"2024-02-16T00:11:04.798736+0000","last_active":"2024-02-16T00:11:51.831550+0000","last_peered":"2024-02-16T00:11:51.831550+0000","last_clean":"2024-02-16T00:11:51.831550+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:11:51.831550+0000","last_undegraded":"2024-02-16T00:11:51.831550+0000","last_fullsized":"2024-02-16T00:11:51.831550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:23.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846657+0000","last_change":"2024-02-16T00:11:02.820397+0000","last_active":"2024-02-16T00:11:50.846657+0000","last_peered":"2024-02-16T00:11:50.846657+0000","last_clean":"2024-02-16T00:11:50.846657+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:11:50.846657+0000","last_undegraded":"2024-02-16T00:11:50.846657+0000","last_fullsized":"2024-02-16T00:11:50.846657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:41:25.514708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842043+0000","last_change":"2024-02-16T00:11:06.805697+0000","last_active":"2024-02-16T00:11:50.842043+0000","last_peered":"2024-02-16T00:11:50.842043+0000","last_clean":"2024-02-16T00:11:50.842043+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:11:50.842043+0000","last_undegraded":"2024-02-16T00:11:50.842043+0000","last_fullsized":"2024-02-16T00:11:50.842043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:39.979662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'33","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.737945+0000","last_change":"2024-02-16T00:11:08.817849+0000","last_active":"2024-02-16T00:12:27.737945+0000","last_peered":"2024-02-16T00:12:27.737945+0000","last_clean":"2024-02-16T00:12:27.737945+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:12:27.737945+0000","last_undegraded":"2024-02-16T00:12:27.737945+0000","last_fullsized":"2024-02-16T00:12:27.737945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:31:51.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846687+0000","last_change":"2024-02-16T00:11:10.826937+0000","last_active":"2024-02-16T00:11:50.846687+0000","last_peered":"2024-02-16T00:11:50.846687+0000","last_clean":"2024-02-16T00:11:50.846687+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:11:50.846687+0000","last_undegraded":"2024-02-16T00:11:50.846687+0000","last_fullsized":"2024-02-16T00:11:50.846687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:44.750899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839475+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:11:50.839475+0000","last_peered":"2024-02-16T00:11:50.839475+0000","last_clean":"2024-02-16T00:11:50.839475+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:11:50.839475+0000","last_undegraded":"2024-02-16T00:11:50.839475+0000","last_fullsized":"2024-02-16T00:11:50.839475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:07.884643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846346+0000","last_change":"2024-02-16T00:11:04.815549+0000","last_active":"2024-02-16T00:11:50.846346+0000","last_peered":"2024-02-16T00:11:50.846346+0000","last_clean":"2024-02-16T00:11:50.846346+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:11:50.846346+0000","last_undegraded":"2024-02-16T00:11:50.846346+0000","last_fullsized":"2024-02-16T00:11:50.846346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:24.693103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847848+0000","last_change":"2024-02-16T00:11:02.796631+0000","last_active":"2024-02-16T00:11:50.847848+0000","last_peered":"2024-02-16T00:11:50.847848+0000","last_clean":"2024-02-16T00:11:50.847848+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:11:50.847848+0000","last_undegraded":"2024-02-16T00:11:50.847848+0000","last_fullsized":"2024-02-16T00:11:50.847848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843956+0000","last_change":"2024-02-16T00:11:06.803105+0000","last_active":"2024-02-16T00:11:50.843956+0000","last_peered":"2024-02-16T00:11:50.843956+0000","last_clean":"2024-02-16T00:11:50.843956+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:11:50.843956+0000","last_undegraded":"2024-02-16T00:11:50.843956+0000","last_fullsized":"2024-02-16T00:11:50.843956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:33.464474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.755720+0000","last_change":"2024-02-16T00:11:08.812229+0000","last_active":"2024-02-16T00:12:27.755720+0000","last_peered":"2024-02-16T00:12:27.755720+0000","last_clean":"2024-02-16T00:12:27.755720+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:27.755720+0000","last_undegraded":"2024-02-16T00:12:27.755720+0000","last_fullsized":"2024-02-16T00:12:27.755720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:29.476819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830448+0000","last_change":"2024-02-16T00:11:10.820773+0000","last_active":"2024-02-16T00:11:51.830448+0000","last_peered":"2024-02-16T00:11:51.830448+0000","last_clean":"2024-02-16T00:11:51.830448+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:11:51.830448+0000","last_undegraded":"2024-02-16T00:11:51.830448+0000","last_fullsized":"2024-02-16T00:11:51.830448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:04.097666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840147+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:11:50.840147+0000","last_peered":"2024-02-16T00:11:50.840147+0000","last_clean":"2024-02-16T00:11:50.840147+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:11:50.840147+0000","last_undegraded":"2024-02-16T00:11:50.840147+0000","last_fullsized":"2024-02-16T00:11:50.840147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.226733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831639+0000","last_change":"2024-02-16T00:11:04.801768+0000","last_active":"2024-02-16T00:11:51.831639+0000","last_peered":"2024-02-16T00:11:51.831639+0000","last_clean":"2024-02-16T00:11:51.831639+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:11:51.831639+0000","last_undegraded":"2024-02-16T00:11:51.831639+0000","last_fullsized":"2024-02-16T00:11:51.831639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:45.811771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841024+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:11:50.841024+0000","last_peered":"2024-02-16T00:11:50.841024+0000","last_clean":"2024-02-16T00:11:50.841024+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:11:50.841024+0000","last_undegraded":"2024-02-16T00:11:50.841024+0000","last_fullsized":"2024-02-16T00:11:50.841024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:13.889993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849296+0000","last_change":"2024-02-16T00:11:06.802067+0000","last_active":"2024-02-16T00:11:50.849296+0000","last_peered":"2024-02-16T00:11:50.849296+0000","last_clean":"2024-02-16T00:11:50.849296+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:11:50.849296+0000","last_undegraded":"2024-02-16T00:11:50.849296+0000","last_fullsized":"2024-02-16T00:11:50.849296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:43.145044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844168+0000","last_change":"2024-02-16T00:11:08.814283+0000","last_active":"2024-02-16T00:11:50.844168+0000","last_peered":"2024-02-16T00:11:50.844168+0000","last_clean":"2024-02-16T00:11:50.844168+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:11:50.844168+0000","last_undegraded":"2024-02-16T00:11:50.844168+0000","last_fullsized":"2024-02-16T00:11:50.844168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:04.932316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'227","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.915833+0000","last_change":"2024-02-16T00:11:10.827795+0000","last_active":"2024-02-16T00:12:27.915833+0000","last_peered":"2024-02-16T00:12:27.915833+0000","last_clean":"2024-02-16T00:12:27.915833+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:27.915833+0000","last_undegraded":"2024-02-16T00:12:27.915833+0000","last_fullsized":"2024-02-16T00:12:27.915833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:46.508578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839100+0000","last_change":"2024-02-16T00:11:12.832363+0000","last_active":"2024-02-16T00:11:50.839100+0000","last_peered":"2024-02-16T00:11:50.839100+0000","last_clean":"2024-02-16T00:11:50.839100+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:11:50.839100+0000","last_undegraded":"2024-02-16T00:11:50.839100+0000","last_fullsized":"2024-02-16T00:11:50.839100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:05.101733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844636+0000","last_change":"2024-02-16T00:11:04.798269+0000","last_active":"2024-02-16T00:11:50.844636+0000","last_peered":"2024-02-16T00:11:50.844636+0000","last_clean":"2024-02-16T00:11:50.844636+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:11:50.844636+0000","last_undegraded":"2024-02-16T00:11:50.844636+0000","last_fullsized":"2024-02-16T00:11:50.844636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:55.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847476+0000","last_change":"2024-02-16T00:11:02.810889+0000","last_active":"2024-02-16T00:11:50.847476+0000","last_peered":"2024-02-16T00:11:50.847476+0000","last_clean":"2024-02-16T00:11:50.847476+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:11:50.847476+0000","last_undegraded":"2024-02-16T00:11:50.847476+0000","last_fullsized":"2024-02-16T00:11:50.847476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848612+0000","last_change":"2024-02-16T00:11:06.805017+0000","last_active":"2024-02-16T00:11:50.848612+0000","last_peered":"2024-02-16T00:11:50.848612+0000","last_clean":"2024-02-16T00:11:50.848612+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:11:50.848612+0000","last_undegraded":"2024-02-16T00:11:50.848612+0000","last_fullsized":"2024-02-16T00:11:50.848612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:38.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'59","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.926363+0000","last_change":"2024-02-16T00:11:08.812824+0000","last_active":"2024-02-16T00:12:27.926363+0000","last_peered":"2024-02-16T00:12:27.926363+0000","last_clean":"2024-02-16T00:12:27.926363+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:27.926363+0000","last_undegraded":"2024-02-16T00:12:27.926363+0000","last_fullsized":"2024-02-16T00:12:27.926363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:49.397658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828558+0000","last_change":"2024-02-16T00:11:10.815519+0000","last_active":"2024-02-16T00:11:51.828558+0000","last_peered":"2024-02-16T00:11:51.828558+0000","last_clean":"2024-02-16T00:11:51.828558+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:11:51.828558+0000","last_undegraded":"2024-02-16T00:11:51.828558+0000","last_fullsized":"2024-02-16T00:11:51.828558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:54.865963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849722+0000","last_change":"2024-02-16T00:11:12.828004+0000","last_active":"2024-02-16T00:11:50.849722+0000","last_peered":"2024-02-16T00:11:50.849722+0000","last_clean":"2024-02-16T00:11:50.849722+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:11:50.849722+0000","last_undegraded":"2024-02-16T00:11:50.849722+0000","last_fullsized":"2024-02-16T00:11:50.849722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:43.107611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842936+0000","last_change":"2024-02-16T00:11:04.802752+0000","last_active":"2024-02-16T00:11:50.842936+0000","last_peered":"2024-02-16T00:11:50.842936+0000","last_clean":"2024-02-16T00:11:50.842936+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:11:50.842936+0000","last_undegraded":"2024-02-16T00:11:50.842936+0000","last_fullsized":"2024-02-16T00:11:50.842936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:08.473080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845216+0000","last_change":"2024-02-16T00:11:02.815829+0000","last_active":"2024-02-16T00:11:50.845216+0000","last_peered":"2024-02-16T00:11:50.845216+0000","last_clean":"2024-02-16T00:11:50.845216+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:11:50.845216+0000","last_undegraded":"2024-02-16T00:11:50.845216+0000","last_fullsized":"2024-02-16T00:11:50.845216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:04.562290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.892226+0000","last_change":"2024-02-16T00:11:06.809403+0000","last_active":"2024-02-16T00:12:27.892226+0000","last_peered":"2024-02-16T00:12:27.892226+0000","last_clean":"2024-02-16T00:12:27.892226+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:27.892226+0000","last_undegraded":"2024-02-16T00:12:27.892226+0000","last_fullsized":"2024-02-16T00:12:27.892226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:35.031327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":875,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":231,"num_read_kb":230,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'35","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.729956+0000","last_change":"2024-02-16T00:11:08.812928+0000","last_active":"2024-02-16T00:12:27.729956+0000","last_peered":"2024-02-16T00:12:27.729956+0000","last_clean":"2024-02-16T00:12:27.729956+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:27.729956+0000","last_undegraded":"2024-02-16T00:12:27.729956+0000","last_fullsized":"2024-02-16T00:12:27.729956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:45.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":52,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839358+0000","last_change":"2024-02-16T00:11:10.827306+0000","last_active":"2024-02-16T00:11:50.839358+0000","last_peered":"2024-02-16T00:11:50.839358+0000","last_clean":"2024-02-16T00:11:50.839358+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:11:50.839358+0000","last_undegraded":"2024-02-16T00:11:50.839358+0000","last_fullsized":"2024-02-16T00:11:50.839358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:46.792767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841996+0000","last_change":"2024-02-16T00:11:12.830200+0000","last_active":"2024-02-16T00:11:50.841996+0000","last_peered":"2024-02-16T00:11:50.841996+0000","last_clean":"2024-02-16T00:11:50.841996+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:11:50.841996+0000","last_undegraded":"2024-02-16T00:11:50.841996+0000","last_fullsized":"2024-02-16T00:11:50.841996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:34.641380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839696+0000","last_change":"2024-02-16T00:11:04.806595+0000","last_active":"2024-02-16T00:11:50.839696+0000","last_peered":"2024-02-16T00:11:50.839696+0000","last_clean":"2024-02-16T00:11:50.839696+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:11:50.839696+0000","last_undegraded":"2024-02-16T00:11:50.839696+0000","last_fullsized":"2024-02-16T00:11:50.839696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:15.344749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830815+0000","last_change":"2024-02-16T00:11:02.802098+0000","last_active":"2024-02-16T00:11:51.830815+0000","last_peered":"2024-02-16T00:11:51.830815+0000","last_clean":"2024-02-16T00:11:51.830815+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:11:51.830815+0000","last_undegraded":"2024-02-16T00:11:51.830815+0000","last_fullsized":"2024-02-16T00:11:51.830815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848845+0000","last_change":"2024-02-16T00:11:06.811600+0000","last_active":"2024-02-16T00:11:50.848845+0000","last_peered":"2024-02-16T00:11:50.848845+0000","last_clean":"2024-02-16T00:11:50.848845+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:11:50.848845+0000","last_undegraded":"2024-02-16T00:11:50.848845+0000","last_fullsized":"2024-02-16T00:11:50.848845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:02.997605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.753485+0000","last_change":"2024-02-16T00:11:08.814011+0000","last_active":"2024-02-16T00:12:27.753485+0000","last_peered":"2024-02-16T00:12:27.753485+0000","last_clean":"2024-02-16T00:12:27.753485+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:27.753485+0000","last_undegraded":"2024-02-16T00:12:27.753485+0000","last_fullsized":"2024-02-16T00:12:27.753485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:05.767514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839700+0000","last_change":"2024-02-16T00:11:10.831082+0000","last_active":"2024-02-16T00:11:50.839700+0000","last_peered":"2024-02-16T00:11:50.839700+0000","last_clean":"2024-02-16T00:11:50.839700+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:11:50.839700+0000","last_undegraded":"2024-02-16T00:11:50.839700+0000","last_fullsized":"2024-02-16T00:11:50.839700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:40.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844236+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:11:50.844236+0000","last_peered":"2024-02-16T00:11:50.844236+0000","last_clean":"2024-02-16T00:11:50.844236+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:11:50.844236+0000","last_undegraded":"2024-02-16T00:11:50.844236+0000","last_fullsized":"2024-02-16T00:11:50.844236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:12.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969458+0000","last_change":"2024-02-16T00:11:04.798644+0000","last_active":"2024-02-16T00:12:27.969458+0000","last_peered":"2024-02-16T00:12:27.969458+0000","last_clean":"2024-02-16T00:12:27.969458+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:12:27.969458+0000","last_undegraded":"2024-02-16T00:12:27.969458+0000","last_fullsized":"2024-02-16T00:12:27.969458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:26.014194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849586+0000","last_change":"2024-02-16T00:11:02.820199+0000","last_active":"2024-02-16T00:11:50.849586+0000","last_peered":"2024-02-16T00:11:50.849586+0000","last_clean":"2024-02-16T00:11:50.849586+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:11:50.849586+0000","last_undegraded":"2024-02-16T00:11:50.849586+0000","last_fullsized":"2024-02-16T00:11:50.849586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847851+0000","last_change":"2024-02-16T00:11:06.809034+0000","last_active":"2024-02-16T00:11:50.847851+0000","last_peered":"2024-02-16T00:11:50.847851+0000","last_clean":"2024-02-16T00:11:50.847851+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:11:50.847851+0000","last_undegraded":"2024-02-16T00:11:50.847851+0000","last_fullsized":"2024-02-16T00:11:50.847851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:17.352311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.756653+0000","last_change":"2024-02-16T00:11:08.814763+0000","last_active":"2024-02-16T00:12:27.756653+0000","last_peered":"2024-02-16T00:12:27.756653+0000","last_clean":"2024-02-16T00:12:27.756653+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:12:27.756653+0000","last_undegraded":"2024-02-16T00:12:27.756653+0000","last_fullsized":"2024-02-16T00:12:27.756653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:51:50.833249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829348+0000","last_change":"2024-02-16T00:11:10.819364+0000","last_active":"2024-02-16T00:11:51.829348+0000","last_peered":"2024-02-16T00:11:51.829348+0000","last_clean":"2024-02-16T00:11:51.829348+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:11:51.829348+0000","last_undegraded":"2024-02-16T00:11:51.829348+0000","last_fullsized":"2024-02-16T00:11:51.829348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:15.575681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841804+0000","last_change":"2024-02-16T00:11:12.831037+0000","last_active":"2024-02-16T00:11:50.841804+0000","last_peered":"2024-02-16T00:11:50.841804+0000","last_clean":"2024-02-16T00:11:50.841804+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:11:50.841804+0000","last_undegraded":"2024-02-16T00:11:50.841804+0000","last_fullsized":"2024-02-16T00:11:50.841804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:19.609072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322586+0000","last_change":"2024-02-16T00:11:04.813889+0000","last_active":"2024-02-16T00:12:27.322586+0000","last_peered":"2024-02-16T00:12:27.322586+0000","last_clean":"2024-02-16T00:12:27.322586+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:12:27.322586+0000","last_undegraded":"2024-02-16T00:12:27.322586+0000","last_fullsized":"2024-02-16T00:12:27.322586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:43.089230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843316+0000","last_change":"2024-02-16T00:11:02.816801+0000","last_active":"2024-02-16T00:11:50.843316+0000","last_peered":"2024-02-16T00:11:50.843316+0000","last_clean":"2024-02-16T00:11:50.843316+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:11:50.843316+0000","last_undegraded":"2024-02-16T00:11:50.843316+0000","last_fullsized":"2024-02-16T00:11:50.843316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322570+0000","last_change":"2024-02-16T00:11:04.801950+0000","last_active":"2024-02-16T00:12:27.322570+0000","last_peered":"2024-02-16T00:12:27.322570+0000","last_clean":"2024-02-16T00:12:27.322570+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:12:27.322570+0000","last_undegraded":"2024-02-16T00:12:27.322570+0000","last_fullsized":"2024-02-16T00:12:27.322570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:03.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828686+0000","last_change":"2024-02-16T00:11:02.808413+0000","last_active":"2024-02-16T00:11:51.828686+0000","last_peered":"2024-02-16T00:11:51.828686+0000","last_clean":"2024-02-16T00:11:51.828686+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:11:51.828686+0000","last_undegraded":"2024-02-16T00:11:51.828686+0000","last_fullsized":"2024-02-16T00:11:51.828686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845101+0000","last_change":"2024-02-16T00:11:04.810063+0000","last_active":"2024-02-16T00:11:50.845101+0000","last_peered":"2024-02-16T00:11:50.845101+0000","last_clean":"2024-02-16T00:11:50.845101+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:11:50.845101+0000","last_undegraded":"2024-02-16T00:11:50.845101+0000","last_fullsized":"2024-02-16T00:11:50.845101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:09.293991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840012+0000","last_change":"2024-02-16T00:11:02.824009+0000","last_active":"2024-02-16T00:11:50.840012+0000","last_peered":"2024-02-16T00:11:50.840012+0000","last_clean":"2024-02-16T00:11:50.840012+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:11:50.840012+0000","last_undegraded":"2024-02-16T00:11:50.840012+0000","last_fullsized":"2024-02-16T00:11:50.840012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:08.487886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831276+0000","last_change":"2024-02-16T00:11:04.801764+0000","last_active":"2024-02-16T00:11:51.831276+0000","last_peered":"2024-02-16T00:11:51.831276+0000","last_clean":"2024-02-16T00:11:51.831276+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:11:51.831276+0000","last_undegraded":"2024-02-16T00:11:51.831276+0000","last_fullsized":"2024-02-16T00:11:51.831276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830270+0000","last_change":"2024-02-16T00:11:02.797510+0000","last_active":"2024-02-16T00:11:51.830270+0000","last_peered":"2024-02-16T00:11:51.830270+0000","last_clean":"2024-02-16T00:11:51.830270+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:11:51.830270+0000","last_undegraded":"2024-02-16T00:11:51.830270+0000","last_fullsized":"2024-02-16T00:11:51.830270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830000+0000","last_change":"2024-02-16T00:11:04.810324+0000","last_active":"2024-02-16T00:11:51.830000+0000","last_peered":"2024-02-16T00:11:51.830000+0000","last_clean":"2024-02-16T00:11:51.830000+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:11:51.830000+0000","last_undegraded":"2024-02-16T00:11:51.830000+0000","last_fullsized":"2024-02-16T00:11:51.830000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:31.576677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831427+0000","last_change":"2024-02-16T00:11:02.801630+0000","last_active":"2024-02-16T00:11:51.831427+0000","last_peered":"2024-02-16T00:11:51.831427+0000","last_clean":"2024-02-16T00:11:51.831427+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:11:51.831427+0000","last_undegraded":"2024-02-16T00:11:51.831427+0000","last_fullsized":"2024-02-16T00:11:51.831427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:16.857323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322847+0000","last_change":"2024-02-16T00:11:04.814522+0000","last_active":"2024-02-16T00:12:27.322847+0000","last_peered":"2024-02-16T00:12:27.322847+0000","last_clean":"2024-02-16T00:12:27.322847+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:12:27.322847+0000","last_undegraded":"2024-02-16T00:12:27.322847+0000","last_fullsized":"2024-02-16T00:12:27.322847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:22:13.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846889+0000","last_change":"2024-02-16T00:11:02.810745+0000","last_active":"2024-02-16T00:11:50.846889+0000","last_peered":"2024-02-16T00:11:50.846889+0000","last_clean":"2024-02-16T00:11:50.846889+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:11:50.846889+0000","last_undegraded":"2024-02-16T00:11:50.846889+0000","last_fullsized":"2024-02-16T00:11:50.846889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'13","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829704+0000","last_change":"2024-02-16T00:11:04.797743+0000","last_active":"2024-02-16T00:11:51.829704+0000","last_peered":"2024-02-16T00:11:51.829704+0000","last_clean":"2024-02-16T00:11:51.829704+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:11:51.829704+0000","last_undegraded":"2024-02-16T00:11:51.829704+0000","last_fullsized":"2024-02-16T00:11:51.829704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842219+0000","last_change":"2024-02-16T00:11:02.815909+0000","last_active":"2024-02-16T00:11:50.842219+0000","last_peered":"2024-02-16T00:11:50.842219+0000","last_clean":"2024-02-16T00:11:50.842219+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:11:50.842219+0000","last_undegraded":"2024-02-16T00:11:50.842219+0000","last_fullsized":"2024-02-16T00:11:50.842219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322807+0000","last_change":"2024-02-16T00:11:04.796966+0000","last_active":"2024-02-16T00:12:27.322807+0000","last_peered":"2024-02-16T00:12:27.322807+0000","last_clean":"2024-02-16T00:12:27.322807+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:12:27.322807+0000","last_undegraded":"2024-02-16T00:12:27.322807+0000","last_fullsized":"2024-02-16T00:12:27.322807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:39.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830839+0000","last_change":"2024-02-16T00:11:02.797604+0000","last_active":"2024-02-16T00:11:51.830839+0000","last_peered":"2024-02-16T00:11:51.830839+0000","last_clean":"2024-02-16T00:11:51.830839+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:11:51.830839+0000","last_undegraded":"2024-02-16T00:11:51.830839+0000","last_fullsized":"2024-02-16T00:11:51.830839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:42.572100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.850078+0000","last_change":"2024-02-16T00:11:04.802856+0000","last_active":"2024-02-16T00:11:50.850078+0000","last_peered":"2024-02-16T00:11:50.850078+0000","last_clean":"2024-02-16T00:11:50.850078+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:11:50.850078+0000","last_undegraded":"2024-02-16T00:11:50.850078+0000","last_fullsized":"2024-02-16T00:11:50.850078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:47:42.006974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839685+0000","last_change":"2024-02-16T00:11:02.820947+0000","last_active":"2024-02-16T00:11:50.839685+0000","last_peered":"2024-02-16T00:11:50.839685+0000","last_clean":"2024-02-16T00:11:50.839685+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:11:50.839685+0000","last_undegraded":"2024-02-16T00:11:50.839685+0000","last_fullsized":"2024-02-16T00:11:50.839685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:21.162020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969475+0000","last_change":"2024-02-16T00:11:04.807293+0000","last_active":"2024-02-16T00:12:27.969475+0000","last_peered":"2024-02-16T00:12:27.969475+0000","last_clean":"2024-02-16T00:12:27.969475+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:12:27.969475+0000","last_undegraded":"2024-02-16T00:12:27.969475+0000","last_fullsized":"2024-02-16T00:12:27.969475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:41.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828960+0000","last_change":"2024-02-16T00:11:02.797276+0000","last_active":"2024-02-16T00:11:51.828960+0000","last_peered":"2024-02-16T00:11:51.828960+0000","last_clean":"2024-02-16T00:11:51.828960+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:11:51.828960+0000","last_undegraded":"2024-02-16T00:11:51.828960+0000","last_fullsized":"2024-02-16T00:11:51.828960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831738+0000","last_change":"2024-02-16T00:11:04.812406+0000","last_active":"2024-02-16T00:11:51.831738+0000","last_peered":"2024-02-16T00:11:51.831738+0000","last_clean":"2024-02-16T00:11:51.831738+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:11:51.831738+0000","last_undegraded":"2024-02-16T00:11:51.831738+0000","last_fullsized":"2024-02-16T00:11:51.831738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847992+0000","last_change":"2024-02-16T00:11:02.809533+0000","last_active":"2024-02-16T00:11:50.847992+0000","last_peered":"2024-02-16T00:11:50.847992+0000","last_clean":"2024-02-16T00:11:50.847992+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:11:50.847992+0000","last_undegraded":"2024-02-16T00:11:50.847992+0000","last_fullsized":"2024-02-16T00:11:50.847992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969462+0000","last_change":"2024-02-16T00:11:04.796459+0000","last_active":"2024-02-16T00:12:27.969462+0000","last_peered":"2024-02-16T00:12:27.969462+0000","last_clean":"2024-02-16T00:12:27.969462+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:12:27.969462+0000","last_undegraded":"2024-02-16T00:12:27.969462+0000","last_fullsized":"2024-02-16T00:12:27.969462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:34.974228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846880+0000","last_change":"2024-02-16T00:11:02.796731+0000","last_active":"2024-02-16T00:11:50.846880+0000","last_peered":"2024-02-16T00:11:50.846880+0000","last_clean":"2024-02-16T00:11:50.846880+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:11:50.846880+0000","last_undegraded":"2024-02-16T00:11:50.846880+0000","last_fullsized":"2024-02-16T00:11:50.846880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847935+0000","last_change":"2024-02-16T00:11:04.814979+0000","last_active":"2024-02-16T00:11:50.847935+0000","last_peered":"2024-02-16T00:11:50.847935+0000","last_clean":"2024-02-16T00:11:50.847935+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:11:50.847935+0000","last_undegraded":"2024-02-16T00:11:50.847935+0000","last_fullsized":"2024-02-16T00:11:50.847935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:45.811771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842495+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:11:50.842495+0000","last_peered":"2024-02-16T00:11:50.842495+0000","last_clean":"2024-02-16T00:11:50.842495+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:11:50.842495+0000","last_undegraded":"2024-02-16T00:11:50.842495+0000","last_fullsized":"2024-02-16T00:11:50.842495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:23.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848738+0000","last_change":"2024-02-16T00:11:04.803538+0000","last_active":"2024-02-16T00:11:50.848738+0000","last_peered":"2024-02-16T00:11:50.848738+0000","last_clean":"2024-02-16T00:11:50.848738+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:11:50.848738+0000","last_undegraded":"2024-02-16T00:11:50.848738+0000","last_fullsized":"2024-02-16T00:11:50.848738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:47.811172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845428+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:11:50.845428+0000","last_peered":"2024-02-16T00:11:50.845428+0000","last_clean":"2024-02-16T00:11:50.845428+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:11:50.845428+0000","last_undegraded":"2024-02-16T00:11:50.845428+0000","last_fullsized":"2024-02-16T00:11:50.845428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:06.466729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840720+0000","last_change":"2024-02-16T00:11:04.808274+0000","last_active":"2024-02-16T00:11:50.840720+0000","last_peered":"2024-02-16T00:11:50.840720+0000","last_clean":"2024-02-16T00:11:50.840720+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:11:50.840720+0000","last_undegraded":"2024-02-16T00:11:50.840720+0000","last_fullsized":"2024-02-16T00:11:50.840720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:36.866397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842918+0000","last_change":"2024-02-16T00:11:02.816585+0000","last_active":"2024-02-16T00:11:50.842918+0000","last_peered":"2024-02-16T00:11:50.842918+0000","last_clean":"2024-02-16T00:11:50.842918+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:11:50.842918+0000","last_undegraded":"2024-02-16T00:11:50.842918+0000","last_fullsized":"2024-02-16T00:11:50.842918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848533+0000","last_change":"2024-02-16T00:11:04.798394+0000","last_active":"2024-02-16T00:11:50.848533+0000","last_peered":"2024-02-16T00:11:50.848533+0000","last_clean":"2024-02-16T00:11:50.848533+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:11:50.848533+0000","last_undegraded":"2024-02-16T00:11:50.848533+0000","last_fullsized":"2024-02-16T00:11:50.848533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:30:00.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843889+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:11:50.843889+0000","last_peered":"2024-02-16T00:11:50.843889+0000","last_clean":"2024-02-16T00:11:50.843889+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:11:50.843889+0000","last_undegraded":"2024-02-16T00:11:50.843889+0000","last_fullsized":"2024-02-16T00:11:50.843889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:01.906683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840067+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:11:50.840067+0000","last_peered":"2024-02-16T00:11:50.840067+0000","last_clean":"2024-02-16T00:11:50.840067+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:11:50.840067+0000","last_undegraded":"2024-02-16T00:11:50.840067+0000","last_fullsized":"2024-02-16T00:11:50.840067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:04.771435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831287+0000","last_change":"2024-02-16T00:11:04.798473+0000","last_active":"2024-02-16T00:11:51.831287+0000","last_peered":"2024-02-16T00:11:51.831287+0000","last_clean":"2024-02-16T00:11:51.831287+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:11:51.831287+0000","last_undegraded":"2024-02-16T00:11:51.831287+0000","last_fullsized":"2024-02-16T00:11:51.831287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:22:13.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829177+0000","last_change":"2024-02-16T00:11:02.808092+0000","last_active":"2024-02-16T00:11:51.829177+0000","last_peered":"2024-02-16T00:11:51.829177+0000","last_clean":"2024-02-16T00:11:51.829177+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:11:51.829177+0000","last_undegraded":"2024-02-16T00:11:51.829177+0000","last_fullsized":"2024-02-16T00:11:51.829177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848586+0000","last_change":"2024-02-16T00:11:04.814263+0000","last_active":"2024-02-16T00:11:50.848586+0000","last_peered":"2024-02-16T00:11:50.848586+0000","last_clean":"2024-02-16T00:11:50.848586+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:11:50.848586+0000","last_undegraded":"2024-02-16T00:11:50.848586+0000","last_fullsized":"2024-02-16T00:11:50.848586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:23.700793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1408,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":451,"num_read_kb":420,"num_write":288,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1816,"ondisk_log_size":1816,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":1607,"num_read_kb":1358,"num_write":691,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1318,"ondisk_log_size":1318,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":760,"num_read_kb":759,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":894,"num_read_kb":840,"num_write":279,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":252,"ondisk_log_size":252,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":48,"num_write":162,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705685,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":143431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705686,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40452,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331388,"statfs":{"total":96636764160,"available":96595341312,"internally_reserved":0,"allocated":978944,"data_stored":728362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.29299999999999998}]},{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.215},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.26800000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.251}]}]},{"osd":1,"up_from":9,"seq":38654705685,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":1003520,"data_stored":728724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.314}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.193},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.22800000000000001}]},{"osd":3,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.249},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.27100000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705686,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":421888,"data_stored":142310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:12:35.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:12:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.773+0000 7fb2f1074640 1 Processor -- start 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.773+0000 7fb2f1074640 1 -- start start 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.773+0000 7fb2f1074640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2ec0993f0 0x7fb2ec133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.773+0000 7fb2f1074640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec09dc90 con 0x7fb2ec098900 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.773+0000 7fb2f1074640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec09a170 con 0x7fb2ec0993f0 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.774+0000 7fb2ea59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2ec0993f0 0x7fb2ec133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.774+0000 7fb2ead9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb2ec098900 0x7fb2ec098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60626/0 (socket says 172.21.15.2:60626) 2024-02-16T00:12:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.774+0000 7fb2ead9d640 1 -- 172.21.15.2:0/3277445920 learned_addr learned my addr 172.21.15.2:0/3277445920 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.774+0000 7fb2ea59c640 1 -- 172.21.15.2:0/3277445920 >> v1:172.21.15.2:6789/0 conn(0x7fb2ec098900 legacy=0x7fb2ec098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.774+0000 7fb2e9d9b640 1 -- 172.21.15.2:0/3277445920 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753426509 0 0) 0x7fb2ec09dc90 con 0x7fb2ec098900 2024-02-16T00:12:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.774+0000 7fb2ea59c640 1 -- 172.21.15.2:0/3277445920 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec099d30 con 0x7fb2ec0993f0 2024-02-16T00:12:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2ea59c640 1 --2- 172.21.15.2:0/3277445920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec0993f0 0x7fb2ec133350 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009720 tx=0x7fb2d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b142de50751a37c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2e9d9b640 1 -- 172.21.15.2:0/3277445920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2d402e070 con 0x7fb2ec0993f0 2024-02-16T00:12:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2e9d9b640 1 -- 172.21.15.2:0/3277445920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d40316d0 con 0x7fb2ec0993f0 2024-02-16T00:12:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2e9d9b640 1 -- 172.21.15.2:0/3277445920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2d4031990 con 0x7fb2ec0993f0 2024-02-16T00:12:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 -- 172.21.15.2:0/3277445920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec0993f0 msgr2=0x7fb2ec133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 --2- 172.21.15.2:0/3277445920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec0993f0 0x7fb2ec133350 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009720 tx=0x7fb2d402b840 comp rx=0 tx=0).stop 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 -- 172.21.15.2:0/3277445920 shutdown_connections 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 --2- 172.21.15.2:0/3277445920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec0993f0 0x7fb2ec133350 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 -- 172.21.15.2:0/3277445920 >> 172.21.15.2:0/3277445920 conn(0x7fb2ec0a0a20 msgr2=0x7fb2ec09cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 -- 172.21.15.2:0/3277445920 shutdown_connections 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.775+0000 7fb2f1074640 1 -- 172.21.15.2:0/3277445920 wait complete. 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.776+0000 7fb2f1074640 1 Processor -- start 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.776+0000 7fb2f1074640 1 -- start start 2024-02-16T00:12:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2f1074640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 0x7fb2ec06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2f1074640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec12c2a0 con 0x7fb2ec098900 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 0x7fb2ec06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 0x7fb2ec06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38430/0 (socket says 172.21.15.2:38430) 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2ead9d640 1 -- 172.21.15.2:0/2296003281 learned_addr learned my addr 172.21.15.2:0/2296003281 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2ead9d640 1 -- 172.21.15.2:0/2296003281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009400 con 0x7fb2ec098900 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2ead9d640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 0x7fb2ec06fca0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c420 tx=0x7fb2e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2e40074d0 con 0x7fb2ec098900 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4007630 con 0x7fb2ec098900 2024-02-16T00:12:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.777+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec12c860 con 0x7fb2ec098900 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.778+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4004950 con 0x7fb2ec098900 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.778+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec071c90 con 0x7fb2ec098900 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.778+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb2e4004b70 con 0x7fb2ec098900 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.778+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec0627b0 con 0x7fb2ec098900 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.778+0000 7fb2e37fe640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb2cc037ea0 0x7fb2cc03a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.779+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fb2e404aa30 con 0x7fb2ec098900 2024-02-16T00:12:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.779+0000 7fb2ea59c640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb2cc037ea0 0x7fb2cc03a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.779+0000 7fb2ea59c640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb2cc037ea0 0x7fb2cc03a360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4036000 tx=0x7fb2d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.783+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2e401abe0 con 0x7fb2ec098900 2024-02-16T00:12:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.957+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2ec09d7e0 con 0x7fb2cc037ea0 2024-02-16T00:12:35.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.974+0000 7fb2e37fe640 1 -- 172.21.15.2:0/2296003281 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673164 (secure 0 0 0) 0x7fb2d4031b80 con 0x7fb2cc037ea0 2024-02-16T00:12:35.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:12:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:12:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb2cc037ea0 msgr2=0x7fb2cc03a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb2cc037ea0 0x7fb2cc03a360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4036000 tx=0x7fb2d4008030 comp rx=0 tx=0).stop 2024-02-16T00:12:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 msgr2=0x7fb2ec06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 0x7fb2ec06fca0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c420 tx=0x7fb2e400c8e0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 shutdown_connections 2024-02-16T00:12:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb2cc037ea0 0x7fb2cc03a360 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 --2- 172.21.15.2:0/2296003281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec098900 0x7fb2ec06fca0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 >> 172.21.15.2:0/2296003281 conn(0x7fb2ec0a0a20 msgr2=0x7fb2ec09b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 shutdown_connections 2024-02-16T00:12:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:35.978+0000 7fb2f1074640 1 -- 172.21.15.2:0/2296003281 wait complete. 2024-02-16T00:12:35.993 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-02-16T00:12:35.696671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600040,"num_objects":243,"num_object_clones":0,"num_object_copies":487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":243,"num_whiteouts":0,"num_read":4053,"num_read_kb":3665,"num_write":1629,"num_write_kb":31917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3851,"ondisk_log_size":3851,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148252,"kb_used_data":2748,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339108,"statfs":{"total":386547056640,"available":386395246592,"internally_reserved":0,"allocated":2813952,"data_stored":1741233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-368,"num_objects":-3,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":0,"num_read":536,"num_read_kb":523,"num_write":151,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003497"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842072+0000","last_change":"2024-02-16T00:11:02.804024+0000","last_active":"2024-02-16T00:11:50.842072+0000","last_peered":"2024-02-16T00:11:50.842072+0000","last_clean":"2024-02-16T00:11:50.842072+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:11:50.842072+0000","last_undegraded":"2024-02-16T00:11:50.842072+0000","last_fullsized":"2024-02-16T00:11:50.842072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848062+0000","last_change":"2024-02-16T00:11:04.803215+0000","last_active":"2024-02-16T00:11:50.848062+0000","last_peered":"2024-02-16T00:11:50.848062+0000","last_clean":"2024-02-16T00:11:50.848062+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:11:50.848062+0000","last_undegraded":"2024-02-16T00:11:50.848062+0000","last_fullsized":"2024-02-16T00:11:50.848062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:23.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830974+0000","last_change":"2024-02-16T00:11:02.797595+0000","last_active":"2024-02-16T00:11:51.830974+0000","last_peered":"2024-02-16T00:11:51.830974+0000","last_clean":"2024-02-16T00:11:51.830974+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:11:51.830974+0000","last_undegraded":"2024-02-16T00:11:51.830974+0000","last_fullsized":"2024-02-16T00:11:51.830974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840747+0000","last_change":"2024-02-16T00:11:04.803831+0000","last_active":"2024-02-16T00:11:50.840747+0000","last_peered":"2024-02-16T00:11:50.840747+0000","last_clean":"2024-02-16T00:11:50.840747+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:11:50.840747+0000","last_undegraded":"2024-02-16T00:11:50.840747+0000","last_fullsized":"2024-02-16T00:11:50.840747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.330427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845795+0000","last_change":"2024-02-16T00:11:02.815592+0000","last_active":"2024-02-16T00:11:50.845795+0000","last_peered":"2024-02-16T00:11:50.845795+0000","last_clean":"2024-02-16T00:11:50.845795+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:11:50.845795+0000","last_undegraded":"2024-02-16T00:11:50.845795+0000","last_fullsized":"2024-02-16T00:11:50.845795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:21.438654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840544+0000","last_change":"2024-02-16T00:11:04.807406+0000","last_active":"2024-02-16T00:11:50.840544+0000","last_peered":"2024-02-16T00:11:50.840544+0000","last_clean":"2024-02-16T00:11:50.840544+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:11:50.840544+0000","last_undegraded":"2024-02-16T00:11:50.840544+0000","last_fullsized":"2024-02-16T00:11:50.840544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:41.270560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843729+0000","last_change":"2024-02-16T00:11:02.818929+0000","last_active":"2024-02-16T00:11:50.843729+0000","last_peered":"2024-02-16T00:11:50.843729+0000","last_clean":"2024-02-16T00:11:50.843729+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:11:50.843729+0000","last_undegraded":"2024-02-16T00:11:50.843729+0000","last_fullsized":"2024-02-16T00:11:50.843729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'7","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322677+0000","last_change":"2024-02-16T00:11:04.807900+0000","last_active":"2024-02-16T00:12:27.322677+0000","last_peered":"2024-02-16T00:12:27.322677+0000","last_clean":"2024-02-16T00:12:27.322677+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:12:27.322677+0000","last_undegraded":"2024-02-16T00:12:27.322677+0000","last_fullsized":"2024-02-16T00:12:27.322677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:18.898214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841183+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:11:50.841183+0000","last_peered":"2024-02-16T00:11:50.841183+0000","last_clean":"2024-02-16T00:11:50.841183+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:11:50.841183+0000","last_undegraded":"2024-02-16T00:11:50.841183+0000","last_fullsized":"2024-02-16T00:11:50.841183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:24.007843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846803+0000","last_change":"2024-02-16T00:11:04.797530+0000","last_active":"2024-02-16T00:11:50.846803+0000","last_peered":"2024-02-16T00:11:50.846803+0000","last_clean":"2024-02-16T00:11:50.846803+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:11:50.846803+0000","last_undegraded":"2024-02-16T00:11:50.846803+0000","last_fullsized":"2024-02-16T00:11:50.846803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:39:54.175731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.442430+0000","last_change":"2024-02-16T00:11:02.803398+0000","last_active":"2024-02-16T00:12:33.442430+0000","last_peered":"2024-02-16T00:12:33.442430+0000","last_clean":"2024-02-16T00:12:33.442430+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:12:33.442430+0000","last_undegraded":"2024-02-16T00:12:33.442430+0000","last_fullsized":"2024-02-16T00:12:33.442430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844846+0000","last_change":"2024-02-16T00:11:04.809182+0000","last_active":"2024-02-16T00:11:50.844846+0000","last_peered":"2024-02-16T00:11:50.844846+0000","last_clean":"2024-02-16T00:11:50.844846+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:11:50.844846+0000","last_undegraded":"2024-02-16T00:11:50.844846+0000","last_fullsized":"2024-02-16T00:11:50.844846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:55.430651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840324+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:11:50.840324+0000","last_peered":"2024-02-16T00:11:50.840324+0000","last_clean":"2024-02-16T00:11:50.840324+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:11:50.840324+0000","last_undegraded":"2024-02-16T00:11:50.840324+0000","last_fullsized":"2024-02-16T00:11:50.840324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:28:12.323667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843211+0000","last_change":"2024-02-16T00:11:04.798579+0000","last_active":"2024-02-16T00:11:50.843211+0000","last_peered":"2024-02-16T00:11:50.843211+0000","last_clean":"2024-02-16T00:11:50.843211+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:11:50.843211+0000","last_undegraded":"2024-02-16T00:11:50.843211+0000","last_fullsized":"2024-02-16T00:11:50.843211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828879+0000","last_change":"2024-02-16T00:11:02.808083+0000","last_active":"2024-02-16T00:11:51.828879+0000","last_peered":"2024-02-16T00:11:51.828879+0000","last_clean":"2024-02-16T00:11:51.828879+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:11:51.828879+0000","last_undegraded":"2024-02-16T00:11:51.828879+0000","last_fullsized":"2024-02-16T00:11:51.828879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447599+0000","last_change":"2024-02-16T00:11:04.808709+0000","last_active":"2024-02-16T00:12:33.447599+0000","last_peered":"2024-02-16T00:12:33.447599+0000","last_clean":"2024-02-16T00:12:33.447599+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:12:33.447599+0000","last_undegraded":"2024-02-16T00:12:33.447599+0000","last_fullsized":"2024-02-16T00:12:33.447599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840576+0000","last_change":"2024-02-16T00:11:04.807676+0000","last_active":"2024-02-16T00:11:50.840576+0000","last_peered":"2024-02-16T00:11:50.840576+0000","last_clean":"2024-02-16T00:11:50.840576+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:11:50.840576+0000","last_undegraded":"2024-02-16T00:11:50.840576+0000","last_fullsized":"2024-02-16T00:11:50.840576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:13.340758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849691+0000","last_change":"2024-02-16T00:11:02.820441+0000","last_active":"2024-02-16T00:11:50.849691+0000","last_peered":"2024-02-16T00:11:50.849691+0000","last_clean":"2024-02-16T00:11:50.849691+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:11:50.849691+0000","last_undegraded":"2024-02-16T00:11:50.849691+0000","last_fullsized":"2024-02-16T00:11:50.849691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847661+0000","last_change":"2024-02-16T00:11:04.798908+0000","last_active":"2024-02-16T00:11:50.847661+0000","last_peered":"2024-02-16T00:11:50.847661+0000","last_clean":"2024-02-16T00:11:50.847661+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:11:50.847661+0000","last_undegraded":"2024-02-16T00:11:50.847661+0000","last_fullsized":"2024-02-16T00:11:50.847661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843030+0000","last_change":"2024-02-16T00:11:02.817331+0000","last_active":"2024-02-16T00:11:50.843030+0000","last_peered":"2024-02-16T00:11:50.843030+0000","last_clean":"2024-02-16T00:11:50.843030+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:11:50.843030+0000","last_undegraded":"2024-02-16T00:11:50.843030+0000","last_fullsized":"2024-02-16T00:11:50.843030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848232+0000","last_change":"2024-02-16T00:11:04.803702+0000","last_active":"2024-02-16T00:11:50.848232+0000","last_peered":"2024-02-16T00:11:50.848232+0000","last_clean":"2024-02-16T00:11:50.848232+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:11:50.848232+0000","last_undegraded":"2024-02-16T00:11:50.848232+0000","last_fullsized":"2024-02-16T00:11:50.848232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:03.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847158+0000","last_change":"2024-02-16T00:11:02.810700+0000","last_active":"2024-02-16T00:11:50.847158+0000","last_peered":"2024-02-16T00:11:50.847158+0000","last_clean":"2024-02-16T00:11:50.847158+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:11:50.847158+0000","last_undegraded":"2024-02-16T00:11:50.847158+0000","last_fullsized":"2024-02-16T00:11:50.847158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830790+0000","last_change":"2024-02-16T00:11:04.810242+0000","last_active":"2024-02-16T00:11:51.830790+0000","last_peered":"2024-02-16T00:11:51.830790+0000","last_clean":"2024-02-16T00:11:51.830790+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:11:51.830790+0000","last_undegraded":"2024-02-16T00:11:51.830790+0000","last_fullsized":"2024-02-16T00:11:51.830790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847357+0000","last_change":"2024-02-16T00:11:02.825186+0000","last_active":"2024-02-16T00:11:50.847357+0000","last_peered":"2024-02-16T00:11:50.847357+0000","last_clean":"2024-02-16T00:11:50.847357+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:11:50.847357+0000","last_undegraded":"2024-02-16T00:11:50.847357+0000","last_fullsized":"2024-02-16T00:11:50.847357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969995+0000","last_change":"2024-02-16T00:11:04.812055+0000","last_active":"2024-02-16T00:12:27.969995+0000","last_peered":"2024-02-16T00:12:27.969995+0000","last_clean":"2024-02-16T00:12:27.969995+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:12:27.969995+0000","last_undegraded":"2024-02-16T00:12:27.969995+0000","last_fullsized":"2024-02-16T00:12:27.969995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830403+0000","last_change":"2024-02-16T00:11:02.797860+0000","last_active":"2024-02-16T00:11:51.830403+0000","last_peered":"2024-02-16T00:11:51.830403+0000","last_clean":"2024-02-16T00:11:51.830403+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:11:51.830403+0000","last_undegraded":"2024-02-16T00:11:51.830403+0000","last_fullsized":"2024-02-16T00:11:51.830403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969670+0000","last_change":"2024-02-16T00:11:04.797835+0000","last_active":"2024-02-16T00:12:27.969670+0000","last_peered":"2024-02-16T00:12:27.969670+0000","last_clean":"2024-02-16T00:12:27.969670+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:12:27.969670+0000","last_undegraded":"2024-02-16T00:12:27.969670+0000","last_fullsized":"2024-02-16T00:12:27.969670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:17.940025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840296+0000","last_change":"2024-02-16T00:11:02.817356+0000","last_active":"2024-02-16T00:11:50.840296+0000","last_peered":"2024-02-16T00:11:50.840296+0000","last_clean":"2024-02-16T00:11:50.840296+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:11:50.840296+0000","last_undegraded":"2024-02-16T00:11:50.840296+0000","last_fullsized":"2024-02-16T00:11:50.840296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:36:34.654920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'19","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.437086+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:33.437086+0000","last_peered":"2024-02-16T00:12:33.437086+0000","last_clean":"2024-02-16T00:12:33.437086+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:33.437086+0000","last_undegraded":"2024-02-16T00:12:33.437086+0000","last_fullsized":"2024-02-16T00:12:33.437086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:34.754053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842557+0000","last_change":"2024-02-16T00:11:04.804063+0000","last_active":"2024-02-16T00:11:50.842557+0000","last_peered":"2024-02-16T00:11:50.842557+0000","last_clean":"2024-02-16T00:11:50.842557+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:11:50.842557+0000","last_undegraded":"2024-02-16T00:11:50.842557+0000","last_fullsized":"2024-02-16T00:11:50.842557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:41.137481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840923+0000","last_change":"2024-02-16T00:11:02.823865+0000","last_active":"2024-02-16T00:11:50.840923+0000","last_peered":"2024-02-16T00:11:50.840923+0000","last_clean":"2024-02-16T00:11:50.840923+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:11:50.840923+0000","last_undegraded":"2024-02-16T00:11:50.840923+0000","last_fullsized":"2024-02-16T00:11:50.840923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.696986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844686+0000","last_change":"2024-02-16T00:11:06.805693+0000","last_active":"2024-02-16T00:11:50.844686+0000","last_peered":"2024-02-16T00:11:50.844686+0000","last_clean":"2024-02-16T00:11:50.844686+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:11:50.844686+0000","last_undegraded":"2024-02-16T00:11:50.844686+0000","last_fullsized":"2024-02-16T00:11:50.844686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:26.998512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'40","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.944224+0000","last_change":"2024-02-16T00:11:08.812405+0000","last_active":"2024-02-16T00:12:27.944224+0000","last_peered":"2024-02-16T00:12:27.944224+0000","last_clean":"2024-02-16T00:12:27.944224+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:27.944224+0000","last_undegraded":"2024-02-16T00:12:27.944224+0000","last_fullsized":"2024-02-16T00:12:27.944224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:52.688126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849593+0000","last_change":"2024-02-16T00:11:10.827632+0000","last_active":"2024-02-16T00:11:50.849593+0000","last_peered":"2024-02-16T00:11:50.849593+0000","last_clean":"2024-02-16T00:11:50.849593+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:11:50.849593+0000","last_undegraded":"2024-02-16T00:11:50.849593+0000","last_fullsized":"2024-02-16T00:11:50.849593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:33.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.281521+0000","last_change":"2024-02-16T00:11:12.835250+0000","last_active":"2024-02-16T00:12:22.281521+0000","last_peered":"2024-02-16T00:12:22.281521+0000","last_clean":"2024-02-16T00:12:22.281521+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:12:22.281521+0000","last_undegraded":"2024-02-16T00:12:22.281521+0000","last_fullsized":"2024-02-16T00:12:22.281521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:33.641560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845318+0000","last_change":"2024-02-16T00:11:04.811172+0000","last_active":"2024-02-16T00:11:50.845318+0000","last_peered":"2024-02-16T00:11:50.845318+0000","last_clean":"2024-02-16T00:11:50.845318+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:11:50.845318+0000","last_undegraded":"2024-02-16T00:11:50.845318+0000","last_fullsized":"2024-02-16T00:11:50.845318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:25.462988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842875+0000","last_change":"2024-02-16T00:11:02.817929+0000","last_active":"2024-02-16T00:11:50.842875+0000","last_peered":"2024-02-16T00:11:50.842875+0000","last_clean":"2024-02-16T00:11:50.842875+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:11:50.842875+0000","last_undegraded":"2024-02-16T00:11:50.842875+0000","last_fullsized":"2024-02-16T00:11:50.842875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829901+0000","last_change":"2024-02-16T00:11:06.803389+0000","last_active":"2024-02-16T00:11:51.829901+0000","last_peered":"2024-02-16T00:11:51.829901+0000","last_clean":"2024-02-16T00:11:51.829901+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:11:51.829901+0000","last_undegraded":"2024-02-16T00:11:51.829901+0000","last_fullsized":"2024-02-16T00:11:51.829901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:31.755567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'12","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848533+0000","last_change":"2024-02-16T00:11:08.813382+0000","last_active":"2024-02-16T00:11:50.848533+0000","last_peered":"2024-02-16T00:11:50.848533+0000","last_clean":"2024-02-16T00:11:50.848533+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:11:50.848533+0000","last_undegraded":"2024-02-16T00:11:50.848533+0000","last_fullsized":"2024-02-16T00:11:50.848533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:56.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848536+0000","last_change":"2024-02-16T00:11:10.823836+0000","last_active":"2024-02-16T00:11:50.848536+0000","last_peered":"2024-02-16T00:11:50.848536+0000","last_clean":"2024-02-16T00:11:50.848536+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:11:50.848536+0000","last_undegraded":"2024-02-16T00:11:50.848536+0000","last_fullsized":"2024-02-16T00:11:50.848536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:15.575681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828823+0000","last_change":"2024-02-16T00:11:12.828416+0000","last_active":"2024-02-16T00:11:51.828823+0000","last_peered":"2024-02-16T00:11:51.828823+0000","last_clean":"2024-02-16T00:11:51.828823+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:11:51.828823+0000","last_undegraded":"2024-02-16T00:11:51.828823+0000","last_fullsized":"2024-02-16T00:11:51.828823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:38.040980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844918+0000","last_change":"2024-02-16T00:11:04.803967+0000","last_active":"2024-02-16T00:11:50.844918+0000","last_peered":"2024-02-16T00:11:50.844918+0000","last_clean":"2024-02-16T00:11:50.844918+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:11:50.844918+0000","last_undegraded":"2024-02-16T00:11:50.844918+0000","last_fullsized":"2024-02-16T00:11:50.844918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:24.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839683+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:11:50.839683+0000","last_peered":"2024-02-16T00:11:50.839683+0000","last_clean":"2024-02-16T00:11:50.839683+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:11:50.839683+0000","last_undegraded":"2024-02-16T00:11:50.839683+0000","last_fullsized":"2024-02-16T00:11:50.839683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:20.668173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831728+0000","last_change":"2024-02-16T00:11:06.804875+0000","last_active":"2024-02-16T00:11:51.831728+0000","last_peered":"2024-02-16T00:11:51.831728+0000","last_clean":"2024-02-16T00:11:51.831728+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:11:51.831728+0000","last_undegraded":"2024-02-16T00:11:51.831728+0000","last_fullsized":"2024-02-16T00:11:51.831728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:38.469870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845030+0000","last_change":"2024-02-16T00:11:08.813640+0000","last_active":"2024-02-16T00:11:50.845030+0000","last_peered":"2024-02-16T00:11:50.845030+0000","last_clean":"2024-02-16T00:11:50.845030+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:11:50.845030+0000","last_undegraded":"2024-02-16T00:11:50.845030+0000","last_fullsized":"2024-02-16T00:11:50.845030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:39.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'239","reported_seq":311,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.617293+0000","last_change":"2024-02-16T00:11:10.830884+0000","last_active":"2024-02-16T00:12:33.617293+0000","last_peered":"2024-02-16T00:12:33.617293+0000","last_clean":"2024-02-16T00:12:33.617293+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:12:33.617293+0000","last_undegraded":"2024-02-16T00:12:33.617293+0000","last_fullsized":"2024-02-16T00:12:33.617293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:17:51.160171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845460+0000","last_change":"2024-02-16T00:11:12.821286+0000","last_active":"2024-02-16T00:11:50.845460+0000","last_peered":"2024-02-16T00:11:50.845460+0000","last_clean":"2024-02-16T00:11:50.845460+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:11:50.845460+0000","last_undegraded":"2024-02-16T00:11:50.845460+0000","last_fullsized":"2024-02-16T00:11:50.845460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.448049+0000","last_change":"2024-02-16T00:11:04.803520+0000","last_active":"2024-02-16T00:12:33.448049+0000","last_peered":"2024-02-16T00:12:33.448049+0000","last_clean":"2024-02-16T00:12:33.448049+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:12:33.448049+0000","last_undegraded":"2024-02-16T00:12:33.448049+0000","last_fullsized":"2024-02-16T00:12:33.448049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:30:00.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847693+0000","last_change":"2024-02-16T00:11:02.820879+0000","last_active":"2024-02-16T00:11:50.847693+0000","last_peered":"2024-02-16T00:11:50.847693+0000","last_clean":"2024-02-16T00:11:50.847693+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:11:50.847693+0000","last_undegraded":"2024-02-16T00:11:50.847693+0000","last_fullsized":"2024-02-16T00:11:50.847693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845158+0000","last_change":"2024-02-16T00:11:06.807048+0000","last_active":"2024-02-16T00:11:50.845158+0000","last_peered":"2024-02-16T00:11:50.845158+0000","last_clean":"2024-02-16T00:11:50.845158+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:11:50.845158+0000","last_undegraded":"2024-02-16T00:11:50.845158+0000","last_fullsized":"2024-02-16T00:11:50.845158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:20:58.481322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.939005+0000","last_change":"2024-02-16T00:11:08.815411+0000","last_active":"2024-02-16T00:12:27.939005+0000","last_peered":"2024-02-16T00:12:27.939005+0000","last_clean":"2024-02-16T00:12:27.939005+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:27.939005+0000","last_undegraded":"2024-02-16T00:12:27.939005+0000","last_fullsized":"2024-02-16T00:12:27.939005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:52.985555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'239","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.621722+0000","last_change":"2024-02-16T00:11:10.820344+0000","last_active":"2024-02-16T00:12:33.621722+0000","last_peered":"2024-02-16T00:12:33.621722+0000","last_clean":"2024-02-16T00:12:33.621722+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:33.621722+0000","last_undegraded":"2024-02-16T00:12:33.621722+0000","last_fullsized":"2024-02-16T00:12:33.621722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:56.315714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.856376+0000","last_change":"2024-02-16T00:11:50.855956+0000","last_active":"2024-02-16T00:11:50.856376+0000","last_peered":"2024-02-16T00:11:50.856376+0000","last_clean":"2024-02-16T00:11:50.856376+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:11:50.856376+0000","last_undegraded":"2024-02-16T00:11:50.856376+0000","last_fullsized":"2024-02-16T00:11:50.856376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:18.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842241+0000","last_change":"2024-02-16T00:11:02.805831+0000","last_active":"2024-02-16T00:11:50.842241+0000","last_peered":"2024-02-16T00:11:50.842241+0000","last_clean":"2024-02-16T00:11:50.842241+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:11:50.842241+0000","last_undegraded":"2024-02-16T00:11:50.842241+0000","last_fullsized":"2024-02-16T00:11:50.842241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846785+0000","last_change":"2024-02-16T00:11:06.809760+0000","last_active":"2024-02-16T00:11:50.846785+0000","last_peered":"2024-02-16T00:11:50.846785+0000","last_clean":"2024-02-16T00:11:50.846785+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:11:50.846785+0000","last_undegraded":"2024-02-16T00:11:50.846785+0000","last_fullsized":"2024-02-16T00:11:50.846785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:40.171212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'46","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.948379+0000","last_change":"2024-02-16T00:11:08.816208+0000","last_active":"2024-02-16T00:12:27.948379+0000","last_peered":"2024-02-16T00:12:27.948379+0000","last_clean":"2024-02-16T00:12:27.948379+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:27.948379+0000","last_undegraded":"2024-02-16T00:12:27.948379+0000","last_fullsized":"2024-02-16T00:12:27.948379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:19.358580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830203+0000","last_change":"2024-02-16T00:11:10.820589+0000","last_active":"2024-02-16T00:11:51.830203+0000","last_peered":"2024-02-16T00:11:51.830203+0000","last_clean":"2024-02-16T00:11:51.830203+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:11:51.830203+0000","last_undegraded":"2024-02-16T00:11:51.830203+0000","last_fullsized":"2024-02-16T00:11:51.830203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:25.136505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.761548+0000","last_change":"2024-02-16T00:11:12.824309+0000","last_active":"2024-02-16T00:12:27.761548+0000","last_peered":"2024-02-16T00:12:27.761548+0000","last_clean":"2024-02-16T00:12:27.761548+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:27.761548+0000","last_undegraded":"2024-02-16T00:12:27.761548+0000","last_fullsized":"2024-02-16T00:12:27.761548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:56.872128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322700+0000","last_change":"2024-02-16T00:11:04.797488+0000","last_active":"2024-02-16T00:12:27.322700+0000","last_peered":"2024-02-16T00:12:27.322700+0000","last_clean":"2024-02-16T00:12:27.322700+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:12:27.322700+0000","last_undegraded":"2024-02-16T00:12:27.322700+0000","last_fullsized":"2024-02-16T00:12:27.322700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.964166+0000","last_change":"2024-02-16T00:11:02.815325+0000","last_active":"2024-02-16T00:12:27.964166+0000","last_peered":"2024-02-16T00:12:27.964166+0000","last_clean":"2024-02-16T00:12:27.964166+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:12:27.964166+0000","last_undegraded":"2024-02-16T00:12:27.964166+0000","last_fullsized":"2024-02-16T00:12:27.964166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829007+0000","last_change":"2024-02-16T00:11:06.808903+0000","last_active":"2024-02-16T00:11:51.829007+0000","last_peered":"2024-02-16T00:11:51.829007+0000","last_clean":"2024-02-16T00:11:51.829007+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:11:51.829007+0000","last_undegraded":"2024-02-16T00:11:51.829007+0000","last_fullsized":"2024-02-16T00:11:51.829007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:23.224863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.928427+0000","last_change":"2024-02-16T00:11:08.810670+0000","last_active":"2024-02-16T00:12:27.928427+0000","last_peered":"2024-02-16T00:12:27.928427+0000","last_clean":"2024-02-16T00:12:27.928427+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:27.928427+0000","last_undegraded":"2024-02-16T00:12:27.928427+0000","last_fullsized":"2024-02-16T00:12:27.928427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:33.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828968+0000","last_change":"2024-02-16T00:11:10.819436+0000","last_active":"2024-02-16T00:11:51.828968+0000","last_peered":"2024-02-16T00:11:51.828968+0000","last_clean":"2024-02-16T00:11:51.828968+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:11:51.828968+0000","last_undegraded":"2024-02-16T00:11:51.828968+0000","last_fullsized":"2024-02-16T00:11:51.828968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:12.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.170900+0000","last_change":"2024-02-16T00:11:12.828694+0000","last_active":"2024-02-16T00:12:22.170900+0000","last_peered":"2024-02-16T00:12:22.170900+0000","last_clean":"2024-02-16T00:12:22.170900+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:12:22.170900+0000","last_undegraded":"2024-02-16T00:12:22.170900+0000","last_fullsized":"2024-02-16T00:12:22.170900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:38.040980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:04.809981+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:10.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.325660+0000","last_change":"2024-02-16T00:11:02.815569+0000","last_active":"2024-02-16T00:12:27.325660+0000","last_peered":"2024-02-16T00:12:27.325660+0000","last_clean":"2024-02-16T00:12:27.325660+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:12:27.325660+0000","last_undegraded":"2024-02-16T00:12:27.325660+0000","last_fullsized":"2024-02-16T00:12:27.325660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:29.570326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831033+0000","last_change":"2024-02-16T00:11:06.806202+0000","last_active":"2024-02-16T00:11:51.831033+0000","last_peered":"2024-02-16T00:11:51.831033+0000","last_clean":"2024-02-16T00:11:51.831033+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:11:51.831033+0000","last_undegraded":"2024-02-16T00:11:51.831033+0000","last_fullsized":"2024-02-16T00:11:51.831033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:08.925296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.950167+0000","last_change":"2024-02-16T00:11:08.813417+0000","last_active":"2024-02-16T00:12:27.950167+0000","last_peered":"2024-02-16T00:12:27.950167+0000","last_clean":"2024-02-16T00:12:27.950167+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:27.950167+0000","last_undegraded":"2024-02-16T00:12:27.950167+0000","last_fullsized":"2024-02-16T00:12:27.950167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:05.893569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'239","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.622742+0000","last_change":"2024-02-16T00:11:10.816060+0000","last_active":"2024-02-16T00:12:33.622742+0000","last_peered":"2024-02-16T00:12:33.622742+0000","last_clean":"2024-02-16T00:12:33.622742+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:33.622742+0000","last_undegraded":"2024-02-16T00:12:33.622742+0000","last_fullsized":"2024-02-16T00:12:33.622742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:59.417398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830309+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:11:51.830309+0000","last_peered":"2024-02-16T00:11:51.830309+0000","last_clean":"2024-02-16T00:11:51.830309+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:11:51.830309+0000","last_undegraded":"2024-02-16T00:11:51.830309+0000","last_fullsized":"2024-02-16T00:11:51.830309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:09.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844394+0000","last_change":"2024-02-16T00:11:04.799023+0000","last_active":"2024-02-16T00:11:50.844394+0000","last_peered":"2024-02-16T00:11:50.844394+0000","last_clean":"2024-02-16T00:11:50.844394+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:11:50.844394+0000","last_undegraded":"2024-02-16T00:11:50.844394+0000","last_fullsized":"2024-02-16T00:11:50.844394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842185+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:11:50.842185+0000","last_peered":"2024-02-16T00:11:50.842185+0000","last_clean":"2024-02-16T00:11:50.842185+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:11:50.842185+0000","last_undegraded":"2024-02-16T00:11:50.842185+0000","last_fullsized":"2024-02-16T00:11:50.842185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:37.649958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829559+0000","last_change":"2024-02-16T00:11:06.808902+0000","last_active":"2024-02-16T00:11:51.829559+0000","last_peered":"2024-02-16T00:11:51.829559+0000","last_clean":"2024-02-16T00:11:51.829559+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:11:51.829559+0000","last_undegraded":"2024-02-16T00:11:51.829559+0000","last_fullsized":"2024-02-16T00:11:51.829559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:38.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'62","reported_seq":129,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.409004+0000","last_change":"2024-02-16T00:11:08.819445+0000","last_active":"2024-02-16T00:12:33.409004+0000","last_peered":"2024-02-16T00:12:33.409004+0000","last_clean":"2024-02-16T00:12:33.409004+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:12:33.409004+0000","last_undegraded":"2024-02-16T00:12:33.409004+0000","last_fullsized":"2024-02-16T00:12:33.409004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:16:44.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828688+0000","last_change":"2024-02-16T00:11:10.822009+0000","last_active":"2024-02-16T00:11:51.828688+0000","last_peered":"2024-02-16T00:11:51.828688+0000","last_clean":"2024-02-16T00:11:51.828688+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:11:51.828688+0000","last_undegraded":"2024-02-16T00:11:51.828688+0000","last_fullsized":"2024-02-16T00:11:51.828688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:44.750899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831614+0000","last_change":"2024-02-16T00:11:12.823579+0000","last_active":"2024-02-16T00:11:51.831614+0000","last_peered":"2024-02-16T00:11:51.831614+0000","last_clean":"2024-02-16T00:11:51.831614+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:11:51.831614+0000","last_undegraded":"2024-02-16T00:11:51.831614+0000","last_fullsized":"2024-02-16T00:11:51.831614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:37.304684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447979+0000","last_change":"2024-02-16T00:11:04.812522+0000","last_active":"2024-02-16T00:12:33.447979+0000","last_peered":"2024-02-16T00:12:33.447979+0000","last_clean":"2024-02-16T00:12:33.447979+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:12:33.447979+0000","last_undegraded":"2024-02-16T00:12:33.447979+0000","last_fullsized":"2024-02-16T00:12:33.447979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:33.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829755+0000","last_change":"2024-02-16T00:11:02.807400+0000","last_active":"2024-02-16T00:11:51.829755+0000","last_peered":"2024-02-16T00:11:51.829755+0000","last_clean":"2024-02-16T00:11:51.829755+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:11:51.829755+0000","last_undegraded":"2024-02-16T00:11:51.829755+0000","last_fullsized":"2024-02-16T00:11:51.829755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841646+0000","last_change":"2024-02-16T00:11:06.807251+0000","last_active":"2024-02-16T00:11:50.841646+0000","last_peered":"2024-02-16T00:11:50.841646+0000","last_clean":"2024-02-16T00:11:50.841646+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:11:50.841646+0000","last_undegraded":"2024-02-16T00:11:50.841646+0000","last_fullsized":"2024-02-16T00:11:50.841646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:25.708356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.932750+0000","last_change":"2024-02-16T00:11:08.809691+0000","last_active":"2024-02-16T00:12:27.932750+0000","last_peered":"2024-02-16T00:12:27.932750+0000","last_clean":"2024-02-16T00:12:27.932750+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:27.932750+0000","last_undegraded":"2024-02-16T00:12:27.932750+0000","last_fullsized":"2024-02-16T00:12:27.932750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:46:18.694281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843496+0000","last_change":"2024-02-16T00:11:10.830170+0000","last_active":"2024-02-16T00:11:50.843496+0000","last_peered":"2024-02-16T00:11:50.843496+0000","last_clean":"2024-02-16T00:11:50.843496+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:11:50.843496+0000","last_undegraded":"2024-02-16T00:11:50.843496+0000","last_fullsized":"2024-02-16T00:11:50.843496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:27:37.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839182+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:11:50.839182+0000","last_peered":"2024-02-16T00:11:50.839182+0000","last_clean":"2024-02-16T00:11:50.839182+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:11:50.839182+0000","last_undegraded":"2024-02-16T00:11:50.839182+0000","last_fullsized":"2024-02-16T00:11:50.839182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:22.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.852536+0000","last_change":"2024-02-16T00:11:50.852046+0000","last_active":"2024-02-16T00:11:50.852536+0000","last_peered":"2024-02-16T00:11:50.852536+0000","last_clean":"2024-02-16T00:11:50.852536+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:11:50.852536+0000","last_undegraded":"2024-02-16T00:11:50.852536+0000","last_fullsized":"2024-02-16T00:11:50.852536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:25.615122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840650+0000","last_change":"2024-02-16T00:11:02.816016+0000","last_active":"2024-02-16T00:11:50.840650+0000","last_peered":"2024-02-16T00:11:50.840650+0000","last_clean":"2024-02-16T00:11:50.840650+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:11:50.840650+0000","last_undegraded":"2024-02-16T00:11:50.840650+0000","last_fullsized":"2024-02-16T00:11:50.840650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:32.229010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849166+0000","last_change":"2024-02-16T00:11:50.848461+0000","last_active":"2024-02-16T00:11:50.849166+0000","last_peered":"2024-02-16T00:11:50.849166+0000","last_clean":"2024-02-16T00:11:50.849166+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:11:50.849166+0000","last_undegraded":"2024-02-16T00:11:50.849166+0000","last_fullsized":"2024-02-16T00:11:50.849166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:15.203256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'35","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.958130+0000","last_change":"2024-02-16T00:11:08.812821+0000","last_active":"2024-02-16T00:12:27.958130+0000","last_peered":"2024-02-16T00:12:27.958130+0000","last_clean":"2024-02-16T00:12:27.958130+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:27.958130+0000","last_undegraded":"2024-02-16T00:12:27.958130+0000","last_fullsized":"2024-02-16T00:12:27.958130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:10.931565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'239","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.618374+0000","last_change":"2024-02-16T00:11:10.825189+0000","last_active":"2024-02-16T00:12:33.618374+0000","last_peered":"2024-02-16T00:12:33.618374+0000","last_clean":"2024-02-16T00:12:33.618374+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:33.618374+0000","last_undegraded":"2024-02-16T00:12:33.618374+0000","last_fullsized":"2024-02-16T00:12:33.618374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:30.694754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.981440+0000","last_change":"2024-02-16T00:11:12.826412+0000","last_active":"2024-02-16T00:12:27.981440+0000","last_peered":"2024-02-16T00:12:27.981440+0000","last_clean":"2024-02-16T00:12:27.981440+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:12:27.981440+0000","last_undegraded":"2024-02-16T00:12:27.981440+0000","last_fullsized":"2024-02-16T00:12:27.981440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:03.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969839+0000","last_change":"2024-02-16T00:11:51.834792+0000","last_active":"2024-02-16T00:12:27.969839+0000","last_peered":"2024-02-16T00:12:27.969839+0000","last_clean":"2024-02-16T00:12:27.969839+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:12:27.969839+0000","last_undegraded":"2024-02-16T00:12:27.969839+0000","last_fullsized":"2024-02-16T00:12:27.969839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:46.509649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840852+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:11:50.840852+0000","last_peered":"2024-02-16T00:11:50.840852+0000","last_clean":"2024-02-16T00:11:50.840852+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:11:50.840852+0000","last_undegraded":"2024-02-16T00:11:50.840852+0000","last_fullsized":"2024-02-16T00:11:50.840852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:54:39.901674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"20'2","reported_seq":349,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.599843+0000","last_change":"2024-02-16T00:11:06.803378+0000","last_active":"2024-02-16T00:12:33.599843+0000","last_peered":"2024-02-16T00:12:33.599843+0000","last_clean":"2024-02-16T00:12:33.599843+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:33.599843+0000","last_undegraded":"2024-02-16T00:12:33.599843+0000","last_fullsized":"2024-02-16T00:12:33.599843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:37.017382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":319,"num_read_kb":319,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844009+0000","last_change":"2024-02-16T00:11:08.818315+0000","last_active":"2024-02-16T00:11:50.844009+0000","last_peered":"2024-02-16T00:11:50.844009+0000","last_clean":"2024-02-16T00:11:50.844009+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:11:50.844009+0000","last_undegraded":"2024-02-16T00:11:50.844009+0000","last_fullsized":"2024-02-16T00:11:50.844009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:40.931409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'239","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.619483+0000","last_change":"2024-02-16T00:11:10.821163+0000","last_active":"2024-02-16T00:12:33.619483+0000","last_peered":"2024-02-16T00:12:33.619483+0000","last_clean":"2024-02-16T00:12:33.619483+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:33.619483+0000","last_undegraded":"2024-02-16T00:12:33.619483+0000","last_fullsized":"2024-02-16T00:12:33.619483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:56.315714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842725+0000","last_change":"2024-02-16T00:11:12.820915+0000","last_active":"2024-02-16T00:11:50.842725+0000","last_peered":"2024-02-16T00:11:50.842725+0000","last_clean":"2024-02-16T00:11:50.842725+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:11:50.842725+0000","last_undegraded":"2024-02-16T00:11:50.842725+0000","last_fullsized":"2024-02-16T00:11:50.842725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:11.680317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849986+0000","last_change":"2024-02-16T00:11:04.814579+0000","last_active":"2024-02-16T00:11:50.849986+0000","last_peered":"2024-02-16T00:11:50.849986+0000","last_clean":"2024-02-16T00:11:50.849986+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:11:50.849986+0000","last_undegraded":"2024-02-16T00:11:50.849986+0000","last_fullsized":"2024-02-16T00:11:50.849986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:37.972099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839956+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:11:50.839956+0000","last_peered":"2024-02-16T00:11:50.839956+0000","last_clean":"2024-02-16T00:11:50.839956+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:11:50.839956+0000","last_undegraded":"2024-02-16T00:11:50.839956+0000","last_fullsized":"2024-02-16T00:11:50.839956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:08.196608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844331+0000","last_change":"2024-02-16T00:11:06.805637+0000","last_active":"2024-02-16T00:11:50.844331+0000","last_peered":"2024-02-16T00:11:50.844331+0000","last_clean":"2024-02-16T00:11:50.844331+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:11:50.844331+0000","last_undegraded":"2024-02-16T00:11:50.844331+0000","last_fullsized":"2024-02-16T00:11:50.844331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:23.532869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.945180+0000","last_change":"2024-02-16T00:11:08.817066+0000","last_active":"2024-02-16T00:12:27.945180+0000","last_peered":"2024-02-16T00:12:27.945180+0000","last_clean":"2024-02-16T00:12:27.945180+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:27.945180+0000","last_undegraded":"2024-02-16T00:12:27.945180+0000","last_fullsized":"2024-02-16T00:12:27.945180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:44.502136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844840+0000","last_change":"2024-02-16T00:11:10.820822+0000","last_active":"2024-02-16T00:11:50.844840+0000","last_peered":"2024-02-16T00:11:50.844840+0000","last_clean":"2024-02-16T00:11:50.844840+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:11:50.844840+0000","last_undegraded":"2024-02-16T00:11:50.844840+0000","last_fullsized":"2024-02-16T00:11:50.844840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.483261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847509+0000","last_change":"2024-02-16T00:11:12.820426+0000","last_active":"2024-02-16T00:11:50.847509+0000","last_peered":"2024-02-16T00:11:50.847509+0000","last_clean":"2024-02-16T00:11:50.847509+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:11:50.847509+0000","last_undegraded":"2024-02-16T00:11:50.847509+0000","last_fullsized":"2024-02-16T00:11:50.847509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:56.437107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447611+0000","last_change":"2024-02-16T00:11:04.815286+0000","last_active":"2024-02-16T00:12:33.447611+0000","last_peered":"2024-02-16T00:12:33.447611+0000","last_clean":"2024-02-16T00:12:33.447611+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:33.447611+0000","last_undegraded":"2024-02-16T00:12:33.447611+0000","last_fullsized":"2024-02-16T00:12:33.447611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:52.351458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847560+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:11:50.847560+0000","last_peered":"2024-02-16T00:11:50.847560+0000","last_clean":"2024-02-16T00:11:50.847560+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:11:50.847560+0000","last_undegraded":"2024-02-16T00:11:50.847560+0000","last_fullsized":"2024-02-16T00:11:50.847560+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:26.862794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841297+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:11:50.841297+0000","last_peered":"2024-02-16T00:11:50.841297+0000","last_clean":"2024-02-16T00:11:50.841297+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:11:50.841297+0000","last_undegraded":"2024-02-16T00:11:50.841297+0000","last_fullsized":"2024-02-16T00:11:50.841297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:10.324975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840128+0000","last_change":"2024-02-16T00:11:02.823633+0000","last_active":"2024-02-16T00:11:50.840128+0000","last_peered":"2024-02-16T00:11:50.840128+0000","last_clean":"2024-02-16T00:11:50.840128+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:11:50.840128+0000","last_undegraded":"2024-02-16T00:11:50.840128+0000","last_fullsized":"2024-02-16T00:11:50.840128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:29:58.094211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847007+0000","last_change":"2024-02-16T00:11:06.802815+0000","last_active":"2024-02-16T00:11:50.847007+0000","last_peered":"2024-02-16T00:11:50.847007+0000","last_clean":"2024-02-16T00:11:50.847007+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:11:50.847007+0000","last_undegraded":"2024-02-16T00:11:50.847007+0000","last_fullsized":"2024-02-16T00:11:50.847007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:15.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.424430+0000","last_change":"2024-02-16T00:11:08.812650+0000","last_active":"2024-02-16T00:12:33.424430+0000","last_peered":"2024-02-16T00:12:33.424430+0000","last_clean":"2024-02-16T00:12:33.424430+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:33.424430+0000","last_undegraded":"2024-02-16T00:12:33.424430+0000","last_fullsized":"2024-02-16T00:12:33.424430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:00:12.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830451+0000","last_change":"2024-02-16T00:11:10.819778+0000","last_active":"2024-02-16T00:11:51.830451+0000","last_peered":"2024-02-16T00:11:51.830451+0000","last_clean":"2024-02-16T00:11:51.830451+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:11:51.830451+0000","last_undegraded":"2024-02-16T00:11:51.830451+0000","last_fullsized":"2024-02-16T00:11:51.830451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:02.494032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.459524+0000","last_change":"2024-02-16T00:11:12.817529+0000","last_active":"2024-02-16T00:12:33.459524+0000","last_peered":"2024-02-16T00:12:33.459524+0000","last_clean":"2024-02-16T00:12:33.459524+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:33.459524+0000","last_undegraded":"2024-02-16T00:12:33.459524+0000","last_fullsized":"2024-02-16T00:12:33.459524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:41.761693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969783+0000","last_change":"2024-02-16T00:11:04.805947+0000","last_active":"2024-02-16T00:12:27.969783+0000","last_peered":"2024-02-16T00:12:27.969783+0000","last_clean":"2024-02-16T00:12:27.969783+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:12:27.969783+0000","last_undegraded":"2024-02-16T00:12:27.969783+0000","last_fullsized":"2024-02-16T00:12:27.969783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:40.488305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839459+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:11:50.839459+0000","last_peered":"2024-02-16T00:11:50.839459+0000","last_clean":"2024-02-16T00:11:50.839459+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:11:50.839459+0000","last_undegraded":"2024-02-16T00:11:50.839459+0000","last_fullsized":"2024-02-16T00:11:50.839459+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:37.927052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828737+0000","last_change":"2024-02-16T00:11:02.808396+0000","last_active":"2024-02-16T00:11:51.828737+0000","last_peered":"2024-02-16T00:11:51.828737+0000","last_clean":"2024-02-16T00:11:51.828737+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:11:51.828737+0000","last_undegraded":"2024-02-16T00:11:51.828737+0000","last_fullsized":"2024-02-16T00:11:51.828737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849902+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:11:50.849902+0000","last_peered":"2024-02-16T00:11:50.849902+0000","last_clean":"2024-02-16T00:11:50.849902+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:11:50.849902+0000","last_undegraded":"2024-02-16T00:11:50.849902+0000","last_fullsized":"2024-02-16T00:11:50.849902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:55:08.909122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'244","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.624081+0000","last_change":"2024-02-16T00:11:08.816886+0000","last_active":"2024-02-16T00:12:33.624081+0000","last_peered":"2024-02-16T00:12:33.624081+0000","last_clean":"2024-02-16T00:12:33.624081+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:33.624081+0000","last_undegraded":"2024-02-16T00:12:33.624081+0000","last_fullsized":"2024-02-16T00:12:33.624081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:28.688312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":324,"num_read_kb":308,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844070+0000","last_change":"2024-02-16T00:11:10.830058+0000","last_active":"2024-02-16T00:11:50.844070+0000","last_peered":"2024-02-16T00:11:50.844070+0000","last_clean":"2024-02-16T00:11:50.844070+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:11:50.844070+0000","last_undegraded":"2024-02-16T00:11:50.844070+0000","last_fullsized":"2024-02-16T00:11:50.844070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:08:24.925584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.291221+0000","last_change":"2024-02-16T00:11:12.828339+0000","last_active":"2024-02-16T00:12:22.291221+0000","last_peered":"2024-02-16T00:12:22.291221+0000","last_clean":"2024-02-16T00:12:22.291221+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:12:22.291221+0000","last_undegraded":"2024-02-16T00:12:22.291221+0000","last_fullsized":"2024-02-16T00:12:22.291221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:03.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831761+0000","last_change":"2024-02-16T00:11:04.803584+0000","last_active":"2024-02-16T00:11:51.831761+0000","last_peered":"2024-02-16T00:11:51.831761+0000","last_clean":"2024-02-16T00:11:51.831761+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:11:51.831761+0000","last_undegraded":"2024-02-16T00:11:51.831761+0000","last_fullsized":"2024-02-16T00:11:51.831761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:39.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841090+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:11:50.841090+0000","last_peered":"2024-02-16T00:11:50.841090+0000","last_clean":"2024-02-16T00:11:50.841090+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:11:50.841090+0000","last_undegraded":"2024-02-16T00:11:50.841090+0000","last_fullsized":"2024-02-16T00:11:50.841090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:55.484965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828521+0000","last_change":"2024-02-16T00:11:02.802061+0000","last_active":"2024-02-16T00:11:51.828521+0000","last_peered":"2024-02-16T00:11:51.828521+0000","last_clean":"2024-02-16T00:11:51.828521+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:11:51.828521+0000","last_undegraded":"2024-02-16T00:11:51.828521+0000","last_fullsized":"2024-02-16T00:11:51.828521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841761+0000","last_change":"2024-02-16T00:11:06.803264+0000","last_active":"2024-02-16T00:11:50.841761+0000","last_peered":"2024-02-16T00:11:50.841761+0000","last_clean":"2024-02-16T00:11:50.841761+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:11:50.841761+0000","last_undegraded":"2024-02-16T00:11:50.841761+0000","last_fullsized":"2024-02-16T00:11:50.841761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:36.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'15","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:26.869931+0000","last_change":"2024-02-16T00:11:08.817972+0000","last_active":"2024-02-16T00:12:26.869931+0000","last_peered":"2024-02-16T00:12:26.869931+0000","last_clean":"2024-02-16T00:12:26.869931+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:26.869931+0000","last_undegraded":"2024-02-16T00:12:26.869931+0000","last_fullsized":"2024-02-16T00:12:26.869931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:40.476138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831062+0000","last_change":"2024-02-16T00:11:10.819489+0000","last_active":"2024-02-16T00:11:51.831062+0000","last_peered":"2024-02-16T00:11:51.831062+0000","last_clean":"2024-02-16T00:11:51.831062+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:11:51.831062+0000","last_undegraded":"2024-02-16T00:11:51.831062+0000","last_fullsized":"2024-02-16T00:11:51.831062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:33.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840050+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:11:50.840050+0000","last_peered":"2024-02-16T00:11:50.840050+0000","last_clean":"2024-02-16T00:11:50.840050+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:11:50.840050+0000","last_undegraded":"2024-02-16T00:11:50.840050+0000","last_fullsized":"2024-02-16T00:11:50.840050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:49.996094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831944+0000","last_change":"2024-02-16T00:11:04.801512+0000","last_active":"2024-02-16T00:11:51.831944+0000","last_peered":"2024-02-16T00:11:51.831944+0000","last_clean":"2024-02-16T00:11:51.831944+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:11:51.831944+0000","last_undegraded":"2024-02-16T00:11:51.831944+0000","last_fullsized":"2024-02-16T00:11:51.831944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:17.940025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839890+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:11:50.839890+0000","last_peered":"2024-02-16T00:11:50.839890+0000","last_clean":"2024-02-16T00:11:50.839890+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:11:50.839890+0000","last_undegraded":"2024-02-16T00:11:50.839890+0000","last_fullsized":"2024-02-16T00:11:50.839890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:16.627592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844174+0000","last_change":"2024-02-16T00:11:02.811825+0000","last_active":"2024-02-16T00:11:50.844174+0000","last_peered":"2024-02-16T00:11:50.844174+0000","last_clean":"2024-02-16T00:11:50.844174+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:11:50.844174+0000","last_undegraded":"2024-02-16T00:11:50.844174+0000","last_fullsized":"2024-02-16T00:11:50.844174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.851641+0000","last_change":"2024-02-16T00:11:50.851092+0000","last_active":"2024-02-16T00:11:50.851641+0000","last_peered":"2024-02-16T00:11:50.851641+0000","last_clean":"2024-02-16T00:11:50.851641+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:11:50.851641+0000","last_undegraded":"2024-02-16T00:11:50.851641+0000","last_fullsized":"2024-02-16T00:11:50.851641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:28.735178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842255+0000","last_change":"2024-02-16T00:11:08.813441+0000","last_active":"2024-02-16T00:11:50.842255+0000","last_peered":"2024-02-16T00:11:50.842255+0000","last_clean":"2024-02-16T00:11:50.842255+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:11:50.842255+0000","last_undegraded":"2024-02-16T00:11:50.842255+0000","last_fullsized":"2024-02-16T00:11:50.842255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:25.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843784+0000","last_change":"2024-02-16T00:11:10.829728+0000","last_active":"2024-02-16T00:11:50.843784+0000","last_peered":"2024-02-16T00:11:50.843784+0000","last_clean":"2024-02-16T00:11:50.843784+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:11:50.843784+0000","last_undegraded":"2024-02-16T00:11:50.843784+0000","last_fullsized":"2024-02-16T00:11:50.843784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:38.430913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848729+0000","last_change":"2024-02-16T00:11:12.835325+0000","last_active":"2024-02-16T00:11:50.848729+0000","last_peered":"2024-02-16T00:11:50.848729+0000","last_clean":"2024-02-16T00:11:50.848729+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:11:50.848729+0000","last_undegraded":"2024-02-16T00:11:50.848729+0000","last_fullsized":"2024-02-16T00:11:50.848729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:54.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621964+0000","last_change":"2024-02-16T00:11:04.814208+0000","last_active":"2024-02-16T00:12:27.621964+0000","last_peered":"2024-02-16T00:12:27.621964+0000","last_clean":"2024-02-16T00:12:27.621964+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:12:27.621964+0000","last_undegraded":"2024-02-16T00:12:27.621964+0000","last_fullsized":"2024-02-16T00:12:27.621964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:31.576677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841417+0000","last_change":"2024-02-16T00:11:02.805928+0000","last_active":"2024-02-16T00:11:50.841417+0000","last_peered":"2024-02-16T00:11:50.841417+0000","last_clean":"2024-02-16T00:11:50.841417+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:11:50.841417+0000","last_undegraded":"2024-02-16T00:11:50.841417+0000","last_fullsized":"2024-02-16T00:11:50.841417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.827694+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:11:51.827694+0000","last_peered":"2024-02-16T00:11:51.827694+0000","last_clean":"2024-02-16T00:11:51.827694+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:11:51.827694+0000","last_undegraded":"2024-02-16T00:11:51.827694+0000","last_fullsized":"2024-02-16T00:11:51.827694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:57:56.387943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830614+0000","last_change":"2024-02-16T00:11:06.809081+0000","last_active":"2024-02-16T00:11:51.830614+0000","last_peered":"2024-02-16T00:11:51.830614+0000","last_clean":"2024-02-16T00:11:51.830614+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:11:51.830614+0000","last_undegraded":"2024-02-16T00:11:51.830614+0000","last_fullsized":"2024-02-16T00:11:51.830614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:37.382506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'68","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.417131+0000","last_change":"2024-02-16T00:11:08.812931+0000","last_active":"2024-02-16T00:12:33.417131+0000","last_peered":"2024-02-16T00:12:33.417131+0000","last_clean":"2024-02-16T00:12:33.417131+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:33.417131+0000","last_undegraded":"2024-02-16T00:12:33.417131+0000","last_fullsized":"2024-02-16T00:12:33.417131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:59.444482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":62,"num_write":36,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842114+0000","last_change":"2024-02-16T00:11:10.824976+0000","last_active":"2024-02-16T00:11:50.842114+0000","last_peered":"2024-02-16T00:11:50.842114+0000","last_clean":"2024-02-16T00:11:50.842114+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:11:50.842114+0000","last_undegraded":"2024-02-16T00:11:50.842114+0000","last_fullsized":"2024-02-16T00:11:50.842114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:01.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.959184+0000","last_change":"2024-02-16T00:11:12.822048+0000","last_active":"2024-02-16T00:12:27.959184+0000","last_peered":"2024-02-16T00:12:27.959184+0000","last_clean":"2024-02-16T00:12:27.959184+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:12:27.959184+0000","last_undegraded":"2024-02-16T00:12:27.959184+0000","last_fullsized":"2024-02-16T00:12:27.959184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:58.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846988+0000","last_change":"2024-02-16T00:11:04.814786+0000","last_active":"2024-02-16T00:11:50.846988+0000","last_peered":"2024-02-16T00:11:50.846988+0000","last_clean":"2024-02-16T00:11:50.846988+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:11:50.846988+0000","last_undegraded":"2024-02-16T00:11:50.846988+0000","last_fullsized":"2024-02-16T00:11:50.846988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:31.456911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831382+0000","last_change":"2024-02-16T00:11:02.801240+0000","last_active":"2024-02-16T00:11:51.831382+0000","last_peered":"2024-02-16T00:11:51.831382+0000","last_clean":"2024-02-16T00:11:51.831382+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:11:51.831382+0000","last_undegraded":"2024-02-16T00:11:51.831382+0000","last_fullsized":"2024-02-16T00:11:51.831382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:37.663185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844947+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:11:50.844947+0000","last_peered":"2024-02-16T00:11:50.844947+0000","last_clean":"2024-02-16T00:11:50.844947+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:11:50.844947+0000","last_undegraded":"2024-02-16T00:11:50.844947+0000","last_fullsized":"2024-02-16T00:11:50.844947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:11:13.167891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839692+0000","last_change":"2024-02-16T00:11:06.807321+0000","last_active":"2024-02-16T00:11:50.839692+0000","last_peered":"2024-02-16T00:11:50.839692+0000","last_clean":"2024-02-16T00:11:50.839692+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:11:50.839692+0000","last_undegraded":"2024-02-16T00:11:50.839692+0000","last_fullsized":"2024-02-16T00:11:50.839692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:40.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846822+0000","last_change":"2024-02-16T00:11:08.816902+0000","last_active":"2024-02-16T00:11:50.846822+0000","last_peered":"2024-02-16T00:11:50.846822+0000","last_clean":"2024-02-16T00:11:50.846822+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:11:50.846822+0000","last_undegraded":"2024-02-16T00:11:50.846822+0000","last_fullsized":"2024-02-16T00:11:50.846822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:28.706934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'239","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.616431+0000","last_change":"2024-02-16T00:11:10.824584+0000","last_active":"2024-02-16T00:12:33.616431+0000","last_peered":"2024-02-16T00:12:33.616431+0000","last_clean":"2024-02-16T00:12:33.616431+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:33.616431+0000","last_undegraded":"2024-02-16T00:12:33.616431+0000","last_fullsized":"2024-02-16T00:12:33.616431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:12.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842453+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:11:50.842453+0000","last_peered":"2024-02-16T00:11:50.842453+0000","last_clean":"2024-02-16T00:11:50.842453+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:11:50.842453+0000","last_undegraded":"2024-02-16T00:11:50.842453+0000","last_fullsized":"2024-02-16T00:11:50.842453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:56:43.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447640+0000","last_change":"2024-02-16T00:11:04.813783+0000","last_active":"2024-02-16T00:12:33.447640+0000","last_peered":"2024-02-16T00:12:33.447640+0000","last_clean":"2024-02-16T00:12:33.447640+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:33.447640+0000","last_undegraded":"2024-02-16T00:12:33.447640+0000","last_fullsized":"2024-02-16T00:12:33.447640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:00.990043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844350+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:11:50.844350+0000","last_peered":"2024-02-16T00:11:50.844350+0000","last_clean":"2024-02-16T00:11:50.844350+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:11:50.844350+0000","last_undegraded":"2024-02-16T00:11:50.844350+0000","last_fullsized":"2024-02-16T00:11:50.844350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:43.805420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828194+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:11:51.828194+0000","last_peered":"2024-02-16T00:11:51.828194+0000","last_clean":"2024-02-16T00:11:51.828194+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:11:51.828194+0000","last_undegraded":"2024-02-16T00:11:51.828194+0000","last_fullsized":"2024-02-16T00:11:51.828194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:33:37.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840930+0000","last_change":"2024-02-16T00:11:06.808524+0000","last_active":"2024-02-16T00:11:50.840930+0000","last_peered":"2024-02-16T00:11:50.840930+0000","last_clean":"2024-02-16T00:11:50.840930+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:11:50.840930+0000","last_undegraded":"2024-02-16T00:11:50.840930+0000","last_fullsized":"2024-02-16T00:11:50.840930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:29.788383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840440+0000","last_change":"2024-02-16T00:11:08.814729+0000","last_active":"2024-02-16T00:11:50.840440+0000","last_peered":"2024-02-16T00:11:50.840440+0000","last_clean":"2024-02-16T00:11:50.840440+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:11:50.840440+0000","last_undegraded":"2024-02-16T00:11:50.840440+0000","last_fullsized":"2024-02-16T00:11:50.840440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:46.912652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'239","reported_seq":309,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.620445+0000","last_change":"2024-02-16T00:11:10.820590+0000","last_active":"2024-02-16T00:12:33.620445+0000","last_peered":"2024-02-16T00:12:33.620445+0000","last_clean":"2024-02-16T00:12:33.620445+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:33.620445+0000","last_undegraded":"2024-02-16T00:12:33.620445+0000","last_fullsized":"2024-02-16T00:12:33.620445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:31.011223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.278591+0000","last_change":"2024-02-16T00:11:12.832931+0000","last_active":"2024-02-16T00:12:22.278591+0000","last_peered":"2024-02-16T00:12:22.278591+0000","last_clean":"2024-02-16T00:12:22.278591+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:12:22.278591+0000","last_undegraded":"2024-02-16T00:12:22.278591+0000","last_fullsized":"2024-02-16T00:12:22.278591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:26.736188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447919+0000","last_change":"2024-02-16T00:11:04.809323+0000","last_active":"2024-02-16T00:12:33.447919+0000","last_peered":"2024-02-16T00:12:33.447919+0000","last_clean":"2024-02-16T00:12:33.447919+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:12:33.447919+0000","last_undegraded":"2024-02-16T00:12:33.447919+0000","last_fullsized":"2024-02-16T00:12:33.447919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:15.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849396+0000","last_change":"2024-02-16T00:11:02.796859+0000","last_active":"2024-02-16T00:11:50.849396+0000","last_peered":"2024-02-16T00:11:50.849396+0000","last_clean":"2024-02-16T00:11:50.849396+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:11:50.849396+0000","last_undegraded":"2024-02-16T00:11:50.849396+0000","last_fullsized":"2024-02-16T00:11:50.849396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843629+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:11:50.843629+0000","last_peered":"2024-02-16T00:11:50.843629+0000","last_clean":"2024-02-16T00:11:50.843629+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:11:50.843629+0000","last_undegraded":"2024-02-16T00:11:50.843629+0000","last_fullsized":"2024-02-16T00:11:50.843629+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:06.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840367+0000","last_change":"2024-02-16T00:11:06.809592+0000","last_active":"2024-02-16T00:11:50.840367+0000","last_peered":"2024-02-16T00:11:50.840367+0000","last_clean":"2024-02-16T00:11:50.840367+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:11:50.840367+0000","last_undegraded":"2024-02-16T00:11:50.840367+0000","last_fullsized":"2024-02-16T00:11:50.840367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:52.303003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":159,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.414040+0000","last_change":"2024-02-16T00:11:08.813647+0000","last_active":"2024-02-16T00:12:33.414040+0000","last_peered":"2024-02-16T00:12:33.414040+0000","last_clean":"2024-02-16T00:12:33.414040+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:33.414040+0000","last_undegraded":"2024-02-16T00:12:33.414040+0000","last_fullsized":"2024-02-16T00:12:33.414040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:57.678721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829880+0000","last_change":"2024-02-16T00:11:10.825204+0000","last_active":"2024-02-16T00:11:51.829880+0000","last_peered":"2024-02-16T00:11:51.829880+0000","last_clean":"2024-02-16T00:11:51.829880+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:11:51.829880+0000","last_undegraded":"2024-02-16T00:11:51.829880+0000","last_fullsized":"2024-02-16T00:11:51.829880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:27.545580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845913+0000","last_change":"2024-02-16T00:11:12.825945+0000","last_active":"2024-02-16T00:11:50.845913+0000","last_peered":"2024-02-16T00:11:50.845913+0000","last_clean":"2024-02-16T00:11:50.845913+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:11:50.845913+0000","last_undegraded":"2024-02-16T00:11:50.845913+0000","last_fullsized":"2024-02-16T00:11:50.845913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:01.423563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.437852+0000","last_change":"2024-02-16T00:11:12.826512+0000","last_active":"2024-02-16T00:12:33.437852+0000","last_peered":"2024-02-16T00:12:33.437852+0000","last_clean":"2024-02-16T00:12:33.437852+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:12:33.437852+0000","last_undegraded":"2024-02-16T00:12:33.437852+0000","last_fullsized":"2024-02-16T00:12:33.437852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:14.444046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969541+0000","last_change":"2024-02-16T00:11:04.810868+0000","last_active":"2024-02-16T00:12:27.969541+0000","last_peered":"2024-02-16T00:12:27.969541+0000","last_clean":"2024-02-16T00:12:27.969541+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:12:27.969541+0000","last_undegraded":"2024-02-16T00:12:27.969541+0000","last_fullsized":"2024-02-16T00:12:27.969541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842296+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:11:50.842296+0000","last_peered":"2024-02-16T00:11:50.842296+0000","last_clean":"2024-02-16T00:11:50.842296+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:11:50.842296+0000","last_undegraded":"2024-02-16T00:11:50.842296+0000","last_fullsized":"2024-02-16T00:11:50.842296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:24.599977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"20'1","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.591526+0000","last_change":"2024-02-16T00:11:06.804629+0000","last_active":"2024-02-16T00:12:33.591526+0000","last_peered":"2024-02-16T00:12:33.591526+0000","last_clean":"2024-02-16T00:12:33.591526+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:33.591526+0000","last_undegraded":"2024-02-16T00:12:33.591526+0000","last_fullsized":"2024-02-16T00:12:33.591526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:33.337990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.949264+0000","last_change":"2024-02-16T00:11:08.817056+0000","last_active":"2024-02-16T00:12:27.949264+0000","last_peered":"2024-02-16T00:12:27.949264+0000","last_clean":"2024-02-16T00:12:27.949264+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:12:27.949264+0000","last_undegraded":"2024-02-16T00:12:27.949264+0000","last_fullsized":"2024-02-16T00:12:27.949264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:14.319677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840209+0000","last_change":"2024-02-16T00:11:10.831264+0000","last_active":"2024-02-16T00:11:50.840209+0000","last_peered":"2024-02-16T00:11:50.840209+0000","last_clean":"2024-02-16T00:11:50.840209+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:11:50.840209+0000","last_undegraded":"2024-02-16T00:11:50.840209+0000","last_fullsized":"2024-02-16T00:11:50.840209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:09:54.744331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830002+0000","last_change":"2024-02-16T00:11:12.819458+0000","last_active":"2024-02-16T00:11:51.830002+0000","last_peered":"2024-02-16T00:11:51.830002+0000","last_clean":"2024-02-16T00:11:51.830002+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:11:51.830002+0000","last_undegraded":"2024-02-16T00:11:51.830002+0000","last_fullsized":"2024-02-16T00:11:51.830002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:18.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.857998+0000","last_change":"2024-02-16T00:11:50.857588+0000","last_active":"2024-02-16T00:11:50.857998+0000","last_peered":"2024-02-16T00:11:50.857998+0000","last_clean":"2024-02-16T00:11:50.857998+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:11:50.857998+0000","last_undegraded":"2024-02-16T00:11:50.857998+0000","last_fullsized":"2024-02-16T00:11:50.857998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:48.410669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841539+0000","last_change":"2024-02-16T00:11:02.805825+0000","last_active":"2024-02-16T00:11:50.841539+0000","last_peered":"2024-02-16T00:11:50.841539+0000","last_clean":"2024-02-16T00:11:50.841539+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:11:50.841539+0000","last_undegraded":"2024-02-16T00:11:50.841539+0000","last_fullsized":"2024-02-16T00:11:50.841539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841830+0000","last_change":"2024-02-16T00:11:06.809728+0000","last_active":"2024-02-16T00:11:50.841830+0000","last_peered":"2024-02-16T00:11:50.841830+0000","last_clean":"2024-02-16T00:11:50.841830+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:11:50.841830+0000","last_undegraded":"2024-02-16T00:11:50.841830+0000","last_fullsized":"2024-02-16T00:11:50.841830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:21.123795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:21.104435+0000","last_change":"2024-02-16T00:11:08.813746+0000","last_active":"2024-02-16T00:12:21.104435+0000","last_peered":"2024-02-16T00:12:21.104435+0000","last_clean":"2024-02-16T00:12:21.104435+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:21.104435+0000","last_undegraded":"2024-02-16T00:12:21.104435+0000","last_fullsized":"2024-02-16T00:12:21.104435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:22.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841313+0000","last_change":"2024-02-16T00:11:10.820413+0000","last_active":"2024-02-16T00:11:50.841313+0000","last_peered":"2024-02-16T00:11:50.841313+0000","last_clean":"2024-02-16T00:11:50.841313+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:11:50.841313+0000","last_undegraded":"2024-02-16T00:11:50.841313+0000","last_fullsized":"2024-02-16T00:11:50.841313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:24.918488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830024+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830024+0000","last_peered":"2024-02-16T00:11:51.830024+0000","last_clean":"2024-02-16T00:11:51.830024+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830024+0000","last_undegraded":"2024-02-16T00:11:51.830024+0000","last_fullsized":"2024-02-16T00:11:51.830024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:38:14.345034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447372+0000","last_change":"2024-02-16T00:11:04.801132+0000","last_active":"2024-02-16T00:12:33.447372+0000","last_peered":"2024-02-16T00:12:33.447372+0000","last_clean":"2024-02-16T00:12:33.447372+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:12:33.447372+0000","last_undegraded":"2024-02-16T00:12:33.447372+0000","last_fullsized":"2024-02-16T00:12:33.447372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842111+0000","last_change":"2024-02-16T00:11:02.815585+0000","last_active":"2024-02-16T00:11:50.842111+0000","last_peered":"2024-02-16T00:11:50.842111+0000","last_clean":"2024-02-16T00:11:50.842111+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:11:50.842111+0000","last_undegraded":"2024-02-16T00:11:50.842111+0000","last_fullsized":"2024-02-16T00:11:50.842111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843904+0000","last_change":"2024-02-16T00:11:06.809635+0000","last_active":"2024-02-16T00:11:50.843904+0000","last_peered":"2024-02-16T00:11:50.843904+0000","last_clean":"2024-02-16T00:11:50.843904+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:11:50.843904+0000","last_undegraded":"2024-02-16T00:11:50.843904+0000","last_fullsized":"2024-02-16T00:11:50.843904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:49.818734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'34","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.243762+0000","last_change":"2024-02-16T00:11:08.810350+0000","last_active":"2024-02-16T00:12:33.243762+0000","last_peered":"2024-02-16T00:12:33.243762+0000","last_clean":"2024-02-16T00:12:33.243762+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:33.243762+0000","last_undegraded":"2024-02-16T00:12:33.243762+0000","last_fullsized":"2024-02-16T00:12:33.243762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:45.445581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847684+0000","last_change":"2024-02-16T00:11:10.823987+0000","last_active":"2024-02-16T00:11:50.847684+0000","last_peered":"2024-02-16T00:11:50.847684+0000","last_clean":"2024-02-16T00:11:50.847684+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:11:50.847684+0000","last_undegraded":"2024-02-16T00:11:50.847684+0000","last_fullsized":"2024-02-16T00:11:50.847684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:59.417398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844306+0000","last_change":"2024-02-16T00:11:12.831687+0000","last_active":"2024-02-16T00:11:50.844306+0000","last_peered":"2024-02-16T00:11:50.844306+0000","last_clean":"2024-02-16T00:11:50.844306+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:11:50.844306+0000","last_undegraded":"2024-02-16T00:11:50.844306+0000","last_fullsized":"2024-02-16T00:11:50.844306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839554+0000","last_change":"2024-02-16T00:11:04.812864+0000","last_active":"2024-02-16T00:11:50.839554+0000","last_peered":"2024-02-16T00:11:50.839554+0000","last_clean":"2024-02-16T00:11:50.839554+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:11:50.839554+0000","last_undegraded":"2024-02-16T00:11:50.839554+0000","last_fullsized":"2024-02-16T00:11:50.839554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:35.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849446+0000","last_change":"2024-02-16T00:11:02.814174+0000","last_active":"2024-02-16T00:11:50.849446+0000","last_peered":"2024-02-16T00:11:50.849446+0000","last_clean":"2024-02-16T00:11:50.849446+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:11:50.849446+0000","last_undegraded":"2024-02-16T00:11:50.849446+0000","last_fullsized":"2024-02-16T00:11:50.849446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839547+0000","last_change":"2024-02-16T00:11:06.803159+0000","last_active":"2024-02-16T00:11:50.839547+0000","last_peered":"2024-02-16T00:11:50.839547+0000","last_clean":"2024-02-16T00:11:50.839547+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:11:50.839547+0000","last_undegraded":"2024-02-16T00:11:50.839547+0000","last_fullsized":"2024-02-16T00:11:50.839547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:11.562971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'28","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.934771+0000","last_change":"2024-02-16T00:11:08.812960+0000","last_active":"2024-02-16T00:12:27.934771+0000","last_peered":"2024-02-16T00:12:27.934771+0000","last_clean":"2024-02-16T00:12:27.934771+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:27.934771+0000","last_undegraded":"2024-02-16T00:12:27.934771+0000","last_fullsized":"2024-02-16T00:12:27.934771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:42.177481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843134+0000","last_change":"2024-02-16T00:11:10.819766+0000","last_active":"2024-02-16T00:11:50.843134+0000","last_peered":"2024-02-16T00:11:50.843134+0000","last_clean":"2024-02-16T00:11:50.843134+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:11:50.843134+0000","last_undegraded":"2024-02-16T00:11:50.843134+0000","last_fullsized":"2024-02-16T00:11:50.843134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:47.452023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977793+0000","last_change":"2024-02-16T00:11:04.799979+0000","last_active":"2024-02-16T00:12:27.977793+0000","last_peered":"2024-02-16T00:12:27.977793+0000","last_clean":"2024-02-16T00:12:27.977793+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:12:27.977793+0000","last_undegraded":"2024-02-16T00:12:27.977793+0000","last_fullsized":"2024-02-16T00:12:27.977793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.383827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839552+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:11:50.839552+0000","last_peered":"2024-02-16T00:11:50.839552+0000","last_clean":"2024-02-16T00:11:50.839552+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:11:50.839552+0000","last_undegraded":"2024-02-16T00:11:50.839552+0000","last_fullsized":"2024-02-16T00:11:50.839552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:56.621924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831788+0000","last_change":"2024-02-16T00:11:06.807366+0000","last_active":"2024-02-16T00:11:51.831788+0000","last_peered":"2024-02-16T00:11:51.831788+0000","last_clean":"2024-02-16T00:11:51.831788+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:11:51.831788+0000","last_undegraded":"2024-02-16T00:11:51.831788+0000","last_fullsized":"2024-02-16T00:11:51.831788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:55.672453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'57","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.411193+0000","last_change":"2024-02-16T00:11:08.813592+0000","last_active":"2024-02-16T00:12:33.411193+0000","last_peered":"2024-02-16T00:12:33.411193+0000","last_clean":"2024-02-16T00:12:33.411193+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:33.411193+0000","last_undegraded":"2024-02-16T00:12:33.411193+0000","last_fullsized":"2024-02-16T00:12:33.411193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:13.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:10.819573+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:15.314264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.975742+0000","last_change":"2024-02-16T00:11:12.826496+0000","last_active":"2024-02-16T00:12:27.975742+0000","last_peered":"2024-02-16T00:12:27.975742+0000","last_clean":"2024-02-16T00:12:27.975742+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:12:27.975742+0000","last_undegraded":"2024-02-16T00:12:27.975742+0000","last_fullsized":"2024-02-16T00:12:27.975742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:43.107611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831550+0000","last_change":"2024-02-16T00:11:04.798736+0000","last_active":"2024-02-16T00:11:51.831550+0000","last_peered":"2024-02-16T00:11:51.831550+0000","last_clean":"2024-02-16T00:11:51.831550+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:11:51.831550+0000","last_undegraded":"2024-02-16T00:11:51.831550+0000","last_fullsized":"2024-02-16T00:11:51.831550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:23.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846657+0000","last_change":"2024-02-16T00:11:02.820397+0000","last_active":"2024-02-16T00:11:50.846657+0000","last_peered":"2024-02-16T00:11:50.846657+0000","last_clean":"2024-02-16T00:11:50.846657+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:11:50.846657+0000","last_undegraded":"2024-02-16T00:11:50.846657+0000","last_fullsized":"2024-02-16T00:11:50.846657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:41:25.514708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842043+0000","last_change":"2024-02-16T00:11:06.805697+0000","last_active":"2024-02-16T00:11:50.842043+0000","last_peered":"2024-02-16T00:11:50.842043+0000","last_clean":"2024-02-16T00:11:50.842043+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:11:50.842043+0000","last_undegraded":"2024-02-16T00:11:50.842043+0000","last_fullsized":"2024-02-16T00:11:50.842043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:39.979662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'34","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.935821+0000","last_change":"2024-02-16T00:11:08.817849+0000","last_active":"2024-02-16T00:12:27.935821+0000","last_peered":"2024-02-16T00:12:27.935821+0000","last_clean":"2024-02-16T00:12:27.935821+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:12:27.935821+0000","last_undegraded":"2024-02-16T00:12:27.935821+0000","last_fullsized":"2024-02-16T00:12:27.935821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:31:51.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846687+0000","last_change":"2024-02-16T00:11:10.826937+0000","last_active":"2024-02-16T00:11:50.846687+0000","last_peered":"2024-02-16T00:11:50.846687+0000","last_clean":"2024-02-16T00:11:50.846687+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:11:50.846687+0000","last_undegraded":"2024-02-16T00:11:50.846687+0000","last_fullsized":"2024-02-16T00:11:50.846687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:44.750899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839475+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:11:50.839475+0000","last_peered":"2024-02-16T00:11:50.839475+0000","last_clean":"2024-02-16T00:11:50.839475+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:11:50.839475+0000","last_undegraded":"2024-02-16T00:11:50.839475+0000","last_fullsized":"2024-02-16T00:11:50.839475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:07.884643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846346+0000","last_change":"2024-02-16T00:11:04.815549+0000","last_active":"2024-02-16T00:11:50.846346+0000","last_peered":"2024-02-16T00:11:50.846346+0000","last_clean":"2024-02-16T00:11:50.846346+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:11:50.846346+0000","last_undegraded":"2024-02-16T00:11:50.846346+0000","last_fullsized":"2024-02-16T00:11:50.846346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:24.693103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847848+0000","last_change":"2024-02-16T00:11:02.796631+0000","last_active":"2024-02-16T00:11:50.847848+0000","last_peered":"2024-02-16T00:11:50.847848+0000","last_clean":"2024-02-16T00:11:50.847848+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:11:50.847848+0000","last_undegraded":"2024-02-16T00:11:50.847848+0000","last_fullsized":"2024-02-16T00:11:50.847848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843956+0000","last_change":"2024-02-16T00:11:06.803105+0000","last_active":"2024-02-16T00:11:50.843956+0000","last_peered":"2024-02-16T00:11:50.843956+0000","last_clean":"2024-02-16T00:11:50.843956+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:11:50.843956+0000","last_undegraded":"2024-02-16T00:11:50.843956+0000","last_fullsized":"2024-02-16T00:11:50.843956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:33.464474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.953025+0000","last_change":"2024-02-16T00:11:08.812229+0000","last_active":"2024-02-16T00:12:27.953025+0000","last_peered":"2024-02-16T00:12:27.953025+0000","last_clean":"2024-02-16T00:12:27.953025+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:27.953025+0000","last_undegraded":"2024-02-16T00:12:27.953025+0000","last_fullsized":"2024-02-16T00:12:27.953025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:29.476819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830448+0000","last_change":"2024-02-16T00:11:10.820773+0000","last_active":"2024-02-16T00:11:51.830448+0000","last_peered":"2024-02-16T00:11:51.830448+0000","last_clean":"2024-02-16T00:11:51.830448+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:11:51.830448+0000","last_undegraded":"2024-02-16T00:11:51.830448+0000","last_fullsized":"2024-02-16T00:11:51.830448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:04.097666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840147+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:11:50.840147+0000","last_peered":"2024-02-16T00:11:50.840147+0000","last_clean":"2024-02-16T00:11:50.840147+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:11:50.840147+0000","last_undegraded":"2024-02-16T00:11:50.840147+0000","last_fullsized":"2024-02-16T00:11:50.840147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.226733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831639+0000","last_change":"2024-02-16T00:11:04.801768+0000","last_active":"2024-02-16T00:11:51.831639+0000","last_peered":"2024-02-16T00:11:51.831639+0000","last_clean":"2024-02-16T00:11:51.831639+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:11:51.831639+0000","last_undegraded":"2024-02-16T00:11:51.831639+0000","last_fullsized":"2024-02-16T00:11:51.831639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:45.811771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841024+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:11:50.841024+0000","last_peered":"2024-02-16T00:11:50.841024+0000","last_clean":"2024-02-16T00:11:50.841024+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:11:50.841024+0000","last_undegraded":"2024-02-16T00:11:50.841024+0000","last_fullsized":"2024-02-16T00:11:50.841024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:13.889993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849296+0000","last_change":"2024-02-16T00:11:06.802067+0000","last_active":"2024-02-16T00:11:50.849296+0000","last_peered":"2024-02-16T00:11:50.849296+0000","last_clean":"2024-02-16T00:11:50.849296+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:11:50.849296+0000","last_undegraded":"2024-02-16T00:11:50.849296+0000","last_fullsized":"2024-02-16T00:11:50.849296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:43.145044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844168+0000","last_change":"2024-02-16T00:11:08.814283+0000","last_active":"2024-02-16T00:11:50.844168+0000","last_peered":"2024-02-16T00:11:50.844168+0000","last_clean":"2024-02-16T00:11:50.844168+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:11:50.844168+0000","last_undegraded":"2024-02-16T00:11:50.844168+0000","last_fullsized":"2024-02-16T00:11:50.844168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:04.932316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'239","reported_seq":328,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.614819+0000","last_change":"2024-02-16T00:11:10.827795+0000","last_active":"2024-02-16T00:12:33.614819+0000","last_peered":"2024-02-16T00:12:33.614819+0000","last_clean":"2024-02-16T00:12:33.614819+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:33.614819+0000","last_undegraded":"2024-02-16T00:12:33.614819+0000","last_fullsized":"2024-02-16T00:12:33.614819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:46.508578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839100+0000","last_change":"2024-02-16T00:11:12.832363+0000","last_active":"2024-02-16T00:11:50.839100+0000","last_peered":"2024-02-16T00:11:50.839100+0000","last_clean":"2024-02-16T00:11:50.839100+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:11:50.839100+0000","last_undegraded":"2024-02-16T00:11:50.839100+0000","last_fullsized":"2024-02-16T00:11:50.839100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:05.101733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447432+0000","last_change":"2024-02-16T00:11:04.798269+0000","last_active":"2024-02-16T00:12:33.447432+0000","last_peered":"2024-02-16T00:12:33.447432+0000","last_clean":"2024-02-16T00:12:33.447432+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:12:33.447432+0000","last_undegraded":"2024-02-16T00:12:33.447432+0000","last_fullsized":"2024-02-16T00:12:33.447432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:55.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847476+0000","last_change":"2024-02-16T00:11:02.810889+0000","last_active":"2024-02-16T00:11:50.847476+0000","last_peered":"2024-02-16T00:11:50.847476+0000","last_clean":"2024-02-16T00:11:50.847476+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:11:50.847476+0000","last_undegraded":"2024-02-16T00:11:50.847476+0000","last_fullsized":"2024-02-16T00:11:50.847476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848612+0000","last_change":"2024-02-16T00:11:06.805017+0000","last_active":"2024-02-16T00:11:50.848612+0000","last_peered":"2024-02-16T00:11:50.848612+0000","last_clean":"2024-02-16T00:11:50.848612+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:11:50.848612+0000","last_undegraded":"2024-02-16T00:11:50.848612+0000","last_fullsized":"2024-02-16T00:11:50.848612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:38.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'60","reported_seq":128,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.980293+0000","last_change":"2024-02-16T00:11:08.812824+0000","last_active":"2024-02-16T00:12:27.980293+0000","last_peered":"2024-02-16T00:12:27.980293+0000","last_clean":"2024-02-16T00:12:27.980293+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:27.980293+0000","last_undegraded":"2024-02-16T00:12:27.980293+0000","last_fullsized":"2024-02-16T00:12:27.980293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:49.397658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828558+0000","last_change":"2024-02-16T00:11:10.815519+0000","last_active":"2024-02-16T00:11:51.828558+0000","last_peered":"2024-02-16T00:11:51.828558+0000","last_clean":"2024-02-16T00:11:51.828558+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:11:51.828558+0000","last_undegraded":"2024-02-16T00:11:51.828558+0000","last_fullsized":"2024-02-16T00:11:51.828558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:54.865963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849722+0000","last_change":"2024-02-16T00:11:12.828004+0000","last_active":"2024-02-16T00:11:50.849722+0000","last_peered":"2024-02-16T00:11:50.849722+0000","last_clean":"2024-02-16T00:11:50.849722+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:11:50.849722+0000","last_undegraded":"2024-02-16T00:11:50.849722+0000","last_fullsized":"2024-02-16T00:11:50.849722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:43.107611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842936+0000","last_change":"2024-02-16T00:11:04.802752+0000","last_active":"2024-02-16T00:11:50.842936+0000","last_peered":"2024-02-16T00:11:50.842936+0000","last_clean":"2024-02-16T00:11:50.842936+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:11:50.842936+0000","last_undegraded":"2024-02-16T00:11:50.842936+0000","last_fullsized":"2024-02-16T00:11:50.842936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:08.473080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845216+0000","last_change":"2024-02-16T00:11:02.815829+0000","last_active":"2024-02-16T00:11:50.845216+0000","last_peered":"2024-02-16T00:11:50.845216+0000","last_clean":"2024-02-16T00:11:50.845216+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:11:50.845216+0000","last_undegraded":"2024-02-16T00:11:50.845216+0000","last_fullsized":"2024-02-16T00:11:50.845216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:04.562290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.590941+0000","last_change":"2024-02-16T00:11:06.809403+0000","last_active":"2024-02-16T00:12:33.590941+0000","last_peered":"2024-02-16T00:12:33.590941+0000","last_clean":"2024-02-16T00:12:33.590941+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:33.590941+0000","last_undegraded":"2024-02-16T00:12:33.590941+0000","last_fullsized":"2024-02-16T00:12:33.590941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:35.031327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":875,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":243,"num_read_kb":242,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.927473+0000","last_change":"2024-02-16T00:11:08.812928+0000","last_active":"2024-02-16T00:12:27.927473+0000","last_peered":"2024-02-16T00:12:27.927473+0000","last_clean":"2024-02-16T00:12:27.927473+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:27.927473+0000","last_undegraded":"2024-02-16T00:12:27.927473+0000","last_fullsized":"2024-02-16T00:12:27.927473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:45.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":52,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839358+0000","last_change":"2024-02-16T00:11:10.827306+0000","last_active":"2024-02-16T00:11:50.839358+0000","last_peered":"2024-02-16T00:11:50.839358+0000","last_clean":"2024-02-16T00:11:50.839358+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:11:50.839358+0000","last_undegraded":"2024-02-16T00:11:50.839358+0000","last_fullsized":"2024-02-16T00:11:50.839358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:46.792767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841996+0000","last_change":"2024-02-16T00:11:12.830200+0000","last_active":"2024-02-16T00:11:50.841996+0000","last_peered":"2024-02-16T00:11:50.841996+0000","last_clean":"2024-02-16T00:11:50.841996+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:11:50.841996+0000","last_undegraded":"2024-02-16T00:11:50.841996+0000","last_fullsized":"2024-02-16T00:11:50.841996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:34.641380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839696+0000","last_change":"2024-02-16T00:11:04.806595+0000","last_active":"2024-02-16T00:11:50.839696+0000","last_peered":"2024-02-16T00:11:50.839696+0000","last_clean":"2024-02-16T00:11:50.839696+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:11:50.839696+0000","last_undegraded":"2024-02-16T00:11:50.839696+0000","last_fullsized":"2024-02-16T00:11:50.839696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:15.344749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830815+0000","last_change":"2024-02-16T00:11:02.802098+0000","last_active":"2024-02-16T00:11:51.830815+0000","last_peered":"2024-02-16T00:11:51.830815+0000","last_clean":"2024-02-16T00:11:51.830815+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:11:51.830815+0000","last_undegraded":"2024-02-16T00:11:51.830815+0000","last_fullsized":"2024-02-16T00:11:51.830815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848845+0000","last_change":"2024-02-16T00:11:06.811600+0000","last_active":"2024-02-16T00:11:50.848845+0000","last_peered":"2024-02-16T00:11:50.848845+0000","last_clean":"2024-02-16T00:11:50.848845+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:11:50.848845+0000","last_undegraded":"2024-02-16T00:11:50.848845+0000","last_fullsized":"2024-02-16T00:11:50.848845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:02.997605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.428055+0000","last_change":"2024-02-16T00:11:08.814011+0000","last_active":"2024-02-16T00:12:33.428055+0000","last_peered":"2024-02-16T00:12:33.428055+0000","last_clean":"2024-02-16T00:12:33.428055+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:33.428055+0000","last_undegraded":"2024-02-16T00:12:33.428055+0000","last_fullsized":"2024-02-16T00:12:33.428055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:05.767514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839700+0000","last_change":"2024-02-16T00:11:10.831082+0000","last_active":"2024-02-16T00:11:50.839700+0000","last_peered":"2024-02-16T00:11:50.839700+0000","last_clean":"2024-02-16T00:11:50.839700+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:11:50.839700+0000","last_undegraded":"2024-02-16T00:11:50.839700+0000","last_fullsized":"2024-02-16T00:11:50.839700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:40.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844236+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:11:50.844236+0000","last_peered":"2024-02-16T00:11:50.844236+0000","last_clean":"2024-02-16T00:11:50.844236+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:11:50.844236+0000","last_undegraded":"2024-02-16T00:11:50.844236+0000","last_fullsized":"2024-02-16T00:11:50.844236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:12.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969458+0000","last_change":"2024-02-16T00:11:04.798644+0000","last_active":"2024-02-16T00:12:27.969458+0000","last_peered":"2024-02-16T00:12:27.969458+0000","last_clean":"2024-02-16T00:12:27.969458+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:12:27.969458+0000","last_undegraded":"2024-02-16T00:12:27.969458+0000","last_fullsized":"2024-02-16T00:12:27.969458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:26.014194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849586+0000","last_change":"2024-02-16T00:11:02.820199+0000","last_active":"2024-02-16T00:11:50.849586+0000","last_peered":"2024-02-16T00:11:50.849586+0000","last_clean":"2024-02-16T00:11:50.849586+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:11:50.849586+0000","last_undegraded":"2024-02-16T00:11:50.849586+0000","last_fullsized":"2024-02-16T00:11:50.849586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847851+0000","last_change":"2024-02-16T00:11:06.809034+0000","last_active":"2024-02-16T00:11:50.847851+0000","last_peered":"2024-02-16T00:11:50.847851+0000","last_clean":"2024-02-16T00:11:50.847851+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:11:50.847851+0000","last_undegraded":"2024-02-16T00:11:50.847851+0000","last_fullsized":"2024-02-16T00:11:50.847851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:17.352311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'40","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.954023+0000","last_change":"2024-02-16T00:11:08.814763+0000","last_active":"2024-02-16T00:12:27.954023+0000","last_peered":"2024-02-16T00:12:27.954023+0000","last_clean":"2024-02-16T00:12:27.954023+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:12:27.954023+0000","last_undegraded":"2024-02-16T00:12:27.954023+0000","last_fullsized":"2024-02-16T00:12:27.954023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:51:50.833249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829348+0000","last_change":"2024-02-16T00:11:10.819364+0000","last_active":"2024-02-16T00:11:51.829348+0000","last_peered":"2024-02-16T00:11:51.829348+0000","last_clean":"2024-02-16T00:11:51.829348+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:11:51.829348+0000","last_undegraded":"2024-02-16T00:11:51.829348+0000","last_fullsized":"2024-02-16T00:11:51.829348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:15.575681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841804+0000","last_change":"2024-02-16T00:11:12.831037+0000","last_active":"2024-02-16T00:11:50.841804+0000","last_peered":"2024-02-16T00:11:50.841804+0000","last_clean":"2024-02-16T00:11:50.841804+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:11:50.841804+0000","last_undegraded":"2024-02-16T00:11:50.841804+0000","last_fullsized":"2024-02-16T00:11:50.841804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:19.609072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322586+0000","last_change":"2024-02-16T00:11:04.813889+0000","last_active":"2024-02-16T00:12:27.322586+0000","last_peered":"2024-02-16T00:12:27.322586+0000","last_clean":"2024-02-16T00:12:27.322586+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:12:27.322586+0000","last_undegraded":"2024-02-16T00:12:27.322586+0000","last_fullsized":"2024-02-16T00:12:27.322586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:43.089230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843316+0000","last_change":"2024-02-16T00:11:02.816801+0000","last_active":"2024-02-16T00:11:50.843316+0000","last_peered":"2024-02-16T00:11:50.843316+0000","last_clean":"2024-02-16T00:11:50.843316+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:11:50.843316+0000","last_undegraded":"2024-02-16T00:11:50.843316+0000","last_fullsized":"2024-02-16T00:11:50.843316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322570+0000","last_change":"2024-02-16T00:11:04.801950+0000","last_active":"2024-02-16T00:12:27.322570+0000","last_peered":"2024-02-16T00:12:27.322570+0000","last_clean":"2024-02-16T00:12:27.322570+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:12:27.322570+0000","last_undegraded":"2024-02-16T00:12:27.322570+0000","last_fullsized":"2024-02-16T00:12:27.322570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:03.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828686+0000","last_change":"2024-02-16T00:11:02.808413+0000","last_active":"2024-02-16T00:11:51.828686+0000","last_peered":"2024-02-16T00:11:51.828686+0000","last_clean":"2024-02-16T00:11:51.828686+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:11:51.828686+0000","last_undegraded":"2024-02-16T00:11:51.828686+0000","last_fullsized":"2024-02-16T00:11:51.828686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447415+0000","last_change":"2024-02-16T00:11:04.810063+0000","last_active":"2024-02-16T00:12:33.447415+0000","last_peered":"2024-02-16T00:12:33.447415+0000","last_clean":"2024-02-16T00:12:33.447415+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:33.447415+0000","last_undegraded":"2024-02-16T00:12:33.447415+0000","last_fullsized":"2024-02-16T00:12:33.447415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:09.293991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840012+0000","last_change":"2024-02-16T00:11:02.824009+0000","last_active":"2024-02-16T00:11:50.840012+0000","last_peered":"2024-02-16T00:11:50.840012+0000","last_clean":"2024-02-16T00:11:50.840012+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:11:50.840012+0000","last_undegraded":"2024-02-16T00:11:50.840012+0000","last_fullsized":"2024-02-16T00:11:50.840012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:08.487886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831276+0000","last_change":"2024-02-16T00:11:04.801764+0000","last_active":"2024-02-16T00:11:51.831276+0000","last_peered":"2024-02-16T00:11:51.831276+0000","last_clean":"2024-02-16T00:11:51.831276+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:11:51.831276+0000","last_undegraded":"2024-02-16T00:11:51.831276+0000","last_fullsized":"2024-02-16T00:11:51.831276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830270+0000","last_change":"2024-02-16T00:11:02.797510+0000","last_active":"2024-02-16T00:11:51.830270+0000","last_peered":"2024-02-16T00:11:51.830270+0000","last_clean":"2024-02-16T00:11:51.830270+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:11:51.830270+0000","last_undegraded":"2024-02-16T00:11:51.830270+0000","last_fullsized":"2024-02-16T00:11:51.830270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830000+0000","last_change":"2024-02-16T00:11:04.810324+0000","last_active":"2024-02-16T00:11:51.830000+0000","last_peered":"2024-02-16T00:11:51.830000+0000","last_clean":"2024-02-16T00:11:51.830000+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:11:51.830000+0000","last_undegraded":"2024-02-16T00:11:51.830000+0000","last_fullsized":"2024-02-16T00:11:51.830000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:31.576677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831427+0000","last_change":"2024-02-16T00:11:02.801630+0000","last_active":"2024-02-16T00:11:51.831427+0000","last_peered":"2024-02-16T00:11:51.831427+0000","last_clean":"2024-02-16T00:11:51.831427+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:11:51.831427+0000","last_undegraded":"2024-02-16T00:11:51.831427+0000","last_fullsized":"2024-02-16T00:11:51.831427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:16.857323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322847+0000","last_change":"2024-02-16T00:11:04.814522+0000","last_active":"2024-02-16T00:12:27.322847+0000","last_peered":"2024-02-16T00:12:27.322847+0000","last_clean":"2024-02-16T00:12:27.322847+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:12:27.322847+0000","last_undegraded":"2024-02-16T00:12:27.322847+0000","last_fullsized":"2024-02-16T00:12:27.322847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:22:13.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846889+0000","last_change":"2024-02-16T00:11:02.810745+0000","last_active":"2024-02-16T00:11:50.846889+0000","last_peered":"2024-02-16T00:11:50.846889+0000","last_clean":"2024-02-16T00:11:50.846889+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:11:50.846889+0000","last_undegraded":"2024-02-16T00:11:50.846889+0000","last_fullsized":"2024-02-16T00:11:50.846889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447290+0000","last_change":"2024-02-16T00:11:04.797743+0000","last_active":"2024-02-16T00:12:33.447290+0000","last_peered":"2024-02-16T00:12:33.447290+0000","last_clean":"2024-02-16T00:12:33.447290+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:12:33.447290+0000","last_undegraded":"2024-02-16T00:12:33.447290+0000","last_fullsized":"2024-02-16T00:12:33.447290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842219+0000","last_change":"2024-02-16T00:11:02.815909+0000","last_active":"2024-02-16T00:11:50.842219+0000","last_peered":"2024-02-16T00:11:50.842219+0000","last_clean":"2024-02-16T00:11:50.842219+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:11:50.842219+0000","last_undegraded":"2024-02-16T00:11:50.842219+0000","last_fullsized":"2024-02-16T00:11:50.842219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322807+0000","last_change":"2024-02-16T00:11:04.796966+0000","last_active":"2024-02-16T00:12:27.322807+0000","last_peered":"2024-02-16T00:12:27.322807+0000","last_clean":"2024-02-16T00:12:27.322807+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:12:27.322807+0000","last_undegraded":"2024-02-16T00:12:27.322807+0000","last_fullsized":"2024-02-16T00:12:27.322807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:39.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830839+0000","last_change":"2024-02-16T00:11:02.797604+0000","last_active":"2024-02-16T00:11:51.830839+0000","last_peered":"2024-02-16T00:11:51.830839+0000","last_clean":"2024-02-16T00:11:51.830839+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:11:51.830839+0000","last_undegraded":"2024-02-16T00:11:51.830839+0000","last_fullsized":"2024-02-16T00:11:51.830839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:42.572100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447505+0000","last_change":"2024-02-16T00:11:04.802856+0000","last_active":"2024-02-16T00:12:33.447505+0000","last_peered":"2024-02-16T00:12:33.447505+0000","last_clean":"2024-02-16T00:12:33.447505+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:12:33.447505+0000","last_undegraded":"2024-02-16T00:12:33.447505+0000","last_fullsized":"2024-02-16T00:12:33.447505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:47:42.006974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839685+0000","last_change":"2024-02-16T00:11:02.820947+0000","last_active":"2024-02-16T00:11:50.839685+0000","last_peered":"2024-02-16T00:11:50.839685+0000","last_clean":"2024-02-16T00:11:50.839685+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:11:50.839685+0000","last_undegraded":"2024-02-16T00:11:50.839685+0000","last_fullsized":"2024-02-16T00:11:50.839685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:21.162020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969475+0000","last_change":"2024-02-16T00:11:04.807293+0000","last_active":"2024-02-16T00:12:27.969475+0000","last_peered":"2024-02-16T00:12:27.969475+0000","last_clean":"2024-02-16T00:12:27.969475+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:12:27.969475+0000","last_undegraded":"2024-02-16T00:12:27.969475+0000","last_fullsized":"2024-02-16T00:12:27.969475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:41.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828960+0000","last_change":"2024-02-16T00:11:02.797276+0000","last_active":"2024-02-16T00:11:51.828960+0000","last_peered":"2024-02-16T00:11:51.828960+0000","last_clean":"2024-02-16T00:11:51.828960+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:11:51.828960+0000","last_undegraded":"2024-02-16T00:11:51.828960+0000","last_fullsized":"2024-02-16T00:11:51.828960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831738+0000","last_change":"2024-02-16T00:11:04.812406+0000","last_active":"2024-02-16T00:11:51.831738+0000","last_peered":"2024-02-16T00:11:51.831738+0000","last_clean":"2024-02-16T00:11:51.831738+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:11:51.831738+0000","last_undegraded":"2024-02-16T00:11:51.831738+0000","last_fullsized":"2024-02-16T00:11:51.831738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847992+0000","last_change":"2024-02-16T00:11:02.809533+0000","last_active":"2024-02-16T00:11:50.847992+0000","last_peered":"2024-02-16T00:11:50.847992+0000","last_clean":"2024-02-16T00:11:50.847992+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:11:50.847992+0000","last_undegraded":"2024-02-16T00:11:50.847992+0000","last_fullsized":"2024-02-16T00:11:50.847992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969462+0000","last_change":"2024-02-16T00:11:04.796459+0000","last_active":"2024-02-16T00:12:27.969462+0000","last_peered":"2024-02-16T00:12:27.969462+0000","last_clean":"2024-02-16T00:12:27.969462+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:12:27.969462+0000","last_undegraded":"2024-02-16T00:12:27.969462+0000","last_fullsized":"2024-02-16T00:12:27.969462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:34.974228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846880+0000","last_change":"2024-02-16T00:11:02.796731+0000","last_active":"2024-02-16T00:11:50.846880+0000","last_peered":"2024-02-16T00:11:50.846880+0000","last_clean":"2024-02-16T00:11:50.846880+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:11:50.846880+0000","last_undegraded":"2024-02-16T00:11:50.846880+0000","last_fullsized":"2024-02-16T00:11:50.846880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847935+0000","last_change":"2024-02-16T00:11:04.814979+0000","last_active":"2024-02-16T00:11:50.847935+0000","last_peered":"2024-02-16T00:11:50.847935+0000","last_clean":"2024-02-16T00:11:50.847935+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:11:50.847935+0000","last_undegraded":"2024-02-16T00:11:50.847935+0000","last_fullsized":"2024-02-16T00:11:50.847935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:45.811771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842495+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:11:50.842495+0000","last_peered":"2024-02-16T00:11:50.842495+0000","last_clean":"2024-02-16T00:11:50.842495+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:11:50.842495+0000","last_undegraded":"2024-02-16T00:11:50.842495+0000","last_fullsized":"2024-02-16T00:11:50.842495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:23.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848738+0000","last_change":"2024-02-16T00:11:04.803538+0000","last_active":"2024-02-16T00:11:50.848738+0000","last_peered":"2024-02-16T00:11:50.848738+0000","last_clean":"2024-02-16T00:11:50.848738+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:11:50.848738+0000","last_undegraded":"2024-02-16T00:11:50.848738+0000","last_fullsized":"2024-02-16T00:11:50.848738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:47.811172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845428+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:11:50.845428+0000","last_peered":"2024-02-16T00:11:50.845428+0000","last_clean":"2024-02-16T00:11:50.845428+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:11:50.845428+0000","last_undegraded":"2024-02-16T00:11:50.845428+0000","last_fullsized":"2024-02-16T00:11:50.845428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:06.466729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840720+0000","last_change":"2024-02-16T00:11:04.808274+0000","last_active":"2024-02-16T00:11:50.840720+0000","last_peered":"2024-02-16T00:11:50.840720+0000","last_clean":"2024-02-16T00:11:50.840720+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:11:50.840720+0000","last_undegraded":"2024-02-16T00:11:50.840720+0000","last_fullsized":"2024-02-16T00:11:50.840720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:36.866397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842918+0000","last_change":"2024-02-16T00:11:02.816585+0000","last_active":"2024-02-16T00:11:50.842918+0000","last_peered":"2024-02-16T00:11:50.842918+0000","last_clean":"2024-02-16T00:11:50.842918+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:11:50.842918+0000","last_undegraded":"2024-02-16T00:11:50.842918+0000","last_fullsized":"2024-02-16T00:11:50.842918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848533+0000","last_change":"2024-02-16T00:11:04.798394+0000","last_active":"2024-02-16T00:11:50.848533+0000","last_peered":"2024-02-16T00:11:50.848533+0000","last_clean":"2024-02-16T00:11:50.848533+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:11:50.848533+0000","last_undegraded":"2024-02-16T00:11:50.848533+0000","last_fullsized":"2024-02-16T00:11:50.848533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:30:00.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843889+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:11:50.843889+0000","last_peered":"2024-02-16T00:11:50.843889+0000","last_clean":"2024-02-16T00:11:50.843889+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:11:50.843889+0000","last_undegraded":"2024-02-16T00:11:50.843889+0000","last_fullsized":"2024-02-16T00:11:50.843889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:01.906683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840067+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:11:50.840067+0000","last_peered":"2024-02-16T00:11:50.840067+0000","last_clean":"2024-02-16T00:11:50.840067+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:11:50.840067+0000","last_undegraded":"2024-02-16T00:11:50.840067+0000","last_fullsized":"2024-02-16T00:11:50.840067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:04.771435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831287+0000","last_change":"2024-02-16T00:11:04.798473+0000","last_active":"2024-02-16T00:11:51.831287+0000","last_peered":"2024-02-16T00:11:51.831287+0000","last_clean":"2024-02-16T00:11:51.831287+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:11:51.831287+0000","last_undegraded":"2024-02-16T00:11:51.831287+0000","last_fullsized":"2024-02-16T00:11:51.831287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:22:13.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829177+0000","last_change":"2024-02-16T00:11:02.808092+0000","last_active":"2024-02-16T00:11:51.829177+0000","last_peered":"2024-02-16T00:11:51.829177+0000","last_clean":"2024-02-16T00:11:51.829177+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:11:51.829177+0000","last_undegraded":"2024-02-16T00:11:51.829177+0000","last_fullsized":"2024-02-16T00:11:51.829177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848586+0000","last_change":"2024-02-16T00:11:04.814263+0000","last_active":"2024-02-16T00:11:50.848586+0000","last_peered":"2024-02-16T00:11:50.848586+0000","last_clean":"2024-02-16T00:11:50.848586+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:11:50.848586+0000","last_undegraded":"2024-02-16T00:11:50.848586+0000","last_fullsized":"2024-02-16T00:11:50.848586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:23.700793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1912,"ondisk_log_size":1912,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":1622,"num_read_kb":1373,"num_write":701,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1361,"ondisk_log_size":1361,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":800,"num_read_kb":799,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705686,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":143431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.499},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28599999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705687,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40452,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331388,"statfs":{"total":96636764160,"available":96595341312,"internally_reserved":0,"allocated":978944,"data_stored":728362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.23300000000000001}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.314},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.25},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.313}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":141433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:12:36.001 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-16T00:12:36.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:12:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.129+0000 7fac2c0ae640 1 Processor -- start 2024-02-16T00:12:36.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.129+0000 7fac2c0ae640 1 -- start start 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.129+0000 7fac2c0ae640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fac2406e110 0x7fac2406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.129+0000 7fac2c0ae640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2406ecc0 con 0x7fac24096ac0 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.129+0000 7fac2c0ae640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac24067100 con 0x7fac2406e110 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.129+0000 7fac29649640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fac2406e110 0x7fac2406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.130+0000 7fac29e4a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fac24096ac0 0x7fac2406ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60632/0 (socket says 172.21.15.2:60632) 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.130+0000 7fac29e4a640 1 -- 172.21.15.2:0/3570993743 learned_addr learned my addr 172.21.15.2:0/3570993743 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:36.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.130+0000 7fac29649640 1 -- 172.21.15.2:0/3570993743 >> v1:172.21.15.2:6789/0 conn(0x7fac24096ac0 legacy=0x7fac2406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.130+0000 7fac29649640 1 -- 172.21.15.2:0/3570993743 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24066b50 con 0x7fac2406e110 2024-02-16T00:12:36.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.130+0000 7fac29649640 1 --2- 172.21.15.2:0/3570993743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac2406d510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fac14009720 tx=0x7fac1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4214164563bedb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:36.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac28e48640 1 -- 172.21.15.2:0/3570993743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac1402e070 con 0x7fac2406e110 2024-02-16T00:12:36.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac28e48640 1 -- 172.21.15.2:0/3570993743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac140316d0 con 0x7fac2406e110 2024-02-16T00:12:36.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac28e48640 1 -- 172.21.15.2:0/3570993743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac14031990 con 0x7fac2406e110 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3570993743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 msgr2=0x7fac2406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 --2- 172.21.15.2:0/3570993743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac2406d510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fac14009720 tx=0x7fac1402b840 comp rx=0 tx=0).stop 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3570993743 shutdown_connections 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 --2- 172.21.15.2:0/3570993743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac2406d510 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3570993743 >> 172.21.15.2:0/3570993743 conn(0x7fac240974b0 msgr2=0x7fac240978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3570993743 shutdown_connections 2024-02-16T00:12:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.131+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3570993743 wait complete. 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.132+0000 7fac2c0ae640 1 Processor -- start 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.132+0000 7fac2c0ae640 1 -- start start 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.132+0000 7fac2c0ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac24090cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.132+0000 7fac2c0ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24092f40 con 0x7fac2406e110 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.132+0000 7fac29e4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac24090cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac29e4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac24090cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38446/0 (socket says 172.21.15.2:38446) 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac29e4a640 1 -- 172.21.15.2:0/3010520503 learned_addr learned my addr 172.21.15.2:0/3010520503 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac29e4a640 1 -- 172.21.15.2:0/3010520503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14009400 con 0x7fac2406e110 2024-02-16T00:12:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac29e4a640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac24090cf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c4a0 tx=0x7fac2000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac20005c10 con 0x7fac2406e110 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20005d70 con 0x7fac2406e110 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24092c90 con 0x7fac2406e110 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac200071a0 con 0x7fac2406e110 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.133+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac24093920 con 0x7fac2406e110 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.134+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fac20007300 con 0x7fac2406e110 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.134+0000 7fac1a7fc640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fac08037ef0 0x7fac0803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.134+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fac2004a8f0 con 0x7fac2406e110 2024-02-16T00:12:36.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.134+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac240627b0 con 0x7fac2406e110 2024-02-16T00:12:36.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.134+0000 7fac29649640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fac08037ef0 0x7fac0803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:36.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.135+0000 7fac29649640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fac08037ef0 0x7fac0803a3b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fac14036000 tx=0x7fac14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:36.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.139+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac20017080 con 0x7fac2406e110 2024-02-16T00:12:36.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.316+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac24133a20 con 0x7fac08037ef0 2024-02-16T00:12:36.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.332+0000 7fac1a7fc640 1 -- 172.21.15.2:0/3010520503 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673164 (secure 0 0 0) 0x7fac14031c00 con 0x7fac08037ef0 2024-02-16T00:12:36.342 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:12:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:12:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.336+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fac08037ef0 msgr2=0x7fac0803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.336+0000 7fac2c0ae640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fac08037ef0 0x7fac0803a3b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fac14036000 tx=0x7fac14008030 comp rx=0 tx=0).stop 2024-02-16T00:12:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.336+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 msgr2=0x7fac24090cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac24090cf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c4a0 tx=0x7fac2000c960 comp rx=0 tx=0).stop 2024-02-16T00:12:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 shutdown_connections 2024-02-16T00:12:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fac08037ef0 0x7fac0803a3b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 --2- 172.21.15.2:0/3010520503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac2406e110 0x7fac24090cf0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 >> 172.21.15.2:0/3010520503 conn(0x7fac240974b0 msgr2=0x7fac24130fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 shutdown_connections 2024-02-16T00:12:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.337+0000 7fac2c0ae640 1 -- 172.21.15.2:0/3010520503 wait complete. 2024-02-16T00:12:36.352 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-02-16T00:12:35.696671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600040,"num_objects":243,"num_object_clones":0,"num_object_copies":487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":243,"num_whiteouts":0,"num_read":4053,"num_read_kb":3665,"num_write":1629,"num_write_kb":31917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3851,"ondisk_log_size":3851,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148252,"kb_used_data":2748,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339108,"statfs":{"total":386547056640,"available":386395246592,"internally_reserved":0,"allocated":2813952,"data_stored":1741233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-368,"num_objects":-3,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":0,"num_read":536,"num_read_kb":523,"num_write":151,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003497"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842072+0000","last_change":"2024-02-16T00:11:02.804024+0000","last_active":"2024-02-16T00:11:50.842072+0000","last_peered":"2024-02-16T00:11:50.842072+0000","last_clean":"2024-02-16T00:11:50.842072+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:11:50.842072+0000","last_undegraded":"2024-02-16T00:11:50.842072+0000","last_fullsized":"2024-02-16T00:11:50.842072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848062+0000","last_change":"2024-02-16T00:11:04.803215+0000","last_active":"2024-02-16T00:11:50.848062+0000","last_peered":"2024-02-16T00:11:50.848062+0000","last_clean":"2024-02-16T00:11:50.848062+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:11:50.848062+0000","last_undegraded":"2024-02-16T00:11:50.848062+0000","last_fullsized":"2024-02-16T00:11:50.848062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:23.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830974+0000","last_change":"2024-02-16T00:11:02.797595+0000","last_active":"2024-02-16T00:11:51.830974+0000","last_peered":"2024-02-16T00:11:51.830974+0000","last_clean":"2024-02-16T00:11:51.830974+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:11:51.830974+0000","last_undegraded":"2024-02-16T00:11:51.830974+0000","last_fullsized":"2024-02-16T00:11:51.830974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840747+0000","last_change":"2024-02-16T00:11:04.803831+0000","last_active":"2024-02-16T00:11:50.840747+0000","last_peered":"2024-02-16T00:11:50.840747+0000","last_clean":"2024-02-16T00:11:50.840747+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:11:50.840747+0000","last_undegraded":"2024-02-16T00:11:50.840747+0000","last_fullsized":"2024-02-16T00:11:50.840747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.330427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845795+0000","last_change":"2024-02-16T00:11:02.815592+0000","last_active":"2024-02-16T00:11:50.845795+0000","last_peered":"2024-02-16T00:11:50.845795+0000","last_clean":"2024-02-16T00:11:50.845795+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:11:50.845795+0000","last_undegraded":"2024-02-16T00:11:50.845795+0000","last_fullsized":"2024-02-16T00:11:50.845795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:21.438654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840544+0000","last_change":"2024-02-16T00:11:04.807406+0000","last_active":"2024-02-16T00:11:50.840544+0000","last_peered":"2024-02-16T00:11:50.840544+0000","last_clean":"2024-02-16T00:11:50.840544+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:11:50.840544+0000","last_undegraded":"2024-02-16T00:11:50.840544+0000","last_fullsized":"2024-02-16T00:11:50.840544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:41.270560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843729+0000","last_change":"2024-02-16T00:11:02.818929+0000","last_active":"2024-02-16T00:11:50.843729+0000","last_peered":"2024-02-16T00:11:50.843729+0000","last_clean":"2024-02-16T00:11:50.843729+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:11:50.843729+0000","last_undegraded":"2024-02-16T00:11:50.843729+0000","last_fullsized":"2024-02-16T00:11:50.843729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'7","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322677+0000","last_change":"2024-02-16T00:11:04.807900+0000","last_active":"2024-02-16T00:12:27.322677+0000","last_peered":"2024-02-16T00:12:27.322677+0000","last_clean":"2024-02-16T00:12:27.322677+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:12:27.322677+0000","last_undegraded":"2024-02-16T00:12:27.322677+0000","last_fullsized":"2024-02-16T00:12:27.322677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:18.898214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841183+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:11:50.841183+0000","last_peered":"2024-02-16T00:11:50.841183+0000","last_clean":"2024-02-16T00:11:50.841183+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:11:50.841183+0000","last_undegraded":"2024-02-16T00:11:50.841183+0000","last_fullsized":"2024-02-16T00:11:50.841183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:24.007843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846803+0000","last_change":"2024-02-16T00:11:04.797530+0000","last_active":"2024-02-16T00:11:50.846803+0000","last_peered":"2024-02-16T00:11:50.846803+0000","last_clean":"2024-02-16T00:11:50.846803+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:11:50.846803+0000","last_undegraded":"2024-02-16T00:11:50.846803+0000","last_fullsized":"2024-02-16T00:11:50.846803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:39:54.175731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.442430+0000","last_change":"2024-02-16T00:11:02.803398+0000","last_active":"2024-02-16T00:12:33.442430+0000","last_peered":"2024-02-16T00:12:33.442430+0000","last_clean":"2024-02-16T00:12:33.442430+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:12:33.442430+0000","last_undegraded":"2024-02-16T00:12:33.442430+0000","last_fullsized":"2024-02-16T00:12:33.442430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844846+0000","last_change":"2024-02-16T00:11:04.809182+0000","last_active":"2024-02-16T00:11:50.844846+0000","last_peered":"2024-02-16T00:11:50.844846+0000","last_clean":"2024-02-16T00:11:50.844846+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:11:50.844846+0000","last_undegraded":"2024-02-16T00:11:50.844846+0000","last_fullsized":"2024-02-16T00:11:50.844846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:55.430651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840324+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:11:50.840324+0000","last_peered":"2024-02-16T00:11:50.840324+0000","last_clean":"2024-02-16T00:11:50.840324+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:11:50.840324+0000","last_undegraded":"2024-02-16T00:11:50.840324+0000","last_fullsized":"2024-02-16T00:11:50.840324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:28:12.323667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843211+0000","last_change":"2024-02-16T00:11:04.798579+0000","last_active":"2024-02-16T00:11:50.843211+0000","last_peered":"2024-02-16T00:11:50.843211+0000","last_clean":"2024-02-16T00:11:50.843211+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:11:50.843211+0000","last_undegraded":"2024-02-16T00:11:50.843211+0000","last_fullsized":"2024-02-16T00:11:50.843211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828879+0000","last_change":"2024-02-16T00:11:02.808083+0000","last_active":"2024-02-16T00:11:51.828879+0000","last_peered":"2024-02-16T00:11:51.828879+0000","last_clean":"2024-02-16T00:11:51.828879+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:11:51.828879+0000","last_undegraded":"2024-02-16T00:11:51.828879+0000","last_fullsized":"2024-02-16T00:11:51.828879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447599+0000","last_change":"2024-02-16T00:11:04.808709+0000","last_active":"2024-02-16T00:12:33.447599+0000","last_peered":"2024-02-16T00:12:33.447599+0000","last_clean":"2024-02-16T00:12:33.447599+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:12:33.447599+0000","last_undegraded":"2024-02-16T00:12:33.447599+0000","last_fullsized":"2024-02-16T00:12:33.447599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840576+0000","last_change":"2024-02-16T00:11:04.807676+0000","last_active":"2024-02-16T00:11:50.840576+0000","last_peered":"2024-02-16T00:11:50.840576+0000","last_clean":"2024-02-16T00:11:50.840576+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:11:50.840576+0000","last_undegraded":"2024-02-16T00:11:50.840576+0000","last_fullsized":"2024-02-16T00:11:50.840576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:13.340758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849691+0000","last_change":"2024-02-16T00:11:02.820441+0000","last_active":"2024-02-16T00:11:50.849691+0000","last_peered":"2024-02-16T00:11:50.849691+0000","last_clean":"2024-02-16T00:11:50.849691+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:11:50.849691+0000","last_undegraded":"2024-02-16T00:11:50.849691+0000","last_fullsized":"2024-02-16T00:11:50.849691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847661+0000","last_change":"2024-02-16T00:11:04.798908+0000","last_active":"2024-02-16T00:11:50.847661+0000","last_peered":"2024-02-16T00:11:50.847661+0000","last_clean":"2024-02-16T00:11:50.847661+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:11:50.847661+0000","last_undegraded":"2024-02-16T00:11:50.847661+0000","last_fullsized":"2024-02-16T00:11:50.847661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843030+0000","last_change":"2024-02-16T00:11:02.817331+0000","last_active":"2024-02-16T00:11:50.843030+0000","last_peered":"2024-02-16T00:11:50.843030+0000","last_clean":"2024-02-16T00:11:50.843030+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:11:50.843030+0000","last_undegraded":"2024-02-16T00:11:50.843030+0000","last_fullsized":"2024-02-16T00:11:50.843030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848232+0000","last_change":"2024-02-16T00:11:04.803702+0000","last_active":"2024-02-16T00:11:50.848232+0000","last_peered":"2024-02-16T00:11:50.848232+0000","last_clean":"2024-02-16T00:11:50.848232+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:11:50.848232+0000","last_undegraded":"2024-02-16T00:11:50.848232+0000","last_fullsized":"2024-02-16T00:11:50.848232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:03.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847158+0000","last_change":"2024-02-16T00:11:02.810700+0000","last_active":"2024-02-16T00:11:50.847158+0000","last_peered":"2024-02-16T00:11:50.847158+0000","last_clean":"2024-02-16T00:11:50.847158+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:11:50.847158+0000","last_undegraded":"2024-02-16T00:11:50.847158+0000","last_fullsized":"2024-02-16T00:11:50.847158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830790+0000","last_change":"2024-02-16T00:11:04.810242+0000","last_active":"2024-02-16T00:11:51.830790+0000","last_peered":"2024-02-16T00:11:51.830790+0000","last_clean":"2024-02-16T00:11:51.830790+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:11:51.830790+0000","last_undegraded":"2024-02-16T00:11:51.830790+0000","last_fullsized":"2024-02-16T00:11:51.830790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847357+0000","last_change":"2024-02-16T00:11:02.825186+0000","last_active":"2024-02-16T00:11:50.847357+0000","last_peered":"2024-02-16T00:11:50.847357+0000","last_clean":"2024-02-16T00:11:50.847357+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:11:50.847357+0000","last_undegraded":"2024-02-16T00:11:50.847357+0000","last_fullsized":"2024-02-16T00:11:50.847357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969995+0000","last_change":"2024-02-16T00:11:04.812055+0000","last_active":"2024-02-16T00:12:27.969995+0000","last_peered":"2024-02-16T00:12:27.969995+0000","last_clean":"2024-02-16T00:12:27.969995+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:12:27.969995+0000","last_undegraded":"2024-02-16T00:12:27.969995+0000","last_fullsized":"2024-02-16T00:12:27.969995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830403+0000","last_change":"2024-02-16T00:11:02.797860+0000","last_active":"2024-02-16T00:11:51.830403+0000","last_peered":"2024-02-16T00:11:51.830403+0000","last_clean":"2024-02-16T00:11:51.830403+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:11:51.830403+0000","last_undegraded":"2024-02-16T00:11:51.830403+0000","last_fullsized":"2024-02-16T00:11:51.830403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969670+0000","last_change":"2024-02-16T00:11:04.797835+0000","last_active":"2024-02-16T00:12:27.969670+0000","last_peered":"2024-02-16T00:12:27.969670+0000","last_clean":"2024-02-16T00:12:27.969670+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:12:27.969670+0000","last_undegraded":"2024-02-16T00:12:27.969670+0000","last_fullsized":"2024-02-16T00:12:27.969670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:17.940025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840296+0000","last_change":"2024-02-16T00:11:02.817356+0000","last_active":"2024-02-16T00:11:50.840296+0000","last_peered":"2024-02-16T00:11:50.840296+0000","last_clean":"2024-02-16T00:11:50.840296+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:11:50.840296+0000","last_undegraded":"2024-02-16T00:11:50.840296+0000","last_fullsized":"2024-02-16T00:11:50.840296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:36:34.654920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'19","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.437086+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:33.437086+0000","last_peered":"2024-02-16T00:12:33.437086+0000","last_clean":"2024-02-16T00:12:33.437086+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:33.437086+0000","last_undegraded":"2024-02-16T00:12:33.437086+0000","last_fullsized":"2024-02-16T00:12:33.437086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:34.754053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842557+0000","last_change":"2024-02-16T00:11:04.804063+0000","last_active":"2024-02-16T00:11:50.842557+0000","last_peered":"2024-02-16T00:11:50.842557+0000","last_clean":"2024-02-16T00:11:50.842557+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:11:50.842557+0000","last_undegraded":"2024-02-16T00:11:50.842557+0000","last_fullsized":"2024-02-16T00:11:50.842557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:41.137481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840923+0000","last_change":"2024-02-16T00:11:02.823865+0000","last_active":"2024-02-16T00:11:50.840923+0000","last_peered":"2024-02-16T00:11:50.840923+0000","last_clean":"2024-02-16T00:11:50.840923+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:11:50.840923+0000","last_undegraded":"2024-02-16T00:11:50.840923+0000","last_fullsized":"2024-02-16T00:11:50.840923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.696986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844686+0000","last_change":"2024-02-16T00:11:06.805693+0000","last_active":"2024-02-16T00:11:50.844686+0000","last_peered":"2024-02-16T00:11:50.844686+0000","last_clean":"2024-02-16T00:11:50.844686+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:11:50.844686+0000","last_undegraded":"2024-02-16T00:11:50.844686+0000","last_fullsized":"2024-02-16T00:11:50.844686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:26.998512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'40","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.944224+0000","last_change":"2024-02-16T00:11:08.812405+0000","last_active":"2024-02-16T00:12:27.944224+0000","last_peered":"2024-02-16T00:12:27.944224+0000","last_clean":"2024-02-16T00:12:27.944224+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:27.944224+0000","last_undegraded":"2024-02-16T00:12:27.944224+0000","last_fullsized":"2024-02-16T00:12:27.944224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:52.688126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849593+0000","last_change":"2024-02-16T00:11:10.827632+0000","last_active":"2024-02-16T00:11:50.849593+0000","last_peered":"2024-02-16T00:11:50.849593+0000","last_clean":"2024-02-16T00:11:50.849593+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:11:50.849593+0000","last_undegraded":"2024-02-16T00:11:50.849593+0000","last_fullsized":"2024-02-16T00:11:50.849593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:33.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.281521+0000","last_change":"2024-02-16T00:11:12.835250+0000","last_active":"2024-02-16T00:12:22.281521+0000","last_peered":"2024-02-16T00:12:22.281521+0000","last_clean":"2024-02-16T00:12:22.281521+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:12:22.281521+0000","last_undegraded":"2024-02-16T00:12:22.281521+0000","last_fullsized":"2024-02-16T00:12:22.281521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:33.641560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845318+0000","last_change":"2024-02-16T00:11:04.811172+0000","last_active":"2024-02-16T00:11:50.845318+0000","last_peered":"2024-02-16T00:11:50.845318+0000","last_clean":"2024-02-16T00:11:50.845318+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:11:50.845318+0000","last_undegraded":"2024-02-16T00:11:50.845318+0000","last_fullsized":"2024-02-16T00:11:50.845318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:25.462988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842875+0000","last_change":"2024-02-16T00:11:02.817929+0000","last_active":"2024-02-16T00:11:50.842875+0000","last_peered":"2024-02-16T00:11:50.842875+0000","last_clean":"2024-02-16T00:11:50.842875+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:11:50.842875+0000","last_undegraded":"2024-02-16T00:11:50.842875+0000","last_fullsized":"2024-02-16T00:11:50.842875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829901+0000","last_change":"2024-02-16T00:11:06.803389+0000","last_active":"2024-02-16T00:11:51.829901+0000","last_peered":"2024-02-16T00:11:51.829901+0000","last_clean":"2024-02-16T00:11:51.829901+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:11:51.829901+0000","last_undegraded":"2024-02-16T00:11:51.829901+0000","last_fullsized":"2024-02-16T00:11:51.829901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:57:31.755567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'12","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848533+0000","last_change":"2024-02-16T00:11:08.813382+0000","last_active":"2024-02-16T00:11:50.848533+0000","last_peered":"2024-02-16T00:11:50.848533+0000","last_clean":"2024-02-16T00:11:50.848533+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:11:50.848533+0000","last_undegraded":"2024-02-16T00:11:50.848533+0000","last_fullsized":"2024-02-16T00:11:50.848533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:56.365289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848536+0000","last_change":"2024-02-16T00:11:10.823836+0000","last_active":"2024-02-16T00:11:50.848536+0000","last_peered":"2024-02-16T00:11:50.848536+0000","last_clean":"2024-02-16T00:11:50.848536+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:11:50.848536+0000","last_undegraded":"2024-02-16T00:11:50.848536+0000","last_fullsized":"2024-02-16T00:11:50.848536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:15.575681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828823+0000","last_change":"2024-02-16T00:11:12.828416+0000","last_active":"2024-02-16T00:11:51.828823+0000","last_peered":"2024-02-16T00:11:51.828823+0000","last_clean":"2024-02-16T00:11:51.828823+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:11:51.828823+0000","last_undegraded":"2024-02-16T00:11:51.828823+0000","last_fullsized":"2024-02-16T00:11:51.828823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:38.040980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844918+0000","last_change":"2024-02-16T00:11:04.803967+0000","last_active":"2024-02-16T00:11:50.844918+0000","last_peered":"2024-02-16T00:11:50.844918+0000","last_clean":"2024-02-16T00:11:50.844918+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:11:50.844918+0000","last_undegraded":"2024-02-16T00:11:50.844918+0000","last_fullsized":"2024-02-16T00:11:50.844918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:24.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839683+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:11:50.839683+0000","last_peered":"2024-02-16T00:11:50.839683+0000","last_clean":"2024-02-16T00:11:50.839683+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:11:50.839683+0000","last_undegraded":"2024-02-16T00:11:50.839683+0000","last_fullsized":"2024-02-16T00:11:50.839683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:20.668173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831728+0000","last_change":"2024-02-16T00:11:06.804875+0000","last_active":"2024-02-16T00:11:51.831728+0000","last_peered":"2024-02-16T00:11:51.831728+0000","last_clean":"2024-02-16T00:11:51.831728+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:11:51.831728+0000","last_undegraded":"2024-02-16T00:11:51.831728+0000","last_fullsized":"2024-02-16T00:11:51.831728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:38.469870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845030+0000","last_change":"2024-02-16T00:11:08.813640+0000","last_active":"2024-02-16T00:11:50.845030+0000","last_peered":"2024-02-16T00:11:50.845030+0000","last_clean":"2024-02-16T00:11:50.845030+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:11:50.845030+0000","last_undegraded":"2024-02-16T00:11:50.845030+0000","last_fullsized":"2024-02-16T00:11:50.845030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:39.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'239","reported_seq":311,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.617293+0000","last_change":"2024-02-16T00:11:10.830884+0000","last_active":"2024-02-16T00:12:33.617293+0000","last_peered":"2024-02-16T00:12:33.617293+0000","last_clean":"2024-02-16T00:12:33.617293+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:12:33.617293+0000","last_undegraded":"2024-02-16T00:12:33.617293+0000","last_fullsized":"2024-02-16T00:12:33.617293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:17:51.160171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845460+0000","last_change":"2024-02-16T00:11:12.821286+0000","last_active":"2024-02-16T00:11:50.845460+0000","last_peered":"2024-02-16T00:11:50.845460+0000","last_clean":"2024-02-16T00:11:50.845460+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:11:50.845460+0000","last_undegraded":"2024-02-16T00:11:50.845460+0000","last_fullsized":"2024-02-16T00:11:50.845460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.448049+0000","last_change":"2024-02-16T00:11:04.803520+0000","last_active":"2024-02-16T00:12:33.448049+0000","last_peered":"2024-02-16T00:12:33.448049+0000","last_clean":"2024-02-16T00:12:33.448049+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:12:33.448049+0000","last_undegraded":"2024-02-16T00:12:33.448049+0000","last_fullsized":"2024-02-16T00:12:33.448049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:30:00.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847693+0000","last_change":"2024-02-16T00:11:02.820879+0000","last_active":"2024-02-16T00:11:50.847693+0000","last_peered":"2024-02-16T00:11:50.847693+0000","last_clean":"2024-02-16T00:11:50.847693+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:11:50.847693+0000","last_undegraded":"2024-02-16T00:11:50.847693+0000","last_fullsized":"2024-02-16T00:11:50.847693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845158+0000","last_change":"2024-02-16T00:11:06.807048+0000","last_active":"2024-02-16T00:11:50.845158+0000","last_peered":"2024-02-16T00:11:50.845158+0000","last_clean":"2024-02-16T00:11:50.845158+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:11:50.845158+0000","last_undegraded":"2024-02-16T00:11:50.845158+0000","last_fullsized":"2024-02-16T00:11:50.845158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:20:58.481322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.939005+0000","last_change":"2024-02-16T00:11:08.815411+0000","last_active":"2024-02-16T00:12:27.939005+0000","last_peered":"2024-02-16T00:12:27.939005+0000","last_clean":"2024-02-16T00:12:27.939005+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:27.939005+0000","last_undegraded":"2024-02-16T00:12:27.939005+0000","last_fullsized":"2024-02-16T00:12:27.939005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:52.985555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'239","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.621722+0000","last_change":"2024-02-16T00:11:10.820344+0000","last_active":"2024-02-16T00:12:33.621722+0000","last_peered":"2024-02-16T00:12:33.621722+0000","last_clean":"2024-02-16T00:12:33.621722+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:33.621722+0000","last_undegraded":"2024-02-16T00:12:33.621722+0000","last_fullsized":"2024-02-16T00:12:33.621722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:56.315714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.856376+0000","last_change":"2024-02-16T00:11:50.855956+0000","last_active":"2024-02-16T00:11:50.856376+0000","last_peered":"2024-02-16T00:11:50.856376+0000","last_clean":"2024-02-16T00:11:50.856376+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:11:50.856376+0000","last_undegraded":"2024-02-16T00:11:50.856376+0000","last_fullsized":"2024-02-16T00:11:50.856376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:18.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842241+0000","last_change":"2024-02-16T00:11:02.805831+0000","last_active":"2024-02-16T00:11:50.842241+0000","last_peered":"2024-02-16T00:11:50.842241+0000","last_clean":"2024-02-16T00:11:50.842241+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:11:50.842241+0000","last_undegraded":"2024-02-16T00:11:50.842241+0000","last_fullsized":"2024-02-16T00:11:50.842241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846785+0000","last_change":"2024-02-16T00:11:06.809760+0000","last_active":"2024-02-16T00:11:50.846785+0000","last_peered":"2024-02-16T00:11:50.846785+0000","last_clean":"2024-02-16T00:11:50.846785+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:11:50.846785+0000","last_undegraded":"2024-02-16T00:11:50.846785+0000","last_fullsized":"2024-02-16T00:11:50.846785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:40.171212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'46","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.948379+0000","last_change":"2024-02-16T00:11:08.816208+0000","last_active":"2024-02-16T00:12:27.948379+0000","last_peered":"2024-02-16T00:12:27.948379+0000","last_clean":"2024-02-16T00:12:27.948379+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:27.948379+0000","last_undegraded":"2024-02-16T00:12:27.948379+0000","last_fullsized":"2024-02-16T00:12:27.948379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:19.358580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830203+0000","last_change":"2024-02-16T00:11:10.820589+0000","last_active":"2024-02-16T00:11:51.830203+0000","last_peered":"2024-02-16T00:11:51.830203+0000","last_clean":"2024-02-16T00:11:51.830203+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:11:51.830203+0000","last_undegraded":"2024-02-16T00:11:51.830203+0000","last_fullsized":"2024-02-16T00:11:51.830203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:25.136505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.761548+0000","last_change":"2024-02-16T00:11:12.824309+0000","last_active":"2024-02-16T00:12:27.761548+0000","last_peered":"2024-02-16T00:12:27.761548+0000","last_clean":"2024-02-16T00:12:27.761548+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:27.761548+0000","last_undegraded":"2024-02-16T00:12:27.761548+0000","last_fullsized":"2024-02-16T00:12:27.761548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:56.872128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322700+0000","last_change":"2024-02-16T00:11:04.797488+0000","last_active":"2024-02-16T00:12:27.322700+0000","last_peered":"2024-02-16T00:12:27.322700+0000","last_clean":"2024-02-16T00:12:27.322700+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:12:27.322700+0000","last_undegraded":"2024-02-16T00:12:27.322700+0000","last_fullsized":"2024-02-16T00:12:27.322700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.964166+0000","last_change":"2024-02-16T00:11:02.815325+0000","last_active":"2024-02-16T00:12:27.964166+0000","last_peered":"2024-02-16T00:12:27.964166+0000","last_clean":"2024-02-16T00:12:27.964166+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:12:27.964166+0000","last_undegraded":"2024-02-16T00:12:27.964166+0000","last_fullsized":"2024-02-16T00:12:27.964166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829007+0000","last_change":"2024-02-16T00:11:06.808903+0000","last_active":"2024-02-16T00:11:51.829007+0000","last_peered":"2024-02-16T00:11:51.829007+0000","last_clean":"2024-02-16T00:11:51.829007+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:11:51.829007+0000","last_undegraded":"2024-02-16T00:11:51.829007+0000","last_fullsized":"2024-02-16T00:11:51.829007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:23.224863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.928427+0000","last_change":"2024-02-16T00:11:08.810670+0000","last_active":"2024-02-16T00:12:27.928427+0000","last_peered":"2024-02-16T00:12:27.928427+0000","last_clean":"2024-02-16T00:12:27.928427+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:27.928427+0000","last_undegraded":"2024-02-16T00:12:27.928427+0000","last_fullsized":"2024-02-16T00:12:27.928427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:33.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828968+0000","last_change":"2024-02-16T00:11:10.819436+0000","last_active":"2024-02-16T00:11:51.828968+0000","last_peered":"2024-02-16T00:11:51.828968+0000","last_clean":"2024-02-16T00:11:51.828968+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:11:51.828968+0000","last_undegraded":"2024-02-16T00:11:51.828968+0000","last_fullsized":"2024-02-16T00:11:51.828968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:12.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.170900+0000","last_change":"2024-02-16T00:11:12.828694+0000","last_active":"2024-02-16T00:12:22.170900+0000","last_peered":"2024-02-16T00:12:22.170900+0000","last_clean":"2024-02-16T00:12:22.170900+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:12:22.170900+0000","last_undegraded":"2024-02-16T00:12:22.170900+0000","last_fullsized":"2024-02-16T00:12:22.170900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:38.040980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:04.809981+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:10.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.325660+0000","last_change":"2024-02-16T00:11:02.815569+0000","last_active":"2024-02-16T00:12:27.325660+0000","last_peered":"2024-02-16T00:12:27.325660+0000","last_clean":"2024-02-16T00:12:27.325660+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:12:27.325660+0000","last_undegraded":"2024-02-16T00:12:27.325660+0000","last_fullsized":"2024-02-16T00:12:27.325660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:29.570326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831033+0000","last_change":"2024-02-16T00:11:06.806202+0000","last_active":"2024-02-16T00:11:51.831033+0000","last_peered":"2024-02-16T00:11:51.831033+0000","last_clean":"2024-02-16T00:11:51.831033+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:11:51.831033+0000","last_undegraded":"2024-02-16T00:11:51.831033+0000","last_fullsized":"2024-02-16T00:11:51.831033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:08.925296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.950167+0000","last_change":"2024-02-16T00:11:08.813417+0000","last_active":"2024-02-16T00:12:27.950167+0000","last_peered":"2024-02-16T00:12:27.950167+0000","last_clean":"2024-02-16T00:12:27.950167+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:27.950167+0000","last_undegraded":"2024-02-16T00:12:27.950167+0000","last_fullsized":"2024-02-16T00:12:27.950167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:05.893569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'239","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.622742+0000","last_change":"2024-02-16T00:11:10.816060+0000","last_active":"2024-02-16T00:12:33.622742+0000","last_peered":"2024-02-16T00:12:33.622742+0000","last_clean":"2024-02-16T00:12:33.622742+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:33.622742+0000","last_undegraded":"2024-02-16T00:12:33.622742+0000","last_fullsized":"2024-02-16T00:12:33.622742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:59.417398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830309+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:11:51.830309+0000","last_peered":"2024-02-16T00:11:51.830309+0000","last_clean":"2024-02-16T00:11:51.830309+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:11:51.830309+0000","last_undegraded":"2024-02-16T00:11:51.830309+0000","last_fullsized":"2024-02-16T00:11:51.830309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:09.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844394+0000","last_change":"2024-02-16T00:11:04.799023+0000","last_active":"2024-02-16T00:11:50.844394+0000","last_peered":"2024-02-16T00:11:50.844394+0000","last_clean":"2024-02-16T00:11:50.844394+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:11:50.844394+0000","last_undegraded":"2024-02-16T00:11:50.844394+0000","last_fullsized":"2024-02-16T00:11:50.844394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842185+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:11:50.842185+0000","last_peered":"2024-02-16T00:11:50.842185+0000","last_clean":"2024-02-16T00:11:50.842185+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:11:50.842185+0000","last_undegraded":"2024-02-16T00:11:50.842185+0000","last_fullsized":"2024-02-16T00:11:50.842185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:37.649958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829559+0000","last_change":"2024-02-16T00:11:06.808902+0000","last_active":"2024-02-16T00:11:51.829559+0000","last_peered":"2024-02-16T00:11:51.829559+0000","last_clean":"2024-02-16T00:11:51.829559+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:11:51.829559+0000","last_undegraded":"2024-02-16T00:11:51.829559+0000","last_fullsized":"2024-02-16T00:11:51.829559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:19:38.862897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'62","reported_seq":129,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.409004+0000","last_change":"2024-02-16T00:11:08.819445+0000","last_active":"2024-02-16T00:12:33.409004+0000","last_peered":"2024-02-16T00:12:33.409004+0000","last_clean":"2024-02-16T00:12:33.409004+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:12:33.409004+0000","last_undegraded":"2024-02-16T00:12:33.409004+0000","last_fullsized":"2024-02-16T00:12:33.409004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:16:44.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828688+0000","last_change":"2024-02-16T00:11:10.822009+0000","last_active":"2024-02-16T00:11:51.828688+0000","last_peered":"2024-02-16T00:11:51.828688+0000","last_clean":"2024-02-16T00:11:51.828688+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:11:51.828688+0000","last_undegraded":"2024-02-16T00:11:51.828688+0000","last_fullsized":"2024-02-16T00:11:51.828688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:44.750899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831614+0000","last_change":"2024-02-16T00:11:12.823579+0000","last_active":"2024-02-16T00:11:51.831614+0000","last_peered":"2024-02-16T00:11:51.831614+0000","last_clean":"2024-02-16T00:11:51.831614+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:11:51.831614+0000","last_undegraded":"2024-02-16T00:11:51.831614+0000","last_fullsized":"2024-02-16T00:11:51.831614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:37.304684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447979+0000","last_change":"2024-02-16T00:11:04.812522+0000","last_active":"2024-02-16T00:12:33.447979+0000","last_peered":"2024-02-16T00:12:33.447979+0000","last_clean":"2024-02-16T00:12:33.447979+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:12:33.447979+0000","last_undegraded":"2024-02-16T00:12:33.447979+0000","last_fullsized":"2024-02-16T00:12:33.447979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:33.023764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829755+0000","last_change":"2024-02-16T00:11:02.807400+0000","last_active":"2024-02-16T00:11:51.829755+0000","last_peered":"2024-02-16T00:11:51.829755+0000","last_clean":"2024-02-16T00:11:51.829755+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:11:51.829755+0000","last_undegraded":"2024-02-16T00:11:51.829755+0000","last_fullsized":"2024-02-16T00:11:51.829755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841646+0000","last_change":"2024-02-16T00:11:06.807251+0000","last_active":"2024-02-16T00:11:50.841646+0000","last_peered":"2024-02-16T00:11:50.841646+0000","last_clean":"2024-02-16T00:11:50.841646+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:11:50.841646+0000","last_undegraded":"2024-02-16T00:11:50.841646+0000","last_fullsized":"2024-02-16T00:11:50.841646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:25.708356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.932750+0000","last_change":"2024-02-16T00:11:08.809691+0000","last_active":"2024-02-16T00:12:27.932750+0000","last_peered":"2024-02-16T00:12:27.932750+0000","last_clean":"2024-02-16T00:12:27.932750+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:27.932750+0000","last_undegraded":"2024-02-16T00:12:27.932750+0000","last_fullsized":"2024-02-16T00:12:27.932750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:46:18.694281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843496+0000","last_change":"2024-02-16T00:11:10.830170+0000","last_active":"2024-02-16T00:11:50.843496+0000","last_peered":"2024-02-16T00:11:50.843496+0000","last_clean":"2024-02-16T00:11:50.843496+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:11:50.843496+0000","last_undegraded":"2024-02-16T00:11:50.843496+0000","last_fullsized":"2024-02-16T00:11:50.843496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:27:37.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839182+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:11:50.839182+0000","last_peered":"2024-02-16T00:11:50.839182+0000","last_clean":"2024-02-16T00:11:50.839182+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:11:50.839182+0000","last_undegraded":"2024-02-16T00:11:50.839182+0000","last_fullsized":"2024-02-16T00:11:50.839182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:22.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.852536+0000","last_change":"2024-02-16T00:11:50.852046+0000","last_active":"2024-02-16T00:11:50.852536+0000","last_peered":"2024-02-16T00:11:50.852536+0000","last_clean":"2024-02-16T00:11:50.852536+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:11:50.852536+0000","last_undegraded":"2024-02-16T00:11:50.852536+0000","last_fullsized":"2024-02-16T00:11:50.852536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:25.615122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840650+0000","last_change":"2024-02-16T00:11:02.816016+0000","last_active":"2024-02-16T00:11:50.840650+0000","last_peered":"2024-02-16T00:11:50.840650+0000","last_clean":"2024-02-16T00:11:50.840650+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:11:50.840650+0000","last_undegraded":"2024-02-16T00:11:50.840650+0000","last_fullsized":"2024-02-16T00:11:50.840650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:32.229010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849166+0000","last_change":"2024-02-16T00:11:50.848461+0000","last_active":"2024-02-16T00:11:50.849166+0000","last_peered":"2024-02-16T00:11:50.849166+0000","last_clean":"2024-02-16T00:11:50.849166+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:11:50.849166+0000","last_undegraded":"2024-02-16T00:11:50.849166+0000","last_fullsized":"2024-02-16T00:11:50.849166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:15.203256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'35","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.958130+0000","last_change":"2024-02-16T00:11:08.812821+0000","last_active":"2024-02-16T00:12:27.958130+0000","last_peered":"2024-02-16T00:12:27.958130+0000","last_clean":"2024-02-16T00:12:27.958130+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:27.958130+0000","last_undegraded":"2024-02-16T00:12:27.958130+0000","last_fullsized":"2024-02-16T00:12:27.958130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:10.931565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'239","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.618374+0000","last_change":"2024-02-16T00:11:10.825189+0000","last_active":"2024-02-16T00:12:33.618374+0000","last_peered":"2024-02-16T00:12:33.618374+0000","last_clean":"2024-02-16T00:12:33.618374+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:33.618374+0000","last_undegraded":"2024-02-16T00:12:33.618374+0000","last_fullsized":"2024-02-16T00:12:33.618374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:30.694754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.981440+0000","last_change":"2024-02-16T00:11:12.826412+0000","last_active":"2024-02-16T00:12:27.981440+0000","last_peered":"2024-02-16T00:12:27.981440+0000","last_clean":"2024-02-16T00:12:27.981440+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:12:27.981440+0000","last_undegraded":"2024-02-16T00:12:27.981440+0000","last_fullsized":"2024-02-16T00:12:27.981440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:03.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969839+0000","last_change":"2024-02-16T00:11:51.834792+0000","last_active":"2024-02-16T00:12:27.969839+0000","last_peered":"2024-02-16T00:12:27.969839+0000","last_clean":"2024-02-16T00:12:27.969839+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:12:27.969839+0000","last_undegraded":"2024-02-16T00:12:27.969839+0000","last_fullsized":"2024-02-16T00:12:27.969839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:46.509649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840852+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:11:50.840852+0000","last_peered":"2024-02-16T00:11:50.840852+0000","last_clean":"2024-02-16T00:11:50.840852+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:11:50.840852+0000","last_undegraded":"2024-02-16T00:11:50.840852+0000","last_fullsized":"2024-02-16T00:11:50.840852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:54:39.901674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"20'2","reported_seq":349,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.599843+0000","last_change":"2024-02-16T00:11:06.803378+0000","last_active":"2024-02-16T00:12:33.599843+0000","last_peered":"2024-02-16T00:12:33.599843+0000","last_clean":"2024-02-16T00:12:33.599843+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:33.599843+0000","last_undegraded":"2024-02-16T00:12:33.599843+0000","last_fullsized":"2024-02-16T00:12:33.599843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:37.017382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":319,"num_read_kb":319,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844009+0000","last_change":"2024-02-16T00:11:08.818315+0000","last_active":"2024-02-16T00:11:50.844009+0000","last_peered":"2024-02-16T00:11:50.844009+0000","last_clean":"2024-02-16T00:11:50.844009+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:11:50.844009+0000","last_undegraded":"2024-02-16T00:11:50.844009+0000","last_fullsized":"2024-02-16T00:11:50.844009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:40.931409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'239","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.619483+0000","last_change":"2024-02-16T00:11:10.821163+0000","last_active":"2024-02-16T00:12:33.619483+0000","last_peered":"2024-02-16T00:12:33.619483+0000","last_clean":"2024-02-16T00:12:33.619483+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:33.619483+0000","last_undegraded":"2024-02-16T00:12:33.619483+0000","last_fullsized":"2024-02-16T00:12:33.619483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:56.315714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842725+0000","last_change":"2024-02-16T00:11:12.820915+0000","last_active":"2024-02-16T00:11:50.842725+0000","last_peered":"2024-02-16T00:11:50.842725+0000","last_clean":"2024-02-16T00:11:50.842725+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:11:50.842725+0000","last_undegraded":"2024-02-16T00:11:50.842725+0000","last_fullsized":"2024-02-16T00:11:50.842725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:11.680317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849986+0000","last_change":"2024-02-16T00:11:04.814579+0000","last_active":"2024-02-16T00:11:50.849986+0000","last_peered":"2024-02-16T00:11:50.849986+0000","last_clean":"2024-02-16T00:11:50.849986+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:11:50.849986+0000","last_undegraded":"2024-02-16T00:11:50.849986+0000","last_fullsized":"2024-02-16T00:11:50.849986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:37.972099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839956+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:11:50.839956+0000","last_peered":"2024-02-16T00:11:50.839956+0000","last_clean":"2024-02-16T00:11:50.839956+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:11:50.839956+0000","last_undegraded":"2024-02-16T00:11:50.839956+0000","last_fullsized":"2024-02-16T00:11:50.839956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:08.196608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844331+0000","last_change":"2024-02-16T00:11:06.805637+0000","last_active":"2024-02-16T00:11:50.844331+0000","last_peered":"2024-02-16T00:11:50.844331+0000","last_clean":"2024-02-16T00:11:50.844331+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:11:50.844331+0000","last_undegraded":"2024-02-16T00:11:50.844331+0000","last_fullsized":"2024-02-16T00:11:50.844331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:23.532869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.945180+0000","last_change":"2024-02-16T00:11:08.817066+0000","last_active":"2024-02-16T00:12:27.945180+0000","last_peered":"2024-02-16T00:12:27.945180+0000","last_clean":"2024-02-16T00:12:27.945180+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:27.945180+0000","last_undegraded":"2024-02-16T00:12:27.945180+0000","last_fullsized":"2024-02-16T00:12:27.945180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:44.502136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844840+0000","last_change":"2024-02-16T00:11:10.820822+0000","last_active":"2024-02-16T00:11:50.844840+0000","last_peered":"2024-02-16T00:11:50.844840+0000","last_clean":"2024-02-16T00:11:50.844840+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:11:50.844840+0000","last_undegraded":"2024-02-16T00:11:50.844840+0000","last_fullsized":"2024-02-16T00:11:50.844840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.483261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847509+0000","last_change":"2024-02-16T00:11:12.820426+0000","last_active":"2024-02-16T00:11:50.847509+0000","last_peered":"2024-02-16T00:11:50.847509+0000","last_clean":"2024-02-16T00:11:50.847509+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:11:50.847509+0000","last_undegraded":"2024-02-16T00:11:50.847509+0000","last_fullsized":"2024-02-16T00:11:50.847509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:56.437107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447611+0000","last_change":"2024-02-16T00:11:04.815286+0000","last_active":"2024-02-16T00:12:33.447611+0000","last_peered":"2024-02-16T00:12:33.447611+0000","last_clean":"2024-02-16T00:12:33.447611+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:33.447611+0000","last_undegraded":"2024-02-16T00:12:33.447611+0000","last_fullsized":"2024-02-16T00:12:33.447611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:52.351458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847560+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:11:50.847560+0000","last_peered":"2024-02-16T00:11:50.847560+0000","last_clean":"2024-02-16T00:11:50.847560+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:11:50.847560+0000","last_undegraded":"2024-02-16T00:11:50.847560+0000","last_fullsized":"2024-02-16T00:11:50.847560+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:26.862794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841297+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:11:50.841297+0000","last_peered":"2024-02-16T00:11:50.841297+0000","last_clean":"2024-02-16T00:11:50.841297+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:11:50.841297+0000","last_undegraded":"2024-02-16T00:11:50.841297+0000","last_fullsized":"2024-02-16T00:11:50.841297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:10.324975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840128+0000","last_change":"2024-02-16T00:11:02.823633+0000","last_active":"2024-02-16T00:11:50.840128+0000","last_peered":"2024-02-16T00:11:50.840128+0000","last_clean":"2024-02-16T00:11:50.840128+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:11:50.840128+0000","last_undegraded":"2024-02-16T00:11:50.840128+0000","last_fullsized":"2024-02-16T00:11:50.840128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:29:58.094211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847007+0000","last_change":"2024-02-16T00:11:06.802815+0000","last_active":"2024-02-16T00:11:50.847007+0000","last_peered":"2024-02-16T00:11:50.847007+0000","last_clean":"2024-02-16T00:11:50.847007+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:11:50.847007+0000","last_undegraded":"2024-02-16T00:11:50.847007+0000","last_fullsized":"2024-02-16T00:11:50.847007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:15.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.424430+0000","last_change":"2024-02-16T00:11:08.812650+0000","last_active":"2024-02-16T00:12:33.424430+0000","last_peered":"2024-02-16T00:12:33.424430+0000","last_clean":"2024-02-16T00:12:33.424430+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:33.424430+0000","last_undegraded":"2024-02-16T00:12:33.424430+0000","last_fullsized":"2024-02-16T00:12:33.424430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:00:12.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830451+0000","last_change":"2024-02-16T00:11:10.819778+0000","last_active":"2024-02-16T00:11:51.830451+0000","last_peered":"2024-02-16T00:11:51.830451+0000","last_clean":"2024-02-16T00:11:51.830451+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:11:51.830451+0000","last_undegraded":"2024-02-16T00:11:51.830451+0000","last_fullsized":"2024-02-16T00:11:51.830451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:21:02.494032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.459524+0000","last_change":"2024-02-16T00:11:12.817529+0000","last_active":"2024-02-16T00:12:33.459524+0000","last_peered":"2024-02-16T00:12:33.459524+0000","last_clean":"2024-02-16T00:12:33.459524+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:33.459524+0000","last_undegraded":"2024-02-16T00:12:33.459524+0000","last_fullsized":"2024-02-16T00:12:33.459524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:41.761693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969783+0000","last_change":"2024-02-16T00:11:04.805947+0000","last_active":"2024-02-16T00:12:27.969783+0000","last_peered":"2024-02-16T00:12:27.969783+0000","last_clean":"2024-02-16T00:12:27.969783+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:12:27.969783+0000","last_undegraded":"2024-02-16T00:12:27.969783+0000","last_fullsized":"2024-02-16T00:12:27.969783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:40.488305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839459+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:11:50.839459+0000","last_peered":"2024-02-16T00:11:50.839459+0000","last_clean":"2024-02-16T00:11:50.839459+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:11:50.839459+0000","last_undegraded":"2024-02-16T00:11:50.839459+0000","last_fullsized":"2024-02-16T00:11:50.839459+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:37.927052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828737+0000","last_change":"2024-02-16T00:11:02.808396+0000","last_active":"2024-02-16T00:11:51.828737+0000","last_peered":"2024-02-16T00:11:51.828737+0000","last_clean":"2024-02-16T00:11:51.828737+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:11:51.828737+0000","last_undegraded":"2024-02-16T00:11:51.828737+0000","last_fullsized":"2024-02-16T00:11:51.828737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849902+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:11:50.849902+0000","last_peered":"2024-02-16T00:11:50.849902+0000","last_clean":"2024-02-16T00:11:50.849902+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:11:50.849902+0000","last_undegraded":"2024-02-16T00:11:50.849902+0000","last_fullsized":"2024-02-16T00:11:50.849902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:55:08.909122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'244","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.624081+0000","last_change":"2024-02-16T00:11:08.816886+0000","last_active":"2024-02-16T00:12:33.624081+0000","last_peered":"2024-02-16T00:12:33.624081+0000","last_clean":"2024-02-16T00:12:33.624081+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:33.624081+0000","last_undegraded":"2024-02-16T00:12:33.624081+0000","last_fullsized":"2024-02-16T00:12:33.624081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:28.688312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":324,"num_read_kb":308,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844070+0000","last_change":"2024-02-16T00:11:10.830058+0000","last_active":"2024-02-16T00:11:50.844070+0000","last_peered":"2024-02-16T00:11:50.844070+0000","last_clean":"2024-02-16T00:11:50.844070+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:11:50.844070+0000","last_undegraded":"2024-02-16T00:11:50.844070+0000","last_fullsized":"2024-02-16T00:11:50.844070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:08:24.925584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.291221+0000","last_change":"2024-02-16T00:11:12.828339+0000","last_active":"2024-02-16T00:12:22.291221+0000","last_peered":"2024-02-16T00:12:22.291221+0000","last_clean":"2024-02-16T00:12:22.291221+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:12:22.291221+0000","last_undegraded":"2024-02-16T00:12:22.291221+0000","last_fullsized":"2024-02-16T00:12:22.291221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:03.444538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831761+0000","last_change":"2024-02-16T00:11:04.803584+0000","last_active":"2024-02-16T00:11:51.831761+0000","last_peered":"2024-02-16T00:11:51.831761+0000","last_clean":"2024-02-16T00:11:51.831761+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:11:51.831761+0000","last_undegraded":"2024-02-16T00:11:51.831761+0000","last_fullsized":"2024-02-16T00:11:51.831761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:39.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841090+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:11:50.841090+0000","last_peered":"2024-02-16T00:11:50.841090+0000","last_clean":"2024-02-16T00:11:50.841090+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:11:50.841090+0000","last_undegraded":"2024-02-16T00:11:50.841090+0000","last_fullsized":"2024-02-16T00:11:50.841090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:55.484965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828521+0000","last_change":"2024-02-16T00:11:02.802061+0000","last_active":"2024-02-16T00:11:51.828521+0000","last_peered":"2024-02-16T00:11:51.828521+0000","last_clean":"2024-02-16T00:11:51.828521+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:11:51.828521+0000","last_undegraded":"2024-02-16T00:11:51.828521+0000","last_fullsized":"2024-02-16T00:11:51.828521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841761+0000","last_change":"2024-02-16T00:11:06.803264+0000","last_active":"2024-02-16T00:11:50.841761+0000","last_peered":"2024-02-16T00:11:50.841761+0000","last_clean":"2024-02-16T00:11:50.841761+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:11:50.841761+0000","last_undegraded":"2024-02-16T00:11:50.841761+0000","last_fullsized":"2024-02-16T00:11:50.841761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:36.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'15","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:26.869931+0000","last_change":"2024-02-16T00:11:08.817972+0000","last_active":"2024-02-16T00:12:26.869931+0000","last_peered":"2024-02-16T00:12:26.869931+0000","last_clean":"2024-02-16T00:12:26.869931+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:26.869931+0000","last_undegraded":"2024-02-16T00:12:26.869931+0000","last_fullsized":"2024-02-16T00:12:26.869931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:40.476138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831062+0000","last_change":"2024-02-16T00:11:10.819489+0000","last_active":"2024-02-16T00:11:51.831062+0000","last_peered":"2024-02-16T00:11:51.831062+0000","last_clean":"2024-02-16T00:11:51.831062+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:11:51.831062+0000","last_undegraded":"2024-02-16T00:11:51.831062+0000","last_fullsized":"2024-02-16T00:11:51.831062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:33.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840050+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:11:50.840050+0000","last_peered":"2024-02-16T00:11:50.840050+0000","last_clean":"2024-02-16T00:11:50.840050+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:11:50.840050+0000","last_undegraded":"2024-02-16T00:11:50.840050+0000","last_fullsized":"2024-02-16T00:11:50.840050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:49.996094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831944+0000","last_change":"2024-02-16T00:11:04.801512+0000","last_active":"2024-02-16T00:11:51.831944+0000","last_peered":"2024-02-16T00:11:51.831944+0000","last_clean":"2024-02-16T00:11:51.831944+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:11:51.831944+0000","last_undegraded":"2024-02-16T00:11:51.831944+0000","last_fullsized":"2024-02-16T00:11:51.831944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:17.940025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839890+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:11:50.839890+0000","last_peered":"2024-02-16T00:11:50.839890+0000","last_clean":"2024-02-16T00:11:50.839890+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:11:50.839890+0000","last_undegraded":"2024-02-16T00:11:50.839890+0000","last_fullsized":"2024-02-16T00:11:50.839890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:16.627592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844174+0000","last_change":"2024-02-16T00:11:02.811825+0000","last_active":"2024-02-16T00:11:50.844174+0000","last_peered":"2024-02-16T00:11:50.844174+0000","last_clean":"2024-02-16T00:11:50.844174+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:11:50.844174+0000","last_undegraded":"2024-02-16T00:11:50.844174+0000","last_fullsized":"2024-02-16T00:11:50.844174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.851641+0000","last_change":"2024-02-16T00:11:50.851092+0000","last_active":"2024-02-16T00:11:50.851641+0000","last_peered":"2024-02-16T00:11:50.851641+0000","last_clean":"2024-02-16T00:11:50.851641+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:11:50.851641+0000","last_undegraded":"2024-02-16T00:11:50.851641+0000","last_fullsized":"2024-02-16T00:11:50.851641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:28.735178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842255+0000","last_change":"2024-02-16T00:11:08.813441+0000","last_active":"2024-02-16T00:11:50.842255+0000","last_peered":"2024-02-16T00:11:50.842255+0000","last_clean":"2024-02-16T00:11:50.842255+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:11:50.842255+0000","last_undegraded":"2024-02-16T00:11:50.842255+0000","last_fullsized":"2024-02-16T00:11:50.842255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:25.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843784+0000","last_change":"2024-02-16T00:11:10.829728+0000","last_active":"2024-02-16T00:11:50.843784+0000","last_peered":"2024-02-16T00:11:50.843784+0000","last_clean":"2024-02-16T00:11:50.843784+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:11:50.843784+0000","last_undegraded":"2024-02-16T00:11:50.843784+0000","last_fullsized":"2024-02-16T00:11:50.843784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:38.430913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848729+0000","last_change":"2024-02-16T00:11:12.835325+0000","last_active":"2024-02-16T00:11:50.848729+0000","last_peered":"2024-02-16T00:11:50.848729+0000","last_clean":"2024-02-16T00:11:50.848729+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:11:50.848729+0000","last_undegraded":"2024-02-16T00:11:50.848729+0000","last_fullsized":"2024-02-16T00:11:50.848729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:54.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621964+0000","last_change":"2024-02-16T00:11:04.814208+0000","last_active":"2024-02-16T00:12:27.621964+0000","last_peered":"2024-02-16T00:12:27.621964+0000","last_clean":"2024-02-16T00:12:27.621964+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:12:27.621964+0000","last_undegraded":"2024-02-16T00:12:27.621964+0000","last_fullsized":"2024-02-16T00:12:27.621964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:31.576677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841417+0000","last_change":"2024-02-16T00:11:02.805928+0000","last_active":"2024-02-16T00:11:50.841417+0000","last_peered":"2024-02-16T00:11:50.841417+0000","last_clean":"2024-02-16T00:11:50.841417+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:11:50.841417+0000","last_undegraded":"2024-02-16T00:11:50.841417+0000","last_fullsized":"2024-02-16T00:11:50.841417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.827694+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:11:51.827694+0000","last_peered":"2024-02-16T00:11:51.827694+0000","last_clean":"2024-02-16T00:11:51.827694+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:11:51.827694+0000","last_undegraded":"2024-02-16T00:11:51.827694+0000","last_fullsized":"2024-02-16T00:11:51.827694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:57:56.387943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830614+0000","last_change":"2024-02-16T00:11:06.809081+0000","last_active":"2024-02-16T00:11:51.830614+0000","last_peered":"2024-02-16T00:11:51.830614+0000","last_clean":"2024-02-16T00:11:51.830614+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:11:51.830614+0000","last_undegraded":"2024-02-16T00:11:51.830614+0000","last_fullsized":"2024-02-16T00:11:51.830614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:37.382506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'68","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.417131+0000","last_change":"2024-02-16T00:11:08.812931+0000","last_active":"2024-02-16T00:12:33.417131+0000","last_peered":"2024-02-16T00:12:33.417131+0000","last_clean":"2024-02-16T00:12:33.417131+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:33.417131+0000","last_undegraded":"2024-02-16T00:12:33.417131+0000","last_fullsized":"2024-02-16T00:12:33.417131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:59.444482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":62,"num_write":36,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842114+0000","last_change":"2024-02-16T00:11:10.824976+0000","last_active":"2024-02-16T00:11:50.842114+0000","last_peered":"2024-02-16T00:11:50.842114+0000","last_clean":"2024-02-16T00:11:50.842114+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:11:50.842114+0000","last_undegraded":"2024-02-16T00:11:50.842114+0000","last_fullsized":"2024-02-16T00:11:50.842114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:01.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.959184+0000","last_change":"2024-02-16T00:11:12.822048+0000","last_active":"2024-02-16T00:12:27.959184+0000","last_peered":"2024-02-16T00:12:27.959184+0000","last_clean":"2024-02-16T00:12:27.959184+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:12:27.959184+0000","last_undegraded":"2024-02-16T00:12:27.959184+0000","last_fullsized":"2024-02-16T00:12:27.959184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:58.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846988+0000","last_change":"2024-02-16T00:11:04.814786+0000","last_active":"2024-02-16T00:11:50.846988+0000","last_peered":"2024-02-16T00:11:50.846988+0000","last_clean":"2024-02-16T00:11:50.846988+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:11:50.846988+0000","last_undegraded":"2024-02-16T00:11:50.846988+0000","last_fullsized":"2024-02-16T00:11:50.846988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:31.456911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831382+0000","last_change":"2024-02-16T00:11:02.801240+0000","last_active":"2024-02-16T00:11:51.831382+0000","last_peered":"2024-02-16T00:11:51.831382+0000","last_clean":"2024-02-16T00:11:51.831382+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:11:51.831382+0000","last_undegraded":"2024-02-16T00:11:51.831382+0000","last_fullsized":"2024-02-16T00:11:51.831382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:35:37.663185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844947+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:11:50.844947+0000","last_peered":"2024-02-16T00:11:50.844947+0000","last_clean":"2024-02-16T00:11:50.844947+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:11:50.844947+0000","last_undegraded":"2024-02-16T00:11:50.844947+0000","last_fullsized":"2024-02-16T00:11:50.844947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:11:13.167891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839692+0000","last_change":"2024-02-16T00:11:06.807321+0000","last_active":"2024-02-16T00:11:50.839692+0000","last_peered":"2024-02-16T00:11:50.839692+0000","last_clean":"2024-02-16T00:11:50.839692+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:11:50.839692+0000","last_undegraded":"2024-02-16T00:11:50.839692+0000","last_fullsized":"2024-02-16T00:11:50.839692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:40.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846822+0000","last_change":"2024-02-16T00:11:08.816902+0000","last_active":"2024-02-16T00:11:50.846822+0000","last_peered":"2024-02-16T00:11:50.846822+0000","last_clean":"2024-02-16T00:11:50.846822+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:11:50.846822+0000","last_undegraded":"2024-02-16T00:11:50.846822+0000","last_fullsized":"2024-02-16T00:11:50.846822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:28.706934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'239","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.616431+0000","last_change":"2024-02-16T00:11:10.824584+0000","last_active":"2024-02-16T00:12:33.616431+0000","last_peered":"2024-02-16T00:12:33.616431+0000","last_clean":"2024-02-16T00:12:33.616431+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:33.616431+0000","last_undegraded":"2024-02-16T00:12:33.616431+0000","last_fullsized":"2024-02-16T00:12:33.616431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:12.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842453+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:11:50.842453+0000","last_peered":"2024-02-16T00:11:50.842453+0000","last_clean":"2024-02-16T00:11:50.842453+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:11:50.842453+0000","last_undegraded":"2024-02-16T00:11:50.842453+0000","last_fullsized":"2024-02-16T00:11:50.842453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:56:43.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447640+0000","last_change":"2024-02-16T00:11:04.813783+0000","last_active":"2024-02-16T00:12:33.447640+0000","last_peered":"2024-02-16T00:12:33.447640+0000","last_clean":"2024-02-16T00:12:33.447640+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:33.447640+0000","last_undegraded":"2024-02-16T00:12:33.447640+0000","last_fullsized":"2024-02-16T00:12:33.447640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:00.990043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844350+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:11:50.844350+0000","last_peered":"2024-02-16T00:11:50.844350+0000","last_clean":"2024-02-16T00:11:50.844350+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:11:50.844350+0000","last_undegraded":"2024-02-16T00:11:50.844350+0000","last_fullsized":"2024-02-16T00:11:50.844350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:43.805420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828194+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:11:51.828194+0000","last_peered":"2024-02-16T00:11:51.828194+0000","last_clean":"2024-02-16T00:11:51.828194+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:11:51.828194+0000","last_undegraded":"2024-02-16T00:11:51.828194+0000","last_fullsized":"2024-02-16T00:11:51.828194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:33:37.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840930+0000","last_change":"2024-02-16T00:11:06.808524+0000","last_active":"2024-02-16T00:11:50.840930+0000","last_peered":"2024-02-16T00:11:50.840930+0000","last_clean":"2024-02-16T00:11:50.840930+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:11:50.840930+0000","last_undegraded":"2024-02-16T00:11:50.840930+0000","last_fullsized":"2024-02-16T00:11:50.840930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:29.788383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840440+0000","last_change":"2024-02-16T00:11:08.814729+0000","last_active":"2024-02-16T00:11:50.840440+0000","last_peered":"2024-02-16T00:11:50.840440+0000","last_clean":"2024-02-16T00:11:50.840440+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:11:50.840440+0000","last_undegraded":"2024-02-16T00:11:50.840440+0000","last_fullsized":"2024-02-16T00:11:50.840440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:46.912652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'239","reported_seq":309,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.620445+0000","last_change":"2024-02-16T00:11:10.820590+0000","last_active":"2024-02-16T00:12:33.620445+0000","last_peered":"2024-02-16T00:12:33.620445+0000","last_clean":"2024-02-16T00:12:33.620445+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:33.620445+0000","last_undegraded":"2024-02-16T00:12:33.620445+0000","last_fullsized":"2024-02-16T00:12:33.620445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:31.011223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.278591+0000","last_change":"2024-02-16T00:11:12.832931+0000","last_active":"2024-02-16T00:12:22.278591+0000","last_peered":"2024-02-16T00:12:22.278591+0000","last_clean":"2024-02-16T00:12:22.278591+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:12:22.278591+0000","last_undegraded":"2024-02-16T00:12:22.278591+0000","last_fullsized":"2024-02-16T00:12:22.278591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:26.736188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447919+0000","last_change":"2024-02-16T00:11:04.809323+0000","last_active":"2024-02-16T00:12:33.447919+0000","last_peered":"2024-02-16T00:12:33.447919+0000","last_clean":"2024-02-16T00:12:33.447919+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:12:33.447919+0000","last_undegraded":"2024-02-16T00:12:33.447919+0000","last_fullsized":"2024-02-16T00:12:33.447919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:15.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849396+0000","last_change":"2024-02-16T00:11:02.796859+0000","last_active":"2024-02-16T00:11:50.849396+0000","last_peered":"2024-02-16T00:11:50.849396+0000","last_clean":"2024-02-16T00:11:50.849396+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:11:50.849396+0000","last_undegraded":"2024-02-16T00:11:50.849396+0000","last_fullsized":"2024-02-16T00:11:50.849396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843629+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:11:50.843629+0000","last_peered":"2024-02-16T00:11:50.843629+0000","last_clean":"2024-02-16T00:11:50.843629+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:11:50.843629+0000","last_undegraded":"2024-02-16T00:11:50.843629+0000","last_fullsized":"2024-02-16T00:11:50.843629+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:06.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840367+0000","last_change":"2024-02-16T00:11:06.809592+0000","last_active":"2024-02-16T00:11:50.840367+0000","last_peered":"2024-02-16T00:11:50.840367+0000","last_clean":"2024-02-16T00:11:50.840367+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:11:50.840367+0000","last_undegraded":"2024-02-16T00:11:50.840367+0000","last_fullsized":"2024-02-16T00:11:50.840367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:52.303003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":159,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.414040+0000","last_change":"2024-02-16T00:11:08.813647+0000","last_active":"2024-02-16T00:12:33.414040+0000","last_peered":"2024-02-16T00:12:33.414040+0000","last_clean":"2024-02-16T00:12:33.414040+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:33.414040+0000","last_undegraded":"2024-02-16T00:12:33.414040+0000","last_fullsized":"2024-02-16T00:12:33.414040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:57.678721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829880+0000","last_change":"2024-02-16T00:11:10.825204+0000","last_active":"2024-02-16T00:11:51.829880+0000","last_peered":"2024-02-16T00:11:51.829880+0000","last_clean":"2024-02-16T00:11:51.829880+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:11:51.829880+0000","last_undegraded":"2024-02-16T00:11:51.829880+0000","last_fullsized":"2024-02-16T00:11:51.829880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:27.545580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845913+0000","last_change":"2024-02-16T00:11:12.825945+0000","last_active":"2024-02-16T00:11:50.845913+0000","last_peered":"2024-02-16T00:11:50.845913+0000","last_clean":"2024-02-16T00:11:50.845913+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:11:50.845913+0000","last_undegraded":"2024-02-16T00:11:50.845913+0000","last_fullsized":"2024-02-16T00:11:50.845913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:01.423563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.437852+0000","last_change":"2024-02-16T00:11:12.826512+0000","last_active":"2024-02-16T00:12:33.437852+0000","last_peered":"2024-02-16T00:12:33.437852+0000","last_clean":"2024-02-16T00:12:33.437852+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:12:33.437852+0000","last_undegraded":"2024-02-16T00:12:33.437852+0000","last_fullsized":"2024-02-16T00:12:33.437852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:14.444046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969541+0000","last_change":"2024-02-16T00:11:04.810868+0000","last_active":"2024-02-16T00:12:27.969541+0000","last_peered":"2024-02-16T00:12:27.969541+0000","last_clean":"2024-02-16T00:12:27.969541+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:12:27.969541+0000","last_undegraded":"2024-02-16T00:12:27.969541+0000","last_fullsized":"2024-02-16T00:12:27.969541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842296+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:11:50.842296+0000","last_peered":"2024-02-16T00:11:50.842296+0000","last_clean":"2024-02-16T00:11:50.842296+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:11:50.842296+0000","last_undegraded":"2024-02-16T00:11:50.842296+0000","last_fullsized":"2024-02-16T00:11:50.842296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:24.599977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"20'1","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.591526+0000","last_change":"2024-02-16T00:11:06.804629+0000","last_active":"2024-02-16T00:12:33.591526+0000","last_peered":"2024-02-16T00:12:33.591526+0000","last_clean":"2024-02-16T00:12:33.591526+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:33.591526+0000","last_undegraded":"2024-02-16T00:12:33.591526+0000","last_fullsized":"2024-02-16T00:12:33.591526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:33.337990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.949264+0000","last_change":"2024-02-16T00:11:08.817056+0000","last_active":"2024-02-16T00:12:27.949264+0000","last_peered":"2024-02-16T00:12:27.949264+0000","last_clean":"2024-02-16T00:12:27.949264+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:12:27.949264+0000","last_undegraded":"2024-02-16T00:12:27.949264+0000","last_fullsized":"2024-02-16T00:12:27.949264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:14.319677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840209+0000","last_change":"2024-02-16T00:11:10.831264+0000","last_active":"2024-02-16T00:11:50.840209+0000","last_peered":"2024-02-16T00:11:50.840209+0000","last_clean":"2024-02-16T00:11:50.840209+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:11:50.840209+0000","last_undegraded":"2024-02-16T00:11:50.840209+0000","last_fullsized":"2024-02-16T00:11:50.840209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:09:54.744331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830002+0000","last_change":"2024-02-16T00:11:12.819458+0000","last_active":"2024-02-16T00:11:51.830002+0000","last_peered":"2024-02-16T00:11:51.830002+0000","last_clean":"2024-02-16T00:11:51.830002+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:11:51.830002+0000","last_undegraded":"2024-02-16T00:11:51.830002+0000","last_fullsized":"2024-02-16T00:11:51.830002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:18.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.857998+0000","last_change":"2024-02-16T00:11:50.857588+0000","last_active":"2024-02-16T00:11:50.857998+0000","last_peered":"2024-02-16T00:11:50.857998+0000","last_clean":"2024-02-16T00:11:50.857998+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:11:50.857998+0000","last_undegraded":"2024-02-16T00:11:50.857998+0000","last_fullsized":"2024-02-16T00:11:50.857998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:48.410669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841539+0000","last_change":"2024-02-16T00:11:02.805825+0000","last_active":"2024-02-16T00:11:50.841539+0000","last_peered":"2024-02-16T00:11:50.841539+0000","last_clean":"2024-02-16T00:11:50.841539+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:11:50.841539+0000","last_undegraded":"2024-02-16T00:11:50.841539+0000","last_fullsized":"2024-02-16T00:11:50.841539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841830+0000","last_change":"2024-02-16T00:11:06.809728+0000","last_active":"2024-02-16T00:11:50.841830+0000","last_peered":"2024-02-16T00:11:50.841830+0000","last_clean":"2024-02-16T00:11:50.841830+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:11:50.841830+0000","last_undegraded":"2024-02-16T00:11:50.841830+0000","last_fullsized":"2024-02-16T00:11:50.841830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:21.123795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:21.104435+0000","last_change":"2024-02-16T00:11:08.813746+0000","last_active":"2024-02-16T00:12:21.104435+0000","last_peered":"2024-02-16T00:12:21.104435+0000","last_clean":"2024-02-16T00:12:21.104435+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:21.104435+0000","last_undegraded":"2024-02-16T00:12:21.104435+0000","last_fullsized":"2024-02-16T00:12:21.104435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:22.912045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841313+0000","last_change":"2024-02-16T00:11:10.820413+0000","last_active":"2024-02-16T00:11:50.841313+0000","last_peered":"2024-02-16T00:11:50.841313+0000","last_clean":"2024-02-16T00:11:50.841313+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:11:50.841313+0000","last_undegraded":"2024-02-16T00:11:50.841313+0000","last_fullsized":"2024-02-16T00:11:50.841313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:24.918488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830024+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830024+0000","last_peered":"2024-02-16T00:11:51.830024+0000","last_clean":"2024-02-16T00:11:51.830024+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830024+0000","last_undegraded":"2024-02-16T00:11:51.830024+0000","last_fullsized":"2024-02-16T00:11:51.830024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:38:14.345034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447372+0000","last_change":"2024-02-16T00:11:04.801132+0000","last_active":"2024-02-16T00:12:33.447372+0000","last_peered":"2024-02-16T00:12:33.447372+0000","last_clean":"2024-02-16T00:12:33.447372+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:12:33.447372+0000","last_undegraded":"2024-02-16T00:12:33.447372+0000","last_fullsized":"2024-02-16T00:12:33.447372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842111+0000","last_change":"2024-02-16T00:11:02.815585+0000","last_active":"2024-02-16T00:11:50.842111+0000","last_peered":"2024-02-16T00:11:50.842111+0000","last_clean":"2024-02-16T00:11:50.842111+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:11:50.842111+0000","last_undegraded":"2024-02-16T00:11:50.842111+0000","last_fullsized":"2024-02-16T00:11:50.842111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843904+0000","last_change":"2024-02-16T00:11:06.809635+0000","last_active":"2024-02-16T00:11:50.843904+0000","last_peered":"2024-02-16T00:11:50.843904+0000","last_clean":"2024-02-16T00:11:50.843904+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:11:50.843904+0000","last_undegraded":"2024-02-16T00:11:50.843904+0000","last_fullsized":"2024-02-16T00:11:50.843904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:49.818734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'34","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.243762+0000","last_change":"2024-02-16T00:11:08.810350+0000","last_active":"2024-02-16T00:12:33.243762+0000","last_peered":"2024-02-16T00:12:33.243762+0000","last_clean":"2024-02-16T00:12:33.243762+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:33.243762+0000","last_undegraded":"2024-02-16T00:12:33.243762+0000","last_fullsized":"2024-02-16T00:12:33.243762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:45.445581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847684+0000","last_change":"2024-02-16T00:11:10.823987+0000","last_active":"2024-02-16T00:11:50.847684+0000","last_peered":"2024-02-16T00:11:50.847684+0000","last_clean":"2024-02-16T00:11:50.847684+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:11:50.847684+0000","last_undegraded":"2024-02-16T00:11:50.847684+0000","last_fullsized":"2024-02-16T00:11:50.847684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:52:59.417398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844306+0000","last_change":"2024-02-16T00:11:12.831687+0000","last_active":"2024-02-16T00:11:50.844306+0000","last_peered":"2024-02-16T00:11:50.844306+0000","last_clean":"2024-02-16T00:11:50.844306+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:11:50.844306+0000","last_undegraded":"2024-02-16T00:11:50.844306+0000","last_fullsized":"2024-02-16T00:11:50.844306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839554+0000","last_change":"2024-02-16T00:11:04.812864+0000","last_active":"2024-02-16T00:11:50.839554+0000","last_peered":"2024-02-16T00:11:50.839554+0000","last_clean":"2024-02-16T00:11:50.839554+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:11:50.839554+0000","last_undegraded":"2024-02-16T00:11:50.839554+0000","last_fullsized":"2024-02-16T00:11:50.839554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:35.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849446+0000","last_change":"2024-02-16T00:11:02.814174+0000","last_active":"2024-02-16T00:11:50.849446+0000","last_peered":"2024-02-16T00:11:50.849446+0000","last_clean":"2024-02-16T00:11:50.849446+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:11:50.849446+0000","last_undegraded":"2024-02-16T00:11:50.849446+0000","last_fullsized":"2024-02-16T00:11:50.849446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839547+0000","last_change":"2024-02-16T00:11:06.803159+0000","last_active":"2024-02-16T00:11:50.839547+0000","last_peered":"2024-02-16T00:11:50.839547+0000","last_clean":"2024-02-16T00:11:50.839547+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:11:50.839547+0000","last_undegraded":"2024-02-16T00:11:50.839547+0000","last_fullsized":"2024-02-16T00:11:50.839547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:11.562971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'28","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.934771+0000","last_change":"2024-02-16T00:11:08.812960+0000","last_active":"2024-02-16T00:12:27.934771+0000","last_peered":"2024-02-16T00:12:27.934771+0000","last_clean":"2024-02-16T00:12:27.934771+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:27.934771+0000","last_undegraded":"2024-02-16T00:12:27.934771+0000","last_fullsized":"2024-02-16T00:12:27.934771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:42.177481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843134+0000","last_change":"2024-02-16T00:11:10.819766+0000","last_active":"2024-02-16T00:11:50.843134+0000","last_peered":"2024-02-16T00:11:50.843134+0000","last_clean":"2024-02-16T00:11:50.843134+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:11:50.843134+0000","last_undegraded":"2024-02-16T00:11:50.843134+0000","last_fullsized":"2024-02-16T00:11:50.843134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:47.452023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977793+0000","last_change":"2024-02-16T00:11:04.799979+0000","last_active":"2024-02-16T00:12:27.977793+0000","last_peered":"2024-02-16T00:12:27.977793+0000","last_clean":"2024-02-16T00:12:27.977793+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:12:27.977793+0000","last_undegraded":"2024-02-16T00:12:27.977793+0000","last_fullsized":"2024-02-16T00:12:27.977793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.383827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839552+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:11:50.839552+0000","last_peered":"2024-02-16T00:11:50.839552+0000","last_clean":"2024-02-16T00:11:50.839552+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:11:50.839552+0000","last_undegraded":"2024-02-16T00:11:50.839552+0000","last_fullsized":"2024-02-16T00:11:50.839552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:56.621924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831788+0000","last_change":"2024-02-16T00:11:06.807366+0000","last_active":"2024-02-16T00:11:51.831788+0000","last_peered":"2024-02-16T00:11:51.831788+0000","last_clean":"2024-02-16T00:11:51.831788+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:11:51.831788+0000","last_undegraded":"2024-02-16T00:11:51.831788+0000","last_fullsized":"2024-02-16T00:11:51.831788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:55.672453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'57","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.411193+0000","last_change":"2024-02-16T00:11:08.813592+0000","last_active":"2024-02-16T00:12:33.411193+0000","last_peered":"2024-02-16T00:12:33.411193+0000","last_clean":"2024-02-16T00:12:33.411193+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:33.411193+0000","last_undegraded":"2024-02-16T00:12:33.411193+0000","last_fullsized":"2024-02-16T00:12:33.411193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:13.307822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:10.819573+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:15.314264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.975742+0000","last_change":"2024-02-16T00:11:12.826496+0000","last_active":"2024-02-16T00:12:27.975742+0000","last_peered":"2024-02-16T00:12:27.975742+0000","last_clean":"2024-02-16T00:12:27.975742+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:12:27.975742+0000","last_undegraded":"2024-02-16T00:12:27.975742+0000","last_fullsized":"2024-02-16T00:12:27.975742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:43.107611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831550+0000","last_change":"2024-02-16T00:11:04.798736+0000","last_active":"2024-02-16T00:11:51.831550+0000","last_peered":"2024-02-16T00:11:51.831550+0000","last_clean":"2024-02-16T00:11:51.831550+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:11:51.831550+0000","last_undegraded":"2024-02-16T00:11:51.831550+0000","last_fullsized":"2024-02-16T00:11:51.831550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:23.445005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846657+0000","last_change":"2024-02-16T00:11:02.820397+0000","last_active":"2024-02-16T00:11:50.846657+0000","last_peered":"2024-02-16T00:11:50.846657+0000","last_clean":"2024-02-16T00:11:50.846657+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:11:50.846657+0000","last_undegraded":"2024-02-16T00:11:50.846657+0000","last_fullsized":"2024-02-16T00:11:50.846657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:41:25.514708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842043+0000","last_change":"2024-02-16T00:11:06.805697+0000","last_active":"2024-02-16T00:11:50.842043+0000","last_peered":"2024-02-16T00:11:50.842043+0000","last_clean":"2024-02-16T00:11:50.842043+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:11:50.842043+0000","last_undegraded":"2024-02-16T00:11:50.842043+0000","last_fullsized":"2024-02-16T00:11:50.842043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:39.979662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'34","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.935821+0000","last_change":"2024-02-16T00:11:08.817849+0000","last_active":"2024-02-16T00:12:27.935821+0000","last_peered":"2024-02-16T00:12:27.935821+0000","last_clean":"2024-02-16T00:12:27.935821+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:12:27.935821+0000","last_undegraded":"2024-02-16T00:12:27.935821+0000","last_fullsized":"2024-02-16T00:12:27.935821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:31:51.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846687+0000","last_change":"2024-02-16T00:11:10.826937+0000","last_active":"2024-02-16T00:11:50.846687+0000","last_peered":"2024-02-16T00:11:50.846687+0000","last_clean":"2024-02-16T00:11:50.846687+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:11:50.846687+0000","last_undegraded":"2024-02-16T00:11:50.846687+0000","last_fullsized":"2024-02-16T00:11:50.846687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:44.750899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839475+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:11:50.839475+0000","last_peered":"2024-02-16T00:11:50.839475+0000","last_clean":"2024-02-16T00:11:50.839475+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:11:50.839475+0000","last_undegraded":"2024-02-16T00:11:50.839475+0000","last_fullsized":"2024-02-16T00:11:50.839475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:07.884643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846346+0000","last_change":"2024-02-16T00:11:04.815549+0000","last_active":"2024-02-16T00:11:50.846346+0000","last_peered":"2024-02-16T00:11:50.846346+0000","last_clean":"2024-02-16T00:11:50.846346+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:11:50.846346+0000","last_undegraded":"2024-02-16T00:11:50.846346+0000","last_fullsized":"2024-02-16T00:11:50.846346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:24.693103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847848+0000","last_change":"2024-02-16T00:11:02.796631+0000","last_active":"2024-02-16T00:11:50.847848+0000","last_peered":"2024-02-16T00:11:50.847848+0000","last_clean":"2024-02-16T00:11:50.847848+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:11:50.847848+0000","last_undegraded":"2024-02-16T00:11:50.847848+0000","last_fullsized":"2024-02-16T00:11:50.847848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843956+0000","last_change":"2024-02-16T00:11:06.803105+0000","last_active":"2024-02-16T00:11:50.843956+0000","last_peered":"2024-02-16T00:11:50.843956+0000","last_clean":"2024-02-16T00:11:50.843956+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:11:50.843956+0000","last_undegraded":"2024-02-16T00:11:50.843956+0000","last_fullsized":"2024-02-16T00:11:50.843956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:33.464474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.953025+0000","last_change":"2024-02-16T00:11:08.812229+0000","last_active":"2024-02-16T00:12:27.953025+0000","last_peered":"2024-02-16T00:12:27.953025+0000","last_clean":"2024-02-16T00:12:27.953025+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:27.953025+0000","last_undegraded":"2024-02-16T00:12:27.953025+0000","last_fullsized":"2024-02-16T00:12:27.953025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:29.476819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830448+0000","last_change":"2024-02-16T00:11:10.820773+0000","last_active":"2024-02-16T00:11:51.830448+0000","last_peered":"2024-02-16T00:11:51.830448+0000","last_clean":"2024-02-16T00:11:51.830448+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:11:51.830448+0000","last_undegraded":"2024-02-16T00:11:51.830448+0000","last_fullsized":"2024-02-16T00:11:51.830448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:04.097666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840147+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:11:50.840147+0000","last_peered":"2024-02-16T00:11:50.840147+0000","last_clean":"2024-02-16T00:11:50.840147+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:11:50.840147+0000","last_undegraded":"2024-02-16T00:11:50.840147+0000","last_fullsized":"2024-02-16T00:11:50.840147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.226733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831639+0000","last_change":"2024-02-16T00:11:04.801768+0000","last_active":"2024-02-16T00:11:51.831639+0000","last_peered":"2024-02-16T00:11:51.831639+0000","last_clean":"2024-02-16T00:11:51.831639+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:11:51.831639+0000","last_undegraded":"2024-02-16T00:11:51.831639+0000","last_fullsized":"2024-02-16T00:11:51.831639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:45.811771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841024+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:11:50.841024+0000","last_peered":"2024-02-16T00:11:50.841024+0000","last_clean":"2024-02-16T00:11:50.841024+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:11:50.841024+0000","last_undegraded":"2024-02-16T00:11:50.841024+0000","last_fullsized":"2024-02-16T00:11:50.841024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:13.889993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849296+0000","last_change":"2024-02-16T00:11:06.802067+0000","last_active":"2024-02-16T00:11:50.849296+0000","last_peered":"2024-02-16T00:11:50.849296+0000","last_clean":"2024-02-16T00:11:50.849296+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:11:50.849296+0000","last_undegraded":"2024-02-16T00:11:50.849296+0000","last_fullsized":"2024-02-16T00:11:50.849296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:43.145044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844168+0000","last_change":"2024-02-16T00:11:08.814283+0000","last_active":"2024-02-16T00:11:50.844168+0000","last_peered":"2024-02-16T00:11:50.844168+0000","last_clean":"2024-02-16T00:11:50.844168+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:11:50.844168+0000","last_undegraded":"2024-02-16T00:11:50.844168+0000","last_fullsized":"2024-02-16T00:11:50.844168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:04.932316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'239","reported_seq":328,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.614819+0000","last_change":"2024-02-16T00:11:10.827795+0000","last_active":"2024-02-16T00:12:33.614819+0000","last_peered":"2024-02-16T00:12:33.614819+0000","last_clean":"2024-02-16T00:12:33.614819+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:33.614819+0000","last_undegraded":"2024-02-16T00:12:33.614819+0000","last_fullsized":"2024-02-16T00:12:33.614819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:46.508578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839100+0000","last_change":"2024-02-16T00:11:12.832363+0000","last_active":"2024-02-16T00:11:50.839100+0000","last_peered":"2024-02-16T00:11:50.839100+0000","last_clean":"2024-02-16T00:11:50.839100+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:11:50.839100+0000","last_undegraded":"2024-02-16T00:11:50.839100+0000","last_fullsized":"2024-02-16T00:11:50.839100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:05.101733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447432+0000","last_change":"2024-02-16T00:11:04.798269+0000","last_active":"2024-02-16T00:12:33.447432+0000","last_peered":"2024-02-16T00:12:33.447432+0000","last_clean":"2024-02-16T00:12:33.447432+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:12:33.447432+0000","last_undegraded":"2024-02-16T00:12:33.447432+0000","last_fullsized":"2024-02-16T00:12:33.447432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:55.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847476+0000","last_change":"2024-02-16T00:11:02.810889+0000","last_active":"2024-02-16T00:11:50.847476+0000","last_peered":"2024-02-16T00:11:50.847476+0000","last_clean":"2024-02-16T00:11:50.847476+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:11:50.847476+0000","last_undegraded":"2024-02-16T00:11:50.847476+0000","last_fullsized":"2024-02-16T00:11:50.847476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848612+0000","last_change":"2024-02-16T00:11:06.805017+0000","last_active":"2024-02-16T00:11:50.848612+0000","last_peered":"2024-02-16T00:11:50.848612+0000","last_clean":"2024-02-16T00:11:50.848612+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:11:50.848612+0000","last_undegraded":"2024-02-16T00:11:50.848612+0000","last_fullsized":"2024-02-16T00:11:50.848612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:38.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'60","reported_seq":128,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.980293+0000","last_change":"2024-02-16T00:11:08.812824+0000","last_active":"2024-02-16T00:12:27.980293+0000","last_peered":"2024-02-16T00:12:27.980293+0000","last_clean":"2024-02-16T00:12:27.980293+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:27.980293+0000","last_undegraded":"2024-02-16T00:12:27.980293+0000","last_fullsized":"2024-02-16T00:12:27.980293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:49.397658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828558+0000","last_change":"2024-02-16T00:11:10.815519+0000","last_active":"2024-02-16T00:11:51.828558+0000","last_peered":"2024-02-16T00:11:51.828558+0000","last_clean":"2024-02-16T00:11:51.828558+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:11:51.828558+0000","last_undegraded":"2024-02-16T00:11:51.828558+0000","last_fullsized":"2024-02-16T00:11:51.828558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:54.865963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849722+0000","last_change":"2024-02-16T00:11:12.828004+0000","last_active":"2024-02-16T00:11:50.849722+0000","last_peered":"2024-02-16T00:11:50.849722+0000","last_clean":"2024-02-16T00:11:50.849722+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:11:50.849722+0000","last_undegraded":"2024-02-16T00:11:50.849722+0000","last_fullsized":"2024-02-16T00:11:50.849722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:43.107611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842936+0000","last_change":"2024-02-16T00:11:04.802752+0000","last_active":"2024-02-16T00:11:50.842936+0000","last_peered":"2024-02-16T00:11:50.842936+0000","last_clean":"2024-02-16T00:11:50.842936+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:11:50.842936+0000","last_undegraded":"2024-02-16T00:11:50.842936+0000","last_fullsized":"2024-02-16T00:11:50.842936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:08.473080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845216+0000","last_change":"2024-02-16T00:11:02.815829+0000","last_active":"2024-02-16T00:11:50.845216+0000","last_peered":"2024-02-16T00:11:50.845216+0000","last_clean":"2024-02-16T00:11:50.845216+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:11:50.845216+0000","last_undegraded":"2024-02-16T00:11:50.845216+0000","last_fullsized":"2024-02-16T00:11:50.845216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:04.562290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.590941+0000","last_change":"2024-02-16T00:11:06.809403+0000","last_active":"2024-02-16T00:12:33.590941+0000","last_peered":"2024-02-16T00:12:33.590941+0000","last_clean":"2024-02-16T00:12:33.590941+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:33.590941+0000","last_undegraded":"2024-02-16T00:12:33.590941+0000","last_fullsized":"2024-02-16T00:12:33.590941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:35.031327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":875,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":243,"num_read_kb":242,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.927473+0000","last_change":"2024-02-16T00:11:08.812928+0000","last_active":"2024-02-16T00:12:27.927473+0000","last_peered":"2024-02-16T00:12:27.927473+0000","last_clean":"2024-02-16T00:12:27.927473+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:27.927473+0000","last_undegraded":"2024-02-16T00:12:27.927473+0000","last_fullsized":"2024-02-16T00:12:27.927473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:45.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":52,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839358+0000","last_change":"2024-02-16T00:11:10.827306+0000","last_active":"2024-02-16T00:11:50.839358+0000","last_peered":"2024-02-16T00:11:50.839358+0000","last_clean":"2024-02-16T00:11:50.839358+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:11:50.839358+0000","last_undegraded":"2024-02-16T00:11:50.839358+0000","last_fullsized":"2024-02-16T00:11:50.839358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:46.792767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841996+0000","last_change":"2024-02-16T00:11:12.830200+0000","last_active":"2024-02-16T00:11:50.841996+0000","last_peered":"2024-02-16T00:11:50.841996+0000","last_clean":"2024-02-16T00:11:50.841996+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:11:50.841996+0000","last_undegraded":"2024-02-16T00:11:50.841996+0000","last_fullsized":"2024-02-16T00:11:50.841996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:34.641380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839696+0000","last_change":"2024-02-16T00:11:04.806595+0000","last_active":"2024-02-16T00:11:50.839696+0000","last_peered":"2024-02-16T00:11:50.839696+0000","last_clean":"2024-02-16T00:11:50.839696+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:11:50.839696+0000","last_undegraded":"2024-02-16T00:11:50.839696+0000","last_fullsized":"2024-02-16T00:11:50.839696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:15.344749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830815+0000","last_change":"2024-02-16T00:11:02.802098+0000","last_active":"2024-02-16T00:11:51.830815+0000","last_peered":"2024-02-16T00:11:51.830815+0000","last_clean":"2024-02-16T00:11:51.830815+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:11:51.830815+0000","last_undegraded":"2024-02-16T00:11:51.830815+0000","last_fullsized":"2024-02-16T00:11:51.830815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848845+0000","last_change":"2024-02-16T00:11:06.811600+0000","last_active":"2024-02-16T00:11:50.848845+0000","last_peered":"2024-02-16T00:11:50.848845+0000","last_clean":"2024-02-16T00:11:50.848845+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:11:50.848845+0000","last_undegraded":"2024-02-16T00:11:50.848845+0000","last_fullsized":"2024-02-16T00:11:50.848845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:02.997605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.428055+0000","last_change":"2024-02-16T00:11:08.814011+0000","last_active":"2024-02-16T00:12:33.428055+0000","last_peered":"2024-02-16T00:12:33.428055+0000","last_clean":"2024-02-16T00:12:33.428055+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:33.428055+0000","last_undegraded":"2024-02-16T00:12:33.428055+0000","last_fullsized":"2024-02-16T00:12:33.428055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:05.767514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839700+0000","last_change":"2024-02-16T00:11:10.831082+0000","last_active":"2024-02-16T00:11:50.839700+0000","last_peered":"2024-02-16T00:11:50.839700+0000","last_clean":"2024-02-16T00:11:50.839700+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:11:50.839700+0000","last_undegraded":"2024-02-16T00:11:50.839700+0000","last_fullsized":"2024-02-16T00:11:50.839700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:40.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844236+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:11:50.844236+0000","last_peered":"2024-02-16T00:11:50.844236+0000","last_clean":"2024-02-16T00:11:50.844236+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:11:50.844236+0000","last_undegraded":"2024-02-16T00:11:50.844236+0000","last_fullsized":"2024-02-16T00:11:50.844236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:12.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969458+0000","last_change":"2024-02-16T00:11:04.798644+0000","last_active":"2024-02-16T00:12:27.969458+0000","last_peered":"2024-02-16T00:12:27.969458+0000","last_clean":"2024-02-16T00:12:27.969458+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:12:27.969458+0000","last_undegraded":"2024-02-16T00:12:27.969458+0000","last_fullsized":"2024-02-16T00:12:27.969458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:26.014194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849586+0000","last_change":"2024-02-16T00:11:02.820199+0000","last_active":"2024-02-16T00:11:50.849586+0000","last_peered":"2024-02-16T00:11:50.849586+0000","last_clean":"2024-02-16T00:11:50.849586+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:11:50.849586+0000","last_undegraded":"2024-02-16T00:11:50.849586+0000","last_fullsized":"2024-02-16T00:11:50.849586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847851+0000","last_change":"2024-02-16T00:11:06.809034+0000","last_active":"2024-02-16T00:11:50.847851+0000","last_peered":"2024-02-16T00:11:50.847851+0000","last_clean":"2024-02-16T00:11:50.847851+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:11:50.847851+0000","last_undegraded":"2024-02-16T00:11:50.847851+0000","last_fullsized":"2024-02-16T00:11:50.847851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:17.352311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'40","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.954023+0000","last_change":"2024-02-16T00:11:08.814763+0000","last_active":"2024-02-16T00:12:27.954023+0000","last_peered":"2024-02-16T00:12:27.954023+0000","last_clean":"2024-02-16T00:12:27.954023+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:12:27.954023+0000","last_undegraded":"2024-02-16T00:12:27.954023+0000","last_fullsized":"2024-02-16T00:12:27.954023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:51:50.833249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829348+0000","last_change":"2024-02-16T00:11:10.819364+0000","last_active":"2024-02-16T00:11:51.829348+0000","last_peered":"2024-02-16T00:11:51.829348+0000","last_clean":"2024-02-16T00:11:51.829348+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:11:51.829348+0000","last_undegraded":"2024-02-16T00:11:51.829348+0000","last_fullsized":"2024-02-16T00:11:51.829348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:15.575681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841804+0000","last_change":"2024-02-16T00:11:12.831037+0000","last_active":"2024-02-16T00:11:50.841804+0000","last_peered":"2024-02-16T00:11:50.841804+0000","last_clean":"2024-02-16T00:11:50.841804+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:11:50.841804+0000","last_undegraded":"2024-02-16T00:11:50.841804+0000","last_fullsized":"2024-02-16T00:11:50.841804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:19.609072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322586+0000","last_change":"2024-02-16T00:11:04.813889+0000","last_active":"2024-02-16T00:12:27.322586+0000","last_peered":"2024-02-16T00:12:27.322586+0000","last_clean":"2024-02-16T00:12:27.322586+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:12:27.322586+0000","last_undegraded":"2024-02-16T00:12:27.322586+0000","last_fullsized":"2024-02-16T00:12:27.322586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:43.089230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843316+0000","last_change":"2024-02-16T00:11:02.816801+0000","last_active":"2024-02-16T00:11:50.843316+0000","last_peered":"2024-02-16T00:11:50.843316+0000","last_clean":"2024-02-16T00:11:50.843316+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:11:50.843316+0000","last_undegraded":"2024-02-16T00:11:50.843316+0000","last_fullsized":"2024-02-16T00:11:50.843316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322570+0000","last_change":"2024-02-16T00:11:04.801950+0000","last_active":"2024-02-16T00:12:27.322570+0000","last_peered":"2024-02-16T00:12:27.322570+0000","last_clean":"2024-02-16T00:12:27.322570+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:12:27.322570+0000","last_undegraded":"2024-02-16T00:12:27.322570+0000","last_fullsized":"2024-02-16T00:12:27.322570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:03.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828686+0000","last_change":"2024-02-16T00:11:02.808413+0000","last_active":"2024-02-16T00:11:51.828686+0000","last_peered":"2024-02-16T00:11:51.828686+0000","last_clean":"2024-02-16T00:11:51.828686+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:11:51.828686+0000","last_undegraded":"2024-02-16T00:11:51.828686+0000","last_fullsized":"2024-02-16T00:11:51.828686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447415+0000","last_change":"2024-02-16T00:11:04.810063+0000","last_active":"2024-02-16T00:12:33.447415+0000","last_peered":"2024-02-16T00:12:33.447415+0000","last_clean":"2024-02-16T00:12:33.447415+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:33.447415+0000","last_undegraded":"2024-02-16T00:12:33.447415+0000","last_fullsized":"2024-02-16T00:12:33.447415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:09.293991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840012+0000","last_change":"2024-02-16T00:11:02.824009+0000","last_active":"2024-02-16T00:11:50.840012+0000","last_peered":"2024-02-16T00:11:50.840012+0000","last_clean":"2024-02-16T00:11:50.840012+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:11:50.840012+0000","last_undegraded":"2024-02-16T00:11:50.840012+0000","last_fullsized":"2024-02-16T00:11:50.840012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:08.487886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831276+0000","last_change":"2024-02-16T00:11:04.801764+0000","last_active":"2024-02-16T00:11:51.831276+0000","last_peered":"2024-02-16T00:11:51.831276+0000","last_clean":"2024-02-16T00:11:51.831276+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:11:51.831276+0000","last_undegraded":"2024-02-16T00:11:51.831276+0000","last_fullsized":"2024-02-16T00:11:51.831276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830270+0000","last_change":"2024-02-16T00:11:02.797510+0000","last_active":"2024-02-16T00:11:51.830270+0000","last_peered":"2024-02-16T00:11:51.830270+0000","last_clean":"2024-02-16T00:11:51.830270+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:11:51.830270+0000","last_undegraded":"2024-02-16T00:11:51.830270+0000","last_fullsized":"2024-02-16T00:11:51.830270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830000+0000","last_change":"2024-02-16T00:11:04.810324+0000","last_active":"2024-02-16T00:11:51.830000+0000","last_peered":"2024-02-16T00:11:51.830000+0000","last_clean":"2024-02-16T00:11:51.830000+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:11:51.830000+0000","last_undegraded":"2024-02-16T00:11:51.830000+0000","last_fullsized":"2024-02-16T00:11:51.830000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:31.576677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831427+0000","last_change":"2024-02-16T00:11:02.801630+0000","last_active":"2024-02-16T00:11:51.831427+0000","last_peered":"2024-02-16T00:11:51.831427+0000","last_clean":"2024-02-16T00:11:51.831427+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:11:51.831427+0000","last_undegraded":"2024-02-16T00:11:51.831427+0000","last_fullsized":"2024-02-16T00:11:51.831427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:52:16.857323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322847+0000","last_change":"2024-02-16T00:11:04.814522+0000","last_active":"2024-02-16T00:12:27.322847+0000","last_peered":"2024-02-16T00:12:27.322847+0000","last_clean":"2024-02-16T00:12:27.322847+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:12:27.322847+0000","last_undegraded":"2024-02-16T00:12:27.322847+0000","last_fullsized":"2024-02-16T00:12:27.322847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:22:13.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846889+0000","last_change":"2024-02-16T00:11:02.810745+0000","last_active":"2024-02-16T00:11:50.846889+0000","last_peered":"2024-02-16T00:11:50.846889+0000","last_clean":"2024-02-16T00:11:50.846889+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:11:50.846889+0000","last_undegraded":"2024-02-16T00:11:50.846889+0000","last_fullsized":"2024-02-16T00:11:50.846889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447290+0000","last_change":"2024-02-16T00:11:04.797743+0000","last_active":"2024-02-16T00:12:33.447290+0000","last_peered":"2024-02-16T00:12:33.447290+0000","last_clean":"2024-02-16T00:12:33.447290+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:12:33.447290+0000","last_undegraded":"2024-02-16T00:12:33.447290+0000","last_fullsized":"2024-02-16T00:12:33.447290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842219+0000","last_change":"2024-02-16T00:11:02.815909+0000","last_active":"2024-02-16T00:11:50.842219+0000","last_peered":"2024-02-16T00:11:50.842219+0000","last_clean":"2024-02-16T00:11:50.842219+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:11:50.842219+0000","last_undegraded":"2024-02-16T00:11:50.842219+0000","last_fullsized":"2024-02-16T00:11:50.842219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322807+0000","last_change":"2024-02-16T00:11:04.796966+0000","last_active":"2024-02-16T00:12:27.322807+0000","last_peered":"2024-02-16T00:12:27.322807+0000","last_clean":"2024-02-16T00:12:27.322807+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:12:27.322807+0000","last_undegraded":"2024-02-16T00:12:27.322807+0000","last_fullsized":"2024-02-16T00:12:27.322807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:39.656309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830839+0000","last_change":"2024-02-16T00:11:02.797604+0000","last_active":"2024-02-16T00:11:51.830839+0000","last_peered":"2024-02-16T00:11:51.830839+0000","last_clean":"2024-02-16T00:11:51.830839+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:11:51.830839+0000","last_undegraded":"2024-02-16T00:11:51.830839+0000","last_fullsized":"2024-02-16T00:11:51.830839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:42.572100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447505+0000","last_change":"2024-02-16T00:11:04.802856+0000","last_active":"2024-02-16T00:12:33.447505+0000","last_peered":"2024-02-16T00:12:33.447505+0000","last_clean":"2024-02-16T00:12:33.447505+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:12:33.447505+0000","last_undegraded":"2024-02-16T00:12:33.447505+0000","last_fullsized":"2024-02-16T00:12:33.447505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:47:42.006974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839685+0000","last_change":"2024-02-16T00:11:02.820947+0000","last_active":"2024-02-16T00:11:50.839685+0000","last_peered":"2024-02-16T00:11:50.839685+0000","last_clean":"2024-02-16T00:11:50.839685+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:11:50.839685+0000","last_undegraded":"2024-02-16T00:11:50.839685+0000","last_fullsized":"2024-02-16T00:11:50.839685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:21.162020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969475+0000","last_change":"2024-02-16T00:11:04.807293+0000","last_active":"2024-02-16T00:12:27.969475+0000","last_peered":"2024-02-16T00:12:27.969475+0000","last_clean":"2024-02-16T00:12:27.969475+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:12:27.969475+0000","last_undegraded":"2024-02-16T00:12:27.969475+0000","last_fullsized":"2024-02-16T00:12:27.969475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:41.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828960+0000","last_change":"2024-02-16T00:11:02.797276+0000","last_active":"2024-02-16T00:11:51.828960+0000","last_peered":"2024-02-16T00:11:51.828960+0000","last_clean":"2024-02-16T00:11:51.828960+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:11:51.828960+0000","last_undegraded":"2024-02-16T00:11:51.828960+0000","last_fullsized":"2024-02-16T00:11:51.828960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831738+0000","last_change":"2024-02-16T00:11:04.812406+0000","last_active":"2024-02-16T00:11:51.831738+0000","last_peered":"2024-02-16T00:11:51.831738+0000","last_clean":"2024-02-16T00:11:51.831738+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:11:51.831738+0000","last_undegraded":"2024-02-16T00:11:51.831738+0000","last_fullsized":"2024-02-16T00:11:51.831738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847992+0000","last_change":"2024-02-16T00:11:02.809533+0000","last_active":"2024-02-16T00:11:50.847992+0000","last_peered":"2024-02-16T00:11:50.847992+0000","last_clean":"2024-02-16T00:11:50.847992+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:11:50.847992+0000","last_undegraded":"2024-02-16T00:11:50.847992+0000","last_fullsized":"2024-02-16T00:11:50.847992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969462+0000","last_change":"2024-02-16T00:11:04.796459+0000","last_active":"2024-02-16T00:12:27.969462+0000","last_peered":"2024-02-16T00:12:27.969462+0000","last_clean":"2024-02-16T00:12:27.969462+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:12:27.969462+0000","last_undegraded":"2024-02-16T00:12:27.969462+0000","last_fullsized":"2024-02-16T00:12:27.969462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:34.974228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846880+0000","last_change":"2024-02-16T00:11:02.796731+0000","last_active":"2024-02-16T00:11:50.846880+0000","last_peered":"2024-02-16T00:11:50.846880+0000","last_clean":"2024-02-16T00:11:50.846880+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:11:50.846880+0000","last_undegraded":"2024-02-16T00:11:50.846880+0000","last_fullsized":"2024-02-16T00:11:50.846880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847935+0000","last_change":"2024-02-16T00:11:04.814979+0000","last_active":"2024-02-16T00:11:50.847935+0000","last_peered":"2024-02-16T00:11:50.847935+0000","last_clean":"2024-02-16T00:11:50.847935+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:11:50.847935+0000","last_undegraded":"2024-02-16T00:11:50.847935+0000","last_fullsized":"2024-02-16T00:11:50.847935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:45.811771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842495+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:11:50.842495+0000","last_peered":"2024-02-16T00:11:50.842495+0000","last_clean":"2024-02-16T00:11:50.842495+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:11:50.842495+0000","last_undegraded":"2024-02-16T00:11:50.842495+0000","last_fullsized":"2024-02-16T00:11:50.842495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:23.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848738+0000","last_change":"2024-02-16T00:11:04.803538+0000","last_active":"2024-02-16T00:11:50.848738+0000","last_peered":"2024-02-16T00:11:50.848738+0000","last_clean":"2024-02-16T00:11:50.848738+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:11:50.848738+0000","last_undegraded":"2024-02-16T00:11:50.848738+0000","last_fullsized":"2024-02-16T00:11:50.848738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:47.811172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845428+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:11:50.845428+0000","last_peered":"2024-02-16T00:11:50.845428+0000","last_clean":"2024-02-16T00:11:50.845428+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:11:50.845428+0000","last_undegraded":"2024-02-16T00:11:50.845428+0000","last_fullsized":"2024-02-16T00:11:50.845428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:06.466729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840720+0000","last_change":"2024-02-16T00:11:04.808274+0000","last_active":"2024-02-16T00:11:50.840720+0000","last_peered":"2024-02-16T00:11:50.840720+0000","last_clean":"2024-02-16T00:11:50.840720+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:11:50.840720+0000","last_undegraded":"2024-02-16T00:11:50.840720+0000","last_fullsized":"2024-02-16T00:11:50.840720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:36.866397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842918+0000","last_change":"2024-02-16T00:11:02.816585+0000","last_active":"2024-02-16T00:11:50.842918+0000","last_peered":"2024-02-16T00:11:50.842918+0000","last_clean":"2024-02-16T00:11:50.842918+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:11:50.842918+0000","last_undegraded":"2024-02-16T00:11:50.842918+0000","last_fullsized":"2024-02-16T00:11:50.842918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848533+0000","last_change":"2024-02-16T00:11:04.798394+0000","last_active":"2024-02-16T00:11:50.848533+0000","last_peered":"2024-02-16T00:11:50.848533+0000","last_clean":"2024-02-16T00:11:50.848533+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:11:50.848533+0000","last_undegraded":"2024-02-16T00:11:50.848533+0000","last_fullsized":"2024-02-16T00:11:50.848533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:30:00.100561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843889+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:11:50.843889+0000","last_peered":"2024-02-16T00:11:50.843889+0000","last_clean":"2024-02-16T00:11:50.843889+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:11:50.843889+0000","last_undegraded":"2024-02-16T00:11:50.843889+0000","last_fullsized":"2024-02-16T00:11:50.843889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:01.906683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840067+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:11:50.840067+0000","last_peered":"2024-02-16T00:11:50.840067+0000","last_clean":"2024-02-16T00:11:50.840067+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:11:50.840067+0000","last_undegraded":"2024-02-16T00:11:50.840067+0000","last_fullsized":"2024-02-16T00:11:50.840067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:04.771435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831287+0000","last_change":"2024-02-16T00:11:04.798473+0000","last_active":"2024-02-16T00:11:51.831287+0000","last_peered":"2024-02-16T00:11:51.831287+0000","last_clean":"2024-02-16T00:11:51.831287+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:11:51.831287+0000","last_undegraded":"2024-02-16T00:11:51.831287+0000","last_fullsized":"2024-02-16T00:11:51.831287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:22:13.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829177+0000","last_change":"2024-02-16T00:11:02.808092+0000","last_active":"2024-02-16T00:11:51.829177+0000","last_peered":"2024-02-16T00:11:51.829177+0000","last_clean":"2024-02-16T00:11:51.829177+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:11:51.829177+0000","last_undegraded":"2024-02-16T00:11:51.829177+0000","last_fullsized":"2024-02-16T00:11:51.829177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848586+0000","last_change":"2024-02-16T00:11:04.814263+0000","last_active":"2024-02-16T00:11:50.848586+0000","last_peered":"2024-02-16T00:11:50.848586+0000","last_clean":"2024-02-16T00:11:50.848586+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:11:50.848586+0000","last_undegraded":"2024-02-16T00:11:50.848586+0000","last_fullsized":"2024-02-16T00:11:50.848586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:23.700793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1912,"ondisk_log_size":1912,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":1622,"num_read_kb":1373,"num_write":701,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1361,"ondisk_log_size":1361,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":800,"num_read_kb":799,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705686,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":143431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.499},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28599999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705687,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40452,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331388,"statfs":{"total":96636764160,"available":96595341312,"internally_reserved":0,"allocated":978944,"data_stored":728362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.23300000000000001}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.314},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.25},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.313}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":141433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:12:36.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T00:12:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa768582640 1 Processor -- start 2024-02-16T00:12:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa768582640 1 -- start start 2024-02-16T00:12:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa768582640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa76006d800 0x7fa7601312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa768582640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa760067090 con 0x7fa76006cd10 2024-02-16T00:12:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa768582640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa760070ca0 con 0x7fa76006d800 2024-02-16T00:12:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa765b1d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa76006d800 0x7fa7601312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa76631e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa76006cd10 0x7fa76006d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60648/0 (socket says 172.21.15.2:60648) 2024-02-16T00:12:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.491+0000 7fa76631e640 1 -- 172.21.15.2:0/3214420272 learned_addr learned my addr 172.21.15.2:0/3214420272 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.492+0000 7fa765b1d640 1 -- 172.21.15.2:0/3214420272 >> v1:172.21.15.2:6789/0 conn(0x7fa76006cd10 legacy=0x7fa76006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.492+0000 7fa765b1d640 1 -- 172.21.15.2:0/3214420272 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760070670 con 0x7fa76006d800 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.492+0000 7fa765b1d640 1 --2- 172.21.15.2:0/3214420272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006d800 0x7fa7601312e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa750009720 tx=0x7fa75002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632a758de46f115d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.492+0000 7fa76531c640 1 -- 172.21.15.2:0/3214420272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75002e070 con 0x7fa76006d800 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa76531c640 1 -- 172.21.15.2:0/3214420272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7500316d0 con 0x7fa76006d800 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa76531c640 1 -- 172.21.15.2:0/3214420272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa750031990 con 0x7fa76006d800 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 -- 172.21.15.2:0/3214420272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006d800 msgr2=0x7fa7601312e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 --2- 172.21.15.2:0/3214420272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006d800 0x7fa7601312e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa750009720 tx=0x7fa75002b840 comp rx=0 tx=0).stop 2024-02-16T00:12:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 -- 172.21.15.2:0/3214420272 shutdown_connections 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 --2- 172.21.15.2:0/3214420272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006d800 0x7fa7601312e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 -- 172.21.15.2:0/3214420272 >> 172.21.15.2:0/3214420272 conn(0x7fa7600974b0 msgr2=0x7fa7600978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 -- 172.21.15.2:0/3214420272 shutdown_connections 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.493+0000 7fa768582640 1 -- 172.21.15.2:0/3214420272 wait complete. 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa768582640 1 Processor -- start 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa768582640 1 -- start start 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa768582640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 0x7fa7601c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa768582640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760130f00 con 0x7fa76006cd10 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa76631e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 0x7fa7601c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa76631e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 0x7fa7601c0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38472/0 (socket says 172.21.15.2:38472) 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.494+0000 7fa76631e640 1 -- 172.21.15.2:0/2111293823 learned_addr learned my addr 172.21.15.2:0/2111293823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa76631e640 1 -- 172.21.15.2:0/2111293823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750009400 con 0x7fa76006cd10 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa76631e640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 0x7fa7601c0b40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c380 tx=0x7fa75c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c005c10 con 0x7fa76006cd10 2024-02-16T00:12:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c005d70 con 0x7fa76006cd10 2024-02-16T00:12:36.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa75c004930 con 0x7fa76006cd10 2024-02-16T00:12:36.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa760127000 con 0x7fa76006cd10 2024-02-16T00:12:36.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.495+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760128b50 con 0x7fa76006cd10 2024-02-16T00:12:36.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.496+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa75c004ba0 con 0x7fa76006cd10 2024-02-16T00:12:36.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.496+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7601277f0 con 0x7fa76006cd10 2024-02-16T00:12:36.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.496+0000 7fa756ffd640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa744037ea0 0x7fa74403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:36.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.496+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa75c04ae30 con 0x7fa76006cd10 2024-02-16T00:12:36.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.496+0000 7fa765b1d640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa744037ea0 0x7fa74403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:36.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.497+0000 7fa765b1d640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa744037ea0 0x7fa74403a360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa750036000 tx=0x7fa750008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:36.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.501+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa75c011dd0 con 0x7fa76006cd10 2024-02-16T00:12:36.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.683+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7600627b0 con 0x7fa76006cd10 2024-02-16T00:12:36.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.685+0000 7fa756ffd640 1 -- 172.21.15.2:0/2111293823 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20960 (secure 0 0 0) 0x7fa75c011bf0 con 0x7fa76006cd10 2024-02-16T00:12:36.687 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:12:36.688 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"fsid":"b6d6fba3-0eb5-4bdf-a061-09e5c8b59f57","created":"2024-02-16T00:10:45.367875+0000","modified":"2024-02-16T00:11:50.836074+0000","last_up_change":"2024-02-16T00:10:53.427469+0000","last_in_change":"2024-02-16T00:10:46.498824+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T00:10:53.708168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T00:10:54.306098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-02-16T00:11:00.793188+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-02-16T00:11:03.136535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-02-16T00:11:05.122020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-02-16T00:11:06.887728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-02-16T00:11:08.835101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-02-16T00:11:10.903435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5f3c90d-053a-47b1-9fae-357476ad3c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6801","nonce":1783370926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6803","nonce":1783370926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6807","nonce":1783370926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1783370926},{"type":"v1","addr":"172.21.15.2:6805","nonce":1783370926}]},"public_addr":"172.21.15.2:6801/1783370926","cluster_addr":"172.21.15.2:6803/1783370926","heartbeat_back_addr":"172.21.15.2:6807/1783370926","heartbeat_front_addr":"172.21.15.2:6805/1783370926","state":["exists","up"]},{"osd":1,"uuid":"9ada2c50-de0c-45de-aa91-91b6bb010c01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6801","nonce":2950936693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6803","nonce":2950936693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6807","nonce":2950936693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2950936693},{"type":"v1","addr":"172.21.15.42:6805","nonce":2950936693}]},"public_addr":"172.21.15.42:6801/2950936693","cluster_addr":"172.21.15.42:6803/2950936693","heartbeat_back_addr":"172.21.15.42:6807/2950936693","heartbeat_front_addr":"172.21.15.42:6805/2950936693","state":["exists","up"]},{"osd":2,"uuid":"3ed7cb8a-b24c-4b3f-9290-6bbaa8e11bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6809","nonce":1288904824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6814","nonce":1288904824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6822","nonce":1288904824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":1288904824},{"type":"v1","addr":"172.21.15.42:6819","nonce":1288904824}]},"public_addr":"172.21.15.42:6809/1288904824","cluster_addr":"172.21.15.42:6814/1288904824","heartbeat_back_addr":"172.21.15.42:6822/1288904824","heartbeat_front_addr":"172.21.15.42:6819/1288904824","state":["exists","up"]},{"osd":3,"uuid":"c55010bc-d742-4bfc-9ac4-190a4e687fdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6811","nonce":474355007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6815","nonce":474355007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6823","nonce":474355007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":474355007},{"type":"v1","addr":"172.21.15.42:6818","nonce":474355007}]},"public_addr":"172.21.15.42:6811/474355007","cluster_addr":"172.21.15.42:6815/474355007","heartbeat_back_addr":"172.21.15.42:6823/474355007","heartbeat_front_addr":"172.21.15.42:6818/474355007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.521740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.603798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.608173+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T00:10:51.642745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"5.5","mappings":[{"from":0,"to":2}]},{"pgid":"5.7","mappings":[{"from":0,"to":2}]},{"pgid":"5.c","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T00:12:36.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa744037ea0 msgr2=0x7fa74403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa744037ea0 0x7fa74403a360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa750036000 tx=0x7fa750008030 comp rx=0 tx=0).stop 2024-02-16T00:12:36.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 msgr2=0x7fa7601c0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 0x7fa7601c0b40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c380 tx=0x7fa75c00c840 comp rx=0 tx=0).stop 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 shutdown_connections 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa744037ea0 0x7fa74403a360 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 --2- 172.21.15.2:0/2111293823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76006cd10 0x7fa7601c0b40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 >> 172.21.15.2:0/2111293823 conn(0x7fa7600974b0 msgr2=0x7fa76012bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 shutdown_connections 2024-02-16T00:12:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:36.687+0000 7fa768582640 1 -- 172.21.15.2:0/2111293823 wait complete. 2024-02-16T00:12:37.700 INFO:tasks.ceph:Scrubbing osd.0 2024-02-16T00:12:37.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-16T00:12:37.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.815+0000 7f706299d640 1 Processor -- start 2024-02-16T00:12:37.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.815+0000 7f706299d640 1 -- start start 2024-02-16T00:12:37.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f706299d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f705c098820 0x7f705c098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f706299d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c09a800 con 0x7f705c099140 2024-02-16T00:12:37.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f706299d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c09dab0 con 0x7f705c098820 2024-02-16T00:12:37.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f705bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f705c098820 0x7f705c098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f705b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f705c099140 0x7f705c096480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60652/0 (socket says 172.21.15.2:60652) 2024-02-16T00:12:37.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f705b7fe640 1 -- 172.21.15.2:0/2549307340 learned_addr learned my addr 172.21.15.2:0/2549307340 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:37.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f705bfff640 1 -- 172.21.15.2:0/2549307340 >> v1:172.21.15.2:6789/0 conn(0x7f705c099140 legacy=0x7f705c096480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.816+0000 7f705bfff640 1 -- 172.21.15.2:0/2549307340 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c09d790 con 0x7f705c098820 2024-02-16T00:12:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.817+0000 7f705bfff640 1 --2- 172.21.15.2:0/2549307340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c098c00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f704c009720 tx=0x7f704c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619ef07b8d026294 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.817+0000 7f705affd640 1 -- 172.21.15.2:0/2549307340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f704c02e070 con 0x7f705c098820 2024-02-16T00:12:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.817+0000 7f705affd640 1 -- 172.21.15.2:0/2549307340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c0316d0 con 0x7f705c098820 2024-02-16T00:12:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.817+0000 7f705affd640 1 -- 172.21.15.2:0/2549307340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f704c031990 con 0x7f705c098820 2024-02-16T00:12:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 -- 172.21.15.2:0/2549307340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 msgr2=0x7f705c098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 --2- 172.21.15.2:0/2549307340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c098c00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f704c009720 tx=0x7f704c02b840 comp rx=0 tx=0).stop 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 -- 172.21.15.2:0/2549307340 shutdown_connections 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 --2- 172.21.15.2:0/2549307340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c098c00 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 -- 172.21.15.2:0/2549307340 >> 172.21.15.2:0/2549307340 conn(0x7f705c0a0940 msgr2=0x7f705c09ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 -- 172.21.15.2:0/2549307340 shutdown_connections 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.818+0000 7f706299d640 1 -- 172.21.15.2:0/2549307340 wait complete. 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f706299d640 1 Processor -- start 2024-02-16T00:12:37.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f706299d640 1 -- start start 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f706299d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c1c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f706299d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c06e250 con 0x7f705c098820 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f705bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c1c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f705bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c1c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38504/0 (socket says 172.21.15.2:38504) 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.819+0000 7f705bfff640 1 -- 172.21.15.2:0/1033436105 learned_addr learned my addr 172.21.15.2:0/1033436105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f705bfff640 1 -- 172.21.15.2:0/1033436105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009400 con 0x7f705c098820 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f705bfff640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c1c29d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f704c034040 tx=0x7f704c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f704c032830 con 0x7f705c098820 2024-02-16T00:12:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c032990 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f704c032c50 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c1c2610 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.820+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c12b6f0 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f705c0998d0 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f704c04d3f0 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7058ff9640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7048037ef0 0x7f704803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f704c06d340 con 0x7f705c098820 2024-02-16T00:12:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7058ff9640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7048044350 0x7f70480467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7048046ec0 con 0x7f7048044350 2024-02-16T00:12:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f704c06f9b0 con 0x7f705c098820 2024-02-16T00:12:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f7060f3a640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7048044350 0x7f70480467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.821+0000 7f705b7fe640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7048037ef0 0x7f704803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.822+0000 7f7060f3a640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7048044350 0x7f70480467f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.822+0000 7f705b7fe640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7048037ef0 0x7f704803a3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7050007fd0 tx=0x7f7050007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.822+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== osd.0 v2:172.21.15.2:6800/1783370926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7048046ec0 con 0x7f7048044350 2024-02-16T00:12:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 --> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f705c0627b0 con 0x7f7048044350 2024-02-16T00:12:37.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f7058ff9640 1 -- 172.21.15.2:0/1033436105 <== osd.0 v2:172.21.15.2:6800/1783370926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f705c0627b0 con 0x7f7048044350 2024-02-16T00:12:37.838 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-02-16T00:12:37.839 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T00:12:37.839 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-02-16T00:12:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7048044350 msgr2=0x7f70480467f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7048044350 0x7f70480467f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7048037ef0 msgr2=0x7f704803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7048037ef0 0x7f704803a3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7050007fd0 tx=0x7f7050007ac0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 msgr2=0x7f705c1c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c1c29d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f704c034040 tx=0x7f704c0046c0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 shutdown_connections 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:6800/1783370926,v1:172.21.15.2:6801/1783370926] conn(0x7f7048044350 0x7f70480467f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7048037ef0 0x7f704803a3b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 --2- 172.21.15.2:0/1033436105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f705c098820 0x7f705c1c29d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 >> 172.21.15.2:0/1033436105 conn(0x7f705c0a0940 msgr2=0x7f705c09b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:37.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 shutdown_connections 2024-02-16T00:12:37.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.836+0000 7f706299d640 1 -- 172.21.15.2:0/1033436105 wait complete. 2024-02-16T00:12:37.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-16T00:12:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8078482640 1 Processor -- start 2024-02-16T00:12:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8078482640 1 -- start start 2024-02-16T00:12:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8078482640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f807012a980 0x7f807012ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8078482640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807012a780 con 0x7f807012b2a0 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8078482640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8070071ff0 con 0x7f807012a980 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f807621e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f807012a980 0x7f807012ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8075a1d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f807012b2a0 0x7f807012db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60662/0 (socket says 172.21.15.2:60662) 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.950+0000 7f8075a1d640 1 -- 172.21.15.2:0/4091157630 learned_addr learned my addr 172.21.15.2:0/4091157630 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807621e640 1 -- 172.21.15.2:0/4091157630 >> v1:172.21.15.2:6789/0 conn(0x7f807012b2a0 legacy=0x7f807012db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807621e640 1 -- 172.21.15.2:0/4091157630 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070098be0 con 0x7f807012a980 2024-02-16T00:12:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807521c640 1 -- 172.21.15.2:0/4091157630 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235363545 0 0) 0x7f807012a780 con 0x7f807012b2a0 2024-02-16T00:12:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807621e640 1 --2- 172.21.15.2:0/4091157630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f807012ad60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f806c009720 tx=0x7f806c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6a8603b76148b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807521c640 1 -- 172.21.15.2:0/4091157630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c02e070 con 0x7f807012a980 2024-02-16T00:12:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807521c640 1 -- 172.21.15.2:0/4091157630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c0316d0 con 0x7f807012a980 2024-02-16T00:12:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.951+0000 7f807521c640 1 -- 172.21.15.2:0/4091157630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c031990 con 0x7f807012a980 2024-02-16T00:12:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 -- 172.21.15.2:0/4091157630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 msgr2=0x7f807012ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:37.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 --2- 172.21.15.2:0/4091157630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f807012ad60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f806c009720 tx=0x7f806c02b840 comp rx=0 tx=0).stop 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 -- 172.21.15.2:0/4091157630 shutdown_connections 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 --2- 172.21.15.2:0/4091157630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f807012ad60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 -- 172.21.15.2:0/4091157630 >> 172.21.15.2:0/4091157630 conn(0x7f807009c210 msgr2=0x7f8070071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 -- 172.21.15.2:0/4091157630 shutdown_connections 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.952+0000 7f8078482640 1 -- 172.21.15.2:0/4091157630 wait complete. 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f8078482640 1 Processor -- start 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f8078482640 1 -- start start 2024-02-16T00:12:37.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f8078482640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f8070118d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f8078482640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807011ae00 con 0x7f807012a980 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f807621e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f8070118d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f807621e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f8070118d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38528/0 (socket says 172.21.15.2:38528) 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.953+0000 7f807621e640 1 -- 172.21.15.2:0/4067497758 learned_addr learned my addr 172.21.15.2:0/4067497758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f807621e640 1 -- 172.21.15.2:0/4067497758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009400 con 0x7f807012a980 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f807621e640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f8070118d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f806c009720 tx=0x7f806c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c0328b0 con 0x7f807012a980 2024-02-16T00:12:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c032a10 con 0x7f807012a980 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807009b800 con 0x7f807012a980 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c032cb0 con 0x7f807012a980 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.954+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807011b8b0 con 0x7f807012a980 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.955+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f806c04e450 con 0x7f807012a980 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.955+0000 7f8066ffd640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8054037ef0 0x7f805403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.955+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807011a2b0 con 0x7f807012a980 2024-02-16T00:12:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.955+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f806c06d5e0 con 0x7f807012a980 2024-02-16T00:12:37.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.955+0000 7f8075a1d640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8054037ef0 0x7f805403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:37.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.956+0000 7f8075a1d640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8054037ef0 0x7f805403a3b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f8060007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:37.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:37.959+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f806c04c940 con 0x7f807012a980 2024-02-16T00:12:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.137+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f807011ba40 con 0x7f8054037ef0 2024-02-16T00:12:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.138+0000 7f8066ffd640 1 -- 172.21.15.2:0/4067497758 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80600058d0 con 0x7f8054037ef0 2024-02-16T00:12:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-02-16T00:12:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8054037ef0 msgr2=0x7f805403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8054037ef0 0x7f805403a3b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f8060007970 comp rx=0 tx=0).stop 2024-02-16T00:12:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 msgr2=0x7f8070118d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f8070118d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f806c009720 tx=0x7f806c0046c0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 shutdown_connections 2024-02-16T00:12:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f8054037ef0 0x7f805403a3b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 --2- 172.21.15.2:0/4067497758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f807012a980 0x7f8070118d70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 >> 172.21.15.2:0/4067497758 conn(0x7f807009c210 msgr2=0x7f807012d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 shutdown_connections 2024-02-16T00:12:38.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.141+0000 7f8078482640 1 -- 172.21.15.2:0/4067497758 wait complete. 2024-02-16T00:12:38.153 INFO:tasks.ceph:Scrubbing osd.1 2024-02-16T00:12:38.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-16T00:12:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.255+0000 7f5884e86640 1 Processor -- start 2024-02-16T00:12:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.255+0000 7f5884e86640 1 -- start start 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f5884e86640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5880098820 0x7f5880098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f5884e86640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588009a800 con 0x7f5880099140 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f5884e86640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588009dab0 con 0x7f5880098820 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f587e59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5880098820 0x7f5880098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f587dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5880099140 0x7f5880096480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60672/0 (socket says 172.21.15.2:60672) 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f587dd9b640 1 -- 172.21.15.2:0/2756950137 learned_addr learned my addr 172.21.15.2:0/2756950137 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f587e59c640 1 -- 172.21.15.2:0/2756950137 >> v1:172.21.15.2:6789/0 conn(0x7f5880099140 legacy=0x7f5880096480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f587e59c640 1 -- 172.21.15.2:0/2756950137 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588009d790 con 0x7f5880098820 2024-02-16T00:12:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.256+0000 7f587d59a640 1 -- 172.21.15.2:0/2756950137 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743612659 0 0) 0x7f588009a800 con 0x7f5880099140 2024-02-16T00:12:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.257+0000 7f587e59c640 1 --2- 172.21.15.2:0/2756950137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f5880098c00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5878009720 tx=0x7f587802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553d57a307951c26 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.257+0000 7f587d59a640 1 -- 172.21.15.2:0/2756950137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f587802e070 con 0x7f5880098820 2024-02-16T00:12:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.257+0000 7f587d59a640 1 -- 172.21.15.2:0/2756950137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780316d0 con 0x7f5880098820 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.257+0000 7f587d59a640 1 -- 172.21.15.2:0/2756950137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5878031990 con 0x7f5880098820 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.257+0000 7f5884e86640 1 -- 172.21.15.2:0/2756950137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 msgr2=0x7f5880098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.257+0000 7f5884e86640 1 --2- 172.21.15.2:0/2756950137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f5880098c00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5878009720 tx=0x7f587802b840 comp rx=0 tx=0).stop 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.258+0000 7f5884e86640 1 -- 172.21.15.2:0/2756950137 shutdown_connections 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.258+0000 7f5884e86640 1 --2- 172.21.15.2:0/2756950137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f5880098c00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.258+0000 7f5884e86640 1 -- 172.21.15.2:0/2756950137 >> 172.21.15.2:0/2756950137 conn(0x7f58800a0940 msgr2=0x7f588009ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.258+0000 7f5884e86640 1 -- 172.21.15.2:0/2756950137 shutdown_connections 2024-02-16T00:12:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.258+0000 7f5884e86640 1 -- 172.21.15.2:0/2756950137 wait complete. 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.258+0000 7f5884e86640 1 Processor -- start 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f5884e86640 1 -- start start 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f5884e86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f588006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f5884e86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588006c350 con 0x7f5880098820 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f587e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f588006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f587e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f588006c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38542/0 (socket says 172.21.15.2:38542) 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f587e59c640 1 -- 172.21.15.2:0/69396700 learned_addr learned my addr 172.21.15.2:0/69396700 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:38.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f587e59c640 1 -- 172.21.15.2:0/69396700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009400 con 0x7f5880098820 2024-02-16T00:12:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.259+0000 7f587e59c640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f588006c7a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f587802b880 tx=0x7f58780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5878004160 con 0x7f5880098820 2024-02-16T00:12:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780042c0 con 0x7f5880098820 2024-02-16T00:12:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5878032640 con 0x7f5880098820 2024-02-16T00:12:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588006e340 con 0x7f5880098820 2024-02-16T00:12:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588006e740 con 0x7f5880098820 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f58780327a0 con 0x7f5880098820 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.260+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58800998d0 con 0x7f5880098820 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f5876ffd640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5860037ef0 0x7f586003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f587806d9a0 con 0x7f5880098820 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f5876ffd640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7f58600442f0 0x7f5860046790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5860046e60 con 0x7f58600442f0 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58780722a0 con 0x7f5880098820 2024-02-16T00:12:38.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f587dd9b640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5860037ef0 0x7f586003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f587ed9d640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7f58600442f0 0x7f5860046790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f587dd9b640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5860037ef0 0x7f586003a3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5868000c00 tx=0x7f5868007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.261+0000 7f587ed9d640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7f58600442f0 0x7f5860046790 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.262+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== osd.1 v2:172.21.15.42:6800/2950936693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5860046e60 con 0x7f58600442f0 2024-02-16T00:12:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.275+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 --> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58800627b0 con 0x7f58600442f0 2024-02-16T00:12:38.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5876ffd640 1 -- 172.21.15.2:0/69396700 <== osd.1 v2:172.21.15.42:6800/2950936693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f58800627b0 con 0x7f58600442f0 2024-02-16T00:12:38.278 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-02-16T00:12:38.279 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T00:12:38.279 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-02-16T00:12:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7f58600442f0 msgr2=0x7f5860046790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7f58600442f0 0x7f5860046790 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5860037ef0 msgr2=0x7f586003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5860037ef0 0x7f586003a3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5868000c00 tx=0x7f5868007970 comp rx=0 tx=0).stop 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 msgr2=0x7f588006c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f588006c7a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f587802b880 tx=0x7f58780046c0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 shutdown_connections 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6800/2950936693,v1:172.21.15.42:6801/2950936693] conn(0x7f58600442f0 0x7f5860046790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f5860037ef0 0x7f586003a3b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 --2- 172.21.15.2:0/69396700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5880098820 0x7f588006c7a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.276+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 >> 172.21.15.2:0/69396700 conn(0x7f58800a0940 msgr2=0x7f588012dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.277+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 shutdown_connections 2024-02-16T00:12:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.277+0000 7f5884e86640 1 -- 172.21.15.2:0/69396700 wait complete. 2024-02-16T00:12:38.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-16T00:12:38.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6d0255640 1 Processor -- start 2024-02-16T00:12:38.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6d0255640 1 -- start start 2024-02-16T00:12:38.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6d0255640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6c812af10 0x7fb6c812b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6d0255640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c8072220 con 0x7fb6c8095020 2024-02-16T00:12:38.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6d0255640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c806cc30 con 0x7fb6c812af10 2024-02-16T00:12:38.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6cdff1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6c812af10 0x7fb6c812b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6cd7f0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb6c8095020 0x7fb6c8095440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60684/0 (socket says 172.21.15.2:60684) 2024-02-16T00:12:38.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.388+0000 7fb6cd7f0640 1 -- 172.21.15.2:0/3821840132 learned_addr learned my addr 172.21.15.2:0/3821840132 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:38.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.389+0000 7fb6cdff1640 1 -- 172.21.15.2:0/3821840132 >> v1:172.21.15.2:6789/0 conn(0x7fb6c8095020 legacy=0x7fb6c8095440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.389+0000 7fb6cdff1640 1 -- 172.21.15.2:0/3821840132 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c812aae0 con 0x7fb6c812af10 2024-02-16T00:12:38.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.389+0000 7fb6cdff1640 1 --2- 172.21.15.2:0/3821840132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c812af10 0x7fb6c812b2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009720 tx=0x7fb6c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b34357db4775e64 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.389+0000 7fb6ccfef640 1 -- 172.21.15.2:0/3821840132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6c402e070 con 0x7fb6c812af10 2024-02-16T00:12:38.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.389+0000 7fb6ccfef640 1 -- 172.21.15.2:0/3821840132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c40316d0 con 0x7fb6c812af10 2024-02-16T00:12:38.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.389+0000 7fb6ccfef640 1 -- 172.21.15.2:0/3821840132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6c4031990 con 0x7fb6c812af10 2024-02-16T00:12:38.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 -- 172.21.15.2:0/3821840132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c812af10 msgr2=0x7fb6c812b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 --2- 172.21.15.2:0/3821840132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c812af10 0x7fb6c812b2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009720 tx=0x7fb6c402b840 comp rx=0 tx=0).stop 2024-02-16T00:12:38.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 -- 172.21.15.2:0/3821840132 shutdown_connections 2024-02-16T00:12:38.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 --2- 172.21.15.2:0/3821840132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c812af10 0x7fb6c812b2f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 -- 172.21.15.2:0/3821840132 >> 172.21.15.2:0/3821840132 conn(0x7fb6c809a050 msgr2=0x7fb6c809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 -- 172.21.15.2:0/3821840132 shutdown_connections 2024-02-16T00:12:38.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.390+0000 7fb6d0255640 1 -- 172.21.15.2:0/3821840132 wait complete. 2024-02-16T00:12:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6d0255640 1 Processor -- start 2024-02-16T00:12:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6d0255640 1 -- start start 2024-02-16T00:12:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6d0255640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 0x7fb6c8123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6d0255640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c81249e0 con 0x7fb6c8095020 2024-02-16T00:12:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6cdff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 0x7fb6c8123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6cdff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 0x7fb6c8123240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38552/0 (socket says 172.21.15.2:38552) 2024-02-16T00:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.391+0000 7fb6cdff1640 1 -- 172.21.15.2:0/2733587227 learned_addr learned my addr 172.21.15.2:0/2733587227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6cdff1640 1 -- 172.21.15.2:0/2733587227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009400 con 0x7fb6c8095020 2024-02-16T00:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6cdff1640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 0x7fb6c8123240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009840 tx=0x7fb6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6c40328b0 con 0x7fb6c8095020 2024-02-16T00:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4032a10 con 0x7fb6c8095020 2024-02-16T00:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c8097d70 con 0x7fb6c8095020 2024-02-16T00:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6c4032cf0 con 0x7fb6c8095020 2024-02-16T00:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.392+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c8071550 con 0x7fb6c8095020 2024-02-16T00:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.393+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb6c404d3f0 con 0x7fb6c8095020 2024-02-16T00:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.393+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c80627b0 con 0x7fb6c8095020 2024-02-16T00:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.393+0000 7fb6be7fc640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb6ac037ef0 0x7fb6ac03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.393+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fb6c406d3d0 con 0x7fb6c8095020 2024-02-16T00:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.393+0000 7fb6cd7f0640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb6ac037ef0 0x7fb6ac03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.394+0000 7fb6cd7f0640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb6ac037ef0 0x7fb6ac03a3b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8007fd0 tx=0x7fb6b8007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.397+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6c40308e0 con 0x7fb6c8095020 2024-02-16T00:12:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.577+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6c806c250 con 0x7fb6ac037ef0 2024-02-16T00:12:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.578+0000 7fb6be7fc640 1 -- 172.21.15.2:0/2733587227 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb6b80012f0 con 0x7fb6ac037ef0 2024-02-16T00:12:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-02-16T00:12:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb6ac037ef0 msgr2=0x7fb6ac03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb6ac037ef0 0x7fb6ac03a3b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8007fd0 tx=0x7fb6b8007ac0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 msgr2=0x7fb6c8123240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 0x7fb6c8123240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009840 tx=0x7fb6c40046c0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 shutdown_connections 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fb6ac037ef0 0x7fb6ac03a3b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 --2- 172.21.15.2:0/2733587227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c8095020 0x7fb6c8123240 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 >> 172.21.15.2:0/2733587227 conn(0x7fb6c809a050 msgr2=0x7fb6c8093ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 shutdown_connections 2024-02-16T00:12:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.580+0000 7fb6d0255640 1 -- 172.21.15.2:0/2733587227 wait complete. 2024-02-16T00:12:38.593 INFO:tasks.ceph:Scrubbing osd.2 2024-02-16T00:12:38.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-16T00:12:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc26c40640 1 Processor -- start 2024-02-16T00:12:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc26c40640 1 -- start start 2024-02-16T00:12:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc26c40640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc2006d3c0 0x7efc2006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc26c40640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2006ea10 con 0x7efc200719c0 2024-02-16T00:12:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc26c40640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc20066f70 con 0x7efc2006d3c0 2024-02-16T00:12:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc1ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc2006d3c0 0x7efc2006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc249dc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efc200719c0 0x7efc2006ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60700/0 (socket says 172.21.15.2:60700) 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc1ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc2006d3c0 0x7efc2006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38568/0 (socket says 172.21.15.2:38568) 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc249dc640 1 -- 172.21.15.2:0/28234835 learned_addr learned my addr 172.21.15.2:0/28234835 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc1ffff640 1 -- 172.21.15.2:0/28234835 >> v1:172.21.15.2:6789/0 conn(0x7efc200719c0 legacy=0x7efc2006ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc1ffff640 1 -- 172.21.15.2:0/28234835 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20066b50 con 0x7efc2006d3c0 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.695+0000 7efc1f7fe640 1 -- 172.21.15.2:0/28234835 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382995439 0 0) 0x7efc2006ea10 con 0x7efc200719c0 2024-02-16T00:12:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.696+0000 7efc1ffff640 1 --2- 172.21.15.2:0/28234835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc2006d7d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009720 tx=0x7efc0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1680036702bf0981 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.696+0000 7efc1f7fe640 1 -- 172.21.15.2:0/28234835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc0c02e070 con 0x7efc2006d3c0 2024-02-16T00:12:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.696+0000 7efc1f7fe640 1 -- 172.21.15.2:0/28234835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c0316d0 con 0x7efc2006d3c0 2024-02-16T00:12:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.696+0000 7efc1f7fe640 1 -- 172.21.15.2:0/28234835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc0c031990 con 0x7efc2006d3c0 2024-02-16T00:12:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 -- 172.21.15.2:0/28234835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 msgr2=0x7efc2006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 --2- 172.21.15.2:0/28234835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc2006d7d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009720 tx=0x7efc0c02b840 comp rx=0 tx=0).stop 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 -- 172.21.15.2:0/28234835 shutdown_connections 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 --2- 172.21.15.2:0/28234835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc2006d7d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 -- 172.21.15.2:0/28234835 >> 172.21.15.2:0/28234835 conn(0x7efc2009cb40 msgr2=0x7efc2009cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 -- 172.21.15.2:0/28234835 shutdown_connections 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.697+0000 7efc26c40640 1 -- 172.21.15.2:0/28234835 wait complete. 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc26c40640 1 Processor -- start 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc26c40640 1 -- start start 2024-02-16T00:12:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc26c40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc20092ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc26c40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc20095870 con 0x7efc2006d3c0 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc249dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc20092ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc249dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc20092ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38574/0 (socket says 172.21.15.2:38574) 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.698+0000 7efc249dc640 1 -- 172.21.15.2:0/3955006211 learned_addr learned my addr 172.21.15.2:0/3955006211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc249dc640 1 -- 172.21.15.2:0/3955006211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009400 con 0x7efc2006d3c0 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc249dc640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc20092ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c420 tx=0x7efc1400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc140074d0 con 0x7efc2006d3c0 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14007630 con 0x7efc2006d3c0 2024-02-16T00:12:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc20094be0 con 0x7efc2006d3c0 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc14004950 con 0x7efc2006d3c0 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.699+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc20096420 con 0x7efc2006d3c0 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efc14004b70 con 0x7efc2006d3c0 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1d7fa640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc04037ed0 0x7efc0403a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7efc1404a9d0 con 0x7efc2006d3c0 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc200962a0 con 0x7efc2006d3c0 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1d7fa640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7efc04044250 0x7efc040466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc04046dc0 con 0x7efc04044250 2024-02-16T00:12:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc1401abe0 con 0x7efc2006d3c0 2024-02-16T00:12:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc1ffff640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc04037ed0 0x7efc0403a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.700+0000 7efc251dd640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7efc04044250 0x7efc040466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.701+0000 7efc1ffff640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc04037ed0 0x7efc0403a390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc0c036000 tx=0x7efc0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.701+0000 7efc251dd640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7efc04044250 0x7efc040466f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.701+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== osd.2 v2:172.21.15.42:6808/1288904824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc04046dc0 con 0x7efc04044250 2024-02-16T00:12:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.714+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 --> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc20071c10 con 0x7efc04044250 2024-02-16T00:12:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc1d7fa640 1 -- 172.21.15.2:0/3955006211 <== osd.2 v2:172.21.15.42:6808/1288904824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efc20071c10 con 0x7efc04044250 2024-02-16T00:12:38.718 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-02-16T00:12:38.718 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T00:12:38.718 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-02-16T00:12:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7efc04044250 msgr2=0x7efc040466f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7efc04044250 0x7efc040466f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc04037ed0 msgr2=0x7efc0403a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc04037ed0 0x7efc0403a390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc0c036000 tx=0x7efc0c008030 comp rx=0 tx=0).stop 2024-02-16T00:12:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 msgr2=0x7efc20092ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc20092ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c420 tx=0x7efc1400c8e0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 shutdown_connections 2024-02-16T00:12:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6808/1288904824,v1:172.21.15.42:6809/1288904824] conn(0x7efc04044250 0x7efc040466f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7efc04037ed0 0x7efc0403a390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 --2- 172.21.15.2:0/3955006211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc2006d3c0 0x7efc20092ed0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 >> 172.21.15.2:0/3955006211 conn(0x7efc2009cb40 msgr2=0x7efc20133170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.715+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 shutdown_connections 2024-02-16T00:12:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.716+0000 7efc26c40640 1 -- 172.21.15.2:0/3955006211 wait complete. 2024-02-16T00:12:38.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-16T00:12:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bc4863640 1 Processor -- start 2024-02-16T00:12:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bc4863640 1 -- start start 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bc4863640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bc00989f0 0x7f4bc01331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bc4863640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc006bdf0 con 0x7f4bc0097f00 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bc4863640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00672c0 con 0x7f4bc00989f0 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bb7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bc00989f0 0x7f4bc01331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bbe59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4bc0097f00 0x7f4bc00982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60708/0 (socket says 172.21.15.2:60708) 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.830+0000 7f4bbe59c640 1 -- 172.21.15.2:0/1228947425 learned_addr learned my addr 172.21.15.2:0/1228947425 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.831+0000 7f4bb7fff640 1 -- 172.21.15.2:0/1228947425 >> v1:172.21.15.2:6789/0 conn(0x7f4bc0097f00 legacy=0x7f4bc00982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.831+0000 7f4bb7fff640 1 -- 172.21.15.2:0/1228947425 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc009a5c0 con 0x7f4bc00989f0 2024-02-16T00:12:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.831+0000 7f4bb7fff640 1 --2- 172.21.15.2:0/1228947425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00989f0 0x7f4bc01331d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009720 tx=0x7f4ba802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1200c327984d582 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bbdd9b640 1 -- 172.21.15.2:0/1228947425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8031760 con 0x7f4bc00989f0 2024-02-16T00:12:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bbdd9b640 1 -- 172.21.15.2:0/1228947425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba80318c0 con 0x7f4bc00989f0 2024-02-16T00:12:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bbdd9b640 1 -- 172.21.15.2:0/1228947425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ba8031b80 con 0x7f4bc00989f0 2024-02-16T00:12:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 -- 172.21.15.2:0/1228947425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00989f0 msgr2=0x7f4bc01331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 --2- 172.21.15.2:0/1228947425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00989f0 0x7f4bc01331d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009720 tx=0x7f4ba802b8d0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 -- 172.21.15.2:0/1228947425 shutdown_connections 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 --2- 172.21.15.2:0/1228947425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00989f0 0x7f4bc01331d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 -- 172.21.15.2:0/1228947425 >> 172.21.15.2:0/1228947425 conn(0x7f4bc009e640 msgr2=0x7f4bc009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 -- 172.21.15.2:0/1228947425 shutdown_connections 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.832+0000 7f4bc4863640 1 -- 172.21.15.2:0/1228947425 wait complete. 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.833+0000 7f4bc4863640 1 Processor -- start 2024-02-16T00:12:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.833+0000 7f4bc4863640 1 -- start start 2024-02-16T00:12:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.833+0000 7f4bc4863640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 0x7f4bc0127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.833+0000 7f4bc4863640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc012f940 con 0x7f4bc0097f00 2024-02-16T00:12:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bbe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 0x7f4bc0127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bbe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 0x7f4bc0127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38596/0 (socket says 172.21.15.2:38596) 2024-02-16T00:12:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bbe59c640 1 -- 172.21.15.2:0/1013243372 learned_addr learned my addr 172.21.15.2:0/1013243372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bbe59c640 1 -- 172.21.15.2:0/1013243372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8009400 con 0x7f4bc0097f00 2024-02-16T00:12:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bbe59c640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 0x7f4bc0127780 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000c4a0 tx=0x7f4bb000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0005c10 con 0x7f4bc0097f00 2024-02-16T00:12:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb0005d70 con 0x7f4bc0097f00 2024-02-16T00:12:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bb00071a0 con 0x7f4bc0097f00 2024-02-16T00:12:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc0130e00 con 0x7f4bc0097f00 2024-02-16T00:12:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.834+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc012fe20 con 0x7f4bc0097f00 2024-02-16T00:12:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.835+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4bb0007300 con 0x7f4bc0097f00 2024-02-16T00:12:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.835+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc01300f0 con 0x7f4bc0097f00 2024-02-16T00:12:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.835+0000 7f4bb6ffd640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba0037ef0 0x7f4ba003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.836+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f4bb004a9b0 con 0x7f4bc0097f00 2024-02-16T00:12:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.836+0000 7f4bb7fff640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba0037ef0 0x7f4ba003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.836+0000 7f4bb7fff640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba0037ef0 0x7f4ba003a3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8036000 tx=0x7f4ba8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:38.840+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4bb0010c20 con 0x7f4bc0097f00 2024-02-16T00:12:39.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.018+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bc009a9f0 con 0x7f4ba0037ef0 2024-02-16T00:12:39.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.019+0000 7f4bb6ffd640 1 -- 172.21.15.2:0/1013243372 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ba803b430 con 0x7f4ba0037ef0 2024-02-16T00:12:39.022 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-02-16T00:12:39.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba0037ef0 msgr2=0x7f4ba003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba0037ef0 0x7f4ba003a3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8036000 tx=0x7f4ba8008030 comp rx=0 tx=0).stop 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 msgr2=0x7f4bc0127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 0x7f4bc0127780 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000c4a0 tx=0x7f4bb000c960 comp rx=0 tx=0).stop 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 shutdown_connections 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f4ba0037ef0 0x7f4ba003a3b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 --2- 172.21.15.2:0/1013243372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc0097f00 0x7f4bc0127780 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 >> 172.21.15.2:0/1013243372 conn(0x7f4bc009e640 msgr2=0x7f4bc0096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 shutdown_connections 2024-02-16T00:12:39.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.021+0000 7f4bc4863640 1 -- 172.21.15.2:0/1013243372 wait complete. 2024-02-16T00:12:39.034 INFO:tasks.ceph:Scrubbing osd.3 2024-02-16T00:12:39.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-16T00:12:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.135+0000 7faf375a8640 1 Processor -- start 2024-02-16T00:12:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf375a8640 1 -- start start 2024-02-16T00:12:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf375a8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf30094360 0x7faf30094740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf375a8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3006c850 con 0x7faf30094c80 2024-02-16T00:12:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf375a8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3006c540 con 0x7faf30094360 2024-02-16T00:12:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf35344640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf30094360 0x7faf30094740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf34b43640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf30094c80 0x7faf3012a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60722/0 (socket says 172.21.15.2:60722) 2024-02-16T00:12:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf34b43640 1 -- 172.21.15.2:0/1185952727 learned_addr learned my addr 172.21.15.2:0/1185952727 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf35344640 1 -- 172.21.15.2:0/1185952727 >> v1:172.21.15.2:6789/0 conn(0x7faf30094c80 legacy=0x7faf3012a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.136+0000 7faf35344640 1 -- 172.21.15.2:0/1185952727 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30071f70 con 0x7faf30094360 2024-02-16T00:12:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.137+0000 7faf35344640 1 --2- 172.21.15.2:0/1185952727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf30094740 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00a8c0 tx=0x7faf2c02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9415d010f7c93b5b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.137+0000 7faf27fff640 1 -- 172.21.15.2:0/1185952727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2c02da00 con 0x7faf30094360 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.137+0000 7faf27fff640 1 -- 172.21.15.2:0/1185952727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c02db60 con 0x7faf30094360 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.137+0000 7faf27fff640 1 -- 172.21.15.2:0/1185952727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2c02de20 con 0x7faf30094360 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 -- 172.21.15.2:0/1185952727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 msgr2=0x7faf30094740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 --2- 172.21.15.2:0/1185952727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf30094740 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00a8c0 tx=0x7faf2c02cd20 comp rx=0 tx=0).stop 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 -- 172.21.15.2:0/1185952727 shutdown_connections 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 --2- 172.21.15.2:0/1185952727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf30094740 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 -- 172.21.15.2:0/1185952727 >> 172.21.15.2:0/1185952727 conn(0x7faf3009a290 msgr2=0x7faf3009a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 -- 172.21.15.2:0/1185952727 shutdown_connections 2024-02-16T00:12:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.138+0000 7faf375a8640 1 -- 172.21.15.2:0/1185952727 wait complete. 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf375a8640 1 Processor -- start 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf375a8640 1 -- start start 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf375a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf301c0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf375a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300907b0 con 0x7faf30094360 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf35344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf301c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf35344640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf301c0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38614/0 (socket says 172.21.15.2:38614) 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf35344640 1 -- 172.21.15.2:0/1302399842 learned_addr learned my addr 172.21.15.2:0/1302399842 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.139+0000 7faf35344640 1 -- 172.21.15.2:0/1302399842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c00a5a0 con 0x7faf30094360 2024-02-16T00:12:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.140+0000 7faf35344640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf301c0300 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faf2c038040 tx=0x7faf2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.140+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2c040650 con 0x7faf30094360 2024-02-16T00:12:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.140+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0407b0 con 0x7faf30094360 2024-02-16T00:12:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.140+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf30127840 con 0x7faf30094360 2024-02-16T00:12:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.140+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2c040a50 con 0x7faf30094360 2024-02-16T00:12:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.140+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf30126ed0 con 0x7faf30094360 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7faf2c03c040 con 0x7faf30094360 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf30093860 con 0x7faf30094360 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf25ffb640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faf14037ef0 0x7faf1403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7faf2c06dbc0 con 0x7faf30094360 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf25ffb640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7faf14044270 0x7faf14046710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf14046de0 con 0x7faf14044270 2024-02-16T00:12:39.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf2c034990 con 0x7faf30094360 2024-02-16T00:12:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf34b43640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faf14037ef0 0x7faf1403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.141+0000 7faf35b45640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7faf14044270 0x7faf14046710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.142+0000 7faf35b45640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7faf14044270 0x7faf14046710 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.142+0000 7faf34b43640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faf14037ef0 0x7faf1403a3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf20005880 tx=0x7faf20007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.142+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== osd.3 v2:172.21.15.42:6810/474355007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faf14046de0 con 0x7faf14044270 2024-02-16T00:12:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.155+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 --> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faf3008b440 con 0x7faf14044270 2024-02-16T00:12:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf25ffb640 1 -- 172.21.15.2:0/1302399842 <== osd.3 v2:172.21.15.42:6810/474355007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faf28011040 con 0x7faf14044270 2024-02-16T00:12:39.158 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-02-16T00:12:39.159 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T00:12:39.159 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-02-16T00:12:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7faf14044270 msgr2=0x7faf14046710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7faf14044270 0x7faf14046710 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faf14037ef0 msgr2=0x7faf1403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faf14037ef0 0x7faf1403a3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf20005880 tx=0x7faf20007a80 comp rx=0 tx=0).stop 2024-02-16T00:12:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 msgr2=0x7faf301c0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf301c0300 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faf2c038040 tx=0x7faf2c0046c0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 shutdown_connections 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7faf14037ef0 0x7faf1403a3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.42:6810/474355007,v1:172.21.15.42:6811/474355007] conn(0x7faf14044270 0x7faf14046710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 --2- 172.21.15.2:0/1302399842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf30094360 0x7faf301c0300 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.156+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 >> 172.21.15.2:0/1302399842 conn(0x7faf3009a290 msgr2=0x7faf30096870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.157+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 shutdown_connections 2024-02-16T00:12:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.157+0000 7faf375a8640 1 -- 172.21.15.2:0/1302399842 wait complete. 2024-02-16T00:12:39.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-16T00:12:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec09123640 1 Processor -- start 2024-02-16T00:12:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec09123640 1 -- start start 2024-02-16T00:12:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec09123640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec04094a00 0x7fec0412f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec09123640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0409c290 con 0x7fec04093f10 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec09123640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec04095230 con 0x7fec04094a00 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec0259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec04094a00 0x7fec0412f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec02d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fec04093f10 0x7fec040942f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60724/0 (socket says 172.21.15.2:60724) 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.267+0000 7fec02d9d640 1 -- 172.21.15.2:0/2275868285 learned_addr learned my addr 172.21.15.2:0/2275868285 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.268+0000 7fec0259c640 1 -- 172.21.15.2:0/2275868285 >> v1:172.21.15.2:6789/0 conn(0x7fec04093f10 legacy=0x7fec040942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.268+0000 7fec0259c640 1 -- 172.21.15.2:0/2275868285 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04095fe0 con 0x7fec04094a00 2024-02-16T00:12:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.268+0000 7fec01d9b640 1 -- 172.21.15.2:0/2275868285 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313149696 0 0) 0x7febf4001110 con 0x7fec04093f10 2024-02-16T00:12:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.268+0000 7fec0259c640 1 --2- 172.21.15.2:0/2275868285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04094a00 0x7fec0412f4c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7febf8009750 tx=0x7febf802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a736efe172a5bcb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.268+0000 7fec01d9b640 1 -- 172.21.15.2:0/2275868285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf802e070 con 0x7fec04094a00 2024-02-16T00:12:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.268+0000 7fec01d9b640 1 -- 172.21.15.2:0/2275868285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80316d0 con 0x7fec04094a00 2024-02-16T00:12:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec01d9b640 1 -- 172.21.15.2:0/2275868285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf8031990 con 0x7fec04094a00 2024-02-16T00:12:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 -- 172.21.15.2:0/2275868285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04094a00 msgr2=0x7fec0412f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 --2- 172.21.15.2:0/2275868285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04094a00 0x7fec0412f4c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7febf8009750 tx=0x7febf802b840 comp rx=0 tx=0).stop 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 -- 172.21.15.2:0/2275868285 shutdown_connections 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 --2- 172.21.15.2:0/2275868285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04094a00 0x7fec0412f4c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 -- 172.21.15.2:0/2275868285 >> 172.21.15.2:0/2275868285 conn(0x7fec0409a050 msgr2=0x7fec0409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 -- 172.21.15.2:0/2275868285 shutdown_connections 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.269+0000 7fec09123640 1 -- 172.21.15.2:0/2275868285 wait complete. 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.270+0000 7fec09123640 1 Processor -- start 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.270+0000 7fec09123640 1 -- start start 2024-02-16T00:12:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.270+0000 7fec09123640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 0x7fec041a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.270+0000 7fec09123640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec041a9330 con 0x7fec04093f10 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec02d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 0x7fec041a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec02d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 0x7fec041a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38632/0 (socket says 172.21.15.2:38632) 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec02d9d640 1 -- 172.21.15.2:0/2587351617 learned_addr learned my addr 172.21.15.2:0/2587351617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec02d9d640 1 -- 172.21.15.2:0/2587351617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8009400 con 0x7fec04093f10 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec02d9d640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 0x7fec041a5d40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7febf400c700 tx=0x7febf400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf40070d0 con 0x7fec04093f10 2024-02-16T00:12:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4007230 con 0x7fec04093f10 2024-02-16T00:12:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf4007530 con 0x7fec04093f10 2024-02-16T00:12:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec041a7af0 con 0x7fec04093f10 2024-02-16T00:12:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.271+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec041a8ef0 con 0x7fec04093f10 2024-02-16T00:12:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.272+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7febf40047e0 con 0x7fec04093f10 2024-02-16T00:12:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.272+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec040627b0 con 0x7fec04093f10 2024-02-16T00:12:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.272+0000 7febeb7fe640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7febf0037ef0 0x7febf003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.272+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7febf404a890 con 0x7fec04093f10 2024-02-16T00:12:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.273+0000 7fec0259c640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7febf0037ef0 0x7febf003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.273+0000 7fec0259c640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7febf0037ef0 0x7febf003a3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7febf8036000 tx=0x7febf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.277+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febf4004a90 con 0x7fec04093f10 2024-02-16T00:12:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.454+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fec04093680 con 0x7febf0037ef0 2024-02-16T00:12:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.455+0000 7febeb7fe640 1 -- 172.21.15.2:0/2587351617 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7febf8031b40 con 0x7febf0037ef0 2024-02-16T00:12:39.458 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-02-16T00:12:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7febf0037ef0 msgr2=0x7febf003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7febf0037ef0 0x7febf003a3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7febf8036000 tx=0x7febf8008030 comp rx=0 tx=0).stop 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 msgr2=0x7fec041a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 0x7fec041a5d40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7febf400c700 tx=0x7febf400cbc0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 shutdown_connections 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7febf0037ef0 0x7febf003a3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.457+0000 7fec09123640 1 --2- 172.21.15.2:0/2587351617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec04093f10 0x7fec041a5d40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.458+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 >> 172.21.15.2:0/2587351617 conn(0x7fec0409a050 msgr2=0x7fec041b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.458+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 shutdown_connections 2024-02-16T00:12:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.458+0000 7fec09123640 1 -- 172.21.15.2:0/2587351617 wait complete. 2024-02-16T00:12:39.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f685d00f640 1 Processor -- start 2024-02-16T00:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f685d00f640 1 -- start start 2024-02-16T00:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f685d00f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6858071ff0 0x7f685806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f685d00f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580969f0 con 0x7f685806c020 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f685d00f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685809d050 con 0x7f6858071ff0 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f685659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6858071ff0 0x7f685806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f6856d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f685806c020 0x7f685806c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60726/0 (socket says 172.21.15.2:60726) 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.569+0000 7f6856d9d640 1 -- 172.21.15.2:0/3156646617 learned_addr learned my addr 172.21.15.2:0/3156646617 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.570+0000 7f685659c640 1 -- 172.21.15.2:0/3156646617 >> v1:172.21.15.2:6789/0 conn(0x7f685806c020 legacy=0x7f685806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.570+0000 7f685659c640 1 -- 172.21.15.2:0/3156646617 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858071a00 con 0x7f6858071ff0 2024-02-16T00:12:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.570+0000 7f685659c640 1 --2- 172.21.15.2:0/3156646617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6858071ff0 0x7f685806cb10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6840009720 tx=0x7f684002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc0b210aad4fab8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.570+0000 7f6855d9b640 1 -- 172.21.15.2:0/3156646617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f684002e070 con 0x7f6858071ff0 2024-02-16T00:12:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f6855d9b640 1 -- 172.21.15.2:0/3156646617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68400316d0 con 0x7f6858071ff0 2024-02-16T00:12:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f6855d9b640 1 -- 172.21.15.2:0/3156646617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6840031990 con 0x7f6858071ff0 2024-02-16T00:12:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 -- 172.21.15.2:0/3156646617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6858071ff0 msgr2=0x7f685806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 --2- 172.21.15.2:0/3156646617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6858071ff0 0x7f685806cb10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6840009720 tx=0x7f684002b840 comp rx=0 tx=0).stop 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 -- 172.21.15.2:0/3156646617 shutdown_connections 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 --2- 172.21.15.2:0/3156646617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6858071ff0 0x7f685806cb10 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 -- 172.21.15.2:0/3156646617 >> 172.21.15.2:0/3156646617 conn(0x7f685809b520 msgr2=0x7f685809b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 -- 172.21.15.2:0/3156646617 shutdown_connections 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.571+0000 7f685d00f640 1 -- 172.21.15.2:0/3156646617 wait complete. 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.572+0000 7f685d00f640 1 Processor -- start 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.572+0000 7f685d00f640 1 -- start start 2024-02-16T00:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f685d00f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 0x7f6858131d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f685d00f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858124d70 con 0x7f685806c020 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f6856d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 0x7f6858131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f6856d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 0x7f6858131d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38658/0 (socket says 172.21.15.2:38658) 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f6856d9d640 1 -- 172.21.15.2:0/3924162778 learned_addr learned my addr 172.21.15.2:0/3924162778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f6856d9d640 1 -- 172.21.15.2:0/3924162778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009400 con 0x7f685806c020 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f6856d9d640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 0x7f6858131d10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f685000c4a0 tx=0x7f685000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6850005c10 con 0x7f685806c020 2024-02-16T00:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850005d70 con 0x7f685806c020 2024-02-16T00:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68500071a0 con 0x7f685806c020 2024-02-16T00:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6858125640 con 0x7f685806c020 2024-02-16T00:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.573+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6858124a90 con 0x7f685806c020 2024-02-16T00:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.574+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6850007300 con 0x7f685806c020 2024-02-16T00:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.574+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6858124eb0 con 0x7f685806c020 2024-02-16T00:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.574+0000 7f684f7fe640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6838037ef0 0x7f683803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.574+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f685004a690 con 0x7f685806c020 2024-02-16T00:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.575+0000 7f685659c640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6838037ef0 0x7f683803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.575+0000 7f685659c640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6838037ef0 0x7f683803a3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6840036000 tx=0x7f6840008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.579+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6858124eb0 con 0x7f685806c020 2024-02-16T00:12:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.756+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6858093390 con 0x7f6838037ef0 2024-02-16T00:12:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.773+0000 7f684f7fe640 1 -- 172.21.15.2:0/3924162778 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+668642 (secure 0 0 0) 0x7f6858093390 con 0x7f6838037ef0 2024-02-16T00:12:39.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:12:39.788 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:12:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6838037ef0 msgr2=0x7f683803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6838037ef0 0x7f683803a3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6840036000 tx=0x7f6840008030 comp rx=0 tx=0).stop 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 msgr2=0x7f6858131d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 0x7f6858131d10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f685000c4a0 tx=0x7f685000c960 comp rx=0 tx=0).stop 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 shutdown_connections 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f6838037ef0 0x7f683803a3b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 --2- 172.21.15.2:0/3924162778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f685806c020 0x7f6858131d10 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 >> 172.21.15.2:0/3924162778 conn(0x7f685809b520 msgr2=0x7f685808c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:39.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 shutdown_connections 2024-02-16T00:12:39.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:39.777+0000 7f685d00f640 1 -- 172.21.15.2:0/3924162778 wait complete. 2024-02-16T00:12:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-02-16T00:12:39.697981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":245,"num_object_clones":0,"num_object_copies":491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":4297,"num_read_kb":3911,"num_write":1709,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3991,"ondisk_log_size":3991,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148212,"kb_used_data":2708,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339148,"statfs":{"total":386547056640,"available":386395287552,"internally_reserved":0,"allocated":2772992,"data_stored":1728024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1179,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":586,"num_read_kb":572,"num_write":181,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003423"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842072+0000","last_change":"2024-02-16T00:11:02.804024+0000","last_active":"2024-02-16T00:11:50.842072+0000","last_peered":"2024-02-16T00:11:50.842072+0000","last_clean":"2024-02-16T00:11:50.842072+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:11:50.842072+0000","last_undegraded":"2024-02-16T00:11:50.842072+0000","last_fullsized":"2024-02-16T00:11:50.842072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:50:10.137563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848107+0000","last_change":"2024-02-16T00:11:04.803215+0000","last_active":"2024-02-16T00:11:50.848107+0000","last_peered":"2024-02-16T00:11:50.848107+0000","last_clean":"2024-02-16T00:11:50.848107+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:11:50.848107+0000","last_undegraded":"2024-02-16T00:11:50.848107+0000","last_fullsized":"2024-02-16T00:11:50.848107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831028+0000","last_change":"2024-02-16T00:11:02.797595+0000","last_active":"2024-02-16T00:11:51.831028+0000","last_peered":"2024-02-16T00:11:51.831028+0000","last_clean":"2024-02-16T00:11:51.831028+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:11:51.831028+0000","last_undegraded":"2024-02-16T00:11:51.831028+0000","last_fullsized":"2024-02-16T00:11:51.831028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840747+0000","last_change":"2024-02-16T00:11:04.803831+0000","last_active":"2024-02-16T00:11:50.840747+0000","last_peered":"2024-02-16T00:11:50.840747+0000","last_clean":"2024-02-16T00:11:50.840747+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:11:50.840747+0000","last_undegraded":"2024-02-16T00:11:50.840747+0000","last_fullsized":"2024-02-16T00:11:50.840747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.330427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845795+0000","last_change":"2024-02-16T00:11:02.815592+0000","last_active":"2024-02-16T00:11:50.845795+0000","last_peered":"2024-02-16T00:11:50.845795+0000","last_clean":"2024-02-16T00:11:50.845795+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:11:50.845795+0000","last_undegraded":"2024-02-16T00:11:50.845795+0000","last_fullsized":"2024-02-16T00:11:50.845795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:56:21.438654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840544+0000","last_change":"2024-02-16T00:11:04.807406+0000","last_active":"2024-02-16T00:11:50.840544+0000","last_peered":"2024-02-16T00:11:50.840544+0000","last_clean":"2024-02-16T00:11:50.840544+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:11:50.840544+0000","last_undegraded":"2024-02-16T00:11:50.840544+0000","last_fullsized":"2024-02-16T00:11:50.840544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:05:41.270560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843729+0000","last_change":"2024-02-16T00:11:02.818929+0000","last_active":"2024-02-16T00:11:50.843729+0000","last_peered":"2024-02-16T00:11:50.843729+0000","last_clean":"2024-02-16T00:11:50.843729+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:11:50.843729+0000","last_undegraded":"2024-02-16T00:11:50.843729+0000","last_fullsized":"2024-02-16T00:11:50.843729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:57:37.741181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'7","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.322677+0000","last_change":"2024-02-16T00:11:04.807900+0000","last_active":"2024-02-16T00:12:27.322677+0000","last_peered":"2024-02-16T00:12:27.322677+0000","last_clean":"2024-02-16T00:12:27.322677+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:12:27.322677+0000","last_undegraded":"2024-02-16T00:12:27.322677+0000","last_fullsized":"2024-02-16T00:12:27.322677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:18.898214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841183+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:11:50.841183+0000","last_peered":"2024-02-16T00:11:50.841183+0000","last_clean":"2024-02-16T00:11:50.841183+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:11:50.841183+0000","last_undegraded":"2024-02-16T00:11:50.841183+0000","last_fullsized":"2024-02-16T00:11:50.841183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:24.007843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846859+0000","last_change":"2024-02-16T00:11:04.797530+0000","last_active":"2024-02-16T00:11:50.846859+0000","last_peered":"2024-02-16T00:11:50.846859+0000","last_clean":"2024-02-16T00:11:50.846859+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:11:50.846859+0000","last_undegraded":"2024-02-16T00:11:50.846859+0000","last_fullsized":"2024-02-16T00:11:50.846859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.442430+0000","last_change":"2024-02-16T00:11:02.803398+0000","last_active":"2024-02-16T00:12:33.442430+0000","last_peered":"2024-02-16T00:12:33.442430+0000","last_clean":"2024-02-16T00:12:33.442430+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:12:33.442430+0000","last_undegraded":"2024-02-16T00:12:33.442430+0000","last_fullsized":"2024-02-16T00:12:33.442430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:51:12.638887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844846+0000","last_change":"2024-02-16T00:11:04.809182+0000","last_active":"2024-02-16T00:11:50.844846+0000","last_peered":"2024-02-16T00:11:50.844846+0000","last_clean":"2024-02-16T00:11:50.844846+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:11:50.844846+0000","last_undegraded":"2024-02-16T00:11:50.844846+0000","last_fullsized":"2024-02-16T00:11:50.844846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:55.430651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840324+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:11:50.840324+0000","last_peered":"2024-02-16T00:11:50.840324+0000","last_clean":"2024-02-16T00:11:50.840324+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:11:50.840324+0000","last_undegraded":"2024-02-16T00:11:50.840324+0000","last_fullsized":"2024-02-16T00:11:50.840324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:28:12.323667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843211+0000","last_change":"2024-02-16T00:11:04.798579+0000","last_active":"2024-02-16T00:11:50.843211+0000","last_peered":"2024-02-16T00:11:50.843211+0000","last_clean":"2024-02-16T00:11:50.843211+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:11:50.843211+0000","last_undegraded":"2024-02-16T00:11:50.843211+0000","last_fullsized":"2024-02-16T00:11:50.843211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:26.606327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828950+0000","last_change":"2024-02-16T00:11:02.808083+0000","last_active":"2024-02-16T00:11:51.828950+0000","last_peered":"2024-02-16T00:11:51.828950+0000","last_clean":"2024-02-16T00:11:51.828950+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:11:51.828950+0000","last_undegraded":"2024-02-16T00:11:51.828950+0000","last_fullsized":"2024-02-16T00:11:51.828950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447599+0000","last_change":"2024-02-16T00:11:04.808709+0000","last_active":"2024-02-16T00:12:33.447599+0000","last_peered":"2024-02-16T00:12:33.447599+0000","last_clean":"2024-02-16T00:12:33.447599+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:12:33.447599+0000","last_undegraded":"2024-02-16T00:12:33.447599+0000","last_fullsized":"2024-02-16T00:12:33.447599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:10.202958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840576+0000","last_change":"2024-02-16T00:11:04.807676+0000","last_active":"2024-02-16T00:11:50.840576+0000","last_peered":"2024-02-16T00:11:50.840576+0000","last_clean":"2024-02-16T00:11:50.840576+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:11:50.840576+0000","last_undegraded":"2024-02-16T00:11:50.840576+0000","last_fullsized":"2024-02-16T00:11:50.840576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:30:13.340758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849734+0000","last_change":"2024-02-16T00:11:02.820441+0000","last_active":"2024-02-16T00:11:50.849734+0000","last_peered":"2024-02-16T00:11:50.849734+0000","last_clean":"2024-02-16T00:11:50.849734+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:11:50.849734+0000","last_undegraded":"2024-02-16T00:11:50.849734+0000","last_fullsized":"2024-02-16T00:11:50.849734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847722+0000","last_change":"2024-02-16T00:11:04.798908+0000","last_active":"2024-02-16T00:11:50.847722+0000","last_peered":"2024-02-16T00:11:50.847722+0000","last_clean":"2024-02-16T00:11:50.847722+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:11:50.847722+0000","last_undegraded":"2024-02-16T00:11:50.847722+0000","last_fullsized":"2024-02-16T00:11:50.847722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843030+0000","last_change":"2024-02-16T00:11:02.817331+0000","last_active":"2024-02-16T00:11:50.843030+0000","last_peered":"2024-02-16T00:11:50.843030+0000","last_clean":"2024-02-16T00:11:50.843030+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:11:50.843030+0000","last_undegraded":"2024-02-16T00:11:50.843030+0000","last_fullsized":"2024-02-16T00:11:50.843030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:32:21.811270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848285+0000","last_change":"2024-02-16T00:11:04.803702+0000","last_active":"2024-02-16T00:11:50.848285+0000","last_peered":"2024-02-16T00:11:50.848285+0000","last_clean":"2024-02-16T00:11:50.848285+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:11:50.848285+0000","last_undegraded":"2024-02-16T00:11:50.848285+0000","last_fullsized":"2024-02-16T00:11:50.848285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847224+0000","last_change":"2024-02-16T00:11:02.810700+0000","last_active":"2024-02-16T00:11:50.847224+0000","last_peered":"2024-02-16T00:11:50.847224+0000","last_clean":"2024-02-16T00:11:50.847224+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:11:50.847224+0000","last_undegraded":"2024-02-16T00:11:50.847224+0000","last_fullsized":"2024-02-16T00:11:50.847224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830842+0000","last_change":"2024-02-16T00:11:04.810242+0000","last_active":"2024-02-16T00:11:51.830842+0000","last_peered":"2024-02-16T00:11:51.830842+0000","last_clean":"2024-02-16T00:11:51.830842+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:11:51.830842+0000","last_undegraded":"2024-02-16T00:11:51.830842+0000","last_fullsized":"2024-02-16T00:11:51.830842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847410+0000","last_change":"2024-02-16T00:11:02.825186+0000","last_active":"2024-02-16T00:11:50.847410+0000","last_peered":"2024-02-16T00:11:50.847410+0000","last_clean":"2024-02-16T00:11:50.847410+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:11:50.847410+0000","last_undegraded":"2024-02-16T00:11:50.847410+0000","last_fullsized":"2024-02-16T00:11:50.847410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969995+0000","last_change":"2024-02-16T00:11:04.812055+0000","last_active":"2024-02-16T00:12:27.969995+0000","last_peered":"2024-02-16T00:12:27.969995+0000","last_clean":"2024-02-16T00:12:27.969995+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:12:27.969995+0000","last_undegraded":"2024-02-16T00:12:27.969995+0000","last_fullsized":"2024-02-16T00:12:27.969995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:25.459813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830452+0000","last_change":"2024-02-16T00:11:02.797860+0000","last_active":"2024-02-16T00:11:51.830452+0000","last_peered":"2024-02-16T00:11:51.830452+0000","last_clean":"2024-02-16T00:11:51.830452+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:11:51.830452+0000","last_undegraded":"2024-02-16T00:11:51.830452+0000","last_fullsized":"2024-02-16T00:11:51.830452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977994+0000","last_change":"2024-02-16T00:11:04.797835+0000","last_active":"2024-02-16T00:12:27.977994+0000","last_peered":"2024-02-16T00:12:27.977994+0000","last_clean":"2024-02-16T00:12:27.977994+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:12:27.977994+0000","last_undegraded":"2024-02-16T00:12:27.977994+0000","last_fullsized":"2024-02-16T00:12:27.977994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840296+0000","last_change":"2024-02-16T00:11:02.817356+0000","last_active":"2024-02-16T00:11:50.840296+0000","last_peered":"2024-02-16T00:11:50.840296+0000","last_clean":"2024-02-16T00:11:50.840296+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:11:50.840296+0000","last_undegraded":"2024-02-16T00:11:50.840296+0000","last_fullsized":"2024-02-16T00:11:50.840296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:36:34.654920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'19","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.466452+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:33.466452+0000","last_peered":"2024-02-16T00:12:33.466452+0000","last_clean":"2024-02-16T00:12:33.466452+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:33.466452+0000","last_undegraded":"2024-02-16T00:12:33.466452+0000","last_fullsized":"2024-02-16T00:12:33.466452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842557+0000","last_change":"2024-02-16T00:11:04.804063+0000","last_active":"2024-02-16T00:11:50.842557+0000","last_peered":"2024-02-16T00:11:50.842557+0000","last_clean":"2024-02-16T00:11:50.842557+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:11:50.842557+0000","last_undegraded":"2024-02-16T00:11:50.842557+0000","last_fullsized":"2024-02-16T00:11:50.842557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:30:41.137481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840923+0000","last_change":"2024-02-16T00:11:02.823865+0000","last_active":"2024-02-16T00:11:50.840923+0000","last_peered":"2024-02-16T00:11:50.840923+0000","last_clean":"2024-02-16T00:11:50.840923+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:11:50.840923+0000","last_undegraded":"2024-02-16T00:11:50.840923+0000","last_fullsized":"2024-02-16T00:11:50.840923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:53.696986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844686+0000","last_change":"2024-02-16T00:11:06.805693+0000","last_active":"2024-02-16T00:11:50.844686+0000","last_peered":"2024-02-16T00:11:50.844686+0000","last_clean":"2024-02-16T00:11:50.844686+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:11:50.844686+0000","last_undegraded":"2024-02-16T00:11:50.844686+0000","last_fullsized":"2024-02-16T00:11:50.844686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:26.998512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'43","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.162765+0000","last_change":"2024-02-16T00:11:08.812405+0000","last_active":"2024-02-16T00:12:35.162765+0000","last_peered":"2024-02-16T00:12:35.162765+0000","last_clean":"2024-02-16T00:12:35.162765+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:35.162765+0000","last_undegraded":"2024-02-16T00:12:35.162765+0000","last_fullsized":"2024-02-16T00:12:35.162765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:52.688126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849631+0000","last_change":"2024-02-16T00:11:10.827632+0000","last_active":"2024-02-16T00:11:50.849631+0000","last_peered":"2024-02-16T00:11:50.849631+0000","last_clean":"2024-02-16T00:11:50.849631+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:11:50.849631+0000","last_undegraded":"2024-02-16T00:11:50.849631+0000","last_fullsized":"2024-02-16T00:11:50.849631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.765463+0000","last_change":"2024-02-16T00:11:12.835250+0000","last_active":"2024-02-16T00:12:27.765463+0000","last_peered":"2024-02-16T00:12:27.765463+0000","last_clean":"2024-02-16T00:12:27.765463+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:12:27.765463+0000","last_undegraded":"2024-02-16T00:12:27.765463+0000","last_fullsized":"2024-02-16T00:12:27.765463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845318+0000","last_change":"2024-02-16T00:11:04.811172+0000","last_active":"2024-02-16T00:11:50.845318+0000","last_peered":"2024-02-16T00:11:50.845318+0000","last_clean":"2024-02-16T00:11:50.845318+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:11:50.845318+0000","last_undegraded":"2024-02-16T00:11:50.845318+0000","last_fullsized":"2024-02-16T00:11:50.845318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:25.462988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842875+0000","last_change":"2024-02-16T00:11:02.817929+0000","last_active":"2024-02-16T00:11:50.842875+0000","last_peered":"2024-02-16T00:11:50.842875+0000","last_clean":"2024-02-16T00:11:50.842875+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:11:50.842875+0000","last_undegraded":"2024-02-16T00:11:50.842875+0000","last_fullsized":"2024-02-16T00:11:50.842875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:13:18.760296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829944+0000","last_change":"2024-02-16T00:11:06.803389+0000","last_active":"2024-02-16T00:11:51.829944+0000","last_peered":"2024-02-16T00:11:51.829944+0000","last_clean":"2024-02-16T00:11:51.829944+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:11:51.829944+0000","last_undegraded":"2024-02-16T00:11:51.829944+0000","last_fullsized":"2024-02-16T00:11:51.829944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'12","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848712+0000","last_change":"2024-02-16T00:11:08.813382+0000","last_active":"2024-02-16T00:11:50.848712+0000","last_peered":"2024-02-16T00:11:50.848712+0000","last_clean":"2024-02-16T00:11:50.848712+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:11:50.848712+0000","last_undegraded":"2024-02-16T00:11:50.848712+0000","last_fullsized":"2024-02-16T00:11:50.848712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849217+0000","last_change":"2024-02-16T00:11:10.823836+0000","last_active":"2024-02-16T00:11:50.849217+0000","last_peered":"2024-02-16T00:11:50.849217+0000","last_clean":"2024-02-16T00:11:50.849217+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:11:50.849217+0000","last_undegraded":"2024-02-16T00:11:50.849217+0000","last_fullsized":"2024-02-16T00:11:50.849217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828906+0000","last_change":"2024-02-16T00:11:12.828416+0000","last_active":"2024-02-16T00:11:51.828906+0000","last_peered":"2024-02-16T00:11:51.828906+0000","last_clean":"2024-02-16T00:11:51.828906+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:11:51.828906+0000","last_undegraded":"2024-02-16T00:11:51.828906+0000","last_fullsized":"2024-02-16T00:11:51.828906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844918+0000","last_change":"2024-02-16T00:11:04.803967+0000","last_active":"2024-02-16T00:11:50.844918+0000","last_peered":"2024-02-16T00:11:50.844918+0000","last_clean":"2024-02-16T00:11:50.844918+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:11:50.844918+0000","last_undegraded":"2024-02-16T00:11:50.844918+0000","last_fullsized":"2024-02-16T00:11:50.844918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:24.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839683+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:11:50.839683+0000","last_peered":"2024-02-16T00:11:50.839683+0000","last_clean":"2024-02-16T00:11:50.839683+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:11:50.839683+0000","last_undegraded":"2024-02-16T00:11:50.839683+0000","last_fullsized":"2024-02-16T00:11:50.839683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:40:20.668173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831773+0000","last_change":"2024-02-16T00:11:06.804875+0000","last_active":"2024-02-16T00:11:51.831773+0000","last_peered":"2024-02-16T00:11:51.831773+0000","last_clean":"2024-02-16T00:11:51.831773+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:11:51.831773+0000","last_undegraded":"2024-02-16T00:11:51.831773+0000","last_fullsized":"2024-02-16T00:11:51.831773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845030+0000","last_change":"2024-02-16T00:11:08.813640+0000","last_active":"2024-02-16T00:11:50.845030+0000","last_peered":"2024-02-16T00:11:50.845030+0000","last_clean":"2024-02-16T00:11:50.845030+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:11:50.845030+0000","last_undegraded":"2024-02-16T00:11:50.845030+0000","last_fullsized":"2024-02-16T00:11:50.845030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:39.388774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'243","reported_seq":315,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.109219+0000","last_change":"2024-02-16T00:11:10.830884+0000","last_active":"2024-02-16T00:12:35.109219+0000","last_peered":"2024-02-16T00:12:35.109219+0000","last_clean":"2024-02-16T00:12:35.109219+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:12:35.109219+0000","last_undegraded":"2024-02-16T00:12:35.109219+0000","last_fullsized":"2024-02-16T00:12:35.109219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:17:51.160171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845460+0000","last_change":"2024-02-16T00:11:12.821286+0000","last_active":"2024-02-16T00:11:50.845460+0000","last_peered":"2024-02-16T00:11:50.845460+0000","last_clean":"2024-02-16T00:11:50.845460+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:11:50.845460+0000","last_undegraded":"2024-02-16T00:11:50.845460+0000","last_fullsized":"2024-02-16T00:11:50.845460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:29.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.456539+0000","last_change":"2024-02-16T00:11:04.803520+0000","last_active":"2024-02-16T00:12:33.456539+0000","last_peered":"2024-02-16T00:12:33.456539+0000","last_clean":"2024-02-16T00:12:33.456539+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:12:33.456539+0000","last_undegraded":"2024-02-16T00:12:33.456539+0000","last_fullsized":"2024-02-16T00:12:33.456539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847741+0000","last_change":"2024-02-16T00:11:02.820879+0000","last_active":"2024-02-16T00:11:50.847741+0000","last_peered":"2024-02-16T00:11:50.847741+0000","last_clean":"2024-02-16T00:11:50.847741+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:11:50.847741+0000","last_undegraded":"2024-02-16T00:11:50.847741+0000","last_fullsized":"2024-02-16T00:11:50.847741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845158+0000","last_change":"2024-02-16T00:11:06.807048+0000","last_active":"2024-02-16T00:11:50.845158+0000","last_peered":"2024-02-16T00:11:50.845158+0000","last_clean":"2024-02-16T00:11:50.845158+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:11:50.845158+0000","last_undegraded":"2024-02-16T00:11:50.845158+0000","last_fullsized":"2024-02-16T00:11:50.845158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:20:58.481322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'37","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.247306+0000","last_change":"2024-02-16T00:11:08.815411+0000","last_active":"2024-02-16T00:12:35.247306+0000","last_peered":"2024-02-16T00:12:35.247306+0000","last_clean":"2024-02-16T00:12:35.247306+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:35.247306+0000","last_undegraded":"2024-02-16T00:12:35.247306+0000","last_fullsized":"2024-02-16T00:12:35.247306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:11:52.985555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'243","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.260819+0000","last_change":"2024-02-16T00:11:10.820344+0000","last_active":"2024-02-16T00:12:35.260819+0000","last_peered":"2024-02-16T00:12:35.260819+0000","last_clean":"2024-02-16T00:12:35.260819+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:35.260819+0000","last_undegraded":"2024-02-16T00:12:35.260819+0000","last_fullsized":"2024-02-16T00:12:35.260819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.856376+0000","last_change":"2024-02-16T00:11:50.855956+0000","last_active":"2024-02-16T00:11:50.856376+0000","last_peered":"2024-02-16T00:11:50.856376+0000","last_clean":"2024-02-16T00:11:50.856376+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:11:50.856376+0000","last_undegraded":"2024-02-16T00:11:50.856376+0000","last_fullsized":"2024-02-16T00:11:50.856376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:18.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842241+0000","last_change":"2024-02-16T00:11:02.805831+0000","last_active":"2024-02-16T00:11:50.842241+0000","last_peered":"2024-02-16T00:11:50.842241+0000","last_clean":"2024-02-16T00:11:50.842241+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:11:50.842241+0000","last_undegraded":"2024-02-16T00:11:50.842241+0000","last_fullsized":"2024-02-16T00:11:50.842241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:48:35.703498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846827+0000","last_change":"2024-02-16T00:11:06.809760+0000","last_active":"2024-02-16T00:11:50.846827+0000","last_peered":"2024-02-16T00:11:50.846827+0000","last_clean":"2024-02-16T00:11:50.846827+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:11:50.846827+0000","last_undegraded":"2024-02-16T00:11:50.846827+0000","last_fullsized":"2024-02-16T00:11:50.846827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'49","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.174984+0000","last_change":"2024-02-16T00:11:08.816208+0000","last_active":"2024-02-16T00:12:35.174984+0000","last_peered":"2024-02-16T00:12:35.174984+0000","last_clean":"2024-02-16T00:12:35.174984+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:35.174984+0000","last_undegraded":"2024-02-16T00:12:35.174984+0000","last_fullsized":"2024-02-16T00:12:35.174984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:19.358580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830253+0000","last_change":"2024-02-16T00:11:10.820589+0000","last_active":"2024-02-16T00:11:51.830253+0000","last_peered":"2024-02-16T00:11:51.830253+0000","last_clean":"2024-02-16T00:11:51.830253+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:11:51.830253+0000","last_undegraded":"2024-02-16T00:11:51.830253+0000","last_fullsized":"2024-02-16T00:11:51.830253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.761548+0000","last_change":"2024-02-16T00:11:12.824309+0000","last_active":"2024-02-16T00:12:27.761548+0000","last_peered":"2024-02-16T00:12:27.761548+0000","last_clean":"2024-02-16T00:12:27.761548+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:27.761548+0000","last_undegraded":"2024-02-16T00:12:27.761548+0000","last_fullsized":"2024-02-16T00:12:27.761548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:00:56.872128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621778+0000","last_change":"2024-02-16T00:11:04.797488+0000","last_active":"2024-02-16T00:12:27.621778+0000","last_peered":"2024-02-16T00:12:27.621778+0000","last_clean":"2024-02-16T00:12:27.621778+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:12:27.621778+0000","last_undegraded":"2024-02-16T00:12:27.621778+0000","last_fullsized":"2024-02-16T00:12:27.621778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.964166+0000","last_change":"2024-02-16T00:11:02.815325+0000","last_active":"2024-02-16T00:12:27.964166+0000","last_peered":"2024-02-16T00:12:27.964166+0000","last_clean":"2024-02-16T00:12:27.964166+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:12:27.964166+0000","last_undegraded":"2024-02-16T00:12:27.964166+0000","last_fullsized":"2024-02-16T00:12:27.964166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:15.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829075+0000","last_change":"2024-02-16T00:11:06.808903+0000","last_active":"2024-02-16T00:11:51.829075+0000","last_peered":"2024-02-16T00:11:51.829075+0000","last_clean":"2024-02-16T00:11:51.829075+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:11:51.829075+0000","last_undegraded":"2024-02-16T00:11:51.829075+0000","last_fullsized":"2024-02-16T00:11:51.829075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'37","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.216126+0000","last_change":"2024-02-16T00:11:08.810670+0000","last_active":"2024-02-16T00:12:35.216126+0000","last_peered":"2024-02-16T00:12:35.216126+0000","last_clean":"2024-02-16T00:12:35.216126+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:35.216126+0000","last_undegraded":"2024-02-16T00:12:35.216126+0000","last_fullsized":"2024-02-16T00:12:35.216126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:59:33.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829090+0000","last_change":"2024-02-16T00:11:10.819436+0000","last_active":"2024-02-16T00:11:51.829090+0000","last_peered":"2024-02-16T00:11:51.829090+0000","last_clean":"2024-02-16T00:11:51.829090+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:11:51.829090+0000","last_undegraded":"2024-02-16T00:11:51.829090+0000","last_fullsized":"2024-02-16T00:11:51.829090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.278055+0000","last_change":"2024-02-16T00:11:12.828694+0000","last_active":"2024-02-16T00:12:22.278055+0000","last_peered":"2024-02-16T00:12:22.278055+0000","last_clean":"2024-02-16T00:12:22.278055+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:12:22.278055+0000","last_undegraded":"2024-02-16T00:12:22.278055+0000","last_fullsized":"2024-02-16T00:12:22.278055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:04.809981+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:10.494236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.325660+0000","last_change":"2024-02-16T00:11:02.815569+0000","last_active":"2024-02-16T00:12:27.325660+0000","last_peered":"2024-02-16T00:12:27.325660+0000","last_clean":"2024-02-16T00:12:27.325660+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:12:27.325660+0000","last_undegraded":"2024-02-16T00:12:27.325660+0000","last_fullsized":"2024-02-16T00:12:27.325660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:11:29.570326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831243+0000","last_change":"2024-02-16T00:11:06.806202+0000","last_active":"2024-02-16T00:11:51.831243+0000","last_peered":"2024-02-16T00:11:51.831243+0000","last_clean":"2024-02-16T00:11:51.831243+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:11:51.831243+0000","last_undegraded":"2024-02-16T00:11:51.831243+0000","last_fullsized":"2024-02-16T00:11:51.831243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'49","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.180693+0000","last_change":"2024-02-16T00:11:08.813417+0000","last_active":"2024-02-16T00:12:35.180693+0000","last_peered":"2024-02-16T00:12:35.180693+0000","last_clean":"2024-02-16T00:12:35.180693+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:35.180693+0000","last_undegraded":"2024-02-16T00:12:35.180693+0000","last_fullsized":"2024-02-16T00:12:35.180693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:05.893569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'243","reported_seq":304,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.261799+0000","last_change":"2024-02-16T00:11:10.816060+0000","last_active":"2024-02-16T00:12:35.261799+0000","last_peered":"2024-02-16T00:12:35.261799+0000","last_clean":"2024-02-16T00:12:35.261799+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:35.261799+0000","last_undegraded":"2024-02-16T00:12:35.261799+0000","last_fullsized":"2024-02-16T00:12:35.261799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830363+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:11:51.830363+0000","last_peered":"2024-02-16T00:11:51.830363+0000","last_clean":"2024-02-16T00:11:51.830363+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:11:51.830363+0000","last_undegraded":"2024-02-16T00:11:51.830363+0000","last_fullsized":"2024-02-16T00:11:51.830363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844394+0000","last_change":"2024-02-16T00:11:04.799023+0000","last_active":"2024-02-16T00:11:50.844394+0000","last_peered":"2024-02-16T00:11:50.844394+0000","last_clean":"2024-02-16T00:11:50.844394+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:11:50.844394+0000","last_undegraded":"2024-02-16T00:11:50.844394+0000","last_fullsized":"2024-02-16T00:11:50.844394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:06.568641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842185+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:11:50.842185+0000","last_peered":"2024-02-16T00:11:50.842185+0000","last_clean":"2024-02-16T00:11:50.842185+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:11:50.842185+0000","last_undegraded":"2024-02-16T00:11:50.842185+0000","last_fullsized":"2024-02-16T00:11:50.842185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:01:37.649958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829611+0000","last_change":"2024-02-16T00:11:06.808902+0000","last_active":"2024-02-16T00:11:51.829611+0000","last_peered":"2024-02-16T00:11:51.829611+0000","last_clean":"2024-02-16T00:11:51.829611+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:11:51.829611+0000","last_undegraded":"2024-02-16T00:11:51.829611+0000","last_fullsized":"2024-02-16T00:11:51.829611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'68","reported_seq":143,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.224835+0000","last_change":"2024-02-16T00:11:08.819445+0000","last_active":"2024-02-16T00:12:35.224835+0000","last_peered":"2024-02-16T00:12:35.224835+0000","last_clean":"2024-02-16T00:12:35.224835+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:12:35.224835+0000","last_undegraded":"2024-02-16T00:12:35.224835+0000","last_fullsized":"2024-02-16T00:12:35.224835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:16:44.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828741+0000","last_change":"2024-02-16T00:11:10.822009+0000","last_active":"2024-02-16T00:11:51.828741+0000","last_peered":"2024-02-16T00:11:51.828741+0000","last_clean":"2024-02-16T00:11:51.828741+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:11:51.828741+0000","last_undegraded":"2024-02-16T00:11:51.828741+0000","last_fullsized":"2024-02-16T00:11:51.828741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.461230+0000","last_change":"2024-02-16T00:11:12.823579+0000","last_active":"2024-02-16T00:12:33.461230+0000","last_peered":"2024-02-16T00:12:33.461230+0000","last_clean":"2024-02-16T00:12:33.461230+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:12:33.461230+0000","last_undegraded":"2024-02-16T00:12:33.461230+0000","last_fullsized":"2024-02-16T00:12:33.461230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.456235+0000","last_change":"2024-02-16T00:11:04.812522+0000","last_active":"2024-02-16T00:12:33.456235+0000","last_peered":"2024-02-16T00:12:33.456235+0000","last_clean":"2024-02-16T00:12:33.456235+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:12:33.456235+0000","last_undegraded":"2024-02-16T00:12:33.456235+0000","last_fullsized":"2024-02-16T00:12:33.456235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829810+0000","last_change":"2024-02-16T00:11:02.807400+0000","last_active":"2024-02-16T00:11:51.829810+0000","last_peered":"2024-02-16T00:11:51.829810+0000","last_clean":"2024-02-16T00:11:51.829810+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:11:51.829810+0000","last_undegraded":"2024-02-16T00:11:51.829810+0000","last_fullsized":"2024-02-16T00:11:51.829810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841646+0000","last_change":"2024-02-16T00:11:06.807251+0000","last_active":"2024-02-16T00:11:50.841646+0000","last_peered":"2024-02-16T00:11:50.841646+0000","last_clean":"2024-02-16T00:11:50.841646+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:11:50.841646+0000","last_undegraded":"2024-02-16T00:11:50.841646+0000","last_fullsized":"2024-02-16T00:11:50.841646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:25.708356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'39","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.229495+0000","last_change":"2024-02-16T00:11:08.809691+0000","last_active":"2024-02-16T00:12:35.229495+0000","last_peered":"2024-02-16T00:12:35.229495+0000","last_clean":"2024-02-16T00:12:35.229495+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:35.229495+0000","last_undegraded":"2024-02-16T00:12:35.229495+0000","last_fullsized":"2024-02-16T00:12:35.229495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843496+0000","last_change":"2024-02-16T00:11:10.830170+0000","last_active":"2024-02-16T00:11:50.843496+0000","last_peered":"2024-02-16T00:11:50.843496+0000","last_clean":"2024-02-16T00:11:50.843496+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:11:50.843496+0000","last_undegraded":"2024-02-16T00:11:50.843496+0000","last_fullsized":"2024-02-16T00:11:50.843496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:27:37.474026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839182+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:11:50.839182+0000","last_peered":"2024-02-16T00:11:50.839182+0000","last_clean":"2024-02-16T00:11:50.839182+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:11:50.839182+0000","last_undegraded":"2024-02-16T00:11:50.839182+0000","last_fullsized":"2024-02-16T00:11:50.839182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:38:22.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.852536+0000","last_change":"2024-02-16T00:11:50.852046+0000","last_active":"2024-02-16T00:11:50.852536+0000","last_peered":"2024-02-16T00:11:50.852536+0000","last_clean":"2024-02-16T00:11:50.852536+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:11:50.852536+0000","last_undegraded":"2024-02-16T00:11:50.852536+0000","last_fullsized":"2024-02-16T00:11:50.852536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:44:25.615122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840650+0000","last_change":"2024-02-16T00:11:02.816016+0000","last_active":"2024-02-16T00:11:50.840650+0000","last_peered":"2024-02-16T00:11:50.840650+0000","last_clean":"2024-02-16T00:11:50.840650+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:11:50.840650+0000","last_undegraded":"2024-02-16T00:11:50.840650+0000","last_fullsized":"2024-02-16T00:11:50.840650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:32.229010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849166+0000","last_change":"2024-02-16T00:11:50.848461+0000","last_active":"2024-02-16T00:11:50.849166+0000","last_peered":"2024-02-16T00:11:50.849166+0000","last_clean":"2024-02-16T00:11:50.849166+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:11:50.849166+0000","last_undegraded":"2024-02-16T00:11:50.849166+0000","last_fullsized":"2024-02-16T00:11:50.849166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:45:15.203256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'38","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.206319+0000","last_change":"2024-02-16T00:11:08.812821+0000","last_active":"2024-02-16T00:12:35.206319+0000","last_peered":"2024-02-16T00:12:35.206319+0000","last_clean":"2024-02-16T00:12:35.206319+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:35.206319+0000","last_undegraded":"2024-02-16T00:12:35.206319+0000","last_fullsized":"2024-02-16T00:12:35.206319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:10.931565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'243","reported_seq":334,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.110143+0000","last_change":"2024-02-16T00:11:10.825189+0000","last_active":"2024-02-16T00:12:35.110143+0000","last_peered":"2024-02-16T00:12:35.110143+0000","last_clean":"2024-02-16T00:12:35.110143+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:35.110143+0000","last_undegraded":"2024-02-16T00:12:35.110143+0000","last_fullsized":"2024-02-16T00:12:35.110143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:55:30.694754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.985572+0000","last_change":"2024-02-16T00:11:12.826412+0000","last_active":"2024-02-16T00:12:27.985572+0000","last_peered":"2024-02-16T00:12:27.985572+0000","last_clean":"2024-02-16T00:12:27.985572+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:12:27.985572+0000","last_undegraded":"2024-02-16T00:12:27.985572+0000","last_fullsized":"2024-02-16T00:12:27.985572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969839+0000","last_change":"2024-02-16T00:11:51.834792+0000","last_active":"2024-02-16T00:12:27.969839+0000","last_peered":"2024-02-16T00:12:27.969839+0000","last_clean":"2024-02-16T00:12:27.969839+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:12:27.969839+0000","last_undegraded":"2024-02-16T00:12:27.969839+0000","last_fullsized":"2024-02-16T00:12:27.969839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:28:46.509649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840852+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:11:50.840852+0000","last_peered":"2024-02-16T00:11:50.840852+0000","last_clean":"2024-02-16T00:11:50.840852+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:11:50.840852+0000","last_undegraded":"2024-02-16T00:11:50.840852+0000","last_fullsized":"2024-02-16T00:11:50.840852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:54:39.901674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":364,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.102845+0000","last_change":"2024-02-16T00:11:06.803378+0000","last_active":"2024-02-16T00:12:35.102845+0000","last_peered":"2024-02-16T00:12:35.102845+0000","last_clean":"2024-02-16T00:12:35.102845+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:35.102845+0000","last_undegraded":"2024-02-16T00:12:35.102845+0000","last_fullsized":"2024-02-16T00:12:35.102845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844009+0000","last_change":"2024-02-16T00:11:08.818315+0000","last_active":"2024-02-16T00:11:50.844009+0000","last_peered":"2024-02-16T00:11:50.844009+0000","last_clean":"2024-02-16T00:11:50.844009+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:11:50.844009+0000","last_undegraded":"2024-02-16T00:11:50.844009+0000","last_fullsized":"2024-02-16T00:11:50.844009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:13:40.931409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'243","reported_seq":338,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.258675+0000","last_change":"2024-02-16T00:11:10.821163+0000","last_active":"2024-02-16T00:12:35.258675+0000","last_peered":"2024-02-16T00:12:35.258675+0000","last_clean":"2024-02-16T00:12:35.258675+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:35.258675+0000","last_undegraded":"2024-02-16T00:12:35.258675+0000","last_fullsized":"2024-02-16T00:12:35.258675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842725+0000","last_change":"2024-02-16T00:11:12.820915+0000","last_active":"2024-02-16T00:11:50.842725+0000","last_peered":"2024-02-16T00:11:50.842725+0000","last_clean":"2024-02-16T00:11:50.842725+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:11:50.842725+0000","last_undegraded":"2024-02-16T00:11:50.842725+0000","last_fullsized":"2024-02-16T00:11:50.842725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:00:11.680317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.850028+0000","last_change":"2024-02-16T00:11:04.814579+0000","last_active":"2024-02-16T00:11:50.850028+0000","last_peered":"2024-02-16T00:11:50.850028+0000","last_clean":"2024-02-16T00:11:50.850028+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:11:50.850028+0000","last_undegraded":"2024-02-16T00:11:50.850028+0000","last_fullsized":"2024-02-16T00:11:50.850028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839956+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:11:50.839956+0000","last_peered":"2024-02-16T00:11:50.839956+0000","last_clean":"2024-02-16T00:11:50.839956+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:11:50.839956+0000","last_undegraded":"2024-02-16T00:11:50.839956+0000","last_fullsized":"2024-02-16T00:11:50.839956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:08.196608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844331+0000","last_change":"2024-02-16T00:11:06.805637+0000","last_active":"2024-02-16T00:11:50.844331+0000","last_peered":"2024-02-16T00:11:50.844331+0000","last_clean":"2024-02-16T00:11:50.844331+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:11:50.844331+0000","last_undegraded":"2024-02-16T00:11:50.844331+0000","last_fullsized":"2024-02-16T00:11:50.844331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:38:23.532869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'40","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.167035+0000","last_change":"2024-02-16T00:11:08.817066+0000","last_active":"2024-02-16T00:12:35.167035+0000","last_peered":"2024-02-16T00:12:35.167035+0000","last_clean":"2024-02-16T00:12:35.167035+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:35.167035+0000","last_undegraded":"2024-02-16T00:12:35.167035+0000","last_fullsized":"2024-02-16T00:12:35.167035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844840+0000","last_change":"2024-02-16T00:11:10.820822+0000","last_active":"2024-02-16T00:11:50.844840+0000","last_peered":"2024-02-16T00:11:50.844840+0000","last_clean":"2024-02-16T00:11:50.844840+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:11:50.844840+0000","last_undegraded":"2024-02-16T00:11:50.844840+0000","last_fullsized":"2024-02-16T00:11:50.844840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:31.483261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.463012+0000","last_change":"2024-02-16T00:11:12.820426+0000","last_active":"2024-02-16T00:12:33.463012+0000","last_peered":"2024-02-16T00:12:33.463012+0000","last_clean":"2024-02-16T00:12:33.463012+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:12:33.463012+0000","last_undegraded":"2024-02-16T00:12:33.463012+0000","last_fullsized":"2024-02-16T00:12:33.463012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447611+0000","last_change":"2024-02-16T00:11:04.815286+0000","last_active":"2024-02-16T00:12:33.447611+0000","last_peered":"2024-02-16T00:12:33.447611+0000","last_clean":"2024-02-16T00:12:33.447611+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:33.447611+0000","last_undegraded":"2024-02-16T00:12:33.447611+0000","last_fullsized":"2024-02-16T00:12:33.447611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:52.351458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847629+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:11:50.847629+0000","last_peered":"2024-02-16T00:11:50.847629+0000","last_clean":"2024-02-16T00:11:50.847629+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:11:50.847629+0000","last_undegraded":"2024-02-16T00:11:50.847629+0000","last_fullsized":"2024-02-16T00:11:50.847629+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841297+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:11:50.841297+0000","last_peered":"2024-02-16T00:11:50.841297+0000","last_clean":"2024-02-16T00:11:50.841297+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:11:50.841297+0000","last_undegraded":"2024-02-16T00:11:50.841297+0000","last_fullsized":"2024-02-16T00:11:50.841297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:58:10.324975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840128+0000","last_change":"2024-02-16T00:11:02.823633+0000","last_active":"2024-02-16T00:11:50.840128+0000","last_peered":"2024-02-16T00:11:50.840128+0000","last_clean":"2024-02-16T00:11:50.840128+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:11:50.840128+0000","last_undegraded":"2024-02-16T00:11:50.840128+0000","last_fullsized":"2024-02-16T00:11:50.840128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:29:58.094211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847055+0000","last_change":"2024-02-16T00:11:06.802815+0000","last_active":"2024-02-16T00:11:50.847055+0000","last_peered":"2024-02-16T00:11:50.847055+0000","last_clean":"2024-02-16T00:11:50.847055+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:11:50.847055+0000","last_undegraded":"2024-02-16T00:11:50.847055+0000","last_fullsized":"2024-02-16T00:11:50.847055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'85","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.199391+0000","last_change":"2024-02-16T00:11:08.812650+0000","last_active":"2024-02-16T00:12:35.199391+0000","last_peered":"2024-02-16T00:12:35.199391+0000","last_clean":"2024-02-16T00:12:35.199391+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:35.199391+0000","last_undegraded":"2024-02-16T00:12:35.199391+0000","last_fullsized":"2024-02-16T00:12:35.199391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:00:12.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830558+0000","last_change":"2024-02-16T00:11:10.819778+0000","last_active":"2024-02-16T00:11:51.830558+0000","last_peered":"2024-02-16T00:11:51.830558+0000","last_clean":"2024-02-16T00:11:51.830558+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:11:51.830558+0000","last_undegraded":"2024-02-16T00:11:51.830558+0000","last_fullsized":"2024-02-16T00:11:51.830558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.459524+0000","last_change":"2024-02-16T00:11:12.817529+0000","last_active":"2024-02-16T00:12:33.459524+0000","last_peered":"2024-02-16T00:12:33.459524+0000","last_clean":"2024-02-16T00:12:33.459524+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:33.459524+0000","last_undegraded":"2024-02-16T00:12:33.459524+0000","last_fullsized":"2024-02-16T00:12:33.459524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:53:41.761693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969783+0000","last_change":"2024-02-16T00:11:04.805947+0000","last_active":"2024-02-16T00:12:27.969783+0000","last_peered":"2024-02-16T00:12:27.969783+0000","last_clean":"2024-02-16T00:12:27.969783+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:12:27.969783+0000","last_undegraded":"2024-02-16T00:12:27.969783+0000","last_fullsized":"2024-02-16T00:12:27.969783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:40.488305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839459+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:11:50.839459+0000","last_peered":"2024-02-16T00:11:50.839459+0000","last_clean":"2024-02-16T00:11:50.839459+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:11:50.839459+0000","last_undegraded":"2024-02-16T00:11:50.839459+0000","last_fullsized":"2024-02-16T00:11:50.839459+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:29:37.927052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828809+0000","last_change":"2024-02-16T00:11:02.808396+0000","last_active":"2024-02-16T00:11:51.828809+0000","last_peered":"2024-02-16T00:11:51.828809+0000","last_clean":"2024-02-16T00:11:51.828809+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:11:51.828809+0000","last_undegraded":"2024-02-16T00:11:51.828809+0000","last_fullsized":"2024-02-16T00:11:51.828809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849902+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:11:50.849902+0000","last_peered":"2024-02-16T00:11:50.849902+0000","last_clean":"2024-02-16T00:11:50.849902+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:11:50.849902+0000","last_undegraded":"2024-02-16T00:11:50.849902+0000","last_fullsized":"2024-02-16T00:11:50.849902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:55:08.909122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'256","reported_seq":444,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.253336+0000","last_change":"2024-02-16T00:11:08.816886+0000","last_active":"2024-02-16T00:12:35.253336+0000","last_peered":"2024-02-16T00:12:35.253336+0000","last_clean":"2024-02-16T00:12:35.253336+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:35.253336+0000","last_undegraded":"2024-02-16T00:12:35.253336+0000","last_fullsized":"2024-02-16T00:12:35.253336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":329,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844070+0000","last_change":"2024-02-16T00:11:10.830058+0000","last_active":"2024-02-16T00:11:50.844070+0000","last_peered":"2024-02-16T00:11:50.844070+0000","last_clean":"2024-02-16T00:11:50.844070+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:11:50.844070+0000","last_undegraded":"2024-02-16T00:11:50.844070+0000","last_fullsized":"2024-02-16T00:11:50.844070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:08:24.925584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.763745+0000","last_change":"2024-02-16T00:11:12.828339+0000","last_active":"2024-02-16T00:12:27.763745+0000","last_peered":"2024-02-16T00:12:27.763745+0000","last_clean":"2024-02-16T00:12:27.763745+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:12:27.763745+0000","last_undegraded":"2024-02-16T00:12:27.763745+0000","last_fullsized":"2024-02-16T00:12:27.763745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831820+0000","last_change":"2024-02-16T00:11:04.803584+0000","last_active":"2024-02-16T00:11:51.831820+0000","last_peered":"2024-02-16T00:11:51.831820+0000","last_clean":"2024-02-16T00:11:51.831820+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:11:51.831820+0000","last_undegraded":"2024-02-16T00:11:51.831820+0000","last_fullsized":"2024-02-16T00:11:51.831820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841090+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:11:50.841090+0000","last_peered":"2024-02-16T00:11:50.841090+0000","last_clean":"2024-02-16T00:11:50.841090+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:11:50.841090+0000","last_undegraded":"2024-02-16T00:11:50.841090+0000","last_fullsized":"2024-02-16T00:11:50.841090+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:55.484965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828577+0000","last_change":"2024-02-16T00:11:02.802061+0000","last_active":"2024-02-16T00:11:51.828577+0000","last_peered":"2024-02-16T00:11:51.828577+0000","last_clean":"2024-02-16T00:11:51.828577+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:11:51.828577+0000","last_undegraded":"2024-02-16T00:11:51.828577+0000","last_fullsized":"2024-02-16T00:11:51.828577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841761+0000","last_change":"2024-02-16T00:11:06.803264+0000","last_active":"2024-02-16T00:11:50.841761+0000","last_peered":"2024-02-16T00:11:50.841761+0000","last_clean":"2024-02-16T00:11:50.841761+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:11:50.841761+0000","last_undegraded":"2024-02-16T00:11:50.841761+0000","last_fullsized":"2024-02-16T00:11:50.841761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:20:36.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:31.870317+0000","last_change":"2024-02-16T00:11:08.817972+0000","last_active":"2024-02-16T00:12:31.870317+0000","last_peered":"2024-02-16T00:12:31.870317+0000","last_clean":"2024-02-16T00:12:31.870317+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:31.870317+0000","last_undegraded":"2024-02-16T00:12:31.870317+0000","last_fullsized":"2024-02-16T00:12:31.870317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:12:40.476138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831275+0000","last_change":"2024-02-16T00:11:10.819489+0000","last_active":"2024-02-16T00:11:51.831275+0000","last_peered":"2024-02-16T00:11:51.831275+0000","last_clean":"2024-02-16T00:11:51.831275+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:11:51.831275+0000","last_undegraded":"2024-02-16T00:11:51.831275+0000","last_fullsized":"2024-02-16T00:11:51.831275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840050+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:11:50.840050+0000","last_peered":"2024-02-16T00:11:50.840050+0000","last_clean":"2024-02-16T00:11:50.840050+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:11:50.840050+0000","last_undegraded":"2024-02-16T00:11:50.840050+0000","last_fullsized":"2024-02-16T00:11:50.840050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:24:49.996094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.832000+0000","last_change":"2024-02-16T00:11:04.801512+0000","last_active":"2024-02-16T00:11:51.832000+0000","last_peered":"2024-02-16T00:11:51.832000+0000","last_clean":"2024-02-16T00:11:51.832000+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:11:51.832000+0000","last_undegraded":"2024-02-16T00:11:51.832000+0000","last_fullsized":"2024-02-16T00:11:51.832000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839890+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:11:50.839890+0000","last_peered":"2024-02-16T00:11:50.839890+0000","last_clean":"2024-02-16T00:11:50.839890+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:11:50.839890+0000","last_undegraded":"2024-02-16T00:11:50.839890+0000","last_fullsized":"2024-02-16T00:11:50.839890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:12:16.627592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844174+0000","last_change":"2024-02-16T00:11:02.811825+0000","last_active":"2024-02-16T00:11:50.844174+0000","last_peered":"2024-02-16T00:11:50.844174+0000","last_clean":"2024-02-16T00:11:50.844174+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:11:50.844174+0000","last_undegraded":"2024-02-16T00:11:50.844174+0000","last_fullsized":"2024-02-16T00:11:50.844174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:43:14.823585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.851641+0000","last_change":"2024-02-16T00:11:50.851092+0000","last_active":"2024-02-16T00:11:50.851641+0000","last_peered":"2024-02-16T00:11:50.851641+0000","last_clean":"2024-02-16T00:11:50.851641+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:11:50.851641+0000","last_undegraded":"2024-02-16T00:11:50.851641+0000","last_fullsized":"2024-02-16T00:11:50.851641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:28.735178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"29'14","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842302+0000","last_change":"2024-02-16T00:11:08.813441+0000","last_active":"2024-02-16T00:11:50.842302+0000","last_peered":"2024-02-16T00:11:50.842302+0000","last_clean":"2024-02-16T00:11:50.842302+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:11:50.842302+0000","last_undegraded":"2024-02-16T00:11:50.842302+0000","last_fullsized":"2024-02-16T00:11:50.842302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:03:25.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843784+0000","last_change":"2024-02-16T00:11:10.829728+0000","last_active":"2024-02-16T00:11:50.843784+0000","last_peered":"2024-02-16T00:11:50.843784+0000","last_clean":"2024-02-16T00:11:50.843784+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:11:50.843784+0000","last_undegraded":"2024-02-16T00:11:50.843784+0000","last_fullsized":"2024-02-16T00:11:50.843784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:38.430913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848782+0000","last_change":"2024-02-16T00:11:12.835325+0000","last_active":"2024-02-16T00:11:50.848782+0000","last_peered":"2024-02-16T00:11:50.848782+0000","last_clean":"2024-02-16T00:11:50.848782+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:11:50.848782+0000","last_undegraded":"2024-02-16T00:11:50.848782+0000","last_fullsized":"2024-02-16T00:11:50.848782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.622182+0000","last_change":"2024-02-16T00:11:04.814208+0000","last_active":"2024-02-16T00:12:27.622182+0000","last_peered":"2024-02-16T00:12:27.622182+0000","last_clean":"2024-02-16T00:12:27.622182+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:12:27.622182+0000","last_undegraded":"2024-02-16T00:12:27.622182+0000","last_fullsized":"2024-02-16T00:12:27.622182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841417+0000","last_change":"2024-02-16T00:11:02.805928+0000","last_active":"2024-02-16T00:11:50.841417+0000","last_peered":"2024-02-16T00:11:50.841417+0000","last_clean":"2024-02-16T00:11:50.841417+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:11:50.841417+0000","last_undegraded":"2024-02-16T00:11:50.841417+0000","last_fullsized":"2024-02-16T00:11:50.841417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:34.109920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.827774+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:11:51.827774+0000","last_peered":"2024-02-16T00:11:51.827774+0000","last_clean":"2024-02-16T00:11:51.827774+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:11:51.827774+0000","last_undegraded":"2024-02-16T00:11:51.827774+0000","last_fullsized":"2024-02-16T00:11:51.827774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830674+0000","last_change":"2024-02-16T00:11:06.809081+0000","last_active":"2024-02-16T00:11:51.830674+0000","last_peered":"2024-02-16T00:11:51.830674+0000","last_clean":"2024-02-16T00:11:51.830674+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:11:51.830674+0000","last_undegraded":"2024-02-16T00:11:51.830674+0000","last_fullsized":"2024-02-16T00:11:51.830674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'74","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.251531+0000","last_change":"2024-02-16T00:11:08.812931+0000","last_active":"2024-02-16T00:12:35.251531+0000","last_peered":"2024-02-16T00:12:35.251531+0000","last_clean":"2024-02-16T00:12:35.251531+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:35.251531+0000","last_undegraded":"2024-02-16T00:12:35.251531+0000","last_fullsized":"2024-02-16T00:12:35.251531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":88,"num_read_kb":74,"num_write":40,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842114+0000","last_change":"2024-02-16T00:11:10.824976+0000","last_active":"2024-02-16T00:11:50.842114+0000","last_peered":"2024-02-16T00:11:50.842114+0000","last_clean":"2024-02-16T00:11:50.842114+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:11:50.842114+0000","last_undegraded":"2024-02-16T00:11:50.842114+0000","last_fullsized":"2024-02-16T00:11:50.842114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:01.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.987291+0000","last_change":"2024-02-16T00:11:12.822048+0000","last_active":"2024-02-16T00:12:27.987291+0000","last_peered":"2024-02-16T00:12:27.987291+0000","last_clean":"2024-02-16T00:12:27.987291+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:12:27.987291+0000","last_undegraded":"2024-02-16T00:12:27.987291+0000","last_fullsized":"2024-02-16T00:12:27.987291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847027+0000","last_change":"2024-02-16T00:11:04.814786+0000","last_active":"2024-02-16T00:11:50.847027+0000","last_peered":"2024-02-16T00:11:50.847027+0000","last_clean":"2024-02-16T00:11:50.847027+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:11:50.847027+0000","last_undegraded":"2024-02-16T00:11:50.847027+0000","last_fullsized":"2024-02-16T00:11:50.847027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831429+0000","last_change":"2024-02-16T00:11:02.801240+0000","last_active":"2024-02-16T00:11:51.831429+0000","last_peered":"2024-02-16T00:11:51.831429+0000","last_clean":"2024-02-16T00:11:51.831429+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:11:51.831429+0000","last_undegraded":"2024-02-16T00:11:51.831429+0000","last_fullsized":"2024-02-16T00:11:51.831429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844947+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:11:50.844947+0000","last_peered":"2024-02-16T00:11:50.844947+0000","last_clean":"2024-02-16T00:11:50.844947+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:11:50.844947+0000","last_undegraded":"2024-02-16T00:11:50.844947+0000","last_fullsized":"2024-02-16T00:11:50.844947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:11:13.167891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839692+0000","last_change":"2024-02-16T00:11:06.807321+0000","last_active":"2024-02-16T00:11:50.839692+0000","last_peered":"2024-02-16T00:11:50.839692+0000","last_clean":"2024-02-16T00:11:50.839692+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:11:50.839692+0000","last_undegraded":"2024-02-16T00:11:50.839692+0000","last_fullsized":"2024-02-16T00:11:50.839692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:22:40.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'20","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846874+0000","last_change":"2024-02-16T00:11:08.816902+0000","last_active":"2024-02-16T00:11:50.846874+0000","last_peered":"2024-02-16T00:11:50.846874+0000","last_clean":"2024-02-16T00:11:50.846874+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:11:50.846874+0000","last_undegraded":"2024-02-16T00:11:50.846874+0000","last_fullsized":"2024-02-16T00:11:50.846874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'243","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.255639+0000","last_change":"2024-02-16T00:11:10.824584+0000","last_active":"2024-02-16T00:12:35.255639+0000","last_peered":"2024-02-16T00:12:35.255639+0000","last_clean":"2024-02-16T00:12:35.255639+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:35.255639+0000","last_undegraded":"2024-02-16T00:12:35.255639+0000","last_fullsized":"2024-02-16T00:12:35.255639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842453+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:11:50.842453+0000","last_peered":"2024-02-16T00:11:50.842453+0000","last_clean":"2024-02-16T00:11:50.842453+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:11:50.842453+0000","last_undegraded":"2024-02-16T00:11:50.842453+0000","last_fullsized":"2024-02-16T00:11:50.842453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:56:43.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447640+0000","last_change":"2024-02-16T00:11:04.813783+0000","last_active":"2024-02-16T00:12:33.447640+0000","last_peered":"2024-02-16T00:12:33.447640+0000","last_clean":"2024-02-16T00:12:33.447640+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:33.447640+0000","last_undegraded":"2024-02-16T00:12:33.447640+0000","last_fullsized":"2024-02-16T00:12:33.447640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:36:00.990043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844350+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:11:50.844350+0000","last_peered":"2024-02-16T00:11:50.844350+0000","last_clean":"2024-02-16T00:11:50.844350+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:11:50.844350+0000","last_undegraded":"2024-02-16T00:11:50.844350+0000","last_fullsized":"2024-02-16T00:11:50.844350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:43.805420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828261+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:11:51.828261+0000","last_peered":"2024-02-16T00:11:51.828261+0000","last_clean":"2024-02-16T00:11:51.828261+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:11:51.828261+0000","last_undegraded":"2024-02-16T00:11:51.828261+0000","last_fullsized":"2024-02-16T00:11:51.828261+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840930+0000","last_change":"2024-02-16T00:11:06.808524+0000","last_active":"2024-02-16T00:11:50.840930+0000","last_peered":"2024-02-16T00:11:50.840930+0000","last_clean":"2024-02-16T00:11:50.840930+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:11:50.840930+0000","last_undegraded":"2024-02-16T00:11:50.840930+0000","last_fullsized":"2024-02-16T00:11:50.840930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:59:29.788383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840440+0000","last_change":"2024-02-16T00:11:08.814729+0000","last_active":"2024-02-16T00:11:50.840440+0000","last_peered":"2024-02-16T00:11:50.840440+0000","last_clean":"2024-02-16T00:11:50.840440+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:11:50.840440+0000","last_undegraded":"2024-02-16T00:11:50.840440+0000","last_fullsized":"2024-02-16T00:11:50.840440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:00:46.912652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'243","reported_seq":314,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.259849+0000","last_change":"2024-02-16T00:11:10.820590+0000","last_active":"2024-02-16T00:12:35.259849+0000","last_peered":"2024-02-16T00:12:35.259849+0000","last_clean":"2024-02-16T00:12:35.259849+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:35.259849+0000","last_undegraded":"2024-02-16T00:12:35.259849+0000","last_fullsized":"2024-02-16T00:12:35.259849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'13","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.279844+0000","last_change":"2024-02-16T00:11:12.832931+0000","last_active":"2024-02-16T00:12:22.279844+0000","last_peered":"2024-02-16T00:12:22.279844+0000","last_clean":"2024-02-16T00:12:22.279844+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:12:22.279844+0000","last_undegraded":"2024-02-16T00:12:22.279844+0000","last_fullsized":"2024-02-16T00:12:22.279844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447919+0000","last_change":"2024-02-16T00:11:04.809323+0000","last_active":"2024-02-16T00:12:33.447919+0000","last_peered":"2024-02-16T00:12:33.447919+0000","last_clean":"2024-02-16T00:12:33.447919+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:12:33.447919+0000","last_undegraded":"2024-02-16T00:12:33.447919+0000","last_fullsized":"2024-02-16T00:12:33.447919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:15.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849445+0000","last_change":"2024-02-16T00:11:02.796859+0000","last_active":"2024-02-16T00:11:50.849445+0000","last_peered":"2024-02-16T00:11:50.849445+0000","last_clean":"2024-02-16T00:11:50.849445+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:11:50.849445+0000","last_undegraded":"2024-02-16T00:11:50.849445+0000","last_fullsized":"2024-02-16T00:11:50.849445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843629+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:11:50.843629+0000","last_peered":"2024-02-16T00:11:50.843629+0000","last_clean":"2024-02-16T00:11:50.843629+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:11:50.843629+0000","last_undegraded":"2024-02-16T00:11:50.843629+0000","last_fullsized":"2024-02-16T00:11:50.843629+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:24:06.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840367+0000","last_change":"2024-02-16T00:11:06.809592+0000","last_active":"2024-02-16T00:11:50.840367+0000","last_peered":"2024-02-16T00:11:50.840367+0000","last_clean":"2024-02-16T00:11:50.840367+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:11:50.840367+0000","last_undegraded":"2024-02-16T00:11:50.840367+0000","last_fullsized":"2024-02-16T00:11:50.840367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:07:52.303003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'91","reported_seq":180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.240487+0000","last_change":"2024-02-16T00:11:08.813647+0000","last_active":"2024-02-16T00:12:35.240487+0000","last_peered":"2024-02-16T00:12:35.240487+0000","last_clean":"2024-02-16T00:12:35.240487+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:35.240487+0000","last_undegraded":"2024-02-16T00:12:35.240487+0000","last_fullsized":"2024-02-16T00:12:35.240487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:57.678721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829943+0000","last_change":"2024-02-16T00:11:10.825204+0000","last_active":"2024-02-16T00:11:51.829943+0000","last_peered":"2024-02-16T00:11:51.829943+0000","last_clean":"2024-02-16T00:11:51.829943+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:11:51.829943+0000","last_undegraded":"2024-02-16T00:11:51.829943+0000","last_fullsized":"2024-02-16T00:11:51.829943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845913+0000","last_change":"2024-02-16T00:11:12.825945+0000","last_active":"2024-02-16T00:11:50.845913+0000","last_peered":"2024-02-16T00:11:50.845913+0000","last_clean":"2024-02-16T00:11:50.845913+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:11:50.845913+0000","last_undegraded":"2024-02-16T00:11:50.845913+0000","last_fullsized":"2024-02-16T00:11:50.845913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:53:01.423563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.437852+0000","last_change":"2024-02-16T00:11:12.826512+0000","last_active":"2024-02-16T00:12:33.437852+0000","last_peered":"2024-02-16T00:12:33.437852+0000","last_clean":"2024-02-16T00:12:33.437852+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:12:33.437852+0000","last_undegraded":"2024-02-16T00:12:33.437852+0000","last_fullsized":"2024-02-16T00:12:33.437852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:14.444046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969541+0000","last_change":"2024-02-16T00:11:04.810868+0000","last_active":"2024-02-16T00:12:27.969541+0000","last_peered":"2024-02-16T00:12:27.969541+0000","last_clean":"2024-02-16T00:12:27.969541+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:12:27.969541+0000","last_undegraded":"2024-02-16T00:12:27.969541+0000","last_fullsized":"2024-02-16T00:12:27.969541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:34.235361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842296+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:11:50.842296+0000","last_peered":"2024-02-16T00:11:50.842296+0000","last_clean":"2024-02-16T00:11:50.842296+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:11:50.842296+0000","last_undegraded":"2024-02-16T00:11:50.842296+0000","last_fullsized":"2024-02-16T00:11:50.842296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:29:24.599977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"29'2","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.103132+0000","last_change":"2024-02-16T00:11:06.804629+0000","last_active":"2024-02-16T00:12:35.103132+0000","last_peered":"2024-02-16T00:12:35.103132+0000","last_clean":"2024-02-16T00:12:35.103132+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:35.103132+0000","last_undegraded":"2024-02-16T00:12:35.103132+0000","last_fullsized":"2024-02-16T00:12:35.103132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'39","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.177798+0000","last_change":"2024-02-16T00:11:08.817056+0000","last_active":"2024-02-16T00:12:35.177798+0000","last_peered":"2024-02-16T00:12:35.177798+0000","last_clean":"2024-02-16T00:12:35.177798+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:12:35.177798+0000","last_undegraded":"2024-02-16T00:12:35.177798+0000","last_fullsized":"2024-02-16T00:12:35.177798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:34:14.319677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840209+0000","last_change":"2024-02-16T00:11:10.831264+0000","last_active":"2024-02-16T00:11:50.840209+0000","last_peered":"2024-02-16T00:11:50.840209+0000","last_clean":"2024-02-16T00:11:50.840209+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:11:50.840209+0000","last_undegraded":"2024-02-16T00:11:50.840209+0000","last_fullsized":"2024-02-16T00:11:50.840209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:09:54.744331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830204+0000","last_change":"2024-02-16T00:11:12.819458+0000","last_active":"2024-02-16T00:11:51.830204+0000","last_peered":"2024-02-16T00:11:51.830204+0000","last_clean":"2024-02-16T00:11:51.830204+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:11:51.830204+0000","last_undegraded":"2024-02-16T00:11:51.830204+0000","last_fullsized":"2024-02-16T00:11:51.830204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.857998+0000","last_change":"2024-02-16T00:11:50.857588+0000","last_active":"2024-02-16T00:11:50.857998+0000","last_peered":"2024-02-16T00:11:50.857998+0000","last_clean":"2024-02-16T00:11:50.857998+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:11:50.857998+0000","last_undegraded":"2024-02-16T00:11:50.857998+0000","last_fullsized":"2024-02-16T00:11:50.857998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:48.410669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841539+0000","last_change":"2024-02-16T00:11:02.805825+0000","last_active":"2024-02-16T00:11:50.841539+0000","last_peered":"2024-02-16T00:11:50.841539+0000","last_clean":"2024-02-16T00:11:50.841539+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:11:50.841539+0000","last_undegraded":"2024-02-16T00:11:50.841539+0000","last_fullsized":"2024-02-16T00:11:50.841539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:59.758776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841830+0000","last_change":"2024-02-16T00:11:06.809728+0000","last_active":"2024-02-16T00:11:50.841830+0000","last_peered":"2024-02-16T00:11:50.841830+0000","last_clean":"2024-02-16T00:11:50.841830+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:11:50.841830+0000","last_undegraded":"2024-02-16T00:11:50.841830+0000","last_fullsized":"2024-02-16T00:11:50.841830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:01:21.123795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:21.234926+0000","last_change":"2024-02-16T00:11:08.813746+0000","last_active":"2024-02-16T00:12:21.234926+0000","last_peered":"2024-02-16T00:12:21.234926+0000","last_clean":"2024-02-16T00:12:21.234926+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:21.234926+0000","last_undegraded":"2024-02-16T00:12:21.234926+0000","last_fullsized":"2024-02-16T00:12:21.234926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841313+0000","last_change":"2024-02-16T00:11:10.820413+0000","last_active":"2024-02-16T00:11:50.841313+0000","last_peered":"2024-02-16T00:11:50.841313+0000","last_clean":"2024-02-16T00:11:50.841313+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:11:50.841313+0000","last_undegraded":"2024-02-16T00:11:50.841313+0000","last_fullsized":"2024-02-16T00:11:50.841313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:16:24.918488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830302+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830302+0000","last_peered":"2024-02-16T00:11:51.830302+0000","last_clean":"2024-02-16T00:11:51.830302+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830302+0000","last_undegraded":"2024-02-16T00:11:51.830302+0000","last_fullsized":"2024-02-16T00:11:51.830302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455753+0000","last_change":"2024-02-16T00:11:04.801132+0000","last_active":"2024-02-16T00:12:33.455753+0000","last_peered":"2024-02-16T00:12:33.455753+0000","last_clean":"2024-02-16T00:12:33.455753+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:12:33.455753+0000","last_undegraded":"2024-02-16T00:12:33.455753+0000","last_fullsized":"2024-02-16T00:12:33.455753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842111+0000","last_change":"2024-02-16T00:11:02.815585+0000","last_active":"2024-02-16T00:11:50.842111+0000","last_peered":"2024-02-16T00:11:50.842111+0000","last_clean":"2024-02-16T00:11:50.842111+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:11:50.842111+0000","last_undegraded":"2024-02-16T00:11:50.842111+0000","last_fullsized":"2024-02-16T00:11:50.842111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:03:15.554299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843904+0000","last_change":"2024-02-16T00:11:06.809635+0000","last_active":"2024-02-16T00:11:50.843904+0000","last_peered":"2024-02-16T00:11:50.843904+0000","last_clean":"2024-02-16T00:11:50.843904+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:11:50.843904+0000","last_undegraded":"2024-02-16T00:11:50.843904+0000","last_fullsized":"2024-02-16T00:11:50.843904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:49.818734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.245339+0000","last_change":"2024-02-16T00:11:08.810350+0000","last_active":"2024-02-16T00:12:35.245339+0000","last_peered":"2024-02-16T00:12:35.245339+0000","last_clean":"2024-02-16T00:12:35.245339+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:35.245339+0000","last_undegraded":"2024-02-16T00:12:35.245339+0000","last_fullsized":"2024-02-16T00:12:35.245339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847736+0000","last_change":"2024-02-16T00:11:10.823987+0000","last_active":"2024-02-16T00:11:50.847736+0000","last_peered":"2024-02-16T00:11:50.847736+0000","last_clean":"2024-02-16T00:11:50.847736+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:11:50.847736+0000","last_undegraded":"2024-02-16T00:11:50.847736+0000","last_fullsized":"2024-02-16T00:11:50.847736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844306+0000","last_change":"2024-02-16T00:11:12.831687+0000","last_active":"2024-02-16T00:11:50.844306+0000","last_peered":"2024-02-16T00:11:50.844306+0000","last_clean":"2024-02-16T00:11:50.844306+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:11:50.844306+0000","last_undegraded":"2024-02-16T00:11:50.844306+0000","last_fullsized":"2024-02-16T00:11:50.844306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:33:37.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839554+0000","last_change":"2024-02-16T00:11:04.812864+0000","last_active":"2024-02-16T00:11:50.839554+0000","last_peered":"2024-02-16T00:11:50.839554+0000","last_clean":"2024-02-16T00:11:50.839554+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:11:50.839554+0000","last_undegraded":"2024-02-16T00:11:50.839554+0000","last_fullsized":"2024-02-16T00:11:50.839554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:35.009820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849489+0000","last_change":"2024-02-16T00:11:02.814174+0000","last_active":"2024-02-16T00:11:50.849489+0000","last_peered":"2024-02-16T00:11:50.849489+0000","last_clean":"2024-02-16T00:11:50.849489+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:11:50.849489+0000","last_undegraded":"2024-02-16T00:11:50.849489+0000","last_fullsized":"2024-02-16T00:11:50.849489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839547+0000","last_change":"2024-02-16T00:11:06.803159+0000","last_active":"2024-02-16T00:11:50.839547+0000","last_peered":"2024-02-16T00:11:50.839547+0000","last_clean":"2024-02-16T00:11:50.839547+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:11:50.839547+0000","last_undegraded":"2024-02-16T00:11:50.839547+0000","last_fullsized":"2024-02-16T00:11:50.839547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:11.562971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'31","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.234853+0000","last_change":"2024-02-16T00:11:08.812960+0000","last_active":"2024-02-16T00:12:35.234853+0000","last_peered":"2024-02-16T00:12:35.234853+0000","last_clean":"2024-02-16T00:12:35.234853+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:35.234853+0000","last_undegraded":"2024-02-16T00:12:35.234853+0000","last_fullsized":"2024-02-16T00:12:35.234853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:17:42.177481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843134+0000","last_change":"2024-02-16T00:11:10.819766+0000","last_active":"2024-02-16T00:11:50.843134+0000","last_peered":"2024-02-16T00:11:50.843134+0000","last_clean":"2024-02-16T00:11:50.843134+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:11:50.843134+0000","last_undegraded":"2024-02-16T00:11:50.843134+0000","last_fullsized":"2024-02-16T00:11:50.843134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:47.452023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977793+0000","last_change":"2024-02-16T00:11:04.799979+0000","last_active":"2024-02-16T00:12:27.977793+0000","last_peered":"2024-02-16T00:12:27.977793+0000","last_clean":"2024-02-16T00:12:27.977793+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:12:27.977793+0000","last_undegraded":"2024-02-16T00:12:27.977793+0000","last_fullsized":"2024-02-16T00:12:27.977793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:13:45.383827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839552+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:11:50.839552+0000","last_peered":"2024-02-16T00:11:50.839552+0000","last_clean":"2024-02-16T00:11:50.839552+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:11:50.839552+0000","last_undegraded":"2024-02-16T00:11:50.839552+0000","last_fullsized":"2024-02-16T00:11:50.839552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:56.621924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831866+0000","last_change":"2024-02-16T00:11:06.807366+0000","last_active":"2024-02-16T00:11:51.831866+0000","last_peered":"2024-02-16T00:11:51.831866+0000","last_clean":"2024-02-16T00:11:51.831866+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:11:51.831866+0000","last_undegraded":"2024-02-16T00:11:51.831866+0000","last_fullsized":"2024-02-16T00:11:51.831866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":133,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.232721+0000","last_change":"2024-02-16T00:11:08.813592+0000","last_active":"2024-02-16T00:12:35.232721+0000","last_peered":"2024-02-16T00:12:35.232721+0000","last_clean":"2024-02-16T00:12:35.232721+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:35.232721+0000","last_undegraded":"2024-02-16T00:12:35.232721+0000","last_fullsized":"2024-02-16T00:12:35.232721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843324+0000","last_change":"2024-02-16T00:11:10.819573+0000","last_active":"2024-02-16T00:11:50.843324+0000","last_peered":"2024-02-16T00:11:50.843324+0000","last_clean":"2024-02-16T00:11:50.843324+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:11:50.843324+0000","last_undegraded":"2024-02-16T00:11:50.843324+0000","last_fullsized":"2024-02-16T00:11:50.843324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:15.314264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.983254+0000","last_change":"2024-02-16T00:11:12.826496+0000","last_active":"2024-02-16T00:12:27.983254+0000","last_peered":"2024-02-16T00:12:27.983254+0000","last_clean":"2024-02-16T00:12:27.983254+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:12:27.983254+0000","last_undegraded":"2024-02-16T00:12:27.983254+0000","last_fullsized":"2024-02-16T00:12:27.983254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831616+0000","last_change":"2024-02-16T00:11:04.798736+0000","last_active":"2024-02-16T00:11:51.831616+0000","last_peered":"2024-02-16T00:11:51.831616+0000","last_clean":"2024-02-16T00:11:51.831616+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:11:51.831616+0000","last_undegraded":"2024-02-16T00:11:51.831616+0000","last_fullsized":"2024-02-16T00:11:51.831616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846701+0000","last_change":"2024-02-16T00:11:02.820397+0000","last_active":"2024-02-16T00:11:50.846701+0000","last_peered":"2024-02-16T00:11:50.846701+0000","last_clean":"2024-02-16T00:11:50.846701+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:11:50.846701+0000","last_undegraded":"2024-02-16T00:11:50.846701+0000","last_fullsized":"2024-02-16T00:11:50.846701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842043+0000","last_change":"2024-02-16T00:11:06.805697+0000","last_active":"2024-02-16T00:11:50.842043+0000","last_peered":"2024-02-16T00:11:50.842043+0000","last_clean":"2024-02-16T00:11:50.842043+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:11:50.842043+0000","last_undegraded":"2024-02-16T00:11:50.842043+0000","last_fullsized":"2024-02-16T00:11:50.842043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:02:39.979662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'37","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.237720+0000","last_change":"2024-02-16T00:11:08.817849+0000","last_active":"2024-02-16T00:12:35.237720+0000","last_peered":"2024-02-16T00:12:35.237720+0000","last_clean":"2024-02-16T00:12:35.237720+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:12:35.237720+0000","last_undegraded":"2024-02-16T00:12:35.237720+0000","last_fullsized":"2024-02-16T00:12:35.237720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:31:51.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846730+0000","last_change":"2024-02-16T00:11:10.826937+0000","last_active":"2024-02-16T00:11:50.846730+0000","last_peered":"2024-02-16T00:11:50.846730+0000","last_clean":"2024-02-16T00:11:50.846730+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:11:50.846730+0000","last_undegraded":"2024-02-16T00:11:50.846730+0000","last_fullsized":"2024-02-16T00:11:50.846730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839475+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:11:50.839475+0000","last_peered":"2024-02-16T00:11:50.839475+0000","last_clean":"2024-02-16T00:11:50.839475+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:11:50.839475+0000","last_undegraded":"2024-02-16T00:11:50.839475+0000","last_fullsized":"2024-02-16T00:11:50.839475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:07.884643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846346+0000","last_change":"2024-02-16T00:11:04.815549+0000","last_active":"2024-02-16T00:11:50.846346+0000","last_peered":"2024-02-16T00:11:50.846346+0000","last_clean":"2024-02-16T00:11:50.846346+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:11:50.846346+0000","last_undegraded":"2024-02-16T00:11:50.846346+0000","last_fullsized":"2024-02-16T00:11:50.846346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:10:24.693103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847897+0000","last_change":"2024-02-16T00:11:02.796631+0000","last_active":"2024-02-16T00:11:50.847897+0000","last_peered":"2024-02-16T00:11:50.847897+0000","last_clean":"2024-02-16T00:11:50.847897+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:11:50.847897+0000","last_undegraded":"2024-02-16T00:11:50.847897+0000","last_fullsized":"2024-02-16T00:11:50.847897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843956+0000","last_change":"2024-02-16T00:11:06.803105+0000","last_active":"2024-02-16T00:11:50.843956+0000","last_peered":"2024-02-16T00:11:50.843956+0000","last_clean":"2024-02-16T00:11:50.843956+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:11:50.843956+0000","last_undegraded":"2024-02-16T00:11:50.843956+0000","last_fullsized":"2024-02-16T00:11:50.843956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:33.464474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.191099+0000","last_change":"2024-02-16T00:11:08.812229+0000","last_active":"2024-02-16T00:12:35.191099+0000","last_peered":"2024-02-16T00:12:35.191099+0000","last_clean":"2024-02-16T00:12:35.191099+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:35.191099+0000","last_undegraded":"2024-02-16T00:12:35.191099+0000","last_fullsized":"2024-02-16T00:12:35.191099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830544+0000","last_change":"2024-02-16T00:11:10.820773+0000","last_active":"2024-02-16T00:11:51.830544+0000","last_peered":"2024-02-16T00:11:51.830544+0000","last_clean":"2024-02-16T00:11:51.830544+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:11:51.830544+0000","last_undegraded":"2024-02-16T00:11:51.830544+0000","last_fullsized":"2024-02-16T00:11:51.830544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840147+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:11:50.840147+0000","last_peered":"2024-02-16T00:11:50.840147+0000","last_clean":"2024-02-16T00:11:50.840147+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:11:50.840147+0000","last_undegraded":"2024-02-16T00:11:50.840147+0000","last_fullsized":"2024-02-16T00:11:50.840147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:35:50.226733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831748+0000","last_change":"2024-02-16T00:11:04.801768+0000","last_active":"2024-02-16T00:11:51.831748+0000","last_peered":"2024-02-16T00:11:51.831748+0000","last_clean":"2024-02-16T00:11:51.831748+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:11:51.831748+0000","last_undegraded":"2024-02-16T00:11:51.831748+0000","last_fullsized":"2024-02-16T00:11:51.831748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841024+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:11:50.841024+0000","last_peered":"2024-02-16T00:11:50.841024+0000","last_clean":"2024-02-16T00:11:50.841024+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:11:50.841024+0000","last_undegraded":"2024-02-16T00:11:50.841024+0000","last_fullsized":"2024-02-16T00:11:50.841024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:13.889993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849341+0000","last_change":"2024-02-16T00:11:06.802067+0000","last_active":"2024-02-16T00:11:50.849341+0000","last_peered":"2024-02-16T00:11:50.849341+0000","last_clean":"2024-02-16T00:11:50.849341+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:11:50.849341+0000","last_undegraded":"2024-02-16T00:11:50.849341+0000","last_fullsized":"2024-02-16T00:11:50.849341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'16","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844168+0000","last_change":"2024-02-16T00:11:08.814283+0000","last_active":"2024-02-16T00:11:50.844168+0000","last_peered":"2024-02-16T00:11:50.844168+0000","last_clean":"2024-02-16T00:11:50.844168+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:11:50.844168+0000","last_undegraded":"2024-02-16T00:11:50.844168+0000","last_fullsized":"2024-02-16T00:11:50.844168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:02:04.932316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'243","reported_seq":332,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.106327+0000","last_change":"2024-02-16T00:11:10.827795+0000","last_active":"2024-02-16T00:12:35.106327+0000","last_peered":"2024-02-16T00:12:35.106327+0000","last_clean":"2024-02-16T00:12:35.106327+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:35.106327+0000","last_undegraded":"2024-02-16T00:12:35.106327+0000","last_fullsized":"2024-02-16T00:12:35.106327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:54:46.508578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839100+0000","last_change":"2024-02-16T00:11:12.832363+0000","last_active":"2024-02-16T00:11:50.839100+0000","last_peered":"2024-02-16T00:11:50.839100+0000","last_clean":"2024-02-16T00:11:50.839100+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:11:50.839100+0000","last_undegraded":"2024-02-16T00:11:50.839100+0000","last_fullsized":"2024-02-16T00:11:50.839100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:04:05.101733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447432+0000","last_change":"2024-02-16T00:11:04.798269+0000","last_active":"2024-02-16T00:12:33.447432+0000","last_peered":"2024-02-16T00:12:33.447432+0000","last_clean":"2024-02-16T00:12:33.447432+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:12:33.447432+0000","last_undegraded":"2024-02-16T00:12:33.447432+0000","last_fullsized":"2024-02-16T00:12:33.447432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:27:55.703337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847530+0000","last_change":"2024-02-16T00:11:02.810889+0000","last_active":"2024-02-16T00:11:50.847530+0000","last_peered":"2024-02-16T00:11:50.847530+0000","last_clean":"2024-02-16T00:11:50.847530+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:11:50.847530+0000","last_undegraded":"2024-02-16T00:11:50.847530+0000","last_fullsized":"2024-02-16T00:11:50.847530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848672+0000","last_change":"2024-02-16T00:11:06.805017+0000","last_active":"2024-02-16T00:11:50.848672+0000","last_peered":"2024-02-16T00:11:50.848672+0000","last_clean":"2024-02-16T00:11:50.848672+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:11:50.848672+0000","last_undegraded":"2024-02-16T00:11:50.848672+0000","last_fullsized":"2024-02-16T00:11:50.848672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.210620+0000","last_change":"2024-02-16T00:11:08.812824+0000","last_active":"2024-02-16T00:12:35.210620+0000","last_peered":"2024-02-16T00:12:35.210620+0000","last_clean":"2024-02-16T00:12:35.210620+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:35.210620+0000","last_undegraded":"2024-02-16T00:12:35.210620+0000","last_fullsized":"2024-02-16T00:12:35.210620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828610+0000","last_change":"2024-02-16T00:11:10.815519+0000","last_active":"2024-02-16T00:11:51.828610+0000","last_peered":"2024-02-16T00:11:51.828610+0000","last_clean":"2024-02-16T00:11:51.828610+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:11:51.828610+0000","last_undegraded":"2024-02-16T00:11:51.828610+0000","last_fullsized":"2024-02-16T00:11:51.828610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849771+0000","last_change":"2024-02-16T00:11:12.828004+0000","last_active":"2024-02-16T00:11:50.849771+0000","last_peered":"2024-02-16T00:11:50.849771+0000","last_clean":"2024-02-16T00:11:50.849771+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:11:50.849771+0000","last_undegraded":"2024-02-16T00:11:50.849771+0000","last_fullsized":"2024-02-16T00:11:50.849771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842936+0000","last_change":"2024-02-16T00:11:04.802752+0000","last_active":"2024-02-16T00:11:50.842936+0000","last_peered":"2024-02-16T00:11:50.842936+0000","last_clean":"2024-02-16T00:11:50.842936+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:11:50.842936+0000","last_undegraded":"2024-02-16T00:11:50.842936+0000","last_fullsized":"2024-02-16T00:11:50.842936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:08.473080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845216+0000","last_change":"2024-02-16T00:11:02.815829+0000","last_active":"2024-02-16T00:11:50.845216+0000","last_peered":"2024-02-16T00:11:50.845216+0000","last_clean":"2024-02-16T00:11:50.845216+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:11:50.845216+0000","last_undegraded":"2024-02-16T00:11:50.845216+0000","last_fullsized":"2024-02-16T00:11:50.845216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:08:04.562290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"29'5","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.082494+0000","last_change":"2024-02-16T00:11:06.809403+0000","last_active":"2024-02-16T00:12:35.082494+0000","last_peered":"2024-02-16T00:12:35.082494+0000","last_clean":"2024-02-16T00:12:35.082494+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:35.082494+0000","last_undegraded":"2024-02-16T00:12:35.082494+0000","last_fullsized":"2024-02-16T00:12:35.082494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:26:35.031327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'39","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.213945+0000","last_change":"2024-02-16T00:11:08.812928+0000","last_active":"2024-02-16T00:12:35.213945+0000","last_peered":"2024-02-16T00:12:35.213945+0000","last_clean":"2024-02-16T00:12:35.213945+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:35.213945+0000","last_undegraded":"2024-02-16T00:12:35.213945+0000","last_fullsized":"2024-02-16T00:12:35.213945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839358+0000","last_change":"2024-02-16T00:11:10.827306+0000","last_active":"2024-02-16T00:11:50.839358+0000","last_peered":"2024-02-16T00:11:50.839358+0000","last_clean":"2024-02-16T00:11:50.839358+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:11:50.839358+0000","last_undegraded":"2024-02-16T00:11:50.839358+0000","last_fullsized":"2024-02-16T00:11:50.839358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:26:46.792767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841996+0000","last_change":"2024-02-16T00:11:12.830200+0000","last_active":"2024-02-16T00:11:50.841996+0000","last_peered":"2024-02-16T00:11:50.841996+0000","last_clean":"2024-02-16T00:11:50.841996+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:11:50.841996+0000","last_undegraded":"2024-02-16T00:11:50.841996+0000","last_fullsized":"2024-02-16T00:11:50.841996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:20:34.641380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839696+0000","last_change":"2024-02-16T00:11:04.806595+0000","last_active":"2024-02-16T00:11:50.839696+0000","last_peered":"2024-02-16T00:11:50.839696+0000","last_clean":"2024-02-16T00:11:50.839696+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:11:50.839696+0000","last_undegraded":"2024-02-16T00:11:50.839696+0000","last_fullsized":"2024-02-16T00:11:50.839696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:56:15.344749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830900+0000","last_change":"2024-02-16T00:11:02.802098+0000","last_active":"2024-02-16T00:11:51.830900+0000","last_peered":"2024-02-16T00:11:51.830900+0000","last_clean":"2024-02-16T00:11:51.830900+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:11:51.830900+0000","last_undegraded":"2024-02-16T00:11:51.830900+0000","last_fullsized":"2024-02-16T00:11:51.830900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848982+0000","last_change":"2024-02-16T00:11:06.811600+0000","last_active":"2024-02-16T00:11:50.848982+0000","last_peered":"2024-02-16T00:11:50.848982+0000","last_clean":"2024-02-16T00:11:50.848982+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:11:50.848982+0000","last_undegraded":"2024-02-16T00:11:50.848982+0000","last_fullsized":"2024-02-16T00:11:50.848982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'34","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.183688+0000","last_change":"2024-02-16T00:11:08.814011+0000","last_active":"2024-02-16T00:12:35.183688+0000","last_peered":"2024-02-16T00:12:35.183688+0000","last_clean":"2024-02-16T00:12:35.183688+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:35.183688+0000","last_undegraded":"2024-02-16T00:12:35.183688+0000","last_fullsized":"2024-02-16T00:12:35.183688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:02:05.767514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839700+0000","last_change":"2024-02-16T00:11:10.831082+0000","last_active":"2024-02-16T00:11:50.839700+0000","last_peered":"2024-02-16T00:11:50.839700+0000","last_clean":"2024-02-16T00:11:50.839700+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:11:50.839700+0000","last_undegraded":"2024-02-16T00:11:50.839700+0000","last_fullsized":"2024-02-16T00:11:50.839700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:40.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844236+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:11:50.844236+0000","last_peered":"2024-02-16T00:11:50.844236+0000","last_clean":"2024-02-16T00:11:50.844236+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:11:50.844236+0000","last_undegraded":"2024-02-16T00:11:50.844236+0000","last_fullsized":"2024-02-16T00:11:50.844236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:04:12.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969458+0000","last_change":"2024-02-16T00:11:04.798644+0000","last_active":"2024-02-16T00:12:27.969458+0000","last_peered":"2024-02-16T00:12:27.969458+0000","last_clean":"2024-02-16T00:12:27.969458+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:12:27.969458+0000","last_undegraded":"2024-02-16T00:12:27.969458+0000","last_fullsized":"2024-02-16T00:12:27.969458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:23:26.014194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849631+0000","last_change":"2024-02-16T00:11:02.820199+0000","last_active":"2024-02-16T00:11:50.849631+0000","last_peered":"2024-02-16T00:11:50.849631+0000","last_clean":"2024-02-16T00:11:50.849631+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:11:50.849631+0000","last_undegraded":"2024-02-16T00:11:50.849631+0000","last_fullsized":"2024-02-16T00:11:50.849631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.889237+0000","last_change":"2024-02-16T00:11:06.809034+0000","last_active":"2024-02-16T00:12:33.889237+0000","last_peered":"2024-02-16T00:12:33.889237+0000","last_clean":"2024-02-16T00:12:33.889237+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:12:33.889237+0000","last_undegraded":"2024-02-16T00:12:33.889237+0000","last_fullsized":"2024-02-16T00:12:33.889237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'44","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.193113+0000","last_change":"2024-02-16T00:11:08.814763+0000","last_active":"2024-02-16T00:12:35.193113+0000","last_peered":"2024-02-16T00:12:35.193113+0000","last_clean":"2024-02-16T00:12:35.193113+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:12:35.193113+0000","last_undegraded":"2024-02-16T00:12:35.193113+0000","last_fullsized":"2024-02-16T00:12:35.193113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:51:50.833249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829394+0000","last_change":"2024-02-16T00:11:10.819364+0000","last_active":"2024-02-16T00:11:51.829394+0000","last_peered":"2024-02-16T00:11:51.829394+0000","last_clean":"2024-02-16T00:11:51.829394+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:11:51.829394+0000","last_undegraded":"2024-02-16T00:11:51.829394+0000","last_fullsized":"2024-02-16T00:11:51.829394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841804+0000","last_change":"2024-02-16T00:11:12.831037+0000","last_active":"2024-02-16T00:11:50.841804+0000","last_peered":"2024-02-16T00:11:50.841804+0000","last_clean":"2024-02-16T00:11:50.841804+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:11:50.841804+0000","last_undegraded":"2024-02-16T00:11:50.841804+0000","last_fullsized":"2024-02-16T00:11:50.841804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:19.609072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621778+0000","last_change":"2024-02-16T00:11:04.813889+0000","last_active":"2024-02-16T00:12:27.621778+0000","last_peered":"2024-02-16T00:12:27.621778+0000","last_clean":"2024-02-16T00:12:27.621778+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:12:27.621778+0000","last_undegraded":"2024-02-16T00:12:27.621778+0000","last_fullsized":"2024-02-16T00:12:27.621778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843316+0000","last_change":"2024-02-16T00:11:02.816801+0000","last_active":"2024-02-16T00:11:50.843316+0000","last_peered":"2024-02-16T00:11:50.843316+0000","last_clean":"2024-02-16T00:11:50.843316+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:11:50.843316+0000","last_undegraded":"2024-02-16T00:11:50.843316+0000","last_fullsized":"2024-02-16T00:11:50.843316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:39:23.147302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.622044+0000","last_change":"2024-02-16T00:11:04.801950+0000","last_active":"2024-02-16T00:12:27.622044+0000","last_peered":"2024-02-16T00:12:27.622044+0000","last_clean":"2024-02-16T00:12:27.622044+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:12:27.622044+0000","last_undegraded":"2024-02-16T00:12:27.622044+0000","last_fullsized":"2024-02-16T00:12:27.622044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829889+0000","last_change":"2024-02-16T00:11:02.808413+0000","last_active":"2024-02-16T00:11:51.829889+0000","last_peered":"2024-02-16T00:11:51.829889+0000","last_clean":"2024-02-16T00:11:51.829889+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:11:51.829889+0000","last_undegraded":"2024-02-16T00:11:51.829889+0000","last_fullsized":"2024-02-16T00:11:51.829889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.447415+0000","last_change":"2024-02-16T00:11:04.810063+0000","last_active":"2024-02-16T00:12:33.447415+0000","last_peered":"2024-02-16T00:12:33.447415+0000","last_clean":"2024-02-16T00:12:33.447415+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:33.447415+0000","last_undegraded":"2024-02-16T00:12:33.447415+0000","last_fullsized":"2024-02-16T00:12:33.447415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:09.293991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840012+0000","last_change":"2024-02-16T00:11:02.824009+0000","last_active":"2024-02-16T00:11:50.840012+0000","last_peered":"2024-02-16T00:11:50.840012+0000","last_clean":"2024-02-16T00:11:50.840012+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:11:50.840012+0000","last_undegraded":"2024-02-16T00:11:50.840012+0000","last_fullsized":"2024-02-16T00:11:50.840012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:08.487886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831346+0000","last_change":"2024-02-16T00:11:04.801764+0000","last_active":"2024-02-16T00:11:51.831346+0000","last_peered":"2024-02-16T00:11:51.831346+0000","last_clean":"2024-02-16T00:11:51.831346+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:11:51.831346+0000","last_undegraded":"2024-02-16T00:11:51.831346+0000","last_fullsized":"2024-02-16T00:11:51.831346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830332+0000","last_change":"2024-02-16T00:11:02.797510+0000","last_active":"2024-02-16T00:11:51.830332+0000","last_peered":"2024-02-16T00:11:51.830332+0000","last_clean":"2024-02-16T00:11:51.830332+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:11:51.830332+0000","last_undegraded":"2024-02-16T00:11:51.830332+0000","last_fullsized":"2024-02-16T00:11:51.830332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830201+0000","last_change":"2024-02-16T00:11:04.810324+0000","last_active":"2024-02-16T00:11:51.830201+0000","last_peered":"2024-02-16T00:11:51.830201+0000","last_clean":"2024-02-16T00:11:51.830201+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:11:51.830201+0000","last_undegraded":"2024-02-16T00:11:51.830201+0000","last_fullsized":"2024-02-16T00:11:51.830201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831467+0000","last_change":"2024-02-16T00:11:02.801630+0000","last_active":"2024-02-16T00:11:51.831467+0000","last_peered":"2024-02-16T00:11:51.831467+0000","last_clean":"2024-02-16T00:11:51.831467+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:11:51.831467+0000","last_undegraded":"2024-02-16T00:11:51.831467+0000","last_fullsized":"2024-02-16T00:11:51.831467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.622174+0000","last_change":"2024-02-16T00:11:04.814522+0000","last_active":"2024-02-16T00:12:27.622174+0000","last_peered":"2024-02-16T00:12:27.622174+0000","last_clean":"2024-02-16T00:12:27.622174+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:12:27.622174+0000","last_undegraded":"2024-02-16T00:12:27.622174+0000","last_fullsized":"2024-02-16T00:12:27.622174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847060+0000","last_change":"2024-02-16T00:11:02.810745+0000","last_active":"2024-02-16T00:11:50.847060+0000","last_peered":"2024-02-16T00:11:50.847060+0000","last_clean":"2024-02-16T00:11:50.847060+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:11:50.847060+0000","last_undegraded":"2024-02-16T00:11:50.847060+0000","last_fullsized":"2024-02-16T00:11:50.847060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.454649+0000","last_change":"2024-02-16T00:11:04.797743+0000","last_active":"2024-02-16T00:12:33.454649+0000","last_peered":"2024-02-16T00:12:33.454649+0000","last_clean":"2024-02-16T00:12:33.454649+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:12:33.454649+0000","last_undegraded":"2024-02-16T00:12:33.454649+0000","last_fullsized":"2024-02-16T00:12:33.454649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842219+0000","last_change":"2024-02-16T00:11:02.815909+0000","last_active":"2024-02-16T00:11:50.842219+0000","last_peered":"2024-02-16T00:11:50.842219+0000","last_clean":"2024-02-16T00:11:50.842219+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:11:50.842219+0000","last_undegraded":"2024-02-16T00:11:50.842219+0000","last_fullsized":"2024-02-16T00:11:50.842219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:10:07.929045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621964+0000","last_change":"2024-02-16T00:11:04.796966+0000","last_active":"2024-02-16T00:12:27.621964+0000","last_peered":"2024-02-16T00:12:27.621964+0000","last_clean":"2024-02-16T00:12:27.621964+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:12:27.621964+0000","last_undegraded":"2024-02-16T00:12:27.621964+0000","last_fullsized":"2024-02-16T00:12:27.621964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830907+0000","last_change":"2024-02-16T00:11:02.797604+0000","last_active":"2024-02-16T00:11:51.830907+0000","last_peered":"2024-02-16T00:11:51.830907+0000","last_clean":"2024-02-16T00:11:51.830907+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:11:51.830907+0000","last_undegraded":"2024-02-16T00:11:51.830907+0000","last_fullsized":"2024-02-16T00:11:51.830907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455248+0000","last_change":"2024-02-16T00:11:04.802856+0000","last_active":"2024-02-16T00:12:33.455248+0000","last_peered":"2024-02-16T00:12:33.455248+0000","last_clean":"2024-02-16T00:12:33.455248+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:12:33.455248+0000","last_undegraded":"2024-02-16T00:12:33.455248+0000","last_fullsized":"2024-02-16T00:12:33.455248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839685+0000","last_change":"2024-02-16T00:11:02.820947+0000","last_active":"2024-02-16T00:11:50.839685+0000","last_peered":"2024-02-16T00:11:50.839685+0000","last_clean":"2024-02-16T00:11:50.839685+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:11:50.839685+0000","last_undegraded":"2024-02-16T00:11:50.839685+0000","last_fullsized":"2024-02-16T00:11:50.839685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:54:21.162020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.969475+0000","last_change":"2024-02-16T00:11:04.807293+0000","last_active":"2024-02-16T00:12:27.969475+0000","last_peered":"2024-02-16T00:12:27.969475+0000","last_clean":"2024-02-16T00:12:27.969475+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:12:27.969475+0000","last_undegraded":"2024-02-16T00:12:27.969475+0000","last_fullsized":"2024-02-16T00:12:27.969475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:11:41.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829008+0000","last_change":"2024-02-16T00:11:02.797276+0000","last_active":"2024-02-16T00:11:51.829008+0000","last_peered":"2024-02-16T00:11:51.829008+0000","last_clean":"2024-02-16T00:11:51.829008+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:11:51.829008+0000","last_undegraded":"2024-02-16T00:11:51.829008+0000","last_fullsized":"2024-02-16T00:11:51.829008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831793+0000","last_change":"2024-02-16T00:11:04.812406+0000","last_active":"2024-02-16T00:11:51.831793+0000","last_peered":"2024-02-16T00:11:51.831793+0000","last_clean":"2024-02-16T00:11:51.831793+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:11:51.831793+0000","last_undegraded":"2024-02-16T00:11:51.831793+0000","last_fullsized":"2024-02-16T00:11:51.831793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848044+0000","last_change":"2024-02-16T00:11:02.809533+0000","last_active":"2024-02-16T00:11:50.848044+0000","last_peered":"2024-02-16T00:11:50.848044+0000","last_clean":"2024-02-16T00:11:50.848044+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:11:50.848044+0000","last_undegraded":"2024-02-16T00:11:50.848044+0000","last_fullsized":"2024-02-16T00:11:50.848044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977493+0000","last_change":"2024-02-16T00:11:04.796459+0000","last_active":"2024-02-16T00:12:27.977493+0000","last_peered":"2024-02-16T00:12:27.977493+0000","last_clean":"2024-02-16T00:12:27.977493+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:12:27.977493+0000","last_undegraded":"2024-02-16T00:12:27.977493+0000","last_fullsized":"2024-02-16T00:12:27.977493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846930+0000","last_change":"2024-02-16T00:11:02.796731+0000","last_active":"2024-02-16T00:11:50.846930+0000","last_peered":"2024-02-16T00:11:50.846930+0000","last_clean":"2024-02-16T00:11:50.846930+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:11:50.846930+0000","last_undegraded":"2024-02-16T00:11:50.846930+0000","last_fullsized":"2024-02-16T00:11:50.846930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847992+0000","last_change":"2024-02-16T00:11:04.814979+0000","last_active":"2024-02-16T00:11:50.847992+0000","last_peered":"2024-02-16T00:11:50.847992+0000","last_clean":"2024-02-16T00:11:50.847992+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:11:50.847992+0000","last_undegraded":"2024-02-16T00:11:50.847992+0000","last_fullsized":"2024-02-16T00:11:50.847992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842495+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:11:50.842495+0000","last_peered":"2024-02-16T00:11:50.842495+0000","last_clean":"2024-02-16T00:11:50.842495+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:11:50.842495+0000","last_undegraded":"2024-02-16T00:11:50.842495+0000","last_fullsized":"2024-02-16T00:11:50.842495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:23.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848786+0000","last_change":"2024-02-16T00:11:04.803538+0000","last_active":"2024-02-16T00:11:50.848786+0000","last_peered":"2024-02-16T00:11:50.848786+0000","last_clean":"2024-02-16T00:11:50.848786+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:11:50.848786+0000","last_undegraded":"2024-02-16T00:11:50.848786+0000","last_fullsized":"2024-02-16T00:11:50.848786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845428+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:11:50.845428+0000","last_peered":"2024-02-16T00:11:50.845428+0000","last_clean":"2024-02-16T00:11:50.845428+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:11:50.845428+0000","last_undegraded":"2024-02-16T00:11:50.845428+0000","last_fullsized":"2024-02-16T00:11:50.845428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:32:06.466729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840720+0000","last_change":"2024-02-16T00:11:04.808274+0000","last_active":"2024-02-16T00:11:50.840720+0000","last_peered":"2024-02-16T00:11:50.840720+0000","last_clean":"2024-02-16T00:11:50.840720+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:11:50.840720+0000","last_undegraded":"2024-02-16T00:11:50.840720+0000","last_fullsized":"2024-02-16T00:11:50.840720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:36.866397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842918+0000","last_change":"2024-02-16T00:11:02.816585+0000","last_active":"2024-02-16T00:11:50.842918+0000","last_peered":"2024-02-16T00:11:50.842918+0000","last_clean":"2024-02-16T00:11:50.842918+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:11:50.842918+0000","last_undegraded":"2024-02-16T00:11:50.842918+0000","last_fullsized":"2024-02-16T00:11:50.842918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:44:38.429120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848582+0000","last_change":"2024-02-16T00:11:04.798394+0000","last_active":"2024-02-16T00:11:50.848582+0000","last_peered":"2024-02-16T00:11:50.848582+0000","last_clean":"2024-02-16T00:11:50.848582+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:11:50.848582+0000","last_undegraded":"2024-02-16T00:11:50.848582+0000","last_fullsized":"2024-02-16T00:11:50.848582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843889+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:11:50.843889+0000","last_peered":"2024-02-16T00:11:50.843889+0000","last_clean":"2024-02-16T00:11:50.843889+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:11:50.843889+0000","last_undegraded":"2024-02-16T00:11:50.843889+0000","last_fullsized":"2024-02-16T00:11:50.843889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:46:01.906683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840067+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:11:50.840067+0000","last_peered":"2024-02-16T00:11:50.840067+0000","last_clean":"2024-02-16T00:11:50.840067+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:11:50.840067+0000","last_undegraded":"2024-02-16T00:11:50.840067+0000","last_fullsized":"2024-02-16T00:11:50.840067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:53:04.771435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831386+0000","last_change":"2024-02-16T00:11:04.798473+0000","last_active":"2024-02-16T00:11:51.831386+0000","last_peered":"2024-02-16T00:11:51.831386+0000","last_clean":"2024-02-16T00:11:51.831386+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:11:51.831386+0000","last_undegraded":"2024-02-16T00:11:51.831386+0000","last_fullsized":"2024-02-16T00:11:51.831386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829317+0000","last_change":"2024-02-16T00:11:02.808092+0000","last_active":"2024-02-16T00:11:51.829317+0000","last_peered":"2024-02-16T00:11:51.829317+0000","last_clean":"2024-02-16T00:11:51.829317+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:11:51.829317+0000","last_undegraded":"2024-02-16T00:11:51.829317+0000","last_fullsized":"2024-02-16T00:11:51.829317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848635+0000","last_change":"2024-02-16T00:11:04.814263+0000","last_active":"2024-02-16T00:11:50.848635+0000","last_peered":"2024-02-16T00:11:50.848635+0000","last_clean":"2024-02-16T00:11:50.848635+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:11:50.848635+0000","last_undegraded":"2024-02-16T00:11:50.848635+0000","last_fullsized":"2024-02-16T00:11:50.848635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1820,"num_read_kb":1574,"num_write":771,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1463,"ondisk_log_size":1463,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705687,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.438},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.378}]},{"osd":1,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.24199999999999999}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.26100000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":966656,"data_stored":723796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.26000000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705687,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Feb 16 00:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":137181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.626},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:12:39.803 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.803 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.803 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.804 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.804 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.804 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.804 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.804 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.804 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.805 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.805 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.805 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.805 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.805 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.805 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.806 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.806 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.806 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.806 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.806 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.806 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.807 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.807 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.807 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.807 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.807 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.807 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.808 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.809 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.809 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.809 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.809 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.809 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.809 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.810 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.811 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.811 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.811 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.811 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.811 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.811 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.812 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.812 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.812 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.812 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.812 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.812 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.813 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.813 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.813 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.813 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.813 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.813 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.814 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.814 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.814 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.814 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.814 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.814 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.815 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.816 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.816 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.816 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.816 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.816 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.816 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.817 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.817 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.817 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.817 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.817 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.817 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.818 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.818 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.818 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.818 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.818 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.818 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.819 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.819 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.819 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.819 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.819 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.819 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.820 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.820 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.820 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.820 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.820 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.820 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.821 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.822 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.822 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.822 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.822 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.822 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.822 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.823 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.823 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.823 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.823 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.823 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.823 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.824 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.824 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.824 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.824 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.824 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.824 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.825 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.825 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.825 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.825 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.825 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.825 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.826 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.826 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.826 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.826 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.826 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.826 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.827 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.827 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.827 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.827 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.827 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.827 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.828 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.828 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.828 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.828 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.828 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.828 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.829 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.830 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.830 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.830 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.830 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.830 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.830 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.831 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.831 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.831 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.831 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.831 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.831 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.832 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.832 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.832 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.832 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.832 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.832 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.833 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.833 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.833 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.833 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.833 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.833 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.834 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.834 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.834 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.834 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.834 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.834 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.835 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.835 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.835 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.835 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.835 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.835 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.836 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.836 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.836 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.836 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.836 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.836 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.837 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.837 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.837 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.837 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.837 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.837 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.838 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.838 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.838 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.838 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.838 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.838 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.839 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.839 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.839 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.839 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.839 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.839 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.840 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.840 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.840 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.840 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.840 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.840 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.841 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.841 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.841 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.841 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.841 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.841 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.842 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.842 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.842 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.842 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.842 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.842 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.843 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.844 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.844 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.844 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.844 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.844 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.844 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.845 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.846 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.846 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.846 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:12:39.846 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T00:12:59.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:12:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.959+0000 7f7f573c8640 1 Processor -- start 2024-02-16T00:12:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.959+0000 7f7f573c8640 1 -- start start 2024-02-16T00:12:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.959+0000 7f7f573c8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f5006e110 0x7f7f5006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.959+0000 7f7f573c8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5006ecc0 con 0x7f7f50096ac0 2024-02-16T00:12:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.959+0000 7f7f573c8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f50067100 con 0x7f7f5006e110 2024-02-16T00:12:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.960+0000 7f7f54963640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f5006e110 0x7f7f5006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.960+0000 7f7f55164640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f50096ac0 0x7f7f5006ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38376/0 (socket says 172.21.15.2:38376) 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.960+0000 7f7f55164640 1 -- 172.21.15.2:0/3515832512 learned_addr learned my addr 172.21.15.2:0/3515832512 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.960+0000 7f7f54963640 1 -- 172.21.15.2:0/3515832512 >> v1:172.21.15.2:6789/0 conn(0x7f7f50096ac0 legacy=0x7f7f5006ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.960+0000 7f7f54963640 1 -- 172.21.15.2:0/3515832512 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50066b50 con 0x7f7f5006e110 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f54963640 1 --2- 172.21.15.2:0/3515832512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f5006d510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009720 tx=0x7f7f4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a7c4811a109112 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f47fff640 1 -- 172.21.15.2:0/3515832512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f4002e070 con 0x7f7f5006e110 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f47fff640 1 -- 172.21.15.2:0/3515832512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400316d0 con 0x7f7f5006e110 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f47fff640 1 -- 172.21.15.2:0/3515832512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f40031990 con 0x7f7f5006e110 2024-02-16T00:12:59.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f573c8640 1 -- 172.21.15.2:0/3515832512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 msgr2=0x7f7f5006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:12:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f573c8640 1 --2- 172.21.15.2:0/3515832512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f5006d510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009720 tx=0x7f7f4002b840 comp rx=0 tx=0).stop 2024-02-16T00:12:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f573c8640 1 -- 172.21.15.2:0/3515832512 shutdown_connections 2024-02-16T00:12:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f573c8640 1 --2- 172.21.15.2:0/3515832512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f5006d510 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:12:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f573c8640 1 -- 172.21.15.2:0/3515832512 >> 172.21.15.2:0/3515832512 conn(0x7f7f500974b0 msgr2=0x7f7f500978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:12:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.961+0000 7f7f573c8640 1 -- 172.21.15.2:0/3515832512 shutdown_connections 2024-02-16T00:12:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.962+0000 7f7f573c8640 1 -- 172.21.15.2:0/3515832512 wait complete. 2024-02-16T00:12:59.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.962+0000 7f7f573c8640 1 Processor -- start 2024-02-16T00:12:59.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.962+0000 7f7f573c8640 1 -- start start 2024-02-16T00:12:59.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f573c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f50090cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:59.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f573c8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50092f40 con 0x7f7f5006e110 2024-02-16T00:12:59.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f55164640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f50090cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f55164640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f50090cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58728/0 (socket says 172.21.15.2:58728) 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f55164640 1 -- 172.21.15.2:0/1054539766 learned_addr learned my addr 172.21.15.2:0/1054539766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f55164640 1 -- 172.21.15.2:0/1054539766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009400 con 0x7f7f5006e110 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f55164640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f50090cf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c4a0 tx=0x7f7f4c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f4c005c10 con 0x7f7f5006e110 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c005d70 con 0x7f7f5006e110 2024-02-16T00:12:59.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.963+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f50092c90 con 0x7f7f5006e110 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.964+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f4c0071a0 con 0x7f7f5006e110 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.964+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f50093920 con 0x7f7f5006e110 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.964+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7f4c007300 con 0x7f7f5006e110 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.965+0000 7f7f45ffb640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7f34037ea0 0x7f7f3403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.965+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f7f4c04a950 con 0x7f7f5006e110 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.965+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f500627b0 con 0x7f7f5006e110 2024-02-16T00:12:59.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.965+0000 7f7f54963640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7f34037ea0 0x7f7f3403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:12:59.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.965+0000 7f7f54963640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7f34037ea0 0x7f7f3403a360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f40036000 tx=0x7f7f40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:12:59.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:12:59.969+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f4c017070 con 0x7f7f5006e110 2024-02-16T00:13:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.146+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f50133a20 con 0x7f7f34037ea0 2024-02-16T00:13:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.163+0000 7f7f45ffb640 1 -- 172.21.15.2:0/1054539766 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666385 (secure 0 0 0) 0x7f7f40031c00 con 0x7f7f34037ea0 2024-02-16T00:13:00.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:13:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:13:00.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7f34037ea0 msgr2=0x7f7f3403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:00.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7f34037ea0 0x7f7f3403a360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f40036000 tx=0x7f7f40008030 comp rx=0 tx=0).stop 2024-02-16T00:13:00.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 msgr2=0x7f7f50090cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f50090cf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c4a0 tx=0x7f7f4c00c960 comp rx=0 tx=0).stop 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 shutdown_connections 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f7f34037ea0 0x7f7f3403a360 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 --2- 172.21.15.2:0/1054539766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5006e110 0x7f7f50090cf0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 >> 172.21.15.2:0/1054539766 conn(0x7f7f500974b0 msgr2=0x7f7f50130fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 shutdown_connections 2024-02-16T00:13:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:00.167+0000 7f7f573c8640 1 -- 172.21.15.2:0/1054539766 wait complete. 2024-02-16T00:13:00.183 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-16T00:12:59.704820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":245,"num_object_clones":0,"num_object_copies":491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":4297,"num_read_kb":3911,"num_write":1709,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4133,"ondisk_log_size":4133,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148212,"kb_used_data":2708,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339148,"statfs":{"total":386547056640,"available":386395287552,"internally_reserved":0,"allocated":2772992,"data_stored":1728024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003698"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842118+0000","last_change":"2024-02-16T00:11:02.804024+0000","last_active":"2024-02-16T00:11:50.842118+0000","last_peered":"2024-02-16T00:11:50.842118+0000","last_clean":"2024-02-16T00:11:50.842118+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:11:50.842118+0000","last_undegraded":"2024-02-16T00:11:50.842118+0000","last_fullsized":"2024-02-16T00:11:50.842118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848107+0000","last_change":"2024-02-16T00:11:04.803215+0000","last_active":"2024-02-16T00:11:50.848107+0000","last_peered":"2024-02-16T00:11:50.848107+0000","last_clean":"2024-02-16T00:11:50.848107+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:11:50.848107+0000","last_undegraded":"2024-02-16T00:11:50.848107+0000","last_fullsized":"2024-02-16T00:11:50.848107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831028+0000","last_change":"2024-02-16T00:11:02.797595+0000","last_active":"2024-02-16T00:11:51.831028+0000","last_peered":"2024-02-16T00:11:51.831028+0000","last_clean":"2024-02-16T00:11:51.831028+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:11:51.831028+0000","last_undegraded":"2024-02-16T00:11:51.831028+0000","last_fullsized":"2024-02-16T00:11:51.831028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840786+0000","last_change":"2024-02-16T00:11:04.803831+0000","last_active":"2024-02-16T00:11:50.840786+0000","last_peered":"2024-02-16T00:11:50.840786+0000","last_clean":"2024-02-16T00:11:50.840786+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:11:50.840786+0000","last_undegraded":"2024-02-16T00:11:50.840786+0000","last_fullsized":"2024-02-16T00:11:50.840786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845837+0000","last_change":"2024-02-16T00:11:02.815592+0000","last_active":"2024-02-16T00:11:50.845837+0000","last_peered":"2024-02-16T00:11:50.845837+0000","last_clean":"2024-02-16T00:11:50.845837+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:11:50.845837+0000","last_undegraded":"2024-02-16T00:11:50.845837+0000","last_fullsized":"2024-02-16T00:11:50.845837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840596+0000","last_change":"2024-02-16T00:11:04.807406+0000","last_active":"2024-02-16T00:11:50.840596+0000","last_peered":"2024-02-16T00:11:50.840596+0000","last_clean":"2024-02-16T00:11:50.840596+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:11:50.840596+0000","last_undegraded":"2024-02-16T00:11:50.840596+0000","last_fullsized":"2024-02-16T00:11:50.840596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843778+0000","last_change":"2024-02-16T00:11:02.818929+0000","last_active":"2024-02-16T00:11:50.843778+0000","last_peered":"2024-02-16T00:11:50.843778+0000","last_clean":"2024-02-16T00:11:50.843778+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:11:50.843778+0000","last_undegraded":"2024-02-16T00:11:50.843778+0000","last_fullsized":"2024-02-16T00:11:50.843778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621880+0000","last_change":"2024-02-16T00:11:04.807900+0000","last_active":"2024-02-16T00:12:27.621880+0000","last_peered":"2024-02-16T00:12:27.621880+0000","last_clean":"2024-02-16T00:12:27.621880+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:12:27.621880+0000","last_undegraded":"2024-02-16T00:12:27.621880+0000","last_fullsized":"2024-02-16T00:12:27.621880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841237+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:11:50.841237+0000","last_peered":"2024-02-16T00:11:50.841237+0000","last_clean":"2024-02-16T00:11:50.841237+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:11:50.841237+0000","last_undegraded":"2024-02-16T00:11:50.841237+0000","last_fullsized":"2024-02-16T00:11:50.841237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846859+0000","last_change":"2024-02-16T00:11:04.797530+0000","last_active":"2024-02-16T00:11:50.846859+0000","last_peered":"2024-02-16T00:11:50.846859+0000","last_clean":"2024-02-16T00:11:50.846859+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:11:50.846859+0000","last_undegraded":"2024-02-16T00:11:50.846859+0000","last_fullsized":"2024-02-16T00:11:50.846859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.445185+0000","last_change":"2024-02-16T00:11:02.803398+0000","last_active":"2024-02-16T00:12:33.445185+0000","last_peered":"2024-02-16T00:12:33.445185+0000","last_clean":"2024-02-16T00:12:33.445185+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:12:33.445185+0000","last_undegraded":"2024-02-16T00:12:33.445185+0000","last_fullsized":"2024-02-16T00:12:33.445185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844892+0000","last_change":"2024-02-16T00:11:04.809182+0000","last_active":"2024-02-16T00:11:50.844892+0000","last_peered":"2024-02-16T00:11:50.844892+0000","last_clean":"2024-02-16T00:11:50.844892+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:11:50.844892+0000","last_undegraded":"2024-02-16T00:11:50.844892+0000","last_fullsized":"2024-02-16T00:11:50.844892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840372+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:11:50.840372+0000","last_peered":"2024-02-16T00:11:50.840372+0000","last_clean":"2024-02-16T00:11:50.840372+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:11:50.840372+0000","last_undegraded":"2024-02-16T00:11:50.840372+0000","last_fullsized":"2024-02-16T00:11:50.840372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843259+0000","last_change":"2024-02-16T00:11:04.798579+0000","last_active":"2024-02-16T00:11:50.843259+0000","last_peered":"2024-02-16T00:11:50.843259+0000","last_clean":"2024-02-16T00:11:50.843259+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:11:50.843259+0000","last_undegraded":"2024-02-16T00:11:50.843259+0000","last_fullsized":"2024-02-16T00:11:50.843259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828950+0000","last_change":"2024-02-16T00:11:02.808083+0000","last_active":"2024-02-16T00:11:51.828950+0000","last_peered":"2024-02-16T00:11:51.828950+0000","last_clean":"2024-02-16T00:11:51.828950+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:11:51.828950+0000","last_undegraded":"2024-02-16T00:11:51.828950+0000","last_fullsized":"2024-02-16T00:11:51.828950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455531+0000","last_change":"2024-02-16T00:11:04.808709+0000","last_active":"2024-02-16T00:12:33.455531+0000","last_peered":"2024-02-16T00:12:33.455531+0000","last_clean":"2024-02-16T00:12:33.455531+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:12:33.455531+0000","last_undegraded":"2024-02-16T00:12:33.455531+0000","last_fullsized":"2024-02-16T00:12:33.455531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840623+0000","last_change":"2024-02-16T00:11:04.807676+0000","last_active":"2024-02-16T00:11:50.840623+0000","last_peered":"2024-02-16T00:11:50.840623+0000","last_clean":"2024-02-16T00:11:50.840623+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:11:50.840623+0000","last_undegraded":"2024-02-16T00:11:50.840623+0000","last_fullsized":"2024-02-16T00:11:50.840623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849734+0000","last_change":"2024-02-16T00:11:02.820441+0000","last_active":"2024-02-16T00:11:50.849734+0000","last_peered":"2024-02-16T00:11:50.849734+0000","last_clean":"2024-02-16T00:11:50.849734+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:11:50.849734+0000","last_undegraded":"2024-02-16T00:11:50.849734+0000","last_fullsized":"2024-02-16T00:11:50.849734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847722+0000","last_change":"2024-02-16T00:11:04.798908+0000","last_active":"2024-02-16T00:11:50.847722+0000","last_peered":"2024-02-16T00:11:50.847722+0000","last_clean":"2024-02-16T00:11:50.847722+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:11:50.847722+0000","last_undegraded":"2024-02-16T00:11:50.847722+0000","last_fullsized":"2024-02-16T00:11:50.847722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843079+0000","last_change":"2024-02-16T00:11:02.817331+0000","last_active":"2024-02-16T00:11:50.843079+0000","last_peered":"2024-02-16T00:11:50.843079+0000","last_clean":"2024-02-16T00:11:50.843079+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:11:50.843079+0000","last_undegraded":"2024-02-16T00:11:50.843079+0000","last_fullsized":"2024-02-16T00:11:50.843079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848285+0000","last_change":"2024-02-16T00:11:04.803702+0000","last_active":"2024-02-16T00:11:50.848285+0000","last_peered":"2024-02-16T00:11:50.848285+0000","last_clean":"2024-02-16T00:11:50.848285+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:11:50.848285+0000","last_undegraded":"2024-02-16T00:11:50.848285+0000","last_fullsized":"2024-02-16T00:11:50.848285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847224+0000","last_change":"2024-02-16T00:11:02.810700+0000","last_active":"2024-02-16T00:11:50.847224+0000","last_peered":"2024-02-16T00:11:50.847224+0000","last_clean":"2024-02-16T00:11:50.847224+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:11:50.847224+0000","last_undegraded":"2024-02-16T00:11:50.847224+0000","last_fullsized":"2024-02-16T00:11:50.847224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830842+0000","last_change":"2024-02-16T00:11:04.810242+0000","last_active":"2024-02-16T00:11:51.830842+0000","last_peered":"2024-02-16T00:11:51.830842+0000","last_clean":"2024-02-16T00:11:51.830842+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:11:51.830842+0000","last_undegraded":"2024-02-16T00:11:51.830842+0000","last_fullsized":"2024-02-16T00:11:51.830842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847410+0000","last_change":"2024-02-16T00:11:02.825186+0000","last_active":"2024-02-16T00:11:50.847410+0000","last_peered":"2024-02-16T00:11:50.847410+0000","last_clean":"2024-02-16T00:11:50.847410+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:11:50.847410+0000","last_undegraded":"2024-02-16T00:11:50.847410+0000","last_fullsized":"2024-02-16T00:11:50.847410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.978160+0000","last_change":"2024-02-16T00:11:04.812055+0000","last_active":"2024-02-16T00:12:27.978160+0000","last_peered":"2024-02-16T00:12:27.978160+0000","last_clean":"2024-02-16T00:12:27.978160+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:12:27.978160+0000","last_undegraded":"2024-02-16T00:12:27.978160+0000","last_fullsized":"2024-02-16T00:12:27.978160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830452+0000","last_change":"2024-02-16T00:11:02.797860+0000","last_active":"2024-02-16T00:11:51.830452+0000","last_peered":"2024-02-16T00:11:51.830452+0000","last_clean":"2024-02-16T00:11:51.830452+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:11:51.830452+0000","last_undegraded":"2024-02-16T00:11:51.830452+0000","last_fullsized":"2024-02-16T00:11:51.830452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977994+0000","last_change":"2024-02-16T00:11:04.797835+0000","last_active":"2024-02-16T00:12:27.977994+0000","last_peered":"2024-02-16T00:12:27.977994+0000","last_clean":"2024-02-16T00:12:27.977994+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:12:27.977994+0000","last_undegraded":"2024-02-16T00:12:27.977994+0000","last_fullsized":"2024-02-16T00:12:27.977994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840347+0000","last_change":"2024-02-16T00:11:02.817356+0000","last_active":"2024-02-16T00:11:50.840347+0000","last_peered":"2024-02-16T00:11:50.840347+0000","last_clean":"2024-02-16T00:11:50.840347+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:11:50.840347+0000","last_undegraded":"2024-02-16T00:11:50.840347+0000","last_fullsized":"2024-02-16T00:11:50.840347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'19","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.466452+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:33.466452+0000","last_peered":"2024-02-16T00:12:33.466452+0000","last_clean":"2024-02-16T00:12:33.466452+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:33.466452+0000","last_undegraded":"2024-02-16T00:12:33.466452+0000","last_fullsized":"2024-02-16T00:12:33.466452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842602+0000","last_change":"2024-02-16T00:11:04.804063+0000","last_active":"2024-02-16T00:11:50.842602+0000","last_peered":"2024-02-16T00:11:50.842602+0000","last_clean":"2024-02-16T00:11:50.842602+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:11:50.842602+0000","last_undegraded":"2024-02-16T00:11:50.842602+0000","last_fullsized":"2024-02-16T00:11:50.842602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840965+0000","last_change":"2024-02-16T00:11:02.823865+0000","last_active":"2024-02-16T00:11:50.840965+0000","last_peered":"2024-02-16T00:11:50.840965+0000","last_clean":"2024-02-16T00:11:50.840965+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:11:50.840965+0000","last_undegraded":"2024-02-16T00:11:50.840965+0000","last_fullsized":"2024-02-16T00:11:50.840965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.921943+0000","last_change":"2024-02-16T00:12:48.921969+0000","last_active":"2024-02-16T00:12:48.921943+0000","last_peered":"2024-02-16T00:12:48.921943+0000","last_clean":"2024-02-16T00:12:48.921943+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:12:48.921943+0000","last_undegraded":"2024-02-16T00:12:48.921943+0000","last_fullsized":"2024-02-16T00:12:48.921943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.921850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:24.218584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'48","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.004572+0000","last_change":"2024-02-16T00:12:45.004614+0000","last_active":"2024-02-16T00:12:45.004572+0000","last_peered":"2024-02-16T00:12:45.004572+0000","last_clean":"2024-02-16T00:12:45.004572+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:45.004572+0000","last_undegraded":"2024-02-16T00:12:45.004572+0000","last_fullsized":"2024-02-16T00:12:45.004572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.004490+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:25.382346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849631+0000","last_change":"2024-02-16T00:11:10.827632+0000","last_active":"2024-02-16T00:11:50.849631+0000","last_peered":"2024-02-16T00:11:50.849631+0000","last_clean":"2024-02-16T00:11:50.849631+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:11:50.849631+0000","last_undegraded":"2024-02-16T00:11:50.849631+0000","last_fullsized":"2024-02-16T00:11:50.849631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.765463+0000","last_change":"2024-02-16T00:11:12.835250+0000","last_active":"2024-02-16T00:12:27.765463+0000","last_peered":"2024-02-16T00:12:27.765463+0000","last_clean":"2024-02-16T00:12:27.765463+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:12:27.765463+0000","last_undegraded":"2024-02-16T00:12:27.765463+0000","last_fullsized":"2024-02-16T00:12:27.765463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.053263+0000","last_change":"2024-02-16T00:12:58.053290+0000","last_active":"2024-02-16T00:12:58.053263+0000","last_peered":"2024-02-16T00:12:58.053263+0000","last_clean":"2024-02-16T00:12:58.053263+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:12:58.053263+0000","last_undegraded":"2024-02-16T00:12:58.053263+0000","last_fullsized":"2024-02-16T00:12:58.053263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.053167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:43:59.274034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842918+0000","last_change":"2024-02-16T00:11:02.817929+0000","last_active":"2024-02-16T00:11:50.842918+0000","last_peered":"2024-02-16T00:11:50.842918+0000","last_clean":"2024-02-16T00:11:50.842918+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:11:50.842918+0000","last_undegraded":"2024-02-16T00:11:50.842918+0000","last_fullsized":"2024-02-16T00:11:50.842918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829944+0000","last_change":"2024-02-16T00:11:06.803389+0000","last_active":"2024-02-16T00:11:51.829944+0000","last_peered":"2024-02-16T00:11:51.829944+0000","last_clean":"2024-02-16T00:11:51.829944+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:11:51.829944+0000","last_undegraded":"2024-02-16T00:11:51.829944+0000","last_fullsized":"2024-02-16T00:11:51.829944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'16","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.427604+0000","last_change":"2024-02-16T00:12:43.427635+0000","last_active":"2024-02-16T00:12:43.427604+0000","last_peered":"2024-02-16T00:12:43.427604+0000","last_clean":"2024-02-16T00:12:43.427604+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:12:43.427604+0000","last_undegraded":"2024-02-16T00:12:43.427604+0000","last_fullsized":"2024-02-16T00:12:43.427604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.427524+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:38.476135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.502455+0000","last_change":"2024-02-16T00:12:46.502479+0000","last_active":"2024-02-16T00:12:46.502455+0000","last_peered":"2024-02-16T00:12:46.502455+0000","last_clean":"2024-02-16T00:12:46.502455+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:12:46.502455+0000","last_undegraded":"2024-02-16T00:12:46.502455+0000","last_fullsized":"2024-02-16T00:12:46.502455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.502371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:24.692093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828906+0000","last_change":"2024-02-16T00:11:12.828416+0000","last_active":"2024-02-16T00:11:51.828906+0000","last_peered":"2024-02-16T00:11:51.828906+0000","last_clean":"2024-02-16T00:11:51.828906+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:11:51.828906+0000","last_undegraded":"2024-02-16T00:11:51.828906+0000","last_fullsized":"2024-02-16T00:11:51.828906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844970+0000","last_change":"2024-02-16T00:11:04.803967+0000","last_active":"2024-02-16T00:11:50.844970+0000","last_peered":"2024-02-16T00:11:50.844970+0000","last_clean":"2024-02-16T00:11:50.844970+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:11:50.844970+0000","last_undegraded":"2024-02-16T00:11:50.844970+0000","last_fullsized":"2024-02-16T00:11:50.844970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839819+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:11:50.839819+0000","last_peered":"2024-02-16T00:11:50.839819+0000","last_clean":"2024-02-16T00:11:50.839819+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:11:50.839819+0000","last_undegraded":"2024-02-16T00:11:50.839819+0000","last_fullsized":"2024-02-16T00:11:50.839819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831773+0000","last_change":"2024-02-16T00:11:06.804875+0000","last_active":"2024-02-16T00:11:51.831773+0000","last_peered":"2024-02-16T00:11:51.831773+0000","last_clean":"2024-02-16T00:11:51.831773+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:11:51.831773+0000","last_undegraded":"2024-02-16T00:11:51.831773+0000","last_fullsized":"2024-02-16T00:11:51.831773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'29","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.157041+0000","last_change":"2024-02-16T00:12:51.157085+0000","last_active":"2024-02-16T00:12:51.157041+0000","last_peered":"2024-02-16T00:12:51.157041+0000","last_clean":"2024-02-16T00:12:51.157041+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:12:51.157041+0000","last_undegraded":"2024-02-16T00:12:51.157041+0000","last_fullsized":"2024-02-16T00:12:51.157041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.156949+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:01.821119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'243","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.256721+0000","last_change":"2024-02-16T00:11:10.830884+0000","last_active":"2024-02-16T00:12:35.256721+0000","last_peered":"2024-02-16T00:12:35.256721+0000","last_clean":"2024-02-16T00:12:35.256721+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:12:35.256721+0000","last_undegraded":"2024-02-16T00:12:35.256721+0000","last_fullsized":"2024-02-16T00:12:35.256721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.081956+0000","last_change":"2024-02-16T00:12:54.081981+0000","last_active":"2024-02-16T00:12:54.081956+0000","last_peered":"2024-02-16T00:12:54.081956+0000","last_clean":"2024-02-16T00:12:54.081956+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:12:54.081956+0000","last_undegraded":"2024-02-16T00:12:54.081956+0000","last_fullsized":"2024-02-16T00:12:54.081956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.081866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:20.234092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.456539+0000","last_change":"2024-02-16T00:11:04.803520+0000","last_active":"2024-02-16T00:12:33.456539+0000","last_peered":"2024-02-16T00:12:33.456539+0000","last_clean":"2024-02-16T00:12:33.456539+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:12:33.456539+0000","last_undegraded":"2024-02-16T00:12:33.456539+0000","last_fullsized":"2024-02-16T00:12:33.456539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847741+0000","last_change":"2024-02-16T00:11:02.820879+0000","last_active":"2024-02-16T00:11:50.847741+0000","last_peered":"2024-02-16T00:11:50.847741+0000","last_clean":"2024-02-16T00:11:50.847741+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:11:50.847741+0000","last_undegraded":"2024-02-16T00:11:50.847741+0000","last_fullsized":"2024-02-16T00:11:50.847741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.040554+0000","last_change":"2024-02-16T00:12:46.040576+0000","last_active":"2024-02-16T00:12:46.040554+0000","last_peered":"2024-02-16T00:12:46.040554+0000","last_clean":"2024-02-16T00:12:46.040554+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:12:46.040554+0000","last_undegraded":"2024-02-16T00:12:46.040554+0000","last_fullsized":"2024-02-16T00:12:46.040554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.040468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:29.717153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'41","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.243627+0000","last_change":"2024-02-16T00:12:49.243662+0000","last_active":"2024-02-16T00:12:49.243627+0000","last_peered":"2024-02-16T00:12:49.243627+0000","last_clean":"2024-02-16T00:12:49.243627+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:49.243627+0000","last_undegraded":"2024-02-16T00:12:49.243627+0000","last_fullsized":"2024-02-16T00:12:49.243627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.243531+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:44.292142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'243","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.916090+0000","last_change":"2024-02-16T00:12:42.916116+0000","last_active":"2024-02-16T00:12:42.916090+0000","last_peered":"2024-02-16T00:12:42.916090+0000","last_clean":"2024-02-16T00:12:42.916090+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:42.916090+0000","last_undegraded":"2024-02-16T00:12:42.916090+0000","last_fullsized":"2024-02-16T00:12:42.916090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.916005+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:53.580174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733569+0000","last_change":"2024-02-16T00:11:50.855956+0000","last_active":"2024-02-16T00:11:53.733569+0000","last_peered":"2024-02-16T00:11:53.733569+0000","last_clean":"2024-02-16T00:11:53.733569+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:11:53.733569+0000","last_undegraded":"2024-02-16T00:11:53.733569+0000","last_fullsized":"2024-02-16T00:11:53.733569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842284+0000","last_change":"2024-02-16T00:11:02.805831+0000","last_active":"2024-02-16T00:11:50.842284+0000","last_peered":"2024-02-16T00:11:50.842284+0000","last_clean":"2024-02-16T00:11:50.842284+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:11:50.842284+0000","last_undegraded":"2024-02-16T00:11:50.842284+0000","last_fullsized":"2024-02-16T00:11:50.842284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.525803+0000","last_change":"2024-02-16T00:12:48.525828+0000","last_active":"2024-02-16T00:12:48.525803+0000","last_peered":"2024-02-16T00:12:48.525803+0000","last_clean":"2024-02-16T00:12:48.525803+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:12:48.525803+0000","last_undegraded":"2024-02-16T00:12:48.525803+0000","last_fullsized":"2024-02-16T00:12:48.525803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.525719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:11.360728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'58","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.244076+0000","last_change":"2024-02-16T00:12:48.244124+0000","last_active":"2024-02-16T00:12:48.244076+0000","last_peered":"2024-02-16T00:12:48.244076+0000","last_clean":"2024-02-16T00:12:48.244076+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:48.244076+0000","last_undegraded":"2024-02-16T00:12:48.244076+0000","last_fullsized":"2024-02-16T00:12:48.244076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.243982+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:25.939262+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.931879+0000","last_change":"2024-02-16T00:12:46.931903+0000","last_active":"2024-02-16T00:12:46.931879+0000","last_peered":"2024-02-16T00:12:46.931879+0000","last_clean":"2024-02-16T00:12:46.931879+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:12:46.931879+0000","last_undegraded":"2024-02-16T00:12:46.931879+0000","last_fullsized":"2024-02-16T00:12:46.931879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.931775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:08:25.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.070338+0000","last_change":"2024-02-16T00:12:58.070398+0000","last_active":"2024-02-16T00:12:58.070338+0000","last_peered":"2024-02-16T00:12:58.070338+0000","last_clean":"2024-02-16T00:12:58.070338+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:58.070338+0000","last_undegraded":"2024-02-16T00:12:58.070338+0000","last_fullsized":"2024-02-16T00:12:58.070338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.070215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:35.924708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621778+0000","last_change":"2024-02-16T00:11:04.797488+0000","last_active":"2024-02-16T00:12:27.621778+0000","last_peered":"2024-02-16T00:12:27.621778+0000","last_clean":"2024-02-16T00:12:27.621778+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:12:27.621778+0000","last_undegraded":"2024-02-16T00:12:27.621778+0000","last_fullsized":"2024-02-16T00:12:27.621778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.966923+0000","last_change":"2024-02-16T00:11:02.815325+0000","last_active":"2024-02-16T00:12:27.966923+0000","last_peered":"2024-02-16T00:12:27.966923+0000","last_clean":"2024-02-16T00:12:27.966923+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:12:27.966923+0000","last_undegraded":"2024-02-16T00:12:27.966923+0000","last_fullsized":"2024-02-16T00:12:27.966923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.788745+0000","last_change":"2024-02-16T00:12:55.788791+0000","last_active":"2024-02-16T00:12:55.788745+0000","last_peered":"2024-02-16T00:12:55.788745+0000","last_clean":"2024-02-16T00:12:55.788745+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:12:55.788745+0000","last_undegraded":"2024-02-16T00:12:55.788745+0000","last_fullsized":"2024-02-16T00:12:55.788745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.788644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:03.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'41","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.074733+0000","last_change":"2024-02-16T00:12:43.074769+0000","last_active":"2024-02-16T00:12:43.074733+0000","last_peered":"2024-02-16T00:12:43.074733+0000","last_clean":"2024-02-16T00:12:43.074733+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:43.074733+0000","last_undegraded":"2024-02-16T00:12:43.074733+0000","last_fullsized":"2024-02-16T00:12:43.074733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.074645+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.611584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.938556+0000","last_change":"2024-02-16T00:12:40.938580+0000","last_active":"2024-02-16T00:12:40.938556+0000","last_peered":"2024-02-16T00:12:40.938556+0000","last_clean":"2024-02-16T00:12:40.938556+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:12:40.938556+0000","last_undegraded":"2024-02-16T00:12:40.938556+0000","last_fullsized":"2024-02-16T00:12:40.938556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.938464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:15:55.114937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.278055+0000","last_change":"2024-02-16T00:11:12.828694+0000","last_active":"2024-02-16T00:12:22.278055+0000","last_peered":"2024-02-16T00:12:22.278055+0000","last_clean":"2024-02-16T00:12:22.278055+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:12:22.278055+0000","last_undegraded":"2024-02-16T00:12:22.278055+0000","last_fullsized":"2024-02-16T00:12:22.278055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843376+0000","last_change":"2024-02-16T00:11:04.809981+0000","last_active":"2024-02-16T00:11:50.843376+0000","last_peered":"2024-02-16T00:11:50.843376+0000","last_clean":"2024-02-16T00:11:50.843376+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:11:50.843376+0000","last_undegraded":"2024-02-16T00:11:50.843376+0000","last_fullsized":"2024-02-16T00:11:50.843376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.624023+0000","last_change":"2024-02-16T00:11:02.815569+0000","last_active":"2024-02-16T00:12:27.624023+0000","last_peered":"2024-02-16T00:12:27.624023+0000","last_clean":"2024-02-16T00:12:27.624023+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:12:27.624023+0000","last_undegraded":"2024-02-16T00:12:27.624023+0000","last_fullsized":"2024-02-16T00:12:27.624023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831243+0000","last_change":"2024-02-16T00:11:06.806202+0000","last_active":"2024-02-16T00:11:51.831243+0000","last_peered":"2024-02-16T00:11:51.831243+0000","last_clean":"2024-02-16T00:11:51.831243+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:11:51.831243+0000","last_undegraded":"2024-02-16T00:11:51.831243+0000","last_fullsized":"2024-02-16T00:11:51.831243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'57","reported_seq":126,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.882837+0000","last_change":"2024-02-16T00:12:50.882918+0000","last_active":"2024-02-16T00:12:50.882837+0000","last_peered":"2024-02-16T00:12:50.882837+0000","last_clean":"2024-02-16T00:12:50.882837+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:50.882837+0000","last_undegraded":"2024-02-16T00:12:50.882837+0000","last_fullsized":"2024-02-16T00:12:50.882837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.882742+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:43.268496+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'243","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.962441+0000","last_change":"2024-02-16T00:12:43.962470+0000","last_active":"2024-02-16T00:12:43.962441+0000","last_peered":"2024-02-16T00:12:43.962441+0000","last_clean":"2024-02-16T00:12:43.962441+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:43.962441+0000","last_undegraded":"2024-02-16T00:12:43.962441+0000","last_fullsized":"2024-02-16T00:12:43.962441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.962355+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:22.152077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830363+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:11:51.830363+0000","last_peered":"2024-02-16T00:11:51.830363+0000","last_clean":"2024-02-16T00:11:51.830363+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:11:51.830363+0000","last_undegraded":"2024-02-16T00:11:51.830363+0000","last_fullsized":"2024-02-16T00:11:51.830363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844432+0000","last_change":"2024-02-16T00:11:04.799023+0000","last_active":"2024-02-16T00:11:50.844432+0000","last_peered":"2024-02-16T00:11:50.844432+0000","last_clean":"2024-02-16T00:11:50.844432+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:11:50.844432+0000","last_undegraded":"2024-02-16T00:11:50.844432+0000","last_fullsized":"2024-02-16T00:11:50.844432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842238+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:11:50.842238+0000","last_peered":"2024-02-16T00:11:50.842238+0000","last_clean":"2024-02-16T00:11:50.842238+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:11:50.842238+0000","last_undegraded":"2024-02-16T00:11:50.842238+0000","last_fullsized":"2024-02-16T00:11:50.842238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.773381+0000","last_change":"2024-02-16T00:12:56.773405+0000","last_active":"2024-02-16T00:12:56.773381+0000","last_peered":"2024-02-16T00:12:56.773381+0000","last_clean":"2024-02-16T00:12:56.773381+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:12:56.773381+0000","last_undegraded":"2024-02-16T00:12:56.773381+0000","last_fullsized":"2024-02-16T00:12:56.773381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.773281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:12.642357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'68","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.225708+0000","last_change":"2024-02-16T00:11:08.819445+0000","last_active":"2024-02-16T00:12:35.225708+0000","last_peered":"2024-02-16T00:12:35.225708+0000","last_clean":"2024-02-16T00:12:35.225708+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:12:35.225708+0000","last_undegraded":"2024-02-16T00:12:35.225708+0000","last_fullsized":"2024-02-16T00:12:35.225708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828741+0000","last_change":"2024-02-16T00:11:10.822009+0000","last_active":"2024-02-16T00:11:51.828741+0000","last_peered":"2024-02-16T00:11:51.828741+0000","last_clean":"2024-02-16T00:11:51.828741+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:11:51.828741+0000","last_undegraded":"2024-02-16T00:11:51.828741+0000","last_fullsized":"2024-02-16T00:11:51.828741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.461230+0000","last_change":"2024-02-16T00:11:12.823579+0000","last_active":"2024-02-16T00:12:33.461230+0000","last_peered":"2024-02-16T00:12:33.461230+0000","last_clean":"2024-02-16T00:12:33.461230+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:12:33.461230+0000","last_undegraded":"2024-02-16T00:12:33.461230+0000","last_fullsized":"2024-02-16T00:12:33.461230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.456235+0000","last_change":"2024-02-16T00:11:04.812522+0000","last_active":"2024-02-16T00:12:33.456235+0000","last_peered":"2024-02-16T00:12:33.456235+0000","last_clean":"2024-02-16T00:12:33.456235+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:12:33.456235+0000","last_undegraded":"2024-02-16T00:12:33.456235+0000","last_fullsized":"2024-02-16T00:12:33.456235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829810+0000","last_change":"2024-02-16T00:11:02.807400+0000","last_active":"2024-02-16T00:11:51.829810+0000","last_peered":"2024-02-16T00:11:51.829810+0000","last_clean":"2024-02-16T00:11:51.829810+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:11:51.829810+0000","last_undegraded":"2024-02-16T00:11:51.829810+0000","last_fullsized":"2024-02-16T00:11:51.829810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841688+0000","last_change":"2024-02-16T00:11:06.807251+0000","last_active":"2024-02-16T00:11:50.841688+0000","last_peered":"2024-02-16T00:11:50.841688+0000","last_clean":"2024-02-16T00:11:50.841688+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:11:50.841688+0000","last_undegraded":"2024-02-16T00:11:50.841688+0000","last_fullsized":"2024-02-16T00:11:50.841688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'44","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.465937+0000","last_change":"2024-02-16T00:12:45.465978+0000","last_active":"2024-02-16T00:12:45.465937+0000","last_peered":"2024-02-16T00:12:45.465937+0000","last_clean":"2024-02-16T00:12:45.465937+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:45.465937+0000","last_undegraded":"2024-02-16T00:12:45.465937+0000","last_fullsized":"2024-02-16T00:12:45.465937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.465843+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:56.130012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843539+0000","last_change":"2024-02-16T00:11:10.830170+0000","last_active":"2024-02-16T00:11:50.843539+0000","last_peered":"2024-02-16T00:11:50.843539+0000","last_clean":"2024-02-16T00:11:50.843539+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:11:50.843539+0000","last_undegraded":"2024-02-16T00:11:50.843539+0000","last_fullsized":"2024-02-16T00:11:50.843539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839259+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:11:50.839259+0000","last_peered":"2024-02-16T00:11:50.839259+0000","last_clean":"2024-02-16T00:11:50.839259+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:11:50.839259+0000","last_undegraded":"2024-02-16T00:11:50.839259+0000","last_fullsized":"2024-02-16T00:11:50.839259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733690+0000","last_change":"2024-02-16T00:11:50.852046+0000","last_active":"2024-02-16T00:11:53.733690+0000","last_peered":"2024-02-16T00:11:53.733690+0000","last_clean":"2024-02-16T00:11:53.733690+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:11:53.733690+0000","last_undegraded":"2024-02-16T00:11:53.733690+0000","last_fullsized":"2024-02-16T00:11:53.733690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840691+0000","last_change":"2024-02-16T00:11:02.816016+0000","last_active":"2024-02-16T00:11:50.840691+0000","last_peered":"2024-02-16T00:11:50.840691+0000","last_clean":"2024-02-16T00:11:50.840691+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:11:50.840691+0000","last_undegraded":"2024-02-16T00:11:50.840691+0000","last_fullsized":"2024-02-16T00:11:50.840691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733673+0000","last_change":"2024-02-16T00:11:50.848461+0000","last_active":"2024-02-16T00:11:53.733673+0000","last_peered":"2024-02-16T00:11:53.733673+0000","last_clean":"2024-02-16T00:11:53.733673+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:11:53.733673+0000","last_undegraded":"2024-02-16T00:11:53.733673+0000","last_fullsized":"2024-02-16T00:11:53.733673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'44","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.094330+0000","last_change":"2024-02-16T00:12:55.094367+0000","last_active":"2024-02-16T00:12:55.094330+0000","last_peered":"2024-02-16T00:12:55.094330+0000","last_clean":"2024-02-16T00:12:55.094330+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:55.094330+0000","last_undegraded":"2024-02-16T00:12:55.094330+0000","last_fullsized":"2024-02-16T00:12:55.094330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.094244+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:26.439070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'243","reported_seq":343,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.239434+0000","last_change":"2024-02-16T00:12:39.239506+0000","last_active":"2024-02-16T00:12:39.239434+0000","last_peered":"2024-02-16T00:12:39.239434+0000","last_clean":"2024-02-16T00:12:39.239434+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:39.239434+0000","last_undegraded":"2024-02-16T00:12:39.239434+0000","last_fullsized":"2024-02-16T00:12:39.239434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.239332+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:03:36.377883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.985572+0000","last_change":"2024-02-16T00:11:12.826412+0000","last_active":"2024-02-16T00:12:27.985572+0000","last_peered":"2024-02-16T00:12:27.985572+0000","last_clean":"2024-02-16T00:12:27.985572+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:12:27.985572+0000","last_undegraded":"2024-02-16T00:12:27.985572+0000","last_fullsized":"2024-02-16T00:12:27.985572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977445+0000","last_change":"2024-02-16T00:11:51.834792+0000","last_active":"2024-02-16T00:12:27.977445+0000","last_peered":"2024-02-16T00:12:27.977445+0000","last_clean":"2024-02-16T00:12:27.977445+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:12:27.977445+0000","last_undegraded":"2024-02-16T00:12:27.977445+0000","last_fullsized":"2024-02-16T00:12:27.977445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840898+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:11:50.840898+0000","last_peered":"2024-02-16T00:11:50.840898+0000","last_clean":"2024-02-16T00:11:50.840898+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:11:50.840898+0000","last_undegraded":"2024-02-16T00:11:50.840898+0000","last_fullsized":"2024-02-16T00:11:50.840898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'4","reported_seq":373,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.634630+0000","last_change":"2024-02-16T00:12:53.634659+0000","last_active":"2024-02-16T00:12:53.634630+0000","last_peered":"2024-02-16T00:12:53.634630+0000","last_clean":"2024-02-16T00:12:53.634630+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:53.634630+0000","last_undegraded":"2024-02-16T00:12:53.634630+0000","last_fullsized":"2024-02-16T00:12:53.634630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.634543+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:19.504192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844057+0000","last_change":"2024-02-16T00:11:08.818315+0000","last_active":"2024-02-16T00:11:50.844057+0000","last_peered":"2024-02-16T00:11:50.844057+0000","last_clean":"2024-02-16T00:11:50.844057+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:11:50.844057+0000","last_undegraded":"2024-02-16T00:11:50.844057+0000","last_fullsized":"2024-02-16T00:11:50.844057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'243","reported_seq":346,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.455920+0000","last_change":"2024-02-16T00:12:42.455945+0000","last_active":"2024-02-16T00:12:42.455920+0000","last_peered":"2024-02-16T00:12:42.455920+0000","last_clean":"2024-02-16T00:12:42.455920+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:42.455920+0000","last_undegraded":"2024-02-16T00:12:42.455920+0000","last_fullsized":"2024-02-16T00:12:42.455920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.455835+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.530697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.191598+0000","last_change":"2024-02-16T00:12:50.191670+0000","last_active":"2024-02-16T00:12:50.191598+0000","last_peered":"2024-02-16T00:12:50.191598+0000","last_clean":"2024-02-16T00:12:50.191598+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:12:50.191598+0000","last_undegraded":"2024-02-16T00:12:50.191598+0000","last_fullsized":"2024-02-16T00:12:50.191598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.191478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:27.718003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.850028+0000","last_change":"2024-02-16T00:11:04.814579+0000","last_active":"2024-02-16T00:11:50.850028+0000","last_peered":"2024-02-16T00:11:50.850028+0000","last_clean":"2024-02-16T00:11:50.850028+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:11:50.850028+0000","last_undegraded":"2024-02-16T00:11:50.850028+0000","last_fullsized":"2024-02-16T00:11:50.850028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840008+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:11:50.840008+0000","last_peered":"2024-02-16T00:11:50.840008+0000","last_clean":"2024-02-16T00:11:50.840008+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:11:50.840008+0000","last_undegraded":"2024-02-16T00:11:50.840008+0000","last_fullsized":"2024-02-16T00:11:50.840008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.956482+0000","last_change":"2024-02-16T00:12:47.956544+0000","last_active":"2024-02-16T00:12:47.956482+0000","last_peered":"2024-02-16T00:12:47.956482+0000","last_clean":"2024-02-16T00:12:47.956482+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:12:47.956482+0000","last_undegraded":"2024-02-16T00:12:47.956482+0000","last_fullsized":"2024-02-16T00:12:47.956482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.956387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:46.994810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.531363+0000","last_change":"2024-02-16T00:12:39.531411+0000","last_active":"2024-02-16T00:12:39.531363+0000","last_peered":"2024-02-16T00:12:39.531363+0000","last_clean":"2024-02-16T00:12:39.531363+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:39.531363+0000","last_undegraded":"2024-02-16T00:12:39.531363+0000","last_fullsized":"2024-02-16T00:12:39.531363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.531279+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:07.205098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.313209+0000","last_change":"2024-02-16T00:12:41.313251+0000","last_active":"2024-02-16T00:12:41.313209+0000","last_peered":"2024-02-16T00:12:41.313209+0000","last_clean":"2024-02-16T00:12:41.313209+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:12:41.313209+0000","last_undegraded":"2024-02-16T00:12:41.313209+0000","last_fullsized":"2024-02-16T00:12:41.313209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.313091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:34.237575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.463012+0000","last_change":"2024-02-16T00:11:12.820426+0000","last_active":"2024-02-16T00:12:33.463012+0000","last_peered":"2024-02-16T00:12:33.463012+0000","last_clean":"2024-02-16T00:12:33.463012+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:12:33.463012+0000","last_undegraded":"2024-02-16T00:12:33.463012+0000","last_fullsized":"2024-02-16T00:12:33.463012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.978862+0000","last_change":"2024-02-16T00:12:53.978897+0000","last_active":"2024-02-16T00:12:53.978862+0000","last_peered":"2024-02-16T00:12:53.978862+0000","last_clean":"2024-02-16T00:12:53.978862+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:53.978862+0000","last_undegraded":"2024-02-16T00:12:53.978862+0000","last_fullsized":"2024-02-16T00:12:53.978862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.978770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:56.425577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579155+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:12:38.579155+0000","last_peered":"2024-02-16T00:12:38.579155+0000","last_clean":"2024-02-16T00:12:38.579155+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:12:38.579155+0000","last_undegraded":"2024-02-16T00:12:38.579155+0000","last_fullsized":"2024-02-16T00:12:38.579155+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841337+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:11:50.841337+0000","last_peered":"2024-02-16T00:11:50.841337+0000","last_clean":"2024-02-16T00:11:50.841337+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:11:50.841337+0000","last_undegraded":"2024-02-16T00:11:50.841337+0000","last_fullsized":"2024-02-16T00:11:50.841337+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840185+0000","last_change":"2024-02-16T00:11:02.823633+0000","last_active":"2024-02-16T00:11:50.840185+0000","last_peered":"2024-02-16T00:11:50.840185+0000","last_clean":"2024-02-16T00:11:50.840185+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:11:50.840185+0000","last_undegraded":"2024-02-16T00:11:50.840185+0000","last_fullsized":"2024-02-16T00:11:50.840185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.646808+0000","last_change":"2024-02-16T00:12:55.646834+0000","last_active":"2024-02-16T00:12:55.646808+0000","last_peered":"2024-02-16T00:12:55.646808+0000","last_clean":"2024-02-16T00:12:55.646808+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:12:55.646808+0000","last_undegraded":"2024-02-16T00:12:55.646808+0000","last_fullsized":"2024-02-16T00:12:55.646808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.646719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:53.816935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.997662+0000","last_change":"2024-02-16T00:12:46.997697+0000","last_active":"2024-02-16T00:12:46.997662+0000","last_peered":"2024-02-16T00:12:46.997662+0000","last_clean":"2024-02-16T00:12:46.997662+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:46.997662+0000","last_undegraded":"2024-02-16T00:12:46.997662+0000","last_fullsized":"2024-02-16T00:12:46.997662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.997576+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:05:47.865804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.895085+0000","last_change":"2024-02-16T00:12:38.895106+0000","last_active":"2024-02-16T00:12:38.895085+0000","last_peered":"2024-02-16T00:12:38.895085+0000","last_clean":"2024-02-16T00:12:38.895085+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:12:38.895085+0000","last_undegraded":"2024-02-16T00:12:38.895085+0000","last_fullsized":"2024-02-16T00:12:38.895085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_clean_scrub_stamp":"2024-02-16T00:12:38.895009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:07.402769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.287831+0000","last_change":"2024-02-16T00:12:46.287858+0000","last_active":"2024-02-16T00:12:46.287831+0000","last_peered":"2024-02-16T00:12:46.287831+0000","last_clean":"2024-02-16T00:12:46.287831+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:46.287831+0000","last_undegraded":"2024-02-16T00:12:46.287831+0000","last_fullsized":"2024-02-16T00:12:46.287831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.287742+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:27.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.978173+0000","last_change":"2024-02-16T00:11:04.805947+0000","last_active":"2024-02-16T00:12:27.978173+0000","last_peered":"2024-02-16T00:12:27.978173+0000","last_clean":"2024-02-16T00:12:27.978173+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:12:27.978173+0000","last_undegraded":"2024-02-16T00:12:27.978173+0000","last_fullsized":"2024-02-16T00:12:27.978173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456516+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:12:39.456516+0000","last_peered":"2024-02-16T00:12:39.456516+0000","last_clean":"2024-02-16T00:12:39.456516+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:12:39.456516+0000","last_undegraded":"2024-02-16T00:12:39.456516+0000","last_fullsized":"2024-02-16T00:12:39.456516+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828809+0000","last_change":"2024-02-16T00:11:02.808396+0000","last_active":"2024-02-16T00:11:51.828809+0000","last_peered":"2024-02-16T00:11:51.828809+0000","last_clean":"2024-02-16T00:11:51.828809+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:11:51.828809+0000","last_undegraded":"2024-02-16T00:11:51.828809+0000","last_fullsized":"2024-02-16T00:11:51.828809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.850763+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:11:50.850763+0000","last_peered":"2024-02-16T00:11:50.850763+0000","last_clean":"2024-02-16T00:11:50.850763+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:11:50.850763+0000","last_undegraded":"2024-02-16T00:11:50.850763+0000","last_fullsized":"2024-02-16T00:11:50.850763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'263","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.503496+0000","last_change":"2024-02-16T00:12:41.503542+0000","last_active":"2024-02-16T00:12:41.503496+0000","last_peered":"2024-02-16T00:12:41.503496+0000","last_clean":"2024-02-16T00:12:41.503496+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:41.503496+0000","last_undegraded":"2024-02-16T00:12:41.503496+0000","last_fullsized":"2024-02-16T00:12:41.503496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'263","last_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_deep_scrub":"29'263","last_deep_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.503409+0000","objects_scrubbed":11,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:12.672777+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":329,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844110+0000","last_change":"2024-02-16T00:11:10.830058+0000","last_active":"2024-02-16T00:11:50.844110+0000","last_peered":"2024-02-16T00:11:50.844110+0000","last_clean":"2024-02-16T00:11:50.844110+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:11:50.844110+0000","last_undegraded":"2024-02-16T00:11:50.844110+0000","last_fullsized":"2024-02-16T00:11:50.844110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.763745+0000","last_change":"2024-02-16T00:11:12.828339+0000","last_active":"2024-02-16T00:12:27.763745+0000","last_peered":"2024-02-16T00:12:27.763745+0000","last_clean":"2024-02-16T00:12:27.763745+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:12:27.763745+0000","last_undegraded":"2024-02-16T00:12:27.763745+0000","last_fullsized":"2024-02-16T00:12:27.763745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831820+0000","last_change":"2024-02-16T00:11:04.803584+0000","last_active":"2024-02-16T00:11:51.831820+0000","last_peered":"2024-02-16T00:11:51.831820+0000","last_clean":"2024-02-16T00:11:51.831820+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:11:51.831820+0000","last_undegraded":"2024-02-16T00:11:51.831820+0000","last_fullsized":"2024-02-16T00:11:51.831820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020394+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:12:39.020394+0000","last_peered":"2024-02-16T00:12:39.020394+0000","last_clean":"2024-02-16T00:12:39.020394+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:12:39.020394+0000","last_undegraded":"2024-02-16T00:12:39.020394+0000","last_fullsized":"2024-02-16T00:12:39.020394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828577+0000","last_change":"2024-02-16T00:11:02.802061+0000","last_active":"2024-02-16T00:11:51.828577+0000","last_peered":"2024-02-16T00:11:51.828577+0000","last_clean":"2024-02-16T00:11:51.828577+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:11:51.828577+0000","last_undegraded":"2024-02-16T00:11:51.828577+0000","last_fullsized":"2024-02-16T00:11:51.828577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841809+0000","last_change":"2024-02-16T00:11:06.803264+0000","last_active":"2024-02-16T00:11:50.841809+0000","last_peered":"2024-02-16T00:11:50.841809+0000","last_clean":"2024-02-16T00:11:50.841809+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:11:50.841809+0000","last_undegraded":"2024-02-16T00:11:50.841809+0000","last_fullsized":"2024-02-16T00:11:50.841809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.284700+0000","last_change":"2024-02-16T00:12:47.284740+0000","last_active":"2024-02-16T00:12:47.284700+0000","last_peered":"2024-02-16T00:12:47.284700+0000","last_clean":"2024-02-16T00:12:47.284700+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:47.284700+0000","last_undegraded":"2024-02-16T00:12:47.284700+0000","last_fullsized":"2024-02-16T00:12:47.284700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.284612+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:18.453979+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.908399+0000","last_change":"2024-02-16T00:12:39.908420+0000","last_active":"2024-02-16T00:12:39.908399+0000","last_peered":"2024-02-16T00:12:39.908399+0000","last_clean":"2024-02-16T00:12:39.908399+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:12:39.908399+0000","last_undegraded":"2024-02-16T00:12:39.908399+0000","last_fullsized":"2024-02-16T00:12:39.908399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.908319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:17.603599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840100+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:11:50.840100+0000","last_peered":"2024-02-16T00:11:50.840100+0000","last_clean":"2024-02-16T00:11:50.840100+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:11:50.840100+0000","last_undegraded":"2024-02-16T00:11:50.840100+0000","last_fullsized":"2024-02-16T00:11:50.840100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.832000+0000","last_change":"2024-02-16T00:11:04.801512+0000","last_active":"2024-02-16T00:11:51.832000+0000","last_peered":"2024-02-16T00:11:51.832000+0000","last_clean":"2024-02-16T00:11:51.832000+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:11:51.832000+0000","last_undegraded":"2024-02-16T00:11:51.832000+0000","last_fullsized":"2024-02-16T00:11:51.832000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456538+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:12:39.456538+0000","last_peered":"2024-02-16T00:12:39.456538+0000","last_clean":"2024-02-16T00:12:39.456538+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:12:39.456538+0000","last_undegraded":"2024-02-16T00:12:39.456538+0000","last_fullsized":"2024-02-16T00:12:39.456538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844284+0000","last_change":"2024-02-16T00:11:02.811825+0000","last_active":"2024-02-16T00:11:50.844284+0000","last_peered":"2024-02-16T00:11:50.844284+0000","last_clean":"2024-02-16T00:11:50.844284+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:11:50.844284+0000","last_undegraded":"2024-02-16T00:11:50.844284+0000","last_fullsized":"2024-02-16T00:11:50.844284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733703+0000","last_change":"2024-02-16T00:11:50.851092+0000","last_active":"2024-02-16T00:11:53.733703+0000","last_peered":"2024-02-16T00:11:53.733703+0000","last_clean":"2024-02-16T00:11:53.733703+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:11:53.733703+0000","last_undegraded":"2024-02-16T00:11:53.733703+0000","last_fullsized":"2024-02-16T00:11:53.733703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.935964+0000","last_change":"2024-02-16T00:12:52.935999+0000","last_active":"2024-02-16T00:12:52.935964+0000","last_peered":"2024-02-16T00:12:52.935964+0000","last_clean":"2024-02-16T00:12:52.935964+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:12:52.935964+0000","last_undegraded":"2024-02-16T00:12:52.935964+0000","last_fullsized":"2024-02-16T00:12:52.935964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.935867+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:29.245202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843831+0000","last_change":"2024-02-16T00:11:10.829728+0000","last_active":"2024-02-16T00:11:50.843831+0000","last_peered":"2024-02-16T00:11:50.843831+0000","last_clean":"2024-02-16T00:11:50.843831+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:11:50.843831+0000","last_undegraded":"2024-02-16T00:11:50.843831+0000","last_fullsized":"2024-02-16T00:11:50.843831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848782+0000","last_change":"2024-02-16T00:11:12.835325+0000","last_active":"2024-02-16T00:11:50.848782+0000","last_peered":"2024-02-16T00:11:50.848782+0000","last_clean":"2024-02-16T00:11:50.848782+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:11:50.848782+0000","last_undegraded":"2024-02-16T00:11:50.848782+0000","last_fullsized":"2024-02-16T00:11:50.848782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.622182+0000","last_change":"2024-02-16T00:11:04.814208+0000","last_active":"2024-02-16T00:12:27.622182+0000","last_peered":"2024-02-16T00:12:27.622182+0000","last_clean":"2024-02-16T00:12:27.622182+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:12:27.622182+0000","last_undegraded":"2024-02-16T00:12:27.622182+0000","last_fullsized":"2024-02-16T00:12:27.622182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841468+0000","last_change":"2024-02-16T00:11:02.805928+0000","last_active":"2024-02-16T00:11:50.841468+0000","last_peered":"2024-02-16T00:11:50.841468+0000","last_clean":"2024-02-16T00:11:50.841468+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:11:50.841468+0000","last_undegraded":"2024-02-16T00:11:50.841468+0000","last_fullsized":"2024-02-16T00:11:50.841468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.827774+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:11:51.827774+0000","last_peered":"2024-02-16T00:11:51.827774+0000","last_clean":"2024-02-16T00:11:51.827774+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:11:51.827774+0000","last_undegraded":"2024-02-16T00:11:51.827774+0000","last_fullsized":"2024-02-16T00:11:51.827774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.830827+0000","last_change":"2024-02-16T00:12:53.830866+0000","last_active":"2024-02-16T00:12:53.830827+0000","last_peered":"2024-02-16T00:12:53.830827+0000","last_clean":"2024-02-16T00:12:53.830827+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:12:53.830827+0000","last_undegraded":"2024-02-16T00:12:53.830827+0000","last_fullsized":"2024-02-16T00:12:53.830827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.830730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:52.000946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'82","reported_seq":169,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.898340+0000","last_change":"2024-02-16T00:12:49.898405+0000","last_active":"2024-02-16T00:12:49.898340+0000","last_peered":"2024-02-16T00:12:49.898340+0000","last_clean":"2024-02-16T00:12:49.898340+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:49.898340+0000","last_undegraded":"2024-02-16T00:12:49.898340+0000","last_fullsized":"2024-02-16T00:12:49.898340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.898247+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:43:05.900172+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":88,"num_read_kb":74,"num_write":40,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.271687+0000","last_change":"2024-02-16T00:12:40.271734+0000","last_active":"2024-02-16T00:12:40.271687+0000","last_peered":"2024-02-16T00:12:40.271687+0000","last_clean":"2024-02-16T00:12:40.271687+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:12:40.271687+0000","last_undegraded":"2024-02-16T00:12:40.271687+0000","last_fullsized":"2024-02-16T00:12:40.271687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.271589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:58.621135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.987291+0000","last_change":"2024-02-16T00:11:12.822048+0000","last_active":"2024-02-16T00:12:27.987291+0000","last_peered":"2024-02-16T00:12:27.987291+0000","last_clean":"2024-02-16T00:12:27.987291+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:12:27.987291+0000","last_undegraded":"2024-02-16T00:12:27.987291+0000","last_fullsized":"2024-02-16T00:12:27.987291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847027+0000","last_change":"2024-02-16T00:11:04.814786+0000","last_active":"2024-02-16T00:11:50.847027+0000","last_peered":"2024-02-16T00:11:50.847027+0000","last_clean":"2024-02-16T00:11:50.847027+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:11:50.847027+0000","last_undegraded":"2024-02-16T00:11:50.847027+0000","last_fullsized":"2024-02-16T00:11:50.847027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831429+0000","last_change":"2024-02-16T00:11:02.801240+0000","last_active":"2024-02-16T00:11:51.831429+0000","last_peered":"2024-02-16T00:11:51.831429+0000","last_clean":"2024-02-16T00:11:51.831429+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:11:51.831429+0000","last_undegraded":"2024-02-16T00:11:51.831429+0000","last_fullsized":"2024-02-16T00:11:51.831429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846946+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:11:50.846946+0000","last_peered":"2024-02-16T00:11:50.846946+0000","last_clean":"2024-02-16T00:11:50.846946+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:11:50.846946+0000","last_undegraded":"2024-02-16T00:11:50.846946+0000","last_fullsized":"2024-02-16T00:11:50.846946+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.038118+0000","last_change":"2024-02-16T00:12:44.038166+0000","last_active":"2024-02-16T00:12:44.038118+0000","last_peered":"2024-02-16T00:12:44.038118+0000","last_clean":"2024-02-16T00:12:44.038118+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:12:44.038118+0000","last_undegraded":"2024-02-16T00:12:44.038118+0000","last_fullsized":"2024-02-16T00:12:44.038118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.038018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:35.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'28","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.546644+0000","last_change":"2024-02-16T00:12:40.546695+0000","last_active":"2024-02-16T00:12:40.546644+0000","last_peered":"2024-02-16T00:12:40.546644+0000","last_clean":"2024-02-16T00:12:40.546644+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:12:40.546644+0000","last_undegraded":"2024-02-16T00:12:40.546644+0000","last_fullsized":"2024-02-16T00:12:40.546644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.546560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:21.906524+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'243","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.683152+0000","last_change":"2024-02-16T00:12:54.683178+0000","last_active":"2024-02-16T00:12:54.683152+0000","last_peered":"2024-02-16T00:12:54.683152+0000","last_clean":"2024-02-16T00:12:54.683152+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:54.683152+0000","last_undegraded":"2024-02-16T00:12:54.683152+0000","last_fullsized":"2024-02-16T00:12:54.683152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.683065+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:10.032872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842508+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:11:50.842508+0000","last_peered":"2024-02-16T00:11:50.842508+0000","last_clean":"2024-02-16T00:11:50.842508+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:11:50.842508+0000","last_undegraded":"2024-02-16T00:11:50.842508+0000","last_fullsized":"2024-02-16T00:11:50.842508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.036852+0000","last_change":"2024-02-16T00:12:56.036881+0000","last_active":"2024-02-16T00:12:56.036852+0000","last_peered":"2024-02-16T00:12:56.036852+0000","last_clean":"2024-02-16T00:12:56.036852+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:56.036852+0000","last_undegraded":"2024-02-16T00:12:56.036852+0000","last_fullsized":"2024-02-16T00:12:56.036852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.036766+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:37:08.513561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844392+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:11:50.844392+0000","last_peered":"2024-02-16T00:11:50.844392+0000","last_clean":"2024-02-16T00:11:50.844392+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:11:50.844392+0000","last_undegraded":"2024-02-16T00:11:50.844392+0000","last_fullsized":"2024-02-16T00:11:50.844392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828261+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:11:51.828261+0000","last_peered":"2024-02-16T00:11:51.828261+0000","last_clean":"2024-02-16T00:11:51.828261+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:11:51.828261+0000","last_undegraded":"2024-02-16T00:11:51.828261+0000","last_fullsized":"2024-02-16T00:11:51.828261+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.031714+0000","last_change":"2024-02-16T00:12:42.031737+0000","last_active":"2024-02-16T00:12:42.031714+0000","last_peered":"2024-02-16T00:12:42.031714+0000","last_clean":"2024-02-16T00:12:42.031714+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:12:42.031714+0000","last_undegraded":"2024-02-16T00:12:42.031714+0000","last_fullsized":"2024-02-16T00:12:42.031714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.031605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:03.714051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'16","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840484+0000","last_change":"2024-02-16T00:11:08.814729+0000","last_active":"2024-02-16T00:11:50.840484+0000","last_peered":"2024-02-16T00:11:50.840484+0000","last_clean":"2024-02-16T00:11:50.840484+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:11:50.840484+0000","last_undegraded":"2024-02-16T00:11:50.840484+0000","last_fullsized":"2024-02-16T00:11:50.840484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'243","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.867259+0000","last_change":"2024-02-16T00:12:50.867290+0000","last_active":"2024-02-16T00:12:50.867259+0000","last_peered":"2024-02-16T00:12:50.867259+0000","last_clean":"2024-02-16T00:12:50.867259+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:50.867259+0000","last_undegraded":"2024-02-16T00:12:50.867259+0000","last_fullsized":"2024-02-16T00:12:50.867259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.867173+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:57.352373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'13","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.279844+0000","last_change":"2024-02-16T00:11:12.832931+0000","last_active":"2024-02-16T00:12:22.279844+0000","last_peered":"2024-02-16T00:12:22.279844+0000","last_clean":"2024-02-16T00:12:22.279844+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:12:22.279844+0000","last_undegraded":"2024-02-16T00:12:22.279844+0000","last_fullsized":"2024-02-16T00:12:22.279844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455847+0000","last_change":"2024-02-16T00:11:04.809323+0000","last_active":"2024-02-16T00:12:33.455847+0000","last_peered":"2024-02-16T00:12:33.455847+0000","last_clean":"2024-02-16T00:12:33.455847+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:12:33.455847+0000","last_undegraded":"2024-02-16T00:12:33.455847+0000","last_fullsized":"2024-02-16T00:12:33.455847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849445+0000","last_change":"2024-02-16T00:11:02.796859+0000","last_active":"2024-02-16T00:11:50.849445+0000","last_peered":"2024-02-16T00:11:50.849445+0000","last_clean":"2024-02-16T00:11:50.849445+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:11:50.849445+0000","last_undegraded":"2024-02-16T00:11:50.849445+0000","last_fullsized":"2024-02-16T00:11:50.849445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843672+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:11:50.843672+0000","last_peered":"2024-02-16T00:11:50.843672+0000","last_clean":"2024-02-16T00:11:50.843672+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:11:50.843672+0000","last_undegraded":"2024-02-16T00:11:50.843672+0000","last_fullsized":"2024-02-16T00:11:50.843672+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.021867+0000","last_change":"2024-02-16T00:12:41.021889+0000","last_active":"2024-02-16T00:12:41.021867+0000","last_peered":"2024-02-16T00:12:41.021867+0000","last_clean":"2024-02-16T00:12:41.021867+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:12:41.021867+0000","last_undegraded":"2024-02-16T00:12:41.021867+0000","last_fullsized":"2024-02-16T00:12:41.021867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.021775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:07.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'97","reported_seq":195,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.110999+0000","last_change":"2024-02-16T00:12:52.111041+0000","last_active":"2024-02-16T00:12:52.110999+0000","last_peered":"2024-02-16T00:12:52.110999+0000","last_clean":"2024-02-16T00:12:52.110999+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:52.110999+0000","last_undegraded":"2024-02-16T00:12:52.110999+0000","last_fullsized":"2024-02-16T00:12:52.110999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'97","last_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_deep_scrub":"29'97","last_deep_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.110898+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:30.300620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829943+0000","last_change":"2024-02-16T00:11:10.825204+0000","last_active":"2024-02-16T00:11:51.829943+0000","last_peered":"2024-02-16T00:11:51.829943+0000","last_clean":"2024-02-16T00:11:51.829943+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:11:51.829943+0000","last_undegraded":"2024-02-16T00:11:51.829943+0000","last_fullsized":"2024-02-16T00:11:51.829943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845966+0000","last_change":"2024-02-16T00:11:12.825945+0000","last_active":"2024-02-16T00:11:50.845966+0000","last_peered":"2024-02-16T00:11:50.845966+0000","last_clean":"2024-02-16T00:11:50.845966+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:11:50.845966+0000","last_undegraded":"2024-02-16T00:11:50.845966+0000","last_fullsized":"2024-02-16T00:11:50.845966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.453322+0000","last_change":"2024-02-16T00:11:12.826512+0000","last_active":"2024-02-16T00:12:33.453322+0000","last_peered":"2024-02-16T00:12:33.453322+0000","last_clean":"2024-02-16T00:12:33.453322+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:12:33.453322+0000","last_undegraded":"2024-02-16T00:12:33.453322+0000","last_fullsized":"2024-02-16T00:12:33.453322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977809+0000","last_change":"2024-02-16T00:11:04.810868+0000","last_active":"2024-02-16T00:12:27.977809+0000","last_peered":"2024-02-16T00:12:27.977809+0000","last_clean":"2024-02-16T00:12:27.977809+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:12:27.977809+0000","last_undegraded":"2024-02-16T00:12:27.977809+0000","last_fullsized":"2024-02-16T00:12:27.977809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842340+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:11:50.842340+0000","last_peered":"2024-02-16T00:11:50.842340+0000","last_clean":"2024-02-16T00:11:50.842340+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:11:50.842340+0000","last_undegraded":"2024-02-16T00:11:50.842340+0000","last_fullsized":"2024-02-16T00:11:50.842340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"29'2","reported_seq":203,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.629013+0000","last_change":"2024-02-16T00:12:52.629040+0000","last_active":"2024-02-16T00:12:52.629013+0000","last_peered":"2024-02-16T00:12:52.629013+0000","last_clean":"2024-02-16T00:12:52.629013+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:52.629013+0000","last_undegraded":"2024-02-16T00:12:52.629013+0000","last_fullsized":"2024-02-16T00:12:52.629013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.628926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:49.990836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'39","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.178689+0000","last_change":"2024-02-16T00:11:08.817056+0000","last_active":"2024-02-16T00:12:35.178689+0000","last_peered":"2024-02-16T00:12:35.178689+0000","last_clean":"2024-02-16T00:12:35.178689+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:12:35.178689+0000","last_undegraded":"2024-02-16T00:12:35.178689+0000","last_fullsized":"2024-02-16T00:12:35.178689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840251+0000","last_change":"2024-02-16T00:11:10.831264+0000","last_active":"2024-02-16T00:11:50.840251+0000","last_peered":"2024-02-16T00:11:50.840251+0000","last_clean":"2024-02-16T00:11:50.840251+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:11:50.840251+0000","last_undegraded":"2024-02-16T00:11:50.840251+0000","last_fullsized":"2024-02-16T00:11:50.840251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830204+0000","last_change":"2024-02-16T00:11:12.819458+0000","last_active":"2024-02-16T00:11:51.830204+0000","last_peered":"2024-02-16T00:11:51.830204+0000","last_clean":"2024-02-16T00:11:51.830204+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:11:51.830204+0000","last_undegraded":"2024-02-16T00:11:51.830204+0000","last_fullsized":"2024-02-16T00:11:51.830204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733630+0000","last_change":"2024-02-16T00:11:50.857588+0000","last_active":"2024-02-16T00:11:53.733630+0000","last_peered":"2024-02-16T00:11:53.733630+0000","last_clean":"2024-02-16T00:11:53.733630+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:11:53.733630+0000","last_undegraded":"2024-02-16T00:11:53.733630+0000","last_fullsized":"2024-02-16T00:11:53.733630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841583+0000","last_change":"2024-02-16T00:11:02.805825+0000","last_active":"2024-02-16T00:11:50.841583+0000","last_peered":"2024-02-16T00:11:50.841583+0000","last_clean":"2024-02-16T00:11:50.841583+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:11:50.841583+0000","last_undegraded":"2024-02-16T00:11:50.841583+0000","last_fullsized":"2024-02-16T00:11:50.841583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.045389+0000","last_change":"2024-02-16T00:12:40.045412+0000","last_active":"2024-02-16T00:12:40.045389+0000","last_peered":"2024-02-16T00:12:40.045389+0000","last_clean":"2024-02-16T00:12:40.045389+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:12:40.045389+0000","last_undegraded":"2024-02-16T00:12:40.045389+0000","last_fullsized":"2024-02-16T00:12:40.045389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.045296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:50.821845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.941059+0000","last_change":"2024-02-16T00:12:45.941093+0000","last_active":"2024-02-16T00:12:45.941059+0000","last_peered":"2024-02-16T00:12:45.941059+0000","last_clean":"2024-02-16T00:12:45.941059+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:45.941059+0000","last_undegraded":"2024-02-16T00:12:45.941059+0000","last_fullsized":"2024-02-16T00:12:45.941059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.940956+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:12.093182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.279152+0000","last_change":"2024-02-16T00:12:43.279177+0000","last_active":"2024-02-16T00:12:43.279152+0000","last_peered":"2024-02-16T00:12:43.279152+0000","last_clean":"2024-02-16T00:12:43.279152+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:12:43.279152+0000","last_undegraded":"2024-02-16T00:12:43.279152+0000","last_fullsized":"2024-02-16T00:12:43.279152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.279059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:05.341803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830302+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830302+0000","last_peered":"2024-02-16T00:11:51.830302+0000","last_clean":"2024-02-16T00:11:51.830302+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830302+0000","last_undegraded":"2024-02-16T00:11:51.830302+0000","last_fullsized":"2024-02-16T00:11:51.830302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455753+0000","last_change":"2024-02-16T00:11:04.801132+0000","last_active":"2024-02-16T00:12:33.455753+0000","last_peered":"2024-02-16T00:12:33.455753+0000","last_clean":"2024-02-16T00:12:33.455753+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:12:33.455753+0000","last_undegraded":"2024-02-16T00:12:33.455753+0000","last_fullsized":"2024-02-16T00:12:33.455753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842156+0000","last_change":"2024-02-16T00:11:02.815585+0000","last_active":"2024-02-16T00:11:50.842156+0000","last_peered":"2024-02-16T00:11:50.842156+0000","last_clean":"2024-02-16T00:11:50.842156+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:11:50.842156+0000","last_undegraded":"2024-02-16T00:11:50.842156+0000","last_fullsized":"2024-02-16T00:11:50.842156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.057517+0000","last_change":"2024-02-16T00:12:56.057565+0000","last_active":"2024-02-16T00:12:56.057517+0000","last_peered":"2024-02-16T00:12:56.057517+0000","last_clean":"2024-02-16T00:12:56.057517+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:12:56.057517+0000","last_undegraded":"2024-02-16T00:12:56.057517+0000","last_fullsized":"2024-02-16T00:12:56.057517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.057413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:26.439361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.803036+0000","last_change":"2024-02-16T00:12:52.803076+0000","last_active":"2024-02-16T00:12:52.803036+0000","last_peered":"2024-02-16T00:12:52.803036+0000","last_clean":"2024-02-16T00:12:52.803036+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:52.803036+0000","last_undegraded":"2024-02-16T00:12:52.803036+0000","last_fullsized":"2024-02-16T00:12:52.803036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.802940+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:55.924565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.555534+0000","last_change":"2024-02-16T00:12:50.555567+0000","last_active":"2024-02-16T00:12:50.555534+0000","last_peered":"2024-02-16T00:12:50.555534+0000","last_clean":"2024-02-16T00:12:50.555534+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:12:50.555534+0000","last_undegraded":"2024-02-16T00:12:50.555534+0000","last_fullsized":"2024-02-16T00:12:50.555534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.555443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:51.432013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844349+0000","last_change":"2024-02-16T00:11:12.831687+0000","last_active":"2024-02-16T00:11:50.844349+0000","last_peered":"2024-02-16T00:11:50.844349+0000","last_clean":"2024-02-16T00:11:50.844349+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:11:50.844349+0000","last_undegraded":"2024-02-16T00:11:50.844349+0000","last_fullsized":"2024-02-16T00:11:50.844349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.080694+0000","last_change":"2024-02-16T00:12:57.080743+0000","last_active":"2024-02-16T00:12:57.080694+0000","last_peered":"2024-02-16T00:12:57.080694+0000","last_clean":"2024-02-16T00:12:57.080694+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:12:57.080694+0000","last_undegraded":"2024-02-16T00:12:57.080694+0000","last_fullsized":"2024-02-16T00:12:57.080694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.080604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:49.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849489+0000","last_change":"2024-02-16T00:11:02.814174+0000","last_active":"2024-02-16T00:11:50.849489+0000","last_peered":"2024-02-16T00:11:50.849489+0000","last_clean":"2024-02-16T00:11:50.849489+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:11:50.849489+0000","last_undegraded":"2024-02-16T00:11:50.849489+0000","last_fullsized":"2024-02-16T00:11:50.849489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.884349+0000","last_change":"2024-02-16T00:12:49.884373+0000","last_active":"2024-02-16T00:12:49.884349+0000","last_peered":"2024-02-16T00:12:49.884349+0000","last_clean":"2024-02-16T00:12:49.884349+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:12:49.884349+0000","last_undegraded":"2024-02-16T00:12:49.884349+0000","last_fullsized":"2024-02-16T00:12:49.884349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.884258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:21.476087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'34","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.114045+0000","last_change":"2024-02-16T00:12:53.114102+0000","last_active":"2024-02-16T00:12:53.114045+0000","last_peered":"2024-02-16T00:12:53.114045+0000","last_clean":"2024-02-16T00:12:53.114045+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:53.114045+0000","last_undegraded":"2024-02-16T00:12:53.114045+0000","last_fullsized":"2024-02-16T00:12:53.114045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.113947+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:53.697900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.267881+0000","last_change":"2024-02-16T00:12:44.267908+0000","last_active":"2024-02-16T00:12:44.267881+0000","last_peered":"2024-02-16T00:12:44.267881+0000","last_clean":"2024-02-16T00:12:44.267881+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:12:44.267881+0000","last_undegraded":"2024-02-16T00:12:44.267881+0000","last_fullsized":"2024-02-16T00:12:44.267881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.267784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:28:21.260343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.978310+0000","last_change":"2024-02-16T00:11:04.799979+0000","last_active":"2024-02-16T00:12:27.978310+0000","last_peered":"2024-02-16T00:12:27.978310+0000","last_clean":"2024-02-16T00:12:27.978310+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:12:27.978310+0000","last_undegraded":"2024-02-16T00:12:27.978310+0000","last_fullsized":"2024-02-16T00:12:27.978310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839602+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:11:50.839602+0000","last_peered":"2024-02-16T00:11:50.839602+0000","last_clean":"2024-02-16T00:11:50.839602+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:11:50.839602+0000","last_undegraded":"2024-02-16T00:11:50.839602+0000","last_fullsized":"2024-02-16T00:11:50.839602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.805054+0000","last_change":"2024-02-16T00:12:57.805078+0000","last_active":"2024-02-16T00:12:57.805054+0000","last_peered":"2024-02-16T00:12:57.805054+0000","last_clean":"2024-02-16T00:12:57.805054+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:12:57.805054+0000","last_undegraded":"2024-02-16T00:12:57.805054+0000","last_fullsized":"2024-02-16T00:12:57.805054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.804963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:37.236667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'67","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.901384+0000","last_change":"2024-02-16T00:12:47.901456+0000","last_active":"2024-02-16T00:12:47.901384+0000","last_peered":"2024-02-16T00:12:47.901384+0000","last_clean":"2024-02-16T00:12:47.901384+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:47.901384+0000","last_undegraded":"2024-02-16T00:12:47.901384+0000","last_fullsized":"2024-02-16T00:12:47.901384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.901291+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:48.763246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.239732+0000","last_change":"2024-02-16T00:12:45.239756+0000","last_active":"2024-02-16T00:12:45.239732+0000","last_peered":"2024-02-16T00:12:45.239732+0000","last_clean":"2024-02-16T00:12:45.239732+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:12:45.239732+0000","last_undegraded":"2024-02-16T00:12:45.239732+0000","last_fullsized":"2024-02-16T00:12:45.239732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.239638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:12.913457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.983254+0000","last_change":"2024-02-16T00:11:12.826496+0000","last_active":"2024-02-16T00:12:27.983254+0000","last_peered":"2024-02-16T00:12:27.983254+0000","last_clean":"2024-02-16T00:12:27.983254+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:12:27.983254+0000","last_undegraded":"2024-02-16T00:12:27.983254+0000","last_fullsized":"2024-02-16T00:12:27.983254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831616+0000","last_change":"2024-02-16T00:11:04.798736+0000","last_active":"2024-02-16T00:11:51.831616+0000","last_peered":"2024-02-16T00:11:51.831616+0000","last_clean":"2024-02-16T00:11:51.831616+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:11:51.831616+0000","last_undegraded":"2024-02-16T00:11:51.831616+0000","last_fullsized":"2024-02-16T00:11:51.831616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846701+0000","last_change":"2024-02-16T00:11:02.820397+0000","last_active":"2024-02-16T00:11:50.846701+0000","last_peered":"2024-02-16T00:11:50.846701+0000","last_clean":"2024-02-16T00:11:50.846701+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:11:50.846701+0000","last_undegraded":"2024-02-16T00:11:50.846701+0000","last_fullsized":"2024-02-16T00:11:50.846701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842088+0000","last_change":"2024-02-16T00:11:06.805697+0000","last_active":"2024-02-16T00:11:50.842088+0000","last_peered":"2024-02-16T00:11:50.842088+0000","last_clean":"2024-02-16T00:11:50.842088+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:11:50.842088+0000","last_undegraded":"2024-02-16T00:11:50.842088+0000","last_fullsized":"2024-02-16T00:11:50.842088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'37","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.238536+0000","last_change":"2024-02-16T00:11:08.817849+0000","last_active":"2024-02-16T00:12:35.238536+0000","last_peered":"2024-02-16T00:12:35.238536+0000","last_clean":"2024-02-16T00:12:35.238536+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:12:35.238536+0000","last_undegraded":"2024-02-16T00:12:35.238536+0000","last_fullsized":"2024-02-16T00:12:35.238536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.644016+0000","last_change":"2024-02-16T00:12:58.644040+0000","last_active":"2024-02-16T00:12:58.644016+0000","last_peered":"2024-02-16T00:12:58.644016+0000","last_clean":"2024-02-16T00:12:58.644016+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:12:58.644016+0000","last_undegraded":"2024-02-16T00:12:58.644016+0000","last_fullsized":"2024-02-16T00:12:58.644016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.643930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:14.513005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839602+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:11:50.839602+0000","last_peered":"2024-02-16T00:11:50.839602+0000","last_clean":"2024-02-16T00:11:50.839602+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:11:50.839602+0000","last_undegraded":"2024-02-16T00:11:50.839602+0000","last_fullsized":"2024-02-16T00:11:50.839602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.909368+0000","last_change":"2024-02-16T00:12:51.909416+0000","last_active":"2024-02-16T00:12:51.909368+0000","last_peered":"2024-02-16T00:12:51.909368+0000","last_clean":"2024-02-16T00:12:51.909368+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:12:51.909368+0000","last_undegraded":"2024-02-16T00:12:51.909368+0000","last_fullsized":"2024-02-16T00:12:51.909368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.909268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:23.726726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847897+0000","last_change":"2024-02-16T00:11:02.796631+0000","last_active":"2024-02-16T00:11:50.847897+0000","last_peered":"2024-02-16T00:11:50.847897+0000","last_clean":"2024-02-16T00:11:50.847897+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:11:50.847897+0000","last_undegraded":"2024-02-16T00:11:50.847897+0000","last_fullsized":"2024-02-16T00:11:50.847897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843992+0000","last_change":"2024-02-16T00:11:06.803105+0000","last_active":"2024-02-16T00:11:50.843992+0000","last_peered":"2024-02-16T00:11:50.843992+0000","last_clean":"2024-02-16T00:11:50.843992+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:11:50.843992+0000","last_undegraded":"2024-02-16T00:11:50.843992+0000","last_fullsized":"2024-02-16T00:11:50.843992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'44","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.821435+0000","last_change":"2024-02-16T00:12:51.821474+0000","last_active":"2024-02-16T00:12:51.821435+0000","last_peered":"2024-02-16T00:12:51.821435+0000","last_clean":"2024-02-16T00:12:51.821435+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:51.821435+0000","last_undegraded":"2024-02-16T00:12:51.821435+0000","last_fullsized":"2024-02-16T00:12:51.821435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.821350+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:13:29.475897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.806784+0000","last_change":"2024-02-16T00:12:54.806808+0000","last_active":"2024-02-16T00:12:54.806784+0000","last_peered":"2024-02-16T00:12:54.806784+0000","last_clean":"2024-02-16T00:12:54.806784+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:12:54.806784+0000","last_undegraded":"2024-02-16T00:12:54.806784+0000","last_fullsized":"2024-02-16T00:12:54.806784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.806699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:52.208925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840203+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:11:50.840203+0000","last_peered":"2024-02-16T00:11:50.840203+0000","last_clean":"2024-02-16T00:11:50.840203+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:11:50.840203+0000","last_undegraded":"2024-02-16T00:11:50.840203+0000","last_fullsized":"2024-02-16T00:11:50.840203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831748+0000","last_change":"2024-02-16T00:11:04.801768+0000","last_active":"2024-02-16T00:11:51.831748+0000","last_peered":"2024-02-16T00:11:51.831748+0000","last_clean":"2024-02-16T00:11:51.831748+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:11:51.831748+0000","last_undegraded":"2024-02-16T00:11:51.831748+0000","last_fullsized":"2024-02-16T00:11:51.831748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841070+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:11:50.841070+0000","last_peered":"2024-02-16T00:11:50.841070+0000","last_clean":"2024-02-16T00:11:50.841070+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:11:50.841070+0000","last_undegraded":"2024-02-16T00:11:50.841070+0000","last_fullsized":"2024-02-16T00:11:50.841070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.635083+0000","last_change":"2024-02-16T00:12:56.635127+0000","last_active":"2024-02-16T00:12:56.635083+0000","last_peered":"2024-02-16T00:12:56.635083+0000","last_clean":"2024-02-16T00:12:56.635083+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:12:56.635083+0000","last_undegraded":"2024-02-16T00:12:56.635083+0000","last_fullsized":"2024-02-16T00:12:56.635083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.634994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:54.037220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'16","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844234+0000","last_change":"2024-02-16T00:11:08.814283+0000","last_active":"2024-02-16T00:11:50.844234+0000","last_peered":"2024-02-16T00:11:50.844234+0000","last_clean":"2024-02-16T00:11:50.844234+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:11:50.844234+0000","last_undegraded":"2024-02-16T00:11:50.844234+0000","last_fullsized":"2024-02-16T00:11:50.844234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'243","reported_seq":341,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.288278+0000","last_change":"2024-02-16T00:12:42.288308+0000","last_active":"2024-02-16T00:12:42.288278+0000","last_peered":"2024-02-16T00:12:42.288278+0000","last_clean":"2024-02-16T00:12:42.288278+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:42.288278+0000","last_undegraded":"2024-02-16T00:12:42.288278+0000","last_fullsized":"2024-02-16T00:12:42.288278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.288179+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:49.835119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839151+0000","last_change":"2024-02-16T00:11:12.832363+0000","last_active":"2024-02-16T00:11:50.839151+0000","last_peered":"2024-02-16T00:11:50.839151+0000","last_clean":"2024-02-16T00:11:50.839151+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:11:50.839151+0000","last_undegraded":"2024-02-16T00:11:50.839151+0000","last_fullsized":"2024-02-16T00:11:50.839151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455092+0000","last_change":"2024-02-16T00:11:04.798269+0000","last_active":"2024-02-16T00:12:33.455092+0000","last_peered":"2024-02-16T00:12:33.455092+0000","last_clean":"2024-02-16T00:12:33.455092+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:12:33.455092+0000","last_undegraded":"2024-02-16T00:12:33.455092+0000","last_fullsized":"2024-02-16T00:12:33.455092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847530+0000","last_change":"2024-02-16T00:11:02.810889+0000","last_active":"2024-02-16T00:11:50.847530+0000","last_peered":"2024-02-16T00:11:50.847530+0000","last_clean":"2024-02-16T00:11:50.847530+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:11:50.847530+0000","last_undegraded":"2024-02-16T00:11:50.847530+0000","last_fullsized":"2024-02-16T00:11:50.847530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.582342+0000","last_change":"2024-02-16T00:12:51.582387+0000","last_active":"2024-02-16T00:12:51.582342+0000","last_peered":"2024-02-16T00:12:51.582342+0000","last_clean":"2024-02-16T00:12:51.582342+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:12:51.582342+0000","last_undegraded":"2024-02-16T00:12:51.582342+0000","last_fullsized":"2024-02-16T00:12:51.582342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.582242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:29.436735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'73","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.419598+0000","last_change":"2024-02-16T00:12:44.419632+0000","last_active":"2024-02-16T00:12:44.419598+0000","last_peered":"2024-02-16T00:12:44.419598+0000","last_clean":"2024-02-16T00:12:44.419598+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:44.419598+0000","last_undegraded":"2024-02-16T00:12:44.419598+0000","last_fullsized":"2024-02-16T00:12:44.419598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.419516+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:22.507611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.985013+0000","last_change":"2024-02-16T00:12:44.985037+0000","last_active":"2024-02-16T00:12:44.985013+0000","last_peered":"2024-02-16T00:12:44.985013+0000","last_clean":"2024-02-16T00:12:44.985013+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:12:44.985013+0000","last_undegraded":"2024-02-16T00:12:44.985013+0000","last_fullsized":"2024-02-16T00:12:44.985013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.984923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.568877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849771+0000","last_change":"2024-02-16T00:11:12.828004+0000","last_active":"2024-02-16T00:11:50.849771+0000","last_peered":"2024-02-16T00:11:50.849771+0000","last_clean":"2024-02-16T00:11:50.849771+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:11:50.849771+0000","last_undegraded":"2024-02-16T00:11:50.849771+0000","last_fullsized":"2024-02-16T00:11:50.849771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842983+0000","last_change":"2024-02-16T00:11:04.802752+0000","last_active":"2024-02-16T00:11:50.842983+0000","last_peered":"2024-02-16T00:11:50.842983+0000","last_clean":"2024-02-16T00:11:50.842983+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:11:50.842983+0000","last_undegraded":"2024-02-16T00:11:50.842983+0000","last_fullsized":"2024-02-16T00:11:50.842983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845255+0000","last_change":"2024-02-16T00:11:02.815829+0000","last_active":"2024-02-16T00:11:50.845255+0000","last_peered":"2024-02-16T00:11:50.845255+0000","last_clean":"2024-02-16T00:11:50.845255+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:11:50.845255+0000","last_undegraded":"2024-02-16T00:11:50.845255+0000","last_fullsized":"2024-02-16T00:11:50.845255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"29'5","reported_seq":210,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.021300+0000","last_change":"2024-02-16T00:12:57.021341+0000","last_active":"2024-02-16T00:12:57.021300+0000","last_peered":"2024-02-16T00:12:57.021300+0000","last_clean":"2024-02-16T00:12:57.021300+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:57.021300+0000","last_undegraded":"2024-02-16T00:12:57.021300+0000","last_fullsized":"2024-02-16T00:12:57.021300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.021207+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:57.897777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'43","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.929803+0000","last_change":"2024-02-16T00:12:48.929840+0000","last_active":"2024-02-16T00:12:48.929803+0000","last_peered":"2024-02-16T00:12:48.929803+0000","last_clean":"2024-02-16T00:12:48.929803+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:48.929803+0000","last_undegraded":"2024-02-16T00:12:48.929803+0000","last_fullsized":"2024-02-16T00:12:48.929803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.929717+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:22:28.327582+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839405+0000","last_change":"2024-02-16T00:11:10.827306+0000","last_active":"2024-02-16T00:11:50.839405+0000","last_peered":"2024-02-16T00:11:50.839405+0000","last_clean":"2024-02-16T00:11:50.839405+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:11:50.839405+0000","last_undegraded":"2024-02-16T00:11:50.839405+0000","last_fullsized":"2024-02-16T00:11:50.839405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842041+0000","last_change":"2024-02-16T00:11:12.830200+0000","last_active":"2024-02-16T00:11:50.842041+0000","last_peered":"2024-02-16T00:11:50.842041+0000","last_clean":"2024-02-16T00:11:50.842041+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:11:50.842041+0000","last_undegraded":"2024-02-16T00:11:50.842041+0000","last_fullsized":"2024-02-16T00:11:50.842041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839874+0000","last_change":"2024-02-16T00:11:04.806595+0000","last_active":"2024-02-16T00:11:50.839874+0000","last_peered":"2024-02-16T00:11:50.839874+0000","last_clean":"2024-02-16T00:11:50.839874+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:11:50.839874+0000","last_undegraded":"2024-02-16T00:11:50.839874+0000","last_fullsized":"2024-02-16T00:11:50.839874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830900+0000","last_change":"2024-02-16T00:11:02.802098+0000","last_active":"2024-02-16T00:11:51.830900+0000","last_peered":"2024-02-16T00:11:51.830900+0000","last_clean":"2024-02-16T00:11:51.830900+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:11:51.830900+0000","last_undegraded":"2024-02-16T00:11:51.830900+0000","last_fullsized":"2024-02-16T00:11:51.830900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.487234+0000","last_change":"2024-02-16T00:12:47.487257+0000","last_active":"2024-02-16T00:12:47.487234+0000","last_peered":"2024-02-16T00:12:47.487234+0000","last_clean":"2024-02-16T00:12:47.487234+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:12:47.487234+0000","last_undegraded":"2024-02-16T00:12:47.487234+0000","last_fullsized":"2024-02-16T00:12:47.487234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.487142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:48.071095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'36","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.996259+0000","last_change":"2024-02-16T00:12:54.996296+0000","last_active":"2024-02-16T00:12:54.996259+0000","last_peered":"2024-02-16T00:12:54.996259+0000","last_clean":"2024-02-16T00:12:54.996259+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:54.996259+0000","last_undegraded":"2024-02-16T00:12:54.996259+0000","last_fullsized":"2024-02-16T00:12:54.996259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.996158+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:24.457006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839834+0000","last_change":"2024-02-16T00:11:10.831082+0000","last_active":"2024-02-16T00:11:50.839834+0000","last_peered":"2024-02-16T00:11:50.839834+0000","last_clean":"2024-02-16T00:11:50.839834+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:11:50.839834+0000","last_undegraded":"2024-02-16T00:11:50.839834+0000","last_fullsized":"2024-02-16T00:11:50.839834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:09.800207+0000","last_clean_scrub_stamp":"2024-02-16T00:11:09.800207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844301+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:11:50.844301+0000","last_peered":"2024-02-16T00:11:50.844301+0000","last_clean":"2024-02-16T00:11:50.844301+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:11:50.844301+0000","last_undegraded":"2024-02-16T00:11:50.844301+0000","last_fullsized":"2024-02-16T00:11:50.844301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977340+0000","last_change":"2024-02-16T00:11:04.798644+0000","last_active":"2024-02-16T00:12:27.977340+0000","last_peered":"2024-02-16T00:12:27.977340+0000","last_clean":"2024-02-16T00:12:27.977340+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:12:27.977340+0000","last_undegraded":"2024-02-16T00:12:27.977340+0000","last_fullsized":"2024-02-16T00:12:27.977340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849631+0000","last_change":"2024-02-16T00:11:02.820199+0000","last_active":"2024-02-16T00:11:50.849631+0000","last_peered":"2024-02-16T00:11:50.849631+0000","last_clean":"2024-02-16T00:11:50.849631+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:11:50.849631+0000","last_undegraded":"2024-02-16T00:11:50.849631+0000","last_fullsized":"2024-02-16T00:11:50.849631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.548961+0000","last_change":"2024-02-16T00:12:49.549032+0000","last_active":"2024-02-16T00:12:49.548961+0000","last_peered":"2024-02-16T00:12:49.548961+0000","last_clean":"2024-02-16T00:12:49.548961+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:12:49.548961+0000","last_undegraded":"2024-02-16T00:12:49.548961+0000","last_fullsized":"2024-02-16T00:12:49.548961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.548866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:23:44.002627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:35.194028+0000","last_change":"2024-02-16T00:11:08.814763+0000","last_active":"2024-02-16T00:12:35.194028+0000","last_peered":"2024-02-16T00:12:35.194028+0000","last_clean":"2024-02-16T00:12:35.194028+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:12:35.194028+0000","last_undegraded":"2024-02-16T00:12:35.194028+0000","last_fullsized":"2024-02-16T00:12:35.194028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:07.793765+0000","last_clean_scrub_stamp":"2024-02-16T00:11:07.793765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.919210+0000","last_change":"2024-02-16T00:12:41.919234+0000","last_active":"2024-02-16T00:12:41.919210+0000","last_peered":"2024-02-16T00:12:41.919210+0000","last_clean":"2024-02-16T00:12:41.919210+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:12:41.919210+0000","last_undegraded":"2024-02-16T00:12:41.919210+0000","last_fullsized":"2024-02-16T00:12:41.919210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.919121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:20.007216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841849+0000","last_change":"2024-02-16T00:11:12.831037+0000","last_active":"2024-02-16T00:11:50.841849+0000","last_peered":"2024-02-16T00:11:50.841849+0000","last_clean":"2024-02-16T00:11:50.841849+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:11:50.841849+0000","last_undegraded":"2024-02-16T00:11:50.841849+0000","last_fullsized":"2024-02-16T00:11:50.841849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621778+0000","last_change":"2024-02-16T00:11:04.813889+0000","last_active":"2024-02-16T00:12:27.621778+0000","last_peered":"2024-02-16T00:12:27.621778+0000","last_clean":"2024-02-16T00:12:27.621778+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:12:27.621778+0000","last_undegraded":"2024-02-16T00:12:27.621778+0000","last_fullsized":"2024-02-16T00:12:27.621778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843507+0000","last_change":"2024-02-16T00:11:02.816801+0000","last_active":"2024-02-16T00:11:50.843507+0000","last_peered":"2024-02-16T00:11:50.843507+0000","last_clean":"2024-02-16T00:11:50.843507+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:11:50.843507+0000","last_undegraded":"2024-02-16T00:11:50.843507+0000","last_fullsized":"2024-02-16T00:11:50.843507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.622044+0000","last_change":"2024-02-16T00:11:04.801950+0000","last_active":"2024-02-16T00:12:27.622044+0000","last_peered":"2024-02-16T00:12:27.622044+0000","last_clean":"2024-02-16T00:12:27.622044+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:12:27.622044+0000","last_undegraded":"2024-02-16T00:12:27.622044+0000","last_fullsized":"2024-02-16T00:12:27.622044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829889+0000","last_change":"2024-02-16T00:11:02.808413+0000","last_active":"2024-02-16T00:11:51.829889+0000","last_peered":"2024-02-16T00:11:51.829889+0000","last_clean":"2024-02-16T00:11:51.829889+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:11:51.829889+0000","last_undegraded":"2024-02-16T00:11:51.829889+0000","last_fullsized":"2024-02-16T00:11:51.829889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455149+0000","last_change":"2024-02-16T00:11:04.810063+0000","last_active":"2024-02-16T00:12:33.455149+0000","last_peered":"2024-02-16T00:12:33.455149+0000","last_clean":"2024-02-16T00:12:33.455149+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:33.455149+0000","last_undegraded":"2024-02-16T00:12:33.455149+0000","last_fullsized":"2024-02-16T00:12:33.455149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840066+0000","last_change":"2024-02-16T00:11:02.824009+0000","last_active":"2024-02-16T00:11:50.840066+0000","last_peered":"2024-02-16T00:11:50.840066+0000","last_clean":"2024-02-16T00:11:50.840066+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:11:50.840066+0000","last_undegraded":"2024-02-16T00:11:50.840066+0000","last_fullsized":"2024-02-16T00:11:50.840066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831346+0000","last_change":"2024-02-16T00:11:04.801764+0000","last_active":"2024-02-16T00:11:51.831346+0000","last_peered":"2024-02-16T00:11:51.831346+0000","last_clean":"2024-02-16T00:11:51.831346+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:11:51.831346+0000","last_undegraded":"2024-02-16T00:11:51.831346+0000","last_fullsized":"2024-02-16T00:11:51.831346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830332+0000","last_change":"2024-02-16T00:11:02.797510+0000","last_active":"2024-02-16T00:11:51.830332+0000","last_peered":"2024-02-16T00:11:51.830332+0000","last_clean":"2024-02-16T00:11:51.830332+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:11:51.830332+0000","last_undegraded":"2024-02-16T00:11:51.830332+0000","last_fullsized":"2024-02-16T00:11:51.830332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830201+0000","last_change":"2024-02-16T00:11:04.810324+0000","last_active":"2024-02-16T00:11:51.830201+0000","last_peered":"2024-02-16T00:11:51.830201+0000","last_clean":"2024-02-16T00:11:51.830201+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:11:51.830201+0000","last_undegraded":"2024-02-16T00:11:51.830201+0000","last_fullsized":"2024-02-16T00:11:51.830201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831467+0000","last_change":"2024-02-16T00:11:02.801630+0000","last_active":"2024-02-16T00:11:51.831467+0000","last_peered":"2024-02-16T00:11:51.831467+0000","last_clean":"2024-02-16T00:11:51.831467+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:11:51.831467+0000","last_undegraded":"2024-02-16T00:11:51.831467+0000","last_fullsized":"2024-02-16T00:11:51.831467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.622174+0000","last_change":"2024-02-16T00:11:04.814522+0000","last_active":"2024-02-16T00:12:27.622174+0000","last_peered":"2024-02-16T00:12:27.622174+0000","last_clean":"2024-02-16T00:12:27.622174+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:12:27.622174+0000","last_undegraded":"2024-02-16T00:12:27.622174+0000","last_fullsized":"2024-02-16T00:12:27.622174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847060+0000","last_change":"2024-02-16T00:11:02.810745+0000","last_active":"2024-02-16T00:11:50.847060+0000","last_peered":"2024-02-16T00:11:50.847060+0000","last_clean":"2024-02-16T00:11:50.847060+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:11:50.847060+0000","last_undegraded":"2024-02-16T00:11:50.847060+0000","last_fullsized":"2024-02-16T00:11:50.847060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.454649+0000","last_change":"2024-02-16T00:11:04.797743+0000","last_active":"2024-02-16T00:12:33.454649+0000","last_peered":"2024-02-16T00:12:33.454649+0000","last_clean":"2024-02-16T00:12:33.454649+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:12:33.454649+0000","last_undegraded":"2024-02-16T00:12:33.454649+0000","last_fullsized":"2024-02-16T00:12:33.454649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842262+0000","last_change":"2024-02-16T00:11:02.815909+0000","last_active":"2024-02-16T00:11:50.842262+0000","last_peered":"2024-02-16T00:11:50.842262+0000","last_clean":"2024-02-16T00:11:50.842262+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:11:50.842262+0000","last_undegraded":"2024-02-16T00:11:50.842262+0000","last_fullsized":"2024-02-16T00:11:50.842262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.621964+0000","last_change":"2024-02-16T00:11:04.796966+0000","last_active":"2024-02-16T00:12:27.621964+0000","last_peered":"2024-02-16T00:12:27.621964+0000","last_clean":"2024-02-16T00:12:27.621964+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:12:27.621964+0000","last_undegraded":"2024-02-16T00:12:27.621964+0000","last_fullsized":"2024-02-16T00:12:27.621964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830907+0000","last_change":"2024-02-16T00:11:02.797604+0000","last_active":"2024-02-16T00:11:51.830907+0000","last_peered":"2024-02-16T00:11:51.830907+0000","last_clean":"2024-02-16T00:11:51.830907+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:11:51.830907+0000","last_undegraded":"2024-02-16T00:11:51.830907+0000","last_fullsized":"2024-02-16T00:11:51.830907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.455248+0000","last_change":"2024-02-16T00:11:04.802856+0000","last_active":"2024-02-16T00:12:33.455248+0000","last_peered":"2024-02-16T00:12:33.455248+0000","last_clean":"2024-02-16T00:12:33.455248+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:12:33.455248+0000","last_undegraded":"2024-02-16T00:12:33.455248+0000","last_fullsized":"2024-02-16T00:12:33.455248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839832+0000","last_change":"2024-02-16T00:11:02.820947+0000","last_active":"2024-02-16T00:11:50.839832+0000","last_peered":"2024-02-16T00:11:50.839832+0000","last_clean":"2024-02-16T00:11:50.839832+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:11:50.839832+0000","last_undegraded":"2024-02-16T00:11:50.839832+0000","last_fullsized":"2024-02-16T00:11:50.839832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.978024+0000","last_change":"2024-02-16T00:11:04.807293+0000","last_active":"2024-02-16T00:12:27.978024+0000","last_peered":"2024-02-16T00:12:27.978024+0000","last_clean":"2024-02-16T00:12:27.978024+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:12:27.978024+0000","last_undegraded":"2024-02-16T00:12:27.978024+0000","last_fullsized":"2024-02-16T00:12:27.978024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829008+0000","last_change":"2024-02-16T00:11:02.797276+0000","last_active":"2024-02-16T00:11:51.829008+0000","last_peered":"2024-02-16T00:11:51.829008+0000","last_clean":"2024-02-16T00:11:51.829008+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:11:51.829008+0000","last_undegraded":"2024-02-16T00:11:51.829008+0000","last_fullsized":"2024-02-16T00:11:51.829008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831793+0000","last_change":"2024-02-16T00:11:04.812406+0000","last_active":"2024-02-16T00:11:51.831793+0000","last_peered":"2024-02-16T00:11:51.831793+0000","last_clean":"2024-02-16T00:11:51.831793+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:11:51.831793+0000","last_undegraded":"2024-02-16T00:11:51.831793+0000","last_fullsized":"2024-02-16T00:11:51.831793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848044+0000","last_change":"2024-02-16T00:11:02.809533+0000","last_active":"2024-02-16T00:11:50.848044+0000","last_peered":"2024-02-16T00:11:50.848044+0000","last_clean":"2024-02-16T00:11:50.848044+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:11:50.848044+0000","last_undegraded":"2024-02-16T00:11:50.848044+0000","last_fullsized":"2024-02-16T00:11:50.848044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977493+0000","last_change":"2024-02-16T00:11:04.796459+0000","last_active":"2024-02-16T00:12:27.977493+0000","last_peered":"2024-02-16T00:12:27.977493+0000","last_clean":"2024-02-16T00:12:27.977493+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:12:27.977493+0000","last_undegraded":"2024-02-16T00:12:27.977493+0000","last_fullsized":"2024-02-16T00:12:27.977493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846930+0000","last_change":"2024-02-16T00:11:02.796731+0000","last_active":"2024-02-16T00:11:50.846930+0000","last_peered":"2024-02-16T00:11:50.846930+0000","last_clean":"2024-02-16T00:11:50.846930+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:11:50.846930+0000","last_undegraded":"2024-02-16T00:11:50.846930+0000","last_fullsized":"2024-02-16T00:11:50.846930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.642947+0000","last_change":"2024-02-16T00:12:57.642973+0000","last_active":"2024-02-16T00:12:57.642947+0000","last_peered":"2024-02-16T00:12:57.642947+0000","last_clean":"2024-02-16T00:12:57.642947+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:12:57.642947+0000","last_undegraded":"2024-02-16T00:12:57.642947+0000","last_fullsized":"2024-02-16T00:12:57.642947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.642852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:29.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842549+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:11:50.842549+0000","last_peered":"2024-02-16T00:11:50.842549+0000","last_clean":"2024-02-16T00:11:50.842549+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:11:50.842549+0000","last_undegraded":"2024-02-16T00:11:50.842549+0000","last_fullsized":"2024-02-16T00:11:50.842549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848786+0000","last_change":"2024-02-16T00:11:04.803538+0000","last_active":"2024-02-16T00:11:50.848786+0000","last_peered":"2024-02-16T00:11:50.848786+0000","last_clean":"2024-02-16T00:11:50.848786+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:11:50.848786+0000","last_undegraded":"2024-02-16T00:11:50.848786+0000","last_fullsized":"2024-02-16T00:11:50.848786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845487+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:11:50.845487+0000","last_peered":"2024-02-16T00:11:50.845487+0000","last_clean":"2024-02-16T00:11:50.845487+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:11:50.845487+0000","last_undegraded":"2024-02-16T00:11:50.845487+0000","last_fullsized":"2024-02-16T00:11:50.845487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840767+0000","last_change":"2024-02-16T00:11:04.808274+0000","last_active":"2024-02-16T00:11:50.840767+0000","last_peered":"2024-02-16T00:11:50.840767+0000","last_clean":"2024-02-16T00:11:50.840767+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:11:50.840767+0000","last_undegraded":"2024-02-16T00:11:50.840767+0000","last_fullsized":"2024-02-16T00:11:50.840767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842968+0000","last_change":"2024-02-16T00:11:02.816585+0000","last_active":"2024-02-16T00:11:50.842968+0000","last_peered":"2024-02-16T00:11:50.842968+0000","last_clean":"2024-02-16T00:11:50.842968+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:11:50.842968+0000","last_undegraded":"2024-02-16T00:11:50.842968+0000","last_fullsized":"2024-02-16T00:11:50.842968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848582+0000","last_change":"2024-02-16T00:11:04.798394+0000","last_active":"2024-02-16T00:11:50.848582+0000","last_peered":"2024-02-16T00:11:50.848582+0000","last_clean":"2024-02-16T00:11:50.848582+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:11:50.848582+0000","last_undegraded":"2024-02-16T00:11:50.848582+0000","last_fullsized":"2024-02-16T00:11:50.848582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843929+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:11:50.843929+0000","last_peered":"2024-02-16T00:11:50.843929+0000","last_clean":"2024-02-16T00:11:50.843929+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:11:50.843929+0000","last_undegraded":"2024-02-16T00:11:50.843929+0000","last_fullsized":"2024-02-16T00:11:50.843929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840111+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:11:50.840111+0000","last_peered":"2024-02-16T00:11:50.840111+0000","last_clean":"2024-02-16T00:11:50.840111+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:11:50.840111+0000","last_undegraded":"2024-02-16T00:11:50.840111+0000","last_fullsized":"2024-02-16T00:11:50.840111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831386+0000","last_change":"2024-02-16T00:11:04.798473+0000","last_active":"2024-02-16T00:11:51.831386+0000","last_peered":"2024-02-16T00:11:51.831386+0000","last_clean":"2024-02-16T00:11:51.831386+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:11:51.831386+0000","last_undegraded":"2024-02-16T00:11:51.831386+0000","last_fullsized":"2024-02-16T00:11:51.831386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.829317+0000","last_change":"2024-02-16T00:11:02.808092+0000","last_active":"2024-02-16T00:11:51.829317+0000","last_peered":"2024-02-16T00:11:51.829317+0000","last_clean":"2024-02-16T00:11:51.829317+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:11:51.829317+0000","last_undegraded":"2024-02-16T00:11:51.829317+0000","last_fullsized":"2024-02-16T00:11:51.829317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848635+0000","last_change":"2024-02-16T00:11:04.814263+0000","last_active":"2024-02-16T00:11:50.848635+0000","last_peered":"2024-02-16T00:11:50.848635+0000","last_clean":"2024-02-16T00:11:50.848635+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:11:50.848635+0000","last_undegraded":"2024-02-16T00:11:50.848635+0000","last_fullsized":"2024-02-16T00:11:50.848635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1820,"num_read_kb":1574,"num_write":771,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1602,"ondisk_log_size":1602,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.26100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.495,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.628,"15min":0.628},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36599999999999999,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.442},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.34799999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.39700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":966656,"data_stored":723796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.438},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.311},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.33400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.438}]},{"osd":2,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.314,"15min":0.318},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.42699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.377},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33900000000000002,"15min":0.34100000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.46400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":137181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Feb 16 00:11:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:13:00.194 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.194 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.194 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.194 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.195 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.195 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.195 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.195 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.195 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.196 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.196 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.196 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.196 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.196 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.196 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.197 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.198 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.198 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.198 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.198 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.198 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.199 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.199 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.199 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.199 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.199 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.199 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.200 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.200 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.200 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.200 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.200 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.200 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.201 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.201 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.201 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.201 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.201 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.202 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.202 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.202 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.202 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.202 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.203 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.203 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.203 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.203 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.203 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.203 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.204 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.204 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.204 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.204 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.204 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.204 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.205 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.205 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.205 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.205 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.205 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.205 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.206 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.206 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.206 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.206 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.206 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.206 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.207 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.207 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.207 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.207 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.207 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.207 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.208 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.208 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.208 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.208 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.208 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.208 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.209 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.209 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.209 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.209 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.209 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.210 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.210 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.210 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.210 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.210 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.210 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.211 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.211 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.211 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.211 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.211 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.212 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.212 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.212 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.212 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.212 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.212 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.213 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.213 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.213 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.213 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.213 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.214 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.214 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.214 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.214 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.214 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.214 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.215 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.215 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.215 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.215 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.215 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.216 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.216 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.216 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.216 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.216 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.217 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.217 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.217 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.217 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.217 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.217 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.218 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.218 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.218 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.218 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.218 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.218 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.219 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.219 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.219 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.219 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.219 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.219 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-16T00:11:09.800207+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=9, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.220 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.220 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.220 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.220 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-16T00:11:07.793765+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=7, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.220 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.221 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.221 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.221 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.221 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.221 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.221 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.222 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.222 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.222 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.222 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.222 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.223 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.223 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.223 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.223 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.223 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.223 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.224 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.224 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.224 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.224 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.224 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.225 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.225 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.225 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.225 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.225 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.225 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.226 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.226 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.226 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.226 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.226 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.226 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.227 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:00.227 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T00:13:20.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:13:20.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd92a806640 1 Processor -- start 2024-02-16T00:13:20.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd92a806640 1 -- start start 2024-02-16T00:13:20.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd92a806640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd92412dcb0 0x7fd9241300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd92a806640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd924095270 con 0x7fd9240956a0 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd92a806640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd924096190 con 0x7fd92412dcb0 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd9237fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd92412dcb0 0x7fd9241300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd923fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd9240956a0 0x7fd924095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42116/0 (socket says 172.21.15.2:42116) 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.341+0000 7fd923fff640 1 -- 172.21.15.2:0/1940925022 learned_addr learned my addr 172.21.15.2:0/1940925022 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.342+0000 7fd922ffd640 1 -- 172.21.15.2:0/1940925022 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058768425 0 0) 0x7fd924095270 con 0x7fd9240956a0 2024-02-16T00:13:20.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.342+0000 7fd922ffd640 1 -- 172.21.15.2:0/1940925022 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c003520 con 0x7fd9240956a0 2024-02-16T00:13:20.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.342+0000 7fd9237fe640 1 -- 172.21.15.2:0/1940925022 >> v1:172.21.15.2:6789/0 conn(0x7fd9240956a0 legacy=0x7fd924095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:20.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.342+0000 7fd9237fe640 1 -- 172.21.15.2:0/1940925022 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240954a0 con 0x7fd92412dcb0 2024-02-16T00:13:20.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.342+0000 7fd9237fe640 1 --2- 172.21.15.2:0/1940925022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92412dcb0 0x7fd9241300a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b9c0 tx=0x7fd91402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3748ee664d3b556 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:13:20.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.342+0000 7fd922ffd640 1 -- 172.21.15.2:0/1940925022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91402ecf0 con 0x7fd92412dcb0 2024-02-16T00:13:20.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd922ffd640 1 -- 172.21.15.2:0/1940925022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91402ee50 con 0x7fd92412dcb0 2024-02-16T00:13:20.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd922ffd640 1 -- 172.21.15.2:0/1940925022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd914036590 con 0x7fd92412dcb0 2024-02-16T00:13:20.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 -- 172.21.15.2:0/1940925022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92412dcb0 msgr2=0x7fd9241300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:20.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 --2- 172.21.15.2:0/1940925022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92412dcb0 0x7fd9241300a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b9c0 tx=0x7fd91402e010 comp rx=0 tx=0).stop 2024-02-16T00:13:20.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 -- 172.21.15.2:0/1940925022 shutdown_connections 2024-02-16T00:13:20.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 --2- 172.21.15.2:0/1940925022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd92412dcb0 0x7fd9241300a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 -- 172.21.15.2:0/1940925022 >> 172.21.15.2:0/1940925022 conn(0x7fd92409a300 msgr2=0x7fd92409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 -- 172.21.15.2:0/1940925022 shutdown_connections 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.343+0000 7fd92a806640 1 -- 172.21.15.2:0/1940925022 wait complete. 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.344+0000 7fd92a806640 1 Processor -- start 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.344+0000 7fd92a806640 1 -- start start 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd92a806640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 0x7fd9240702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:13:20.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd92a806640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924071990 con 0x7fd9240956a0 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd923fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 0x7fd9240702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd923fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 0x7fd9240702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56066/0 (socket says 172.21.15.2:56066) 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd923fff640 1 -- 172.21.15.2:0/677476767 learned_addr learned my addr 172.21.15.2:0/677476767 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd923fff640 1 -- 172.21.15.2:0/677476767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91400b6a0 con 0x7fd9240956a0 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd923fff640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 0x7fd9240702f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c390 tx=0x7fd91800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd918005c10 con 0x7fd9240956a0 2024-02-16T00:13:20.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918005d70 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd924129340 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd918007220 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.345+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd924129da0 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.346+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd918007380 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.346+0000 7fd920ff9640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd910037ef0 0x7fd91003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.346+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd924129120 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.346+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fd91804aa60 con 0x7fd9240956a0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.347+0000 7fd9237fe640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd910037ef0 0x7fd91003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:13:20.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.347+0000 7fd9237fe640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd910037ef0 0x7fd91003a3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd914038000 tx=0x7fd914032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:13:20.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.351+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9180199b0 con 0x7fd9240956a0 2024-02-16T00:13:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.532+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd92406c2e0 con 0x7fd910037ef0 2024-02-16T00:13:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.549+0000 7fd920ff9640 1 -- 172.21.15.2:0/677476767 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669497 (secure 0 0 0) 0x7fd91402ece0 con 0x7fd910037ef0 2024-02-16T00:13:20.559 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:13:20.565 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:13:20.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd910037ef0 msgr2=0x7fd91003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd910037ef0 0x7fd91003a3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd914038000 tx=0x7fd914032000 comp rx=0 tx=0).stop 2024-02-16T00:13:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 msgr2=0x7fd9240702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 0x7fd9240702f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c390 tx=0x7fd91800c850 comp rx=0 tx=0).stop 2024-02-16T00:13:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 shutdown_connections 2024-02-16T00:13:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fd910037ef0 0x7fd91003a3b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:20.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 --2- 172.21.15.2:0/677476767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9240956a0 0x7fd9240702f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 >> 172.21.15.2:0/677476767 conn(0x7fd92409a300 msgr2=0x7fd9241210a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:13:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 shutdown_connections 2024-02-16T00:13:20.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:20.554+0000 7fd92a806640 1 -- 172.21.15.2:0/677476767 wait complete. 2024-02-16T00:13:20.570 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-02-16T00:13:19.711395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":245,"num_object_clones":0,"num_object_copies":491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":4297,"num_read_kb":3911,"num_write":1709,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1709,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4186,"ondisk_log_size":4186,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148212,"kb_used_data":2708,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339148,"statfs":{"total":386547056640,"available":386395287552,"internally_reserved":0,"allocated":2772992,"data_stored":1728024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1109,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003672"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020601+0000","last_change":"2024-02-16T00:11:02.804024+0000","last_active":"2024-02-16T00:12:39.020601+0000","last_peered":"2024-02-16T00:12:39.020601+0000","last_clean":"2024-02-16T00:12:39.020601+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:12:39.020601+0000","last_undegraded":"2024-02-16T00:12:39.020601+0000","last_fullsized":"2024-02-16T00:12:39.020601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848107+0000","last_change":"2024-02-16T00:11:04.803215+0000","last_active":"2024-02-16T00:11:50.848107+0000","last_peered":"2024-02-16T00:11:50.848107+0000","last_clean":"2024-02-16T00:11:50.848107+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:11:50.848107+0000","last_undegraded":"2024-02-16T00:11:50.848107+0000","last_fullsized":"2024-02-16T00:11:50.848107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140139+0000","last_change":"2024-02-16T00:11:02.797595+0000","last_active":"2024-02-16T00:12:38.140139+0000","last_peered":"2024-02-16T00:12:38.140139+0000","last_clean":"2024-02-16T00:12:38.140139+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:12:38.140139+0000","last_undegraded":"2024-02-16T00:12:38.140139+0000","last_fullsized":"2024-02-16T00:12:38.140139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840786+0000","last_change":"2024-02-16T00:11:04.803831+0000","last_active":"2024-02-16T00:11:50.840786+0000","last_peered":"2024-02-16T00:11:50.840786+0000","last_clean":"2024-02-16T00:11:50.840786+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:11:50.840786+0000","last_undegraded":"2024-02-16T00:11:50.840786+0000","last_fullsized":"2024-02-16T00:11:50.840786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457086+0000","last_change":"2024-02-16T00:11:02.815592+0000","last_active":"2024-02-16T00:12:39.457086+0000","last_peered":"2024-02-16T00:12:39.457086+0000","last_clean":"2024-02-16T00:12:39.457086+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:12:39.457086+0000","last_undegraded":"2024-02-16T00:12:39.457086+0000","last_fullsized":"2024-02-16T00:12:39.457086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.058478+0000","last_change":"2024-02-16T00:13:18.058556+0000","last_active":"2024-02-16T00:13:18.058478+0000","last_peered":"2024-02-16T00:13:18.058478+0000","last_clean":"2024-02-16T00:13:18.058478+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:13:18.058478+0000","last_undegraded":"2024-02-16T00:13:18.058478+0000","last_fullsized":"2024-02-16T00:13:18.058478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.058378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:23.057832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.241221+0000","last_change":"2024-02-16T00:13:09.241249+0000","last_active":"2024-02-16T00:13:09.241221+0000","last_peered":"2024-02-16T00:13:09.241221+0000","last_clean":"2024-02-16T00:13:09.241221+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:13:09.241221+0000","last_undegraded":"2024-02-16T00:13:09.241221+0000","last_fullsized":"2024-02-16T00:13:09.241221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.241098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:35.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.023893+0000","last_change":"2024-02-16T00:13:16.023923+0000","last_active":"2024-02-16T00:13:16.023893+0000","last_peered":"2024-02-16T00:13:16.023893+0000","last_clean":"2024-02-16T00:13:16.023893+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:13:16.023893+0000","last_undegraded":"2024-02-16T00:13:16.023893+0000","last_fullsized":"2024-02-16T00:13:16.023893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.023799+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:15.106437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841237+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:11:50.841237+0000","last_peered":"2024-02-16T00:11:50.841237+0000","last_clean":"2024-02-16T00:11:50.841237+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:11:50.841237+0000","last_undegraded":"2024-02-16T00:11:50.841237+0000","last_fullsized":"2024-02-16T00:11:50.841237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.550754+0000","last_change":"2024-02-16T00:13:10.550783+0000","last_active":"2024-02-16T00:13:10.550754+0000","last_peered":"2024-02-16T00:13:10.550754+0000","last_clean":"2024-02-16T00:13:10.550754+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:13:10.550754+0000","last_undegraded":"2024-02-16T00:13:10.550754+0000","last_fullsized":"2024-02-16T00:13:10.550754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.550668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:01.925080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.445185+0000","last_change":"2024-02-16T00:11:02.803398+0000","last_active":"2024-02-16T00:12:33.445185+0000","last_peered":"2024-02-16T00:12:33.445185+0000","last_clean":"2024-02-16T00:12:33.445185+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:12:33.445185+0000","last_undegraded":"2024-02-16T00:12:33.445185+0000","last_fullsized":"2024-02-16T00:12:33.445185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.969656+0000","last_change":"2024-02-16T00:13:12.969656+0000","last_active":"2024-02-16T00:13:12.969656+0000","last_peered":"2024-02-16T00:13:12.969656+0000","last_clean":"2024-02-16T00:13:12.969656+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:13:12.969656+0000","last_undegraded":"2024-02-16T00:13:12.969656+0000","last_fullsized":"2024-02-16T00:13:12.969656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.969541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:09.036334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840372+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:11:50.840372+0000","last_peered":"2024-02-16T00:11:50.840372+0000","last_clean":"2024-02-16T00:11:50.840372+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:11:50.840372+0000","last_undegraded":"2024-02-16T00:11:50.840372+0000","last_fullsized":"2024-02-16T00:11:50.840372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.234405+0000","last_change":"2024-02-16T00:13:06.234405+0000","last_active":"2024-02-16T00:13:06.234405+0000","last_peered":"2024-02-16T00:13:06.234405+0000","last_clean":"2024-02-16T00:13:06.234405+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:13:06.234405+0000","last_undegraded":"2024-02-16T00:13:06.234405+0000","last_fullsized":"2024-02-16T00:13:06.234405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.234291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:22.103367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.806096+0000","last_change":"2024-02-16T00:13:13.806168+0000","last_active":"2024-02-16T00:13:13.806096+0000","last_peered":"2024-02-16T00:13:13.806096+0000","last_clean":"2024-02-16T00:13:13.806096+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:13:13.806096+0000","last_undegraded":"2024-02-16T00:13:13.806096+0000","last_fullsized":"2024-02-16T00:13:13.806096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.805990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:04.108688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.179359+0000","last_change":"2024-02-16T00:13:12.179359+0000","last_active":"2024-02-16T00:13:12.179359+0000","last_peered":"2024-02-16T00:13:12.179359+0000","last_clean":"2024-02-16T00:13:12.179359+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:13:12.179359+0000","last_undegraded":"2024-02-16T00:13:12.179359+0000","last_fullsized":"2024-02-16T00:13:12.179359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.179243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:55.195210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.051222+0000","last_change":"2024-02-16T00:13:17.051248+0000","last_active":"2024-02-16T00:13:17.051222+0000","last_peered":"2024-02-16T00:13:17.051222+0000","last_clean":"2024-02-16T00:13:17.051222+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:13:17.051222+0000","last_undegraded":"2024-02-16T00:13:17.051222+0000","last_fullsized":"2024-02-16T00:13:17.051222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.051125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:36.761214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.601527+0000","last_change":"2024-02-16T00:13:17.601554+0000","last_active":"2024-02-16T00:13:17.601527+0000","last_peered":"2024-02-16T00:13:17.601527+0000","last_clean":"2024-02-16T00:13:17.601527+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:13:17.601527+0000","last_undegraded":"2024-02-16T00:13:17.601527+0000","last_fullsized":"2024-02-16T00:13:17.601527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.601433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:29.123516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.577146+0000","last_change":"2024-02-16T00:13:16.577174+0000","last_active":"2024-02-16T00:13:16.577146+0000","last_peered":"2024-02-16T00:13:16.577146+0000","last_clean":"2024-02-16T00:13:16.577146+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:13:16.577146+0000","last_undegraded":"2024-02-16T00:13:16.577146+0000","last_fullsized":"2024-02-16T00:13:16.577146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.577052+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:46.037900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.149339+0000","last_change":"2024-02-16T00:13:13.149364+0000","last_active":"2024-02-16T00:13:13.149339+0000","last_peered":"2024-02-16T00:13:13.149339+0000","last_clean":"2024-02-16T00:13:13.149339+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:13:13.149339+0000","last_undegraded":"2024-02-16T00:13:13.149339+0000","last_fullsized":"2024-02-16T00:13:13.149339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.149246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:19.171364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848285+0000","last_change":"2024-02-16T00:11:04.803702+0000","last_active":"2024-02-16T00:11:50.848285+0000","last_peered":"2024-02-16T00:11:50.848285+0000","last_clean":"2024-02-16T00:11:50.848285+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:11:50.848285+0000","last_undegraded":"2024-02-16T00:11:50.848285+0000","last_fullsized":"2024-02-16T00:11:50.848285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847224+0000","last_change":"2024-02-16T00:11:02.810700+0000","last_active":"2024-02-16T00:11:50.847224+0000","last_peered":"2024-02-16T00:11:50.847224+0000","last_clean":"2024-02-16T00:11:50.847224+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:11:50.847224+0000","last_undegraded":"2024-02-16T00:11:50.847224+0000","last_fullsized":"2024-02-16T00:11:50.847224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.829533+0000","last_change":"2024-02-16T00:13:05.829592+0000","last_active":"2024-02-16T00:13:05.829533+0000","last_peered":"2024-02-16T00:13:05.829533+0000","last_clean":"2024-02-16T00:13:05.829533+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:13:05.829533+0000","last_undegraded":"2024-02-16T00:13:05.829533+0000","last_fullsized":"2024-02-16T00:13:05.829533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.829438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:12.076944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.583101+0000","last_change":"2024-02-16T00:13:13.583128+0000","last_active":"2024-02-16T00:13:13.583101+0000","last_peered":"2024-02-16T00:13:13.583101+0000","last_clean":"2024-02-16T00:13:13.583101+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:13:13.583101+0000","last_undegraded":"2024-02-16T00:13:13.583101+0000","last_fullsized":"2024-02-16T00:13:13.583101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.583017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:43.065222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.978160+0000","last_change":"2024-02-16T00:11:04.812055+0000","last_active":"2024-02-16T00:12:27.978160+0000","last_peered":"2024-02-16T00:12:27.978160+0000","last_clean":"2024-02-16T00:12:27.978160+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:12:27.978160+0000","last_undegraded":"2024-02-16T00:12:27.978160+0000","last_fullsized":"2024-02-16T00:12:27.978160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830452+0000","last_change":"2024-02-16T00:11:02.797860+0000","last_active":"2024-02-16T00:11:51.830452+0000","last_peered":"2024-02-16T00:11:51.830452+0000","last_clean":"2024-02-16T00:11:51.830452+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:11:51.830452+0000","last_undegraded":"2024-02-16T00:11:51.830452+0000","last_fullsized":"2024-02-16T00:11:51.830452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.565948+0000","last_change":"2024-02-16T00:13:12.565976+0000","last_active":"2024-02-16T00:13:12.565948+0000","last_peered":"2024-02-16T00:13:12.565948+0000","last_clean":"2024-02-16T00:13:12.565948+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:13:12.565948+0000","last_undegraded":"2024-02-16T00:13:12.565948+0000","last_fullsized":"2024-02-16T00:13:12.565948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.565846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:00.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840347+0000","last_change":"2024-02-16T00:11:02.817356+0000","last_active":"2024-02-16T00:11:50.840347+0000","last_peered":"2024-02-16T00:11:50.840347+0000","last_clean":"2024-02-16T00:11:50.840347+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:11:50.840347+0000","last_undegraded":"2024-02-16T00:11:50.840347+0000","last_fullsized":"2024-02-16T00:11:50.840347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'19","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.466452+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:33.466452+0000","last_peered":"2024-02-16T00:12:33.466452+0000","last_clean":"2024-02-16T00:12:33.466452+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:33.466452+0000","last_undegraded":"2024-02-16T00:12:33.466452+0000","last_fullsized":"2024-02-16T00:12:33.466452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842602+0000","last_change":"2024-02-16T00:11:04.804063+0000","last_active":"2024-02-16T00:11:50.842602+0000","last_peered":"2024-02-16T00:11:50.842602+0000","last_clean":"2024-02-16T00:11:50.842602+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:11:50.842602+0000","last_undegraded":"2024-02-16T00:11:50.842602+0000","last_fullsized":"2024-02-16T00:11:50.842602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840965+0000","last_change":"2024-02-16T00:11:02.823865+0000","last_active":"2024-02-16T00:11:50.840965+0000","last_peered":"2024-02-16T00:11:50.840965+0000","last_clean":"2024-02-16T00:11:50.840965+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:11:50.840965+0000","last_undegraded":"2024-02-16T00:11:50.840965+0000","last_fullsized":"2024-02-16T00:11:50.840965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.921943+0000","last_change":"2024-02-16T00:12:48.921969+0000","last_active":"2024-02-16T00:12:48.921943+0000","last_peered":"2024-02-16T00:12:48.921943+0000","last_clean":"2024-02-16T00:12:48.921943+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:12:48.921943+0000","last_undegraded":"2024-02-16T00:12:48.921943+0000","last_fullsized":"2024-02-16T00:12:48.921943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.921850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:24.218584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'48","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.004572+0000","last_change":"2024-02-16T00:12:45.004614+0000","last_active":"2024-02-16T00:12:45.004572+0000","last_peered":"2024-02-16T00:12:45.004572+0000","last_clean":"2024-02-16T00:12:45.004572+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:45.004572+0000","last_undegraded":"2024-02-16T00:12:45.004572+0000","last_fullsized":"2024-02-16T00:12:45.004572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.004490+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:25.382346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.647188+0000","last_change":"2024-02-16T00:13:02.647238+0000","last_active":"2024-02-16T00:13:02.647188+0000","last_peered":"2024-02-16T00:13:02.647188+0000","last_clean":"2024-02-16T00:13:02.647188+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:13:02.647188+0000","last_undegraded":"2024-02-16T00:13:02.647188+0000","last_fullsized":"2024-02-16T00:13:02.647188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.647086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:24.329532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.765463+0000","last_change":"2024-02-16T00:11:12.835250+0000","last_active":"2024-02-16T00:12:27.765463+0000","last_peered":"2024-02-16T00:12:27.765463+0000","last_clean":"2024-02-16T00:12:27.765463+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:12:27.765463+0000","last_undegraded":"2024-02-16T00:12:27.765463+0000","last_fullsized":"2024-02-16T00:12:27.765463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.053263+0000","last_change":"2024-02-16T00:12:58.053290+0000","last_active":"2024-02-16T00:12:58.053263+0000","last_peered":"2024-02-16T00:12:58.053263+0000","last_clean":"2024-02-16T00:12:58.053263+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:12:58.053263+0000","last_undegraded":"2024-02-16T00:12:58.053263+0000","last_fullsized":"2024-02-16T00:12:58.053263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.053167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:43:59.274034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.224920+0000","last_change":"2024-02-16T00:13:11.224954+0000","last_active":"2024-02-16T00:13:11.224920+0000","last_peered":"2024-02-16T00:13:11.224920+0000","last_clean":"2024-02-16T00:13:11.224920+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:13:11.224920+0000","last_undegraded":"2024-02-16T00:13:11.224920+0000","last_fullsized":"2024-02-16T00:13:11.224920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.224827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:55.853002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.890674+0000","last_change":"2024-02-16T00:13:01.890717+0000","last_active":"2024-02-16T00:13:01.890674+0000","last_peered":"2024-02-16T00:13:01.890674+0000","last_clean":"2024-02-16T00:13:01.890674+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:13:01.890674+0000","last_undegraded":"2024-02-16T00:13:01.890674+0000","last_fullsized":"2024-02-16T00:13:01.890674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.890582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:01:28.904624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'16","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.427604+0000","last_change":"2024-02-16T00:12:43.427635+0000","last_active":"2024-02-16T00:12:43.427604+0000","last_peered":"2024-02-16T00:12:43.427604+0000","last_clean":"2024-02-16T00:12:43.427604+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:12:43.427604+0000","last_undegraded":"2024-02-16T00:12:43.427604+0000","last_fullsized":"2024-02-16T00:12:43.427604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.427524+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:38.476135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.502455+0000","last_change":"2024-02-16T00:12:46.502479+0000","last_active":"2024-02-16T00:12:46.502455+0000","last_peered":"2024-02-16T00:12:46.502455+0000","last_clean":"2024-02-16T00:12:46.502455+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:12:46.502455+0000","last_undegraded":"2024-02-16T00:12:46.502455+0000","last_fullsized":"2024-02-16T00:12:46.502455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.502371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:24.692093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.828906+0000","last_change":"2024-02-16T00:11:12.828416+0000","last_active":"2024-02-16T00:11:51.828906+0000","last_peered":"2024-02-16T00:11:51.828906+0000","last_clean":"2024-02-16T00:11:51.828906+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:11:51.828906+0000","last_undegraded":"2024-02-16T00:11:51.828906+0000","last_fullsized":"2024-02-16T00:11:51.828906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844970+0000","last_change":"2024-02-16T00:11:04.803967+0000","last_active":"2024-02-16T00:11:50.844970+0000","last_peered":"2024-02-16T00:11:50.844970+0000","last_clean":"2024-02-16T00:11:50.844970+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:11:50.844970+0000","last_undegraded":"2024-02-16T00:11:50.844970+0000","last_fullsized":"2024-02-16T00:11:50.844970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839819+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:11:50.839819+0000","last_peered":"2024-02-16T00:11:50.839819+0000","last_clean":"2024-02-16T00:11:50.839819+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:11:50.839819+0000","last_undegraded":"2024-02-16T00:11:50.839819+0000","last_fullsized":"2024-02-16T00:11:50.839819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.886656+0000","last_change":"2024-02-16T00:13:00.886683+0000","last_active":"2024-02-16T00:13:00.886656+0000","last_peered":"2024-02-16T00:13:00.886656+0000","last_clean":"2024-02-16T00:13:00.886656+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:13:00.886656+0000","last_undegraded":"2024-02-16T00:13:00.886656+0000","last_fullsized":"2024-02-16T00:13:00.886656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.886566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:06.116856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'29","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.157041+0000","last_change":"2024-02-16T00:12:51.157085+0000","last_active":"2024-02-16T00:12:51.157041+0000","last_peered":"2024-02-16T00:12:51.157041+0000","last_clean":"2024-02-16T00:12:51.157041+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:12:51.157041+0000","last_undegraded":"2024-02-16T00:12:51.157041+0000","last_fullsized":"2024-02-16T00:12:51.157041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.156949+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:01.821119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'244","reported_seq":325,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.041758+0000","last_change":"2024-02-16T00:13:07.041805+0000","last_active":"2024-02-16T00:13:07.041758+0000","last_peered":"2024-02-16T00:13:07.041758+0000","last_clean":"2024-02-16T00:13:07.041758+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:13:07.041758+0000","last_undegraded":"2024-02-16T00:13:07.041758+0000","last_fullsized":"2024-02-16T00:13:07.041758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'244","last_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_deep_scrub":"29'244","last_deep_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.041669+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:08:31.087156+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.081956+0000","last_change":"2024-02-16T00:12:54.081981+0000","last_active":"2024-02-16T00:12:54.081956+0000","last_peered":"2024-02-16T00:12:54.081956+0000","last_clean":"2024-02-16T00:12:54.081956+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:12:54.081956+0000","last_undegraded":"2024-02-16T00:12:54.081956+0000","last_fullsized":"2024-02-16T00:12:54.081956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.081866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:20.234092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.456539+0000","last_change":"2024-02-16T00:11:04.803520+0000","last_active":"2024-02-16T00:12:33.456539+0000","last_peered":"2024-02-16T00:12:33.456539+0000","last_clean":"2024-02-16T00:12:33.456539+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:12:33.456539+0000","last_undegraded":"2024-02-16T00:12:33.456539+0000","last_fullsized":"2024-02-16T00:12:33.456539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.584168+0000","last_change":"2024-02-16T00:13:15.584199+0000","last_active":"2024-02-16T00:13:15.584168+0000","last_peered":"2024-02-16T00:13:15.584168+0000","last_clean":"2024-02-16T00:13:15.584168+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:13:15.584168+0000","last_undegraded":"2024-02-16T00:13:15.584168+0000","last_fullsized":"2024-02-16T00:13:15.584168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.584073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:18.030880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.040554+0000","last_change":"2024-02-16T00:12:46.040576+0000","last_active":"2024-02-16T00:12:46.040554+0000","last_peered":"2024-02-16T00:12:46.040554+0000","last_clean":"2024-02-16T00:12:46.040554+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:12:46.040554+0000","last_undegraded":"2024-02-16T00:12:46.040554+0000","last_fullsized":"2024-02-16T00:12:46.040554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.040468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:29.717153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'41","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.243627+0000","last_change":"2024-02-16T00:12:49.243662+0000","last_active":"2024-02-16T00:12:49.243627+0000","last_peered":"2024-02-16T00:12:49.243627+0000","last_clean":"2024-02-16T00:12:49.243627+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:49.243627+0000","last_undegraded":"2024-02-16T00:12:49.243627+0000","last_fullsized":"2024-02-16T00:12:49.243627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.243531+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:44.292142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'243","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.916090+0000","last_change":"2024-02-16T00:12:42.916116+0000","last_active":"2024-02-16T00:12:42.916090+0000","last_peered":"2024-02-16T00:12:42.916090+0000","last_clean":"2024-02-16T00:12:42.916090+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:42.916090+0000","last_undegraded":"2024-02-16T00:12:42.916090+0000","last_fullsized":"2024-02-16T00:12:42.916090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.916005+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:53.580174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733569+0000","last_change":"2024-02-16T00:11:50.855956+0000","last_active":"2024-02-16T00:11:53.733569+0000","last_peered":"2024-02-16T00:11:53.733569+0000","last_clean":"2024-02-16T00:11:53.733569+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:11:53.733569+0000","last_undegraded":"2024-02-16T00:11:53.733569+0000","last_fullsized":"2024-02-16T00:11:53.733569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020426+0000","last_change":"2024-02-16T00:11:02.805831+0000","last_active":"2024-02-16T00:12:39.020426+0000","last_peered":"2024-02-16T00:12:39.020426+0000","last_clean":"2024-02-16T00:12:39.020426+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:12:39.020426+0000","last_undegraded":"2024-02-16T00:12:39.020426+0000","last_fullsized":"2024-02-16T00:12:39.020426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.525828+0000","last_change":"2024-02-16T00:12:48.525828+0000","last_active":"2024-02-16T00:12:48.525828+0000","last_peered":"2024-02-16T00:12:48.525828+0000","last_clean":"2024-02-16T00:12:48.525828+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:12:48.525828+0000","last_undegraded":"2024-02-16T00:12:48.525828+0000","last_fullsized":"2024-02-16T00:12:48.525828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.525719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:11.360728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'58","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.244124+0000","last_change":"2024-02-16T00:12:48.244124+0000","last_active":"2024-02-16T00:12:48.244124+0000","last_peered":"2024-02-16T00:12:48.244124+0000","last_clean":"2024-02-16T00:12:48.244124+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:48.244124+0000","last_undegraded":"2024-02-16T00:12:48.244124+0000","last_fullsized":"2024-02-16T00:12:48.244124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.243982+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:25.939262+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.931879+0000","last_change":"2024-02-16T00:12:46.931903+0000","last_active":"2024-02-16T00:12:46.931879+0000","last_peered":"2024-02-16T00:12:46.931879+0000","last_clean":"2024-02-16T00:12:46.931879+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:12:46.931879+0000","last_undegraded":"2024-02-16T00:12:46.931879+0000","last_fullsized":"2024-02-16T00:12:46.931879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.931775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:08:25.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.070398+0000","last_change":"2024-02-16T00:12:58.070398+0000","last_active":"2024-02-16T00:12:58.070398+0000","last_peered":"2024-02-16T00:12:58.070398+0000","last_clean":"2024-02-16T00:12:58.070398+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:58.070398+0000","last_undegraded":"2024-02-16T00:12:58.070398+0000","last_fullsized":"2024-02-16T00:12:58.070398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.070215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:35.924708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.553664+0000","last_change":"2024-02-16T00:13:08.553664+0000","last_active":"2024-02-16T00:13:08.553664+0000","last_peered":"2024-02-16T00:13:08.553664+0000","last_clean":"2024-02-16T00:13:08.553664+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:13:08.553664+0000","last_undegraded":"2024-02-16T00:13:08.553664+0000","last_fullsized":"2024-02-16T00:13:08.553664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.553541+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:34.676748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020427+0000","last_change":"2024-02-16T00:11:02.815325+0000","last_active":"2024-02-16T00:12:39.020427+0000","last_peered":"2024-02-16T00:12:39.020427+0000","last_clean":"2024-02-16T00:12:39.020427+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:12:39.020427+0000","last_undegraded":"2024-02-16T00:12:39.020427+0000","last_fullsized":"2024-02-16T00:12:39.020427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.788791+0000","last_change":"2024-02-16T00:12:55.788791+0000","last_active":"2024-02-16T00:12:55.788791+0000","last_peered":"2024-02-16T00:12:55.788791+0000","last_clean":"2024-02-16T00:12:55.788791+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:12:55.788791+0000","last_undegraded":"2024-02-16T00:12:55.788791+0000","last_fullsized":"2024-02-16T00:12:55.788791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.788644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:03.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'41","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.074733+0000","last_change":"2024-02-16T00:12:43.074769+0000","last_active":"2024-02-16T00:12:43.074733+0000","last_peered":"2024-02-16T00:12:43.074733+0000","last_clean":"2024-02-16T00:12:43.074733+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:43.074733+0000","last_undegraded":"2024-02-16T00:12:43.074733+0000","last_fullsized":"2024-02-16T00:12:43.074733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.074645+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.611584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.938556+0000","last_change":"2024-02-16T00:12:40.938580+0000","last_active":"2024-02-16T00:12:40.938556+0000","last_peered":"2024-02-16T00:12:40.938556+0000","last_clean":"2024-02-16T00:12:40.938556+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:12:40.938556+0000","last_undegraded":"2024-02-16T00:12:40.938556+0000","last_fullsized":"2024-02-16T00:12:40.938556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.938464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:15:55.114937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.580394+0000","last_change":"2024-02-16T00:11:12.828694+0000","last_active":"2024-02-16T00:12:38.580394+0000","last_peered":"2024-02-16T00:12:38.580394+0000","last_clean":"2024-02-16T00:12:38.580394+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:12:38.580394+0000","last_undegraded":"2024-02-16T00:12:38.580394+0000","last_fullsized":"2024-02-16T00:12:38.580394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.194785+0000","last_change":"2024-02-16T00:13:16.194785+0000","last_active":"2024-02-16T00:13:16.194785+0000","last_peered":"2024-02-16T00:13:16.194785+0000","last_clean":"2024-02-16T00:13:16.194785+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:13:16.194785+0000","last_undegraded":"2024-02-16T00:13:16.194785+0000","last_fullsized":"2024-02-16T00:13:16.194785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.194674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:42.317881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456724+0000","last_change":"2024-02-16T00:11:02.815569+0000","last_active":"2024-02-16T00:12:39.456724+0000","last_peered":"2024-02-16T00:12:39.456724+0000","last_clean":"2024-02-16T00:12:39.456724+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:12:39.456724+0000","last_undegraded":"2024-02-16T00:12:39.456724+0000","last_fullsized":"2024-02-16T00:12:39.456724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.864788+0000","last_change":"2024-02-16T00:12:59.864812+0000","last_active":"2024-02-16T00:12:59.864788+0000","last_peered":"2024-02-16T00:12:59.864788+0000","last_clean":"2024-02-16T00:12:59.864788+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:12:59.864788+0000","last_undegraded":"2024-02-16T00:12:59.864788+0000","last_fullsized":"2024-02-16T00:12:59.864788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.864691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:37:20.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'57","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.882918+0000","last_change":"2024-02-16T00:12:50.882918+0000","last_active":"2024-02-16T00:12:50.882918+0000","last_peered":"2024-02-16T00:12:50.882918+0000","last_clean":"2024-02-16T00:12:50.882918+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:50.882918+0000","last_undegraded":"2024-02-16T00:12:50.882918+0000","last_fullsized":"2024-02-16T00:12:50.882918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.882742+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:43.268496+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'243","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.962441+0000","last_change":"2024-02-16T00:12:43.962470+0000","last_active":"2024-02-16T00:12:43.962441+0000","last_peered":"2024-02-16T00:12:43.962441+0000","last_clean":"2024-02-16T00:12:43.962441+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:43.962441+0000","last_undegraded":"2024-02-16T00:12:43.962441+0000","last_fullsized":"2024-02-16T00:12:43.962441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.962355+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:22.152077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830363+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:11:51.830363+0000","last_peered":"2024-02-16T00:11:51.830363+0000","last_clean":"2024-02-16T00:11:51.830363+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:11:51.830363+0000","last_undegraded":"2024-02-16T00:11:51.830363+0000","last_fullsized":"2024-02-16T00:11:51.830363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.207251+0000","last_change":"2024-02-16T00:13:08.207275+0000","last_active":"2024-02-16T00:13:08.207251+0000","last_peered":"2024-02-16T00:13:08.207251+0000","last_clean":"2024-02-16T00:13:08.207251+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:13:08.207251+0000","last_undegraded":"2024-02-16T00:13:08.207251+0000","last_fullsized":"2024-02-16T00:13:08.207251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.207150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:18.983700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456735+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:12:39.456735+0000","last_peered":"2024-02-16T00:12:39.456735+0000","last_clean":"2024-02-16T00:12:39.456735+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:12:39.456735+0000","last_undegraded":"2024-02-16T00:12:39.456735+0000","last_fullsized":"2024-02-16T00:12:39.456735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.773405+0000","last_change":"2024-02-16T00:12:56.773405+0000","last_active":"2024-02-16T00:12:56.773405+0000","last_peered":"2024-02-16T00:12:56.773405+0000","last_clean":"2024-02-16T00:12:56.773405+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:12:56.773405+0000","last_undegraded":"2024-02-16T00:12:56.773405+0000","last_fullsized":"2024-02-16T00:12:56.773405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.773281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:12.642357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'73","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.029931+0000","last_change":"2024-02-16T00:13:05.029931+0000","last_active":"2024-02-16T00:13:05.029931+0000","last_peered":"2024-02-16T00:13:05.029931+0000","last_clean":"2024-02-16T00:13:05.029931+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:13:05.029931+0000","last_undegraded":"2024-02-16T00:13:05.029931+0000","last_fullsized":"2024-02-16T00:13:05.029931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.029752+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:42.315448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.833631+0000","last_change":"2024-02-16T00:12:58.833657+0000","last_active":"2024-02-16T00:12:58.833631+0000","last_peered":"2024-02-16T00:12:58.833631+0000","last_clean":"2024-02-16T00:12:58.833631+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:12:58.833631+0000","last_undegraded":"2024-02-16T00:12:58.833631+0000","last_fullsized":"2024-02-16T00:12:58.833631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.833533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:45:54.589076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:33.461230+0000","last_change":"2024-02-16T00:11:12.823579+0000","last_active":"2024-02-16T00:12:33.461230+0000","last_peered":"2024-02-16T00:12:33.461230+0000","last_clean":"2024-02-16T00:12:33.461230+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:12:33.461230+0000","last_undegraded":"2024-02-16T00:12:33.461230+0000","last_fullsized":"2024-02-16T00:12:33.461230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.551003+0000","last_change":"2024-02-16T00:13:07.551036+0000","last_active":"2024-02-16T00:13:07.551003+0000","last_peered":"2024-02-16T00:13:07.551003+0000","last_clean":"2024-02-16T00:13:07.551003+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:13:07.551003+0000","last_undegraded":"2024-02-16T00:13:07.551003+0000","last_fullsized":"2024-02-16T00:13:07.551003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.550917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:08.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.807521+0000","last_change":"2024-02-16T00:13:17.807521+0000","last_active":"2024-02-16T00:13:17.807521+0000","last_peered":"2024-02-16T00:13:17.807521+0000","last_clean":"2024-02-16T00:13:17.807521+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:13:17.807521+0000","last_undegraded":"2024-02-16T00:13:17.807521+0000","last_fullsized":"2024-02-16T00:13:17.807521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.807409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:10.662061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.114744+0000","last_change":"2024-02-16T00:12:59.114782+0000","last_active":"2024-02-16T00:12:59.114744+0000","last_peered":"2024-02-16T00:12:59.114744+0000","last_clean":"2024-02-16T00:12:59.114744+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:12:59.114744+0000","last_undegraded":"2024-02-16T00:12:59.114744+0000","last_fullsized":"2024-02-16T00:12:59.114744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.114637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:06.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'44","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.465937+0000","last_change":"2024-02-16T00:12:45.465978+0000","last_active":"2024-02-16T00:12:45.465937+0000","last_peered":"2024-02-16T00:12:45.465937+0000","last_clean":"2024-02-16T00:12:45.465937+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:45.465937+0000","last_undegraded":"2024-02-16T00:12:45.465937+0000","last_fullsized":"2024-02-16T00:12:45.465937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.465843+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:56.130012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.024810+0000","last_change":"2024-02-16T00:13:03.024834+0000","last_active":"2024-02-16T00:13:03.024810+0000","last_peered":"2024-02-16T00:13:03.024810+0000","last_clean":"2024-02-16T00:13:03.024810+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:13:03.024810+0000","last_undegraded":"2024-02-16T00:13:03.024810+0000","last_fullsized":"2024-02-16T00:13:03.024810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.024725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:07.760259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458009+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:12:39.458009+0000","last_peered":"2024-02-16T00:12:39.458009+0000","last_clean":"2024-02-16T00:12:39.458009+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:12:39.458009+0000","last_undegraded":"2024-02-16T00:12:39.458009+0000","last_fullsized":"2024-02-16T00:12:39.458009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733690+0000","last_change":"2024-02-16T00:11:50.852046+0000","last_active":"2024-02-16T00:11:53.733690+0000","last_peered":"2024-02-16T00:11:53.733690+0000","last_clean":"2024-02-16T00:11:53.733690+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:11:53.733690+0000","last_undegraded":"2024-02-16T00:11:53.733690+0000","last_fullsized":"2024-02-16T00:11:53.733690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456684+0000","last_change":"2024-02-16T00:11:02.816016+0000","last_active":"2024-02-16T00:12:39.456684+0000","last_peered":"2024-02-16T00:12:39.456684+0000","last_clean":"2024-02-16T00:12:39.456684+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:12:39.456684+0000","last_undegraded":"2024-02-16T00:12:39.456684+0000","last_fullsized":"2024-02-16T00:12:39.456684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733673+0000","last_change":"2024-02-16T00:11:50.848461+0000","last_active":"2024-02-16T00:11:53.733673+0000","last_peered":"2024-02-16T00:11:53.733673+0000","last_clean":"2024-02-16T00:11:53.733673+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:11:53.733673+0000","last_undegraded":"2024-02-16T00:11:53.733673+0000","last_fullsized":"2024-02-16T00:11:53.733673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'44","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.094330+0000","last_change":"2024-02-16T00:12:55.094367+0000","last_active":"2024-02-16T00:12:55.094330+0000","last_peered":"2024-02-16T00:12:55.094330+0000","last_clean":"2024-02-16T00:12:55.094330+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:55.094330+0000","last_undegraded":"2024-02-16T00:12:55.094330+0000","last_fullsized":"2024-02-16T00:12:55.094330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.094244+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:26.439070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'243","reported_seq":343,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.239434+0000","last_change":"2024-02-16T00:12:39.239506+0000","last_active":"2024-02-16T00:12:39.239434+0000","last_peered":"2024-02-16T00:12:39.239434+0000","last_clean":"2024-02-16T00:12:39.239434+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:39.239434+0000","last_undegraded":"2024-02-16T00:12:39.239434+0000","last_fullsized":"2024-02-16T00:12:39.239434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.239332+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:03:36.377883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140843+0000","last_change":"2024-02-16T00:11:12.826412+0000","last_active":"2024-02-16T00:12:38.140843+0000","last_peered":"2024-02-16T00:12:38.140843+0000","last_clean":"2024-02-16T00:12:38.140843+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:12:38.140843+0000","last_undegraded":"2024-02-16T00:12:38.140843+0000","last_fullsized":"2024-02-16T00:12:38.140843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.977445+0000","last_change":"2024-02-16T00:11:51.834792+0000","last_active":"2024-02-16T00:12:27.977445+0000","last_peered":"2024-02-16T00:12:27.977445+0000","last_clean":"2024-02-16T00:12:27.977445+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:12:27.977445+0000","last_undegraded":"2024-02-16T00:12:27.977445+0000","last_fullsized":"2024-02-16T00:12:27.977445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456693+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:12:39.456693+0000","last_peered":"2024-02-16T00:12:39.456693+0000","last_clean":"2024-02-16T00:12:39.456693+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:12:39.456693+0000","last_undegraded":"2024-02-16T00:12:39.456693+0000","last_fullsized":"2024-02-16T00:12:39.456693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'4","reported_seq":373,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.634630+0000","last_change":"2024-02-16T00:12:53.634659+0000","last_active":"2024-02-16T00:12:53.634630+0000","last_peered":"2024-02-16T00:12:53.634630+0000","last_clean":"2024-02-16T00:12:53.634630+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:53.634630+0000","last_undegraded":"2024-02-16T00:12:53.634630+0000","last_fullsized":"2024-02-16T00:12:53.634630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.634543+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:19.504192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.010885+0000","last_change":"2024-02-16T00:13:06.010930+0000","last_active":"2024-02-16T00:13:06.010885+0000","last_peered":"2024-02-16T00:13:06.010885+0000","last_clean":"2024-02-16T00:13:06.010885+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:13:06.010885+0000","last_undegraded":"2024-02-16T00:13:06.010885+0000","last_fullsized":"2024-02-16T00:13:06.010885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.010796+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:32.982515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'243","reported_seq":346,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.455920+0000","last_change":"2024-02-16T00:12:42.455945+0000","last_active":"2024-02-16T00:12:42.455920+0000","last_peered":"2024-02-16T00:12:42.455920+0000","last_clean":"2024-02-16T00:12:42.455920+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:42.455920+0000","last_undegraded":"2024-02-16T00:12:42.455920+0000","last_fullsized":"2024-02-16T00:12:42.455920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.455835+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.530697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.191670+0000","last_change":"2024-02-16T00:12:50.191670+0000","last_active":"2024-02-16T00:12:50.191670+0000","last_peered":"2024-02-16T00:12:50.191670+0000","last_clean":"2024-02-16T00:12:50.191670+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:12:50.191670+0000","last_undegraded":"2024-02-16T00:12:50.191670+0000","last_fullsized":"2024-02-16T00:12:50.191670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.191478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:27.718003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.608023+0000","last_change":"2024-02-16T00:13:00.608047+0000","last_active":"2024-02-16T00:13:00.608023+0000","last_peered":"2024-02-16T00:13:00.608023+0000","last_clean":"2024-02-16T00:13:00.608023+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:13:00.608023+0000","last_undegraded":"2024-02-16T00:13:00.608023+0000","last_fullsized":"2024-02-16T00:13:00.608023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.607926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:11.384475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456620+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:12:39.456620+0000","last_peered":"2024-02-16T00:12:39.456620+0000","last_clean":"2024-02-16T00:12:39.456620+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:12:39.456620+0000","last_undegraded":"2024-02-16T00:12:39.456620+0000","last_fullsized":"2024-02-16T00:12:39.456620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.956482+0000","last_change":"2024-02-16T00:12:47.956544+0000","last_active":"2024-02-16T00:12:47.956482+0000","last_peered":"2024-02-16T00:12:47.956482+0000","last_clean":"2024-02-16T00:12:47.956482+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:12:47.956482+0000","last_undegraded":"2024-02-16T00:12:47.956482+0000","last_fullsized":"2024-02-16T00:12:47.956482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.956387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:46.994810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.531363+0000","last_change":"2024-02-16T00:12:39.531411+0000","last_active":"2024-02-16T00:12:39.531363+0000","last_peered":"2024-02-16T00:12:39.531363+0000","last_clean":"2024-02-16T00:12:39.531363+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:39.531363+0000","last_undegraded":"2024-02-16T00:12:39.531363+0000","last_fullsized":"2024-02-16T00:12:39.531363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.531279+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:07.205098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.313209+0000","last_change":"2024-02-16T00:12:41.313251+0000","last_active":"2024-02-16T00:12:41.313209+0000","last_peered":"2024-02-16T00:12:41.313209+0000","last_clean":"2024-02-16T00:12:41.313209+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:12:41.313209+0000","last_undegraded":"2024-02-16T00:12:41.313209+0000","last_fullsized":"2024-02-16T00:12:41.313209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.313091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:34.237575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.551467+0000","last_change":"2024-02-16T00:13:06.551467+0000","last_active":"2024-02-16T00:13:06.551467+0000","last_peered":"2024-02-16T00:13:06.551467+0000","last_clean":"2024-02-16T00:13:06.551467+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:13:06.551467+0000","last_undegraded":"2024-02-16T00:13:06.551467+0000","last_fullsized":"2024-02-16T00:13:06.551467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.551352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:50.228037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.978897+0000","last_change":"2024-02-16T00:12:53.978897+0000","last_active":"2024-02-16T00:12:53.978897+0000","last_peered":"2024-02-16T00:12:53.978897+0000","last_clean":"2024-02-16T00:12:53.978897+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:53.978897+0000","last_undegraded":"2024-02-16T00:12:53.978897+0000","last_fullsized":"2024-02-16T00:12:53.978897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.978770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:56.425577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579155+0000","last_change":"2024-02-16T00:10:55.438548+0000","last_active":"2024-02-16T00:12:38.579155+0000","last_peered":"2024-02-16T00:12:38.579155+0000","last_clean":"2024-02-16T00:12:38.579155+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:12:38.579155+0000","last_undegraded":"2024-02-16T00:12:38.579155+0000","last_fullsized":"2024-02-16T00:12:38.579155+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456522+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:12:39.456522+0000","last_peered":"2024-02-16T00:12:39.456522+0000","last_clean":"2024-02-16T00:12:39.456522+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:12:39.456522+0000","last_undegraded":"2024-02-16T00:12:39.456522+0000","last_fullsized":"2024-02-16T00:12:39.456522+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456591+0000","last_change":"2024-02-16T00:11:02.823633+0000","last_active":"2024-02-16T00:12:39.456591+0000","last_peered":"2024-02-16T00:12:39.456591+0000","last_clean":"2024-02-16T00:12:39.456591+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:12:39.456591+0000","last_undegraded":"2024-02-16T00:12:39.456591+0000","last_fullsized":"2024-02-16T00:12:39.456591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.646834+0000","last_change":"2024-02-16T00:12:55.646834+0000","last_active":"2024-02-16T00:12:55.646834+0000","last_peered":"2024-02-16T00:12:55.646834+0000","last_clean":"2024-02-16T00:12:55.646834+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:12:55.646834+0000","last_undegraded":"2024-02-16T00:12:55.646834+0000","last_fullsized":"2024-02-16T00:12:55.646834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.646719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:53.816935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.997697+0000","last_change":"2024-02-16T00:12:46.997697+0000","last_active":"2024-02-16T00:12:46.997697+0000","last_peered":"2024-02-16T00:12:46.997697+0000","last_clean":"2024-02-16T00:12:46.997697+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:46.997697+0000","last_undegraded":"2024-02-16T00:12:46.997697+0000","last_fullsized":"2024-02-16T00:12:46.997697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.997576+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:05:47.865804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.895085+0000","last_change":"2024-02-16T00:12:38.895106+0000","last_active":"2024-02-16T00:12:38.895085+0000","last_peered":"2024-02-16T00:12:38.895085+0000","last_clean":"2024-02-16T00:12:38.895085+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:12:38.895085+0000","last_undegraded":"2024-02-16T00:12:38.895085+0000","last_fullsized":"2024-02-16T00:12:38.895085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_clean_scrub_stamp":"2024-02-16T00:12:38.895009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:07.402769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.287831+0000","last_change":"2024-02-16T00:12:46.287858+0000","last_active":"2024-02-16T00:12:46.287831+0000","last_peered":"2024-02-16T00:12:46.287831+0000","last_clean":"2024-02-16T00:12:46.287831+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:46.287831+0000","last_undegraded":"2024-02-16T00:12:46.287831+0000","last_fullsized":"2024-02-16T00:12:46.287831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.287742+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:27.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457120+0000","last_change":"2024-02-16T00:11:04.805947+0000","last_active":"2024-02-16T00:12:39.457120+0000","last_peered":"2024-02-16T00:12:39.457120+0000","last_clean":"2024-02-16T00:12:39.457120+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:12:39.457120+0000","last_undegraded":"2024-02-16T00:12:39.457120+0000","last_fullsized":"2024-02-16T00:12:39.457120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456516+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:12:39.456516+0000","last_peered":"2024-02-16T00:12:39.456516+0000","last_clean":"2024-02-16T00:12:39.456516+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:12:39.456516+0000","last_undegraded":"2024-02-16T00:12:39.456516+0000","last_fullsized":"2024-02-16T00:12:39.456516+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.808017+0000","last_change":"2024-02-16T00:13:11.808042+0000","last_active":"2024-02-16T00:13:11.808017+0000","last_peered":"2024-02-16T00:13:11.808017+0000","last_clean":"2024-02-16T00:13:11.808017+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:13:11.808017+0000","last_undegraded":"2024-02-16T00:13:11.808017+0000","last_fullsized":"2024-02-16T00:13:11.808017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.807928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:43.625385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457476+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:12:39.457476+0000","last_peered":"2024-02-16T00:12:39.457476+0000","last_clean":"2024-02-16T00:12:39.457476+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:12:39.457476+0000","last_undegraded":"2024-02-16T00:12:39.457476+0000","last_fullsized":"2024-02-16T00:12:39.457476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'263","reported_seq":460,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.503542+0000","last_change":"2024-02-16T00:12:41.503542+0000","last_active":"2024-02-16T00:12:41.503542+0000","last_peered":"2024-02-16T00:12:41.503542+0000","last_clean":"2024-02-16T00:12:41.503542+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:41.503542+0000","last_undegraded":"2024-02-16T00:12:41.503542+0000","last_fullsized":"2024-02-16T00:12:41.503542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'263","last_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_deep_scrub":"29'263","last_deep_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.503409+0000","objects_scrubbed":11,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:12.672777+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":329,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.038391+0000","last_change":"2024-02-16T00:13:01.038391+0000","last_active":"2024-02-16T00:13:01.038391+0000","last_peered":"2024-02-16T00:13:01.038391+0000","last_clean":"2024-02-16T00:13:01.038391+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:13:01.038391+0000","last_undegraded":"2024-02-16T00:13:01.038391+0000","last_fullsized":"2024-02-16T00:13:01.038391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.038282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:10:49.789079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.763745+0000","last_change":"2024-02-16T00:11:12.828339+0000","last_active":"2024-02-16T00:12:27.763745+0000","last_peered":"2024-02-16T00:12:27.763745+0000","last_clean":"2024-02-16T00:12:27.763745+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:12:27.763745+0000","last_undegraded":"2024-02-16T00:12:27.763745+0000","last_fullsized":"2024-02-16T00:12:27.763745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.757812+0000","last_change":"2024-02-16T00:13:07.757812+0000","last_active":"2024-02-16T00:13:07.757812+0000","last_peered":"2024-02-16T00:13:07.757812+0000","last_clean":"2024-02-16T00:13:07.757812+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:13:07.757812+0000","last_undegraded":"2024-02-16T00:13:07.757812+0000","last_fullsized":"2024-02-16T00:13:07.757812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.757686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:36.310457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020394+0000","last_change":"2024-02-16T00:10:55.436659+0000","last_active":"2024-02-16T00:12:39.020394+0000","last_peered":"2024-02-16T00:12:39.020394+0000","last_clean":"2024-02-16T00:12:39.020394+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:12:39.020394+0000","last_undegraded":"2024-02-16T00:12:39.020394+0000","last_fullsized":"2024-02-16T00:12:39.020394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.139830+0000","last_change":"2024-02-16T00:11:02.802061+0000","last_active":"2024-02-16T00:12:38.139830+0000","last_peered":"2024-02-16T00:12:38.139830+0000","last_clean":"2024-02-16T00:12:38.139830+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:12:38.139830+0000","last_undegraded":"2024-02-16T00:12:38.139830+0000","last_fullsized":"2024-02-16T00:12:38.139830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.171880+0000","last_change":"2024-02-16T00:13:01.171880+0000","last_active":"2024-02-16T00:13:01.171880+0000","last_peered":"2024-02-16T00:13:01.171880+0000","last_clean":"2024-02-16T00:13:01.171880+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:13:01.171880+0000","last_undegraded":"2024-02-16T00:13:01.171880+0000","last_fullsized":"2024-02-16T00:13:01.171880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.171761+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:27.041410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.284740+0000","last_change":"2024-02-16T00:12:47.284740+0000","last_active":"2024-02-16T00:12:47.284740+0000","last_peered":"2024-02-16T00:12:47.284740+0000","last_clean":"2024-02-16T00:12:47.284740+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:47.284740+0000","last_undegraded":"2024-02-16T00:12:47.284740+0000","last_fullsized":"2024-02-16T00:12:47.284740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.284612+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:18.453979+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.908420+0000","last_change":"2024-02-16T00:12:39.908420+0000","last_active":"2024-02-16T00:12:39.908420+0000","last_peered":"2024-02-16T00:12:39.908420+0000","last_clean":"2024-02-16T00:12:39.908420+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:12:39.908420+0000","last_undegraded":"2024-02-16T00:12:39.908420+0000","last_fullsized":"2024-02-16T00:12:39.908420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.908319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:17.603599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840100+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:11:50.840100+0000","last_peered":"2024-02-16T00:11:50.840100+0000","last_clean":"2024-02-16T00:11:50.840100+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:11:50.840100+0000","last_undegraded":"2024-02-16T00:11:50.840100+0000","last_fullsized":"2024-02-16T00:11:50.840100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.824008+0000","last_change":"2024-02-16T00:13:16.824040+0000","last_active":"2024-02-16T00:13:16.824008+0000","last_peered":"2024-02-16T00:13:16.824008+0000","last_clean":"2024-02-16T00:13:16.824008+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:13:16.824008+0000","last_undegraded":"2024-02-16T00:13:16.824008+0000","last_fullsized":"2024-02-16T00:13:16.824008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.823910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:40.976221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456538+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:12:39.456538+0000","last_peered":"2024-02-16T00:12:39.456538+0000","last_clean":"2024-02-16T00:12:39.456538+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:12:39.456538+0000","last_undegraded":"2024-02-16T00:12:39.456538+0000","last_fullsized":"2024-02-16T00:12:39.456538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020390+0000","last_change":"2024-02-16T00:11:02.811825+0000","last_active":"2024-02-16T00:12:39.020390+0000","last_peered":"2024-02-16T00:12:39.020390+0000","last_clean":"2024-02-16T00:12:39.020390+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:12:39.020390+0000","last_undegraded":"2024-02-16T00:12:39.020390+0000","last_fullsized":"2024-02-16T00:12:39.020390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733703+0000","last_change":"2024-02-16T00:11:50.851092+0000","last_active":"2024-02-16T00:11:53.733703+0000","last_peered":"2024-02-16T00:11:53.733703+0000","last_clean":"2024-02-16T00:11:53.733703+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:11:53.733703+0000","last_undegraded":"2024-02-16T00:11:53.733703+0000","last_fullsized":"2024-02-16T00:11:53.733703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.935999+0000","last_change":"2024-02-16T00:12:52.935999+0000","last_active":"2024-02-16T00:12:52.935999+0000","last_peered":"2024-02-16T00:12:52.935999+0000","last_clean":"2024-02-16T00:12:52.935999+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:12:52.935999+0000","last_undegraded":"2024-02-16T00:12:52.935999+0000","last_fullsized":"2024-02-16T00:12:52.935999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.935867+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:29.245202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.060676+0000","last_change":"2024-02-16T00:13:02.060701+0000","last_active":"2024-02-16T00:13:02.060676+0000","last_peered":"2024-02-16T00:13:02.060676+0000","last_clean":"2024-02-16T00:13:02.060676+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:13:02.060676+0000","last_undegraded":"2024-02-16T00:13:02.060676+0000","last_fullsized":"2024-02-16T00:13:02.060676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.060586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:22.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848782+0000","last_change":"2024-02-16T00:11:12.835325+0000","last_active":"2024-02-16T00:11:50.848782+0000","last_peered":"2024-02-16T00:11:50.848782+0000","last_clean":"2024-02-16T00:11:50.848782+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:11:50.848782+0000","last_undegraded":"2024-02-16T00:11:50.848782+0000","last_fullsized":"2024-02-16T00:11:50.848782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.631131+0000","last_change":"2024-02-16T00:13:03.631131+0000","last_active":"2024-02-16T00:13:03.631131+0000","last_peered":"2024-02-16T00:13:03.631131+0000","last_clean":"2024-02-16T00:13:03.631131+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:13:03.631131+0000","last_undegraded":"2024-02-16T00:13:03.631131+0000","last_fullsized":"2024-02-16T00:13:03.631131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.630995+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:48.259171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.020434+0000","last_change":"2024-02-16T00:11:02.805928+0000","last_active":"2024-02-16T00:12:39.020434+0000","last_peered":"2024-02-16T00:12:39.020434+0000","last_clean":"2024-02-16T00:12:39.020434+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:12:39.020434+0000","last_undegraded":"2024-02-16T00:12:39.020434+0000","last_fullsized":"2024-02-16T00:12:39.020434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.139809+0000","last_change":"2024-02-16T00:10:55.436709+0000","last_active":"2024-02-16T00:12:38.139809+0000","last_peered":"2024-02-16T00:12:38.139809+0000","last_clean":"2024-02-16T00:12:38.139809+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:12:38.139809+0000","last_undegraded":"2024-02-16T00:12:38.139809+0000","last_fullsized":"2024-02-16T00:12:38.139809+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.830866+0000","last_change":"2024-02-16T00:12:53.830866+0000","last_active":"2024-02-16T00:12:53.830866+0000","last_peered":"2024-02-16T00:12:53.830866+0000","last_clean":"2024-02-16T00:12:53.830866+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:12:53.830866+0000","last_undegraded":"2024-02-16T00:12:53.830866+0000","last_fullsized":"2024-02-16T00:12:53.830866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.830730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:52.000946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'82","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.898405+0000","last_change":"2024-02-16T00:12:49.898405+0000","last_active":"2024-02-16T00:12:49.898405+0000","last_peered":"2024-02-16T00:12:49.898405+0000","last_clean":"2024-02-16T00:12:49.898405+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:49.898405+0000","last_undegraded":"2024-02-16T00:12:49.898405+0000","last_fullsized":"2024-02-16T00:12:49.898405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.898247+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:43:05.900172+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":88,"num_read_kb":74,"num_write":40,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.271734+0000","last_change":"2024-02-16T00:12:40.271734+0000","last_active":"2024-02-16T00:12:40.271734+0000","last_peered":"2024-02-16T00:12:40.271734+0000","last_clean":"2024-02-16T00:12:40.271734+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:12:40.271734+0000","last_undegraded":"2024-02-16T00:12:40.271734+0000","last_fullsized":"2024-02-16T00:12:40.271734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.271589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:58.621135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.987291+0000","last_change":"2024-02-16T00:11:12.822048+0000","last_active":"2024-02-16T00:12:27.987291+0000","last_peered":"2024-02-16T00:12:27.987291+0000","last_clean":"2024-02-16T00:12:27.987291+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:12:27.987291+0000","last_undegraded":"2024-02-16T00:12:27.987291+0000","last_fullsized":"2024-02-16T00:12:27.987291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.602576+0000","last_change":"2024-02-16T00:12:59.602576+0000","last_active":"2024-02-16T00:12:59.602576+0000","last_peered":"2024-02-16T00:12:59.602576+0000","last_clean":"2024-02-16T00:12:59.602576+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:12:59.602576+0000","last_undegraded":"2024-02-16T00:12:59.602576+0000","last_fullsized":"2024-02-16T00:12:59.602576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.602467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:39.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.139934+0000","last_change":"2024-02-16T00:11:02.801240+0000","last_active":"2024-02-16T00:12:38.139934+0000","last_peered":"2024-02-16T00:12:38.139934+0000","last_clean":"2024-02-16T00:12:38.139934+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:12:38.139934+0000","last_undegraded":"2024-02-16T00:12:38.139934+0000","last_fullsized":"2024-02-16T00:12:38.139934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456618+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:12:39.456618+0000","last_peered":"2024-02-16T00:12:39.456618+0000","last_clean":"2024-02-16T00:12:39.456618+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:12:39.456618+0000","last_undegraded":"2024-02-16T00:12:39.456618+0000","last_fullsized":"2024-02-16T00:12:39.456618+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.038166+0000","last_change":"2024-02-16T00:12:44.038166+0000","last_active":"2024-02-16T00:12:44.038166+0000","last_peered":"2024-02-16T00:12:44.038166+0000","last_clean":"2024-02-16T00:12:44.038166+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:12:44.038166+0000","last_undegraded":"2024-02-16T00:12:44.038166+0000","last_fullsized":"2024-02-16T00:12:44.038166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.038018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:35.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'28","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.546695+0000","last_change":"2024-02-16T00:12:40.546695+0000","last_active":"2024-02-16T00:12:40.546695+0000","last_peered":"2024-02-16T00:12:40.546695+0000","last_clean":"2024-02-16T00:12:40.546695+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:12:40.546695+0000","last_undegraded":"2024-02-16T00:12:40.546695+0000","last_fullsized":"2024-02-16T00:12:40.546695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.546560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:21.906524+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'243","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.683178+0000","last_change":"2024-02-16T00:12:54.683178+0000","last_active":"2024-02-16T00:12:54.683178+0000","last_peered":"2024-02-16T00:12:54.683178+0000","last_clean":"2024-02-16T00:12:54.683178+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:54.683178+0000","last_undegraded":"2024-02-16T00:12:54.683178+0000","last_fullsized":"2024-02-16T00:12:54.683178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.683065+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:10.032872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842508+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:11:50.842508+0000","last_peered":"2024-02-16T00:11:50.842508+0000","last_clean":"2024-02-16T00:11:50.842508+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:11:50.842508+0000","last_undegraded":"2024-02-16T00:11:50.842508+0000","last_fullsized":"2024-02-16T00:11:50.842508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.036881+0000","last_change":"2024-02-16T00:12:56.036881+0000","last_active":"2024-02-16T00:12:56.036881+0000","last_peered":"2024-02-16T00:12:56.036881+0000","last_clean":"2024-02-16T00:12:56.036881+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:56.036881+0000","last_undegraded":"2024-02-16T00:12:56.036881+0000","last_fullsized":"2024-02-16T00:12:56.036881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.036766+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:37:08.513561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456628+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:12:39.456628+0000","last_peered":"2024-02-16T00:12:39.456628+0000","last_clean":"2024-02-16T00:12:39.456628+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:12:39.456628+0000","last_undegraded":"2024-02-16T00:12:39.456628+0000","last_fullsized":"2024-02-16T00:12:39.456628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.139819+0000","last_change":"2024-02-16T00:10:55.437732+0000","last_active":"2024-02-16T00:12:38.139819+0000","last_peered":"2024-02-16T00:12:38.139819+0000","last_clean":"2024-02-16T00:12:38.139819+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:12:38.139819+0000","last_undegraded":"2024-02-16T00:12:38.139819+0000","last_fullsized":"2024-02-16T00:12:38.139819+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.031737+0000","last_change":"2024-02-16T00:12:42.031737+0000","last_active":"2024-02-16T00:12:42.031737+0000","last_peered":"2024-02-16T00:12:42.031737+0000","last_clean":"2024-02-16T00:12:42.031737+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:12:42.031737+0000","last_undegraded":"2024-02-16T00:12:42.031737+0000","last_fullsized":"2024-02-16T00:12:42.031737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.031605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:03.714051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.979307+0000","last_change":"2024-02-16T00:13:11.979307+0000","last_active":"2024-02-16T00:13:11.979307+0000","last_peered":"2024-02-16T00:13:11.979307+0000","last_clean":"2024-02-16T00:13:11.979307+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:13:11.979307+0000","last_undegraded":"2024-02-16T00:13:11.979307+0000","last_fullsized":"2024-02-16T00:13:11.979307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.979168+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.839816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'243","reported_seq":323,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.867290+0000","last_change":"2024-02-16T00:12:50.867290+0000","last_active":"2024-02-16T00:12:50.867290+0000","last_peered":"2024-02-16T00:12:50.867290+0000","last_clean":"2024-02-16T00:12:50.867290+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:50.867290+0000","last_undegraded":"2024-02-16T00:12:50.867290+0000","last_fullsized":"2024-02-16T00:12:50.867290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.867173+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:57.352373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'13","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:22.279844+0000","last_change":"2024-02-16T00:11:12.832931+0000","last_active":"2024-02-16T00:12:22.279844+0000","last_peered":"2024-02-16T00:12:22.279844+0000","last_clean":"2024-02-16T00:12:22.279844+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:12:22.279844+0000","last_undegraded":"2024-02-16T00:12:22.279844+0000","last_fullsized":"2024-02-16T00:12:22.279844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.178067+0000","last_change":"2024-02-16T00:13:14.178092+0000","last_active":"2024-02-16T00:13:14.178067+0000","last_peered":"2024-02-16T00:13:14.178067+0000","last_clean":"2024-02-16T00:13:14.178067+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:13:14.178067+0000","last_undegraded":"2024-02-16T00:13:14.178067+0000","last_fullsized":"2024-02-16T00:13:14.178067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.177977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:57.854662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579173+0000","last_change":"2024-02-16T00:11:02.796859+0000","last_active":"2024-02-16T00:12:38.579173+0000","last_peered":"2024-02-16T00:12:38.579173+0000","last_clean":"2024-02-16T00:12:38.579173+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:12:38.579173+0000","last_undegraded":"2024-02-16T00:12:38.579173+0000","last_fullsized":"2024-02-16T00:12:38.579173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456594+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:12:39.456594+0000","last_peered":"2024-02-16T00:12:39.456594+0000","last_clean":"2024-02-16T00:12:39.456594+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:12:39.456594+0000","last_undegraded":"2024-02-16T00:12:39.456594+0000","last_fullsized":"2024-02-16T00:12:39.456594+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.021889+0000","last_change":"2024-02-16T00:12:41.021889+0000","last_active":"2024-02-16T00:12:41.021889+0000","last_peered":"2024-02-16T00:12:41.021889+0000","last_clean":"2024-02-16T00:12:41.021889+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:12:41.021889+0000","last_undegraded":"2024-02-16T00:12:41.021889+0000","last_fullsized":"2024-02-16T00:12:41.021889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.021775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:07.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'97","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.111041+0000","last_change":"2024-02-16T00:12:52.111041+0000","last_active":"2024-02-16T00:12:52.111041+0000","last_peered":"2024-02-16T00:12:52.111041+0000","last_clean":"2024-02-16T00:12:52.111041+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:52.111041+0000","last_undegraded":"2024-02-16T00:12:52.111041+0000","last_fullsized":"2024-02-16T00:12:52.111041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'97","last_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_deep_scrub":"29'97","last_deep_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.110898+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:30.300620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.913378+0000","last_change":"2024-02-16T00:13:02.913378+0000","last_active":"2024-02-16T00:13:02.913378+0000","last_peered":"2024-02-16T00:13:02.913378+0000","last_clean":"2024-02-16T00:13:02.913378+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:13:02.913378+0000","last_undegraded":"2024-02-16T00:13:02.913378+0000","last_fullsized":"2024-02-16T00:13:02.913378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.913264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:45.929231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.193776+0000","last_change":"2024-02-16T00:13:02.193822+0000","last_active":"2024-02-16T00:13:02.193776+0000","last_peered":"2024-02-16T00:13:02.193776+0000","last_clean":"2024-02-16T00:13:02.193776+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:13:02.193776+0000","last_undegraded":"2024-02-16T00:13:02.193776+0000","last_fullsized":"2024-02-16T00:13:02.193776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.193681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:17.543487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.021443+0000","last_change":"2024-02-16T00:11:12.826512+0000","last_active":"2024-02-16T00:12:39.021443+0000","last_peered":"2024-02-16T00:12:39.021443+0000","last_clean":"2024-02-16T00:12:39.021443+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:12:39.021443+0000","last_undegraded":"2024-02-16T00:12:39.021443+0000","last_fullsized":"2024-02-16T00:12:39.021443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.185599+0000","last_change":"2024-02-16T00:13:18.185628+0000","last_active":"2024-02-16T00:13:18.185599+0000","last_peered":"2024-02-16T00:13:18.185599+0000","last_clean":"2024-02-16T00:13:18.185599+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:13:18.185599+0000","last_undegraded":"2024-02-16T00:13:18.185599+0000","last_fullsized":"2024-02-16T00:13:18.185599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.185505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:49.777334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842340+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:11:50.842340+0000","last_peered":"2024-02-16T00:11:50.842340+0000","last_clean":"2024-02-16T00:11:50.842340+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:11:50.842340+0000","last_undegraded":"2024-02-16T00:11:50.842340+0000","last_fullsized":"2024-02-16T00:11:50.842340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"29'2","reported_seq":203,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.629013+0000","last_change":"2024-02-16T00:12:52.629040+0000","last_active":"2024-02-16T00:12:52.629013+0000","last_peered":"2024-02-16T00:12:52.629013+0000","last_clean":"2024-02-16T00:12:52.629013+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:52.629013+0000","last_undegraded":"2024-02-16T00:12:52.629013+0000","last_fullsized":"2024-02-16T00:12:52.629013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.628926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:49.990836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'45","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.017727+0000","last_change":"2024-02-16T00:13:09.017778+0000","last_active":"2024-02-16T00:13:09.017727+0000","last_peered":"2024-02-16T00:13:09.017727+0000","last_clean":"2024-02-16T00:13:09.017727+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:13:09.017727+0000","last_undegraded":"2024-02-16T00:13:09.017727+0000","last_fullsized":"2024-02-16T00:13:09.017727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.017638+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:00.113238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.985105+0000","last_change":"2024-02-16T00:13:14.985144+0000","last_active":"2024-02-16T00:13:14.985105+0000","last_peered":"2024-02-16T00:13:14.985105+0000","last_clean":"2024-02-16T00:13:14.985105+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:13:14.985105+0000","last_undegraded":"2024-02-16T00:13:14.985105+0000","last_fullsized":"2024-02-16T00:13:14.985105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.985010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:26.901071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.788597+0000","last_change":"2024-02-16T00:13:06.788597+0000","last_active":"2024-02-16T00:13:06.788597+0000","last_peered":"2024-02-16T00:13:06.788597+0000","last_clean":"2024-02-16T00:13:06.788597+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:13:06.788597+0000","last_undegraded":"2024-02-16T00:13:06.788597+0000","last_fullsized":"2024-02-16T00:13:06.788597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.788487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:05.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:53.733630+0000","last_change":"2024-02-16T00:11:50.857588+0000","last_active":"2024-02-16T00:11:53.733630+0000","last_peered":"2024-02-16T00:11:53.733630+0000","last_clean":"2024-02-16T00:11:53.733630+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:11:53.733630+0000","last_undegraded":"2024-02-16T00:11:53.733630+0000","last_fullsized":"2024-02-16T00:11:53.733630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841583+0000","last_change":"2024-02-16T00:11:02.805825+0000","last_active":"2024-02-16T00:11:50.841583+0000","last_peered":"2024-02-16T00:11:50.841583+0000","last_clean":"2024-02-16T00:11:50.841583+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:11:50.841583+0000","last_undegraded":"2024-02-16T00:11:50.841583+0000","last_fullsized":"2024-02-16T00:11:50.841583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.045389+0000","last_change":"2024-02-16T00:12:40.045412+0000","last_active":"2024-02-16T00:12:40.045389+0000","last_peered":"2024-02-16T00:12:40.045389+0000","last_clean":"2024-02-16T00:12:40.045389+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:12:40.045389+0000","last_undegraded":"2024-02-16T00:12:40.045389+0000","last_fullsized":"2024-02-16T00:12:40.045389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.045296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:50.821845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.941059+0000","last_change":"2024-02-16T00:12:45.941093+0000","last_active":"2024-02-16T00:12:45.941059+0000","last_peered":"2024-02-16T00:12:45.941059+0000","last_clean":"2024-02-16T00:12:45.941059+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:45.941059+0000","last_undegraded":"2024-02-16T00:12:45.941059+0000","last_fullsized":"2024-02-16T00:12:45.941059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.940956+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:12.093182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.279152+0000","last_change":"2024-02-16T00:12:43.279177+0000","last_active":"2024-02-16T00:12:43.279152+0000","last_peered":"2024-02-16T00:12:43.279152+0000","last_clean":"2024-02-16T00:12:43.279152+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:12:43.279152+0000","last_undegraded":"2024-02-16T00:12:43.279152+0000","last_fullsized":"2024-02-16T00:12:43.279152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.279059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:05.341803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830302+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830302+0000","last_peered":"2024-02-16T00:11:51.830302+0000","last_clean":"2024-02-16T00:11:51.830302+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830302+0000","last_undegraded":"2024-02-16T00:11:51.830302+0000","last_fullsized":"2024-02-16T00:11:51.830302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.767230+0000","last_change":"2024-02-16T00:13:14.767257+0000","last_active":"2024-02-16T00:13:14.767230+0000","last_peered":"2024-02-16T00:13:14.767230+0000","last_clean":"2024-02-16T00:13:14.767230+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:13:14.767230+0000","last_undegraded":"2024-02-16T00:13:14.767230+0000","last_fullsized":"2024-02-16T00:13:14.767230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.767144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:02.591440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842156+0000","last_change":"2024-02-16T00:11:02.815585+0000","last_active":"2024-02-16T00:11:50.842156+0000","last_peered":"2024-02-16T00:11:50.842156+0000","last_clean":"2024-02-16T00:11:50.842156+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:11:50.842156+0000","last_undegraded":"2024-02-16T00:11:50.842156+0000","last_fullsized":"2024-02-16T00:11:50.842156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.057517+0000","last_change":"2024-02-16T00:12:56.057565+0000","last_active":"2024-02-16T00:12:56.057517+0000","last_peered":"2024-02-16T00:12:56.057517+0000","last_clean":"2024-02-16T00:12:56.057517+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:12:56.057517+0000","last_undegraded":"2024-02-16T00:12:56.057517+0000","last_fullsized":"2024-02-16T00:12:56.057517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.057413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:26.439361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.803036+0000","last_change":"2024-02-16T00:12:52.803076+0000","last_active":"2024-02-16T00:12:52.803036+0000","last_peered":"2024-02-16T00:12:52.803036+0000","last_clean":"2024-02-16T00:12:52.803036+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:52.803036+0000","last_undegraded":"2024-02-16T00:12:52.803036+0000","last_fullsized":"2024-02-16T00:12:52.803036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.802940+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:55.924565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.555534+0000","last_change":"2024-02-16T00:12:50.555567+0000","last_active":"2024-02-16T00:12:50.555534+0000","last_peered":"2024-02-16T00:12:50.555534+0000","last_clean":"2024-02-16T00:12:50.555534+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:12:50.555534+0000","last_undegraded":"2024-02-16T00:12:50.555534+0000","last_fullsized":"2024-02-16T00:12:50.555534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.555443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:51.432013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844349+0000","last_change":"2024-02-16T00:11:12.831687+0000","last_active":"2024-02-16T00:11:50.844349+0000","last_peered":"2024-02-16T00:11:50.844349+0000","last_clean":"2024-02-16T00:11:50.844349+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:11:50.844349+0000","last_undegraded":"2024-02-16T00:11:50.844349+0000","last_fullsized":"2024-02-16T00:11:50.844349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.080694+0000","last_change":"2024-02-16T00:12:57.080743+0000","last_active":"2024-02-16T00:12:57.080694+0000","last_peered":"2024-02-16T00:12:57.080694+0000","last_clean":"2024-02-16T00:12:57.080694+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:12:57.080694+0000","last_undegraded":"2024-02-16T00:12:57.080694+0000","last_fullsized":"2024-02-16T00:12:57.080694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.080604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:49.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849489+0000","last_change":"2024-02-16T00:11:02.814174+0000","last_active":"2024-02-16T00:11:50.849489+0000","last_peered":"2024-02-16T00:11:50.849489+0000","last_clean":"2024-02-16T00:11:50.849489+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:11:50.849489+0000","last_undegraded":"2024-02-16T00:11:50.849489+0000","last_fullsized":"2024-02-16T00:11:50.849489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.884349+0000","last_change":"2024-02-16T00:12:49.884373+0000","last_active":"2024-02-16T00:12:49.884349+0000","last_peered":"2024-02-16T00:12:49.884349+0000","last_clean":"2024-02-16T00:12:49.884349+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:12:49.884349+0000","last_undegraded":"2024-02-16T00:12:49.884349+0000","last_fullsized":"2024-02-16T00:12:49.884349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.884258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:21.476087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'34","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.114045+0000","last_change":"2024-02-16T00:12:53.114102+0000","last_active":"2024-02-16T00:12:53.114045+0000","last_peered":"2024-02-16T00:12:53.114045+0000","last_clean":"2024-02-16T00:12:53.114045+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:53.114045+0000","last_undegraded":"2024-02-16T00:12:53.114045+0000","last_fullsized":"2024-02-16T00:12:53.114045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.113947+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:53.697900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.267881+0000","last_change":"2024-02-16T00:12:44.267908+0000","last_active":"2024-02-16T00:12:44.267881+0000","last_peered":"2024-02-16T00:12:44.267881+0000","last_clean":"2024-02-16T00:12:44.267881+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:12:44.267881+0000","last_undegraded":"2024-02-16T00:12:44.267881+0000","last_fullsized":"2024-02-16T00:12:44.267881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.267784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:28:21.260343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457268+0000","last_change":"2024-02-16T00:11:04.799979+0000","last_active":"2024-02-16T00:12:39.457268+0000","last_peered":"2024-02-16T00:12:39.457268+0000","last_clean":"2024-02-16T00:12:39.457268+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:12:39.457268+0000","last_undegraded":"2024-02-16T00:12:39.457268+0000","last_fullsized":"2024-02-16T00:12:39.457268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839602+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:11:50.839602+0000","last_peered":"2024-02-16T00:11:50.839602+0000","last_clean":"2024-02-16T00:11:50.839602+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:11:50.839602+0000","last_undegraded":"2024-02-16T00:11:50.839602+0000","last_fullsized":"2024-02-16T00:11:50.839602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.805078+0000","last_change":"2024-02-16T00:12:57.805078+0000","last_active":"2024-02-16T00:12:57.805078+0000","last_peered":"2024-02-16T00:12:57.805078+0000","last_clean":"2024-02-16T00:12:57.805078+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:12:57.805078+0000","last_undegraded":"2024-02-16T00:12:57.805078+0000","last_fullsized":"2024-02-16T00:12:57.805078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.804963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:37.236667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'67","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.901384+0000","last_change":"2024-02-16T00:12:47.901456+0000","last_active":"2024-02-16T00:12:47.901384+0000","last_peered":"2024-02-16T00:12:47.901384+0000","last_clean":"2024-02-16T00:12:47.901384+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:47.901384+0000","last_undegraded":"2024-02-16T00:12:47.901384+0000","last_fullsized":"2024-02-16T00:12:47.901384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.901291+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:48.763246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.239732+0000","last_change":"2024-02-16T00:12:45.239756+0000","last_active":"2024-02-16T00:12:45.239732+0000","last_peered":"2024-02-16T00:12:45.239732+0000","last_clean":"2024-02-16T00:12:45.239732+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:12:45.239732+0000","last_undegraded":"2024-02-16T00:12:45.239732+0000","last_fullsized":"2024-02-16T00:12:45.239732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.239638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:12.913457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.983254+0000","last_change":"2024-02-16T00:11:12.826496+0000","last_active":"2024-02-16T00:12:27.983254+0000","last_peered":"2024-02-16T00:12:27.983254+0000","last_clean":"2024-02-16T00:12:27.983254+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:12:27.983254+0000","last_undegraded":"2024-02-16T00:12:27.983254+0000","last_fullsized":"2024-02-16T00:12:27.983254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.800160+0000","last_change":"2024-02-16T00:13:12.800216+0000","last_active":"2024-02-16T00:13:12.800160+0000","last_peered":"2024-02-16T00:13:12.800160+0000","last_clean":"2024-02-16T00:13:12.800160+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:13:12.800160+0000","last_undegraded":"2024-02-16T00:13:12.800160+0000","last_fullsized":"2024-02-16T00:13:12.800160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.800049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:49.109384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.846701+0000","last_change":"2024-02-16T00:11:02.820397+0000","last_active":"2024-02-16T00:11:50.846701+0000","last_peered":"2024-02-16T00:11:50.846701+0000","last_clean":"2024-02-16T00:11:50.846701+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:11:50.846701+0000","last_undegraded":"2024-02-16T00:11:50.846701+0000","last_fullsized":"2024-02-16T00:11:50.846701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.155308+0000","last_change":"2024-02-16T00:13:00.155308+0000","last_active":"2024-02-16T00:13:00.155308+0000","last_peered":"2024-02-16T00:13:00.155308+0000","last_clean":"2024-02-16T00:13:00.155308+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:13:00.155308+0000","last_undegraded":"2024-02-16T00:13:00.155308+0000","last_fullsized":"2024-02-16T00:13:00.155308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.155119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:57.517028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'44","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.019881+0000","last_change":"2024-02-16T00:13:08.019925+0000","last_active":"2024-02-16T00:13:08.019881+0000","last_peered":"2024-02-16T00:13:08.019881+0000","last_clean":"2024-02-16T00:13:08.019881+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:13:08.019881+0000","last_undegraded":"2024-02-16T00:13:08.019881+0000","last_fullsized":"2024-02-16T00:13:08.019881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.019795+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:01.526130+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.644016+0000","last_change":"2024-02-16T00:12:58.644040+0000","last_active":"2024-02-16T00:12:58.644016+0000","last_peered":"2024-02-16T00:12:58.644016+0000","last_clean":"2024-02-16T00:12:58.644016+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:12:58.644016+0000","last_undegraded":"2024-02-16T00:12:58.644016+0000","last_fullsized":"2024-02-16T00:12:58.644016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.643930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:14.513005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839602+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:11:50.839602+0000","last_peered":"2024-02-16T00:11:50.839602+0000","last_clean":"2024-02-16T00:11:50.839602+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:11:50.839602+0000","last_undegraded":"2024-02-16T00:11:50.839602+0000","last_fullsized":"2024-02-16T00:11:50.839602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.909368+0000","last_change":"2024-02-16T00:12:51.909416+0000","last_active":"2024-02-16T00:12:51.909368+0000","last_peered":"2024-02-16T00:12:51.909368+0000","last_clean":"2024-02-16T00:12:51.909368+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:12:51.909368+0000","last_undegraded":"2024-02-16T00:12:51.909368+0000","last_fullsized":"2024-02-16T00:12:51.909368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.909268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:23.726726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847897+0000","last_change":"2024-02-16T00:11:02.796631+0000","last_active":"2024-02-16T00:11:50.847897+0000","last_peered":"2024-02-16T00:11:50.847897+0000","last_clean":"2024-02-16T00:11:50.847897+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:11:50.847897+0000","last_undegraded":"2024-02-16T00:11:50.847897+0000","last_fullsized":"2024-02-16T00:11:50.847897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.196550+0000","last_change":"2024-02-16T00:13:03.196573+0000","last_active":"2024-02-16T00:13:03.196550+0000","last_peered":"2024-02-16T00:13:03.196550+0000","last_clean":"2024-02-16T00:13:03.196550+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:13:03.196550+0000","last_undegraded":"2024-02-16T00:13:03.196550+0000","last_fullsized":"2024-02-16T00:13:03.196550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.196453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:01.366669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.821474+0000","last_change":"2024-02-16T00:12:51.821474+0000","last_active":"2024-02-16T00:12:51.821474+0000","last_peered":"2024-02-16T00:12:51.821474+0000","last_clean":"2024-02-16T00:12:51.821474+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:51.821474+0000","last_undegraded":"2024-02-16T00:12:51.821474+0000","last_fullsized":"2024-02-16T00:12:51.821474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.821350+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:13:29.475897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.806808+0000","last_change":"2024-02-16T00:12:54.806808+0000","last_active":"2024-02-16T00:12:54.806808+0000","last_peered":"2024-02-16T00:12:54.806808+0000","last_clean":"2024-02-16T00:12:54.806808+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:12:54.806808+0000","last_undegraded":"2024-02-16T00:12:54.806808+0000","last_fullsized":"2024-02-16T00:12:54.806808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.806699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:52.208925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840203+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:11:50.840203+0000","last_peered":"2024-02-16T00:11:50.840203+0000","last_clean":"2024-02-16T00:11:50.840203+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:11:50.840203+0000","last_undegraded":"2024-02-16T00:11:50.840203+0000","last_fullsized":"2024-02-16T00:11:50.840203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.831748+0000","last_change":"2024-02-16T00:11:04.801768+0000","last_active":"2024-02-16T00:11:51.831748+0000","last_peered":"2024-02-16T00:11:51.831748+0000","last_clean":"2024-02-16T00:11:51.831748+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:11:51.831748+0000","last_undegraded":"2024-02-16T00:11:51.831748+0000","last_fullsized":"2024-02-16T00:11:51.831748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841070+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:11:50.841070+0000","last_peered":"2024-02-16T00:11:50.841070+0000","last_clean":"2024-02-16T00:11:50.841070+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:11:50.841070+0000","last_undegraded":"2024-02-16T00:11:50.841070+0000","last_fullsized":"2024-02-16T00:11:50.841070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.635083+0000","last_change":"2024-02-16T00:12:56.635127+0000","last_active":"2024-02-16T00:12:56.635083+0000","last_peered":"2024-02-16T00:12:56.635083+0000","last_clean":"2024-02-16T00:12:56.635083+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:12:56.635083+0000","last_undegraded":"2024-02-16T00:12:56.635083+0000","last_fullsized":"2024-02-16T00:12:56.635083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.634994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:54.037220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.029345+0000","last_change":"2024-02-16T00:12:59.029345+0000","last_active":"2024-02-16T00:12:59.029345+0000","last_peered":"2024-02-16T00:12:59.029345+0000","last_clean":"2024-02-16T00:12:59.029345+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:12:59.029345+0000","last_undegraded":"2024-02-16T00:12:59.029345+0000","last_fullsized":"2024-02-16T00:12:59.029345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.029179+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:59.276538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'243","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.288308+0000","last_change":"2024-02-16T00:12:42.288308+0000","last_active":"2024-02-16T00:12:42.288308+0000","last_peered":"2024-02-16T00:12:42.288308+0000","last_clean":"2024-02-16T00:12:42.288308+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:42.288308+0000","last_undegraded":"2024-02-16T00:12:42.288308+0000","last_fullsized":"2024-02-16T00:12:42.288308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.288179+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:49.835119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839151+0000","last_change":"2024-02-16T00:11:12.832363+0000","last_active":"2024-02-16T00:11:50.839151+0000","last_peered":"2024-02-16T00:11:50.839151+0000","last_clean":"2024-02-16T00:11:50.839151+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:11:50.839151+0000","last_undegraded":"2024-02-16T00:11:50.839151+0000","last_fullsized":"2024-02-16T00:11:50.839151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.183063+0000","last_change":"2024-02-16T00:13:04.183094+0000","last_active":"2024-02-16T00:13:04.183063+0000","last_peered":"2024-02-16T00:13:04.183063+0000","last_clean":"2024-02-16T00:13:04.183063+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:13:04.183063+0000","last_undegraded":"2024-02-16T00:13:04.183063+0000","last_fullsized":"2024-02-16T00:13:04.183063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.182975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:01.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.847530+0000","last_change":"2024-02-16T00:11:02.810889+0000","last_active":"2024-02-16T00:11:50.847530+0000","last_peered":"2024-02-16T00:11:50.847530+0000","last_clean":"2024-02-16T00:11:50.847530+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:11:50.847530+0000","last_undegraded":"2024-02-16T00:11:50.847530+0000","last_fullsized":"2024-02-16T00:11:50.847530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.582342+0000","last_change":"2024-02-16T00:12:51.582387+0000","last_active":"2024-02-16T00:12:51.582342+0000","last_peered":"2024-02-16T00:12:51.582342+0000","last_clean":"2024-02-16T00:12:51.582342+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:12:51.582342+0000","last_undegraded":"2024-02-16T00:12:51.582342+0000","last_fullsized":"2024-02-16T00:12:51.582342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.582242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:29.436735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'73","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.419598+0000","last_change":"2024-02-16T00:12:44.419632+0000","last_active":"2024-02-16T00:12:44.419598+0000","last_peered":"2024-02-16T00:12:44.419598+0000","last_clean":"2024-02-16T00:12:44.419598+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:44.419598+0000","last_undegraded":"2024-02-16T00:12:44.419598+0000","last_fullsized":"2024-02-16T00:12:44.419598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.419516+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:22.507611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.985013+0000","last_change":"2024-02-16T00:12:44.985037+0000","last_active":"2024-02-16T00:12:44.985013+0000","last_peered":"2024-02-16T00:12:44.985013+0000","last_clean":"2024-02-16T00:12:44.985013+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:12:44.985013+0000","last_undegraded":"2024-02-16T00:12:44.985013+0000","last_fullsized":"2024-02-16T00:12:44.985013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.984923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.568877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.849771+0000","last_change":"2024-02-16T00:11:12.828004+0000","last_active":"2024-02-16T00:11:50.849771+0000","last_peered":"2024-02-16T00:11:50.849771+0000","last_clean":"2024-02-16T00:11:50.849771+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:11:50.849771+0000","last_undegraded":"2024-02-16T00:11:50.849771+0000","last_fullsized":"2024-02-16T00:11:50.849771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.234115+0000","last_change":"2024-02-16T00:13:10.234145+0000","last_active":"2024-02-16T00:13:10.234115+0000","last_peered":"2024-02-16T00:13:10.234115+0000","last_clean":"2024-02-16T00:13:10.234115+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:13:10.234115+0000","last_undegraded":"2024-02-16T00:13:10.234115+0000","last_fullsized":"2024-02-16T00:13:10.234115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.234022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.916468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.845255+0000","last_change":"2024-02-16T00:11:02.815829+0000","last_active":"2024-02-16T00:11:50.845255+0000","last_peered":"2024-02-16T00:11:50.845255+0000","last_clean":"2024-02-16T00:11:50.845255+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:11:50.845255+0000","last_undegraded":"2024-02-16T00:11:50.845255+0000","last_fullsized":"2024-02-16T00:11:50.845255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"29'5","reported_seq":210,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.021300+0000","last_change":"2024-02-16T00:12:57.021341+0000","last_active":"2024-02-16T00:12:57.021300+0000","last_peered":"2024-02-16T00:12:57.021300+0000","last_clean":"2024-02-16T00:12:57.021300+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:57.021300+0000","last_undegraded":"2024-02-16T00:12:57.021300+0000","last_fullsized":"2024-02-16T00:12:57.021300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.021207+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:57.897777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'43","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.929803+0000","last_change":"2024-02-16T00:12:48.929840+0000","last_active":"2024-02-16T00:12:48.929803+0000","last_peered":"2024-02-16T00:12:48.929803+0000","last_clean":"2024-02-16T00:12:48.929803+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:48.929803+0000","last_undegraded":"2024-02-16T00:12:48.929803+0000","last_fullsized":"2024-02-16T00:12:48.929803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.929717+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:22:28.327582+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.044560+0000","last_change":"2024-02-16T00:13:04.044584+0000","last_active":"2024-02-16T00:13:04.044560+0000","last_peered":"2024-02-16T00:13:04.044560+0000","last_clean":"2024-02-16T00:13:04.044560+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:13:04.044560+0000","last_undegraded":"2024-02-16T00:13:04.044560+0000","last_fullsized":"2024-02-16T00:13:04.044560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.044474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:49.333820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.842041+0000","last_change":"2024-02-16T00:11:12.830200+0000","last_active":"2024-02-16T00:11:50.842041+0000","last_peered":"2024-02-16T00:11:50.842041+0000","last_clean":"2024-02-16T00:11:50.842041+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:11:50.842041+0000","last_undegraded":"2024-02-16T00:11:50.842041+0000","last_fullsized":"2024-02-16T00:11:50.842041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.839874+0000","last_change":"2024-02-16T00:11:04.806595+0000","last_active":"2024-02-16T00:11:50.839874+0000","last_peered":"2024-02-16T00:11:50.839874+0000","last_clean":"2024-02-16T00:11:50.839874+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:11:50.839874+0000","last_undegraded":"2024-02-16T00:11:50.839874+0000","last_fullsized":"2024-02-16T00:11:50.839874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.139960+0000","last_change":"2024-02-16T00:11:02.802098+0000","last_active":"2024-02-16T00:12:38.139960+0000","last_peered":"2024-02-16T00:12:38.139960+0000","last_clean":"2024-02-16T00:12:38.139960+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:12:38.139960+0000","last_undegraded":"2024-02-16T00:12:38.139960+0000","last_fullsized":"2024-02-16T00:12:38.139960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.487234+0000","last_change":"2024-02-16T00:12:47.487257+0000","last_active":"2024-02-16T00:12:47.487234+0000","last_peered":"2024-02-16T00:12:47.487234+0000","last_clean":"2024-02-16T00:12:47.487234+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:12:47.487234+0000","last_undegraded":"2024-02-16T00:12:47.487234+0000","last_fullsized":"2024-02-16T00:12:47.487234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.487142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:48.071095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'36","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.996259+0000","last_change":"2024-02-16T00:12:54.996296+0000","last_active":"2024-02-16T00:12:54.996259+0000","last_peered":"2024-02-16T00:12:54.996259+0000","last_clean":"2024-02-16T00:12:54.996259+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:54.996259+0000","last_undegraded":"2024-02-16T00:12:54.996259+0000","last_fullsized":"2024-02-16T00:12:54.996259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.996158+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:24.457006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.981978+0000","last_change":"2024-02-16T00:13:10.982002+0000","last_active":"2024-02-16T00:13:10.981978+0000","last_peered":"2024-02-16T00:13:10.981978+0000","last_clean":"2024-02-16T00:13:10.981978+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:13:10.981978+0000","last_undegraded":"2024-02-16T00:13:10.981978+0000","last_fullsized":"2024-02-16T00:13:10.981978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:09.819667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.844301+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:11:50.844301+0000","last_peered":"2024-02-16T00:11:50.844301+0000","last_clean":"2024-02-16T00:11:50.844301+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:11:50.844301+0000","last_undegraded":"2024-02-16T00:11:50.844301+0000","last_fullsized":"2024-02-16T00:11:50.844301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.188575+0000","last_change":"2024-02-16T00:13:05.188599+0000","last_active":"2024-02-16T00:13:05.188575+0000","last_peered":"2024-02-16T00:13:05.188575+0000","last_clean":"2024-02-16T00:13:05.188575+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:13:05.188575+0000","last_undegraded":"2024-02-16T00:13:05.188575+0000","last_fullsized":"2024-02-16T00:13:05.188575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.188488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:37.525070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579246+0000","last_change":"2024-02-16T00:11:02.820199+0000","last_active":"2024-02-16T00:12:38.579246+0000","last_peered":"2024-02-16T00:12:38.579246+0000","last_clean":"2024-02-16T00:12:38.579246+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:12:38.579246+0000","last_undegraded":"2024-02-16T00:12:38.579246+0000","last_fullsized":"2024-02-16T00:12:38.579246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.548961+0000","last_change":"2024-02-16T00:12:49.549032+0000","last_active":"2024-02-16T00:12:49.548961+0000","last_peered":"2024-02-16T00:12:49.548961+0000","last_clean":"2024-02-16T00:12:49.548961+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:12:49.548961+0000","last_undegraded":"2024-02-16T00:12:49.548961+0000","last_fullsized":"2024-02-16T00:12:49.548961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.548866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:23:44.002627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'51","reported_seq":117,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.986554+0000","last_change":"2024-02-16T00:13:09.986591+0000","last_active":"2024-02-16T00:13:09.986554+0000","last_peered":"2024-02-16T00:13:09.986554+0000","last_clean":"2024-02-16T00:13:09.986554+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:13:09.986554+0000","last_undegraded":"2024-02-16T00:13:09.986554+0000","last_fullsized":"2024-02-16T00:13:09.986554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.986464+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:29:21.387242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.919210+0000","last_change":"2024-02-16T00:12:41.919234+0000","last_active":"2024-02-16T00:12:41.919210+0000","last_peered":"2024-02-16T00:12:41.919210+0000","last_clean":"2024-02-16T00:12:41.919210+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:12:41.919210+0000","last_undegraded":"2024-02-16T00:12:41.919210+0000","last_fullsized":"2024-02-16T00:12:41.919210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.919121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:20.007216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.841849+0000","last_change":"2024-02-16T00:11:12.831037+0000","last_active":"2024-02-16T00:11:50.841849+0000","last_peered":"2024-02-16T00:11:50.841849+0000","last_clean":"2024-02-16T00:11:50.841849+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:11:50.841849+0000","last_undegraded":"2024-02-16T00:11:50.841849+0000","last_fullsized":"2024-02-16T00:11:50.841849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.556771+0000","last_change":"2024-02-16T00:13:05.556771+0000","last_active":"2024-02-16T00:13:05.556771+0000","last_peered":"2024-02-16T00:13:05.556771+0000","last_clean":"2024-02-16T00:13:05.556771+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:13:05.556771+0000","last_undegraded":"2024-02-16T00:13:05.556771+0000","last_fullsized":"2024-02-16T00:13:05.556771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.556664+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:11.578783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.247747+0000","last_change":"2024-02-16T00:13:07.247747+0000","last_active":"2024-02-16T00:13:07.247747+0000","last_peered":"2024-02-16T00:13:07.247747+0000","last_clean":"2024-02-16T00:13:07.247747+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:13:07.247747+0000","last_undegraded":"2024-02-16T00:13:07.247747+0000","last_fullsized":"2024-02-16T00:13:07.247747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.247620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:46.679324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'1","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140267+0000","last_change":"2024-02-16T00:11:04.801950+0000","last_active":"2024-02-16T00:12:38.140267+0000","last_peered":"2024-02-16T00:12:38.140267+0000","last_clean":"2024-02-16T00:12:38.140267+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:12:38.140267+0000","last_undegraded":"2024-02-16T00:12:38.140267+0000","last_fullsized":"2024-02-16T00:12:38.140267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.776378+0000","last_change":"2024-02-16T00:13:09.776405+0000","last_active":"2024-02-16T00:13:09.776378+0000","last_peered":"2024-02-16T00:13:09.776378+0000","last_clean":"2024-02-16T00:13:09.776378+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:13:09.776378+0000","last_undegraded":"2024-02-16T00:13:09.776378+0000","last_fullsized":"2024-02-16T00:13:09.776378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.776278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:41.368106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.999252+0000","last_change":"2024-02-16T00:12:59.999252+0000","last_active":"2024-02-16T00:12:59.999252+0000","last_peered":"2024-02-16T00:12:59.999252+0000","last_clean":"2024-02-16T00:12:59.999252+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:59.999252+0000","last_undegraded":"2024-02-16T00:12:59.999252+0000","last_fullsized":"2024-02-16T00:12:59.999252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.999131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.804655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456828+0000","last_change":"2024-02-16T00:11:02.824009+0000","last_active":"2024-02-16T00:12:39.456828+0000","last_peered":"2024-02-16T00:12:39.456828+0000","last_clean":"2024-02-16T00:12:39.456828+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:12:39.456828+0000","last_undegraded":"2024-02-16T00:12:39.456828+0000","last_fullsized":"2024-02-16T00:12:39.456828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140231+0000","last_change":"2024-02-16T00:11:04.801764+0000","last_active":"2024-02-16T00:12:38.140231+0000","last_peered":"2024-02-16T00:12:38.140231+0000","last_clean":"2024-02-16T00:12:38.140231+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:12:38.140231+0000","last_undegraded":"2024-02-16T00:12:38.140231+0000","last_fullsized":"2024-02-16T00:12:38.140231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140056+0000","last_change":"2024-02-16T00:11:02.797510+0000","last_active":"2024-02-16T00:12:38.140056+0000","last_peered":"2024-02-16T00:12:38.140056+0000","last_clean":"2024-02-16T00:12:38.140056+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:12:38.140056+0000","last_undegraded":"2024-02-16T00:12:38.140056+0000","last_fullsized":"2024-02-16T00:12:38.140056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.878278+0000","last_change":"2024-02-16T00:13:04.878278+0000","last_active":"2024-02-16T00:13:04.878278+0000","last_peered":"2024-02-16T00:13:04.878278+0000","last_clean":"2024-02-16T00:13:04.878278+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:13:04.878278+0000","last_undegraded":"2024-02-16T00:13:04.878278+0000","last_fullsized":"2024-02-16T00:13:04.878278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.878154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.624777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140038+0000","last_change":"2024-02-16T00:11:02.801630+0000","last_active":"2024-02-16T00:12:38.140038+0000","last_peered":"2024-02-16T00:12:38.140038+0000","last_clean":"2024-02-16T00:12:38.140038+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:12:38.140038+0000","last_undegraded":"2024-02-16T00:12:38.140038+0000","last_fullsized":"2024-02-16T00:12:38.140038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.624499+0000","last_change":"2024-02-16T00:13:01.624499+0000","last_active":"2024-02-16T00:13:01.624499+0000","last_peered":"2024-02-16T00:13:01.624499+0000","last_clean":"2024-02-16T00:13:01.624499+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:13:01.624499+0000","last_undegraded":"2024-02-16T00:13:01.624499+0000","last_fullsized":"2024-02-16T00:13:01.624499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.624385+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:27.761857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579282+0000","last_change":"2024-02-16T00:11:02.810745+0000","last_active":"2024-02-16T00:12:38.579282+0000","last_peered":"2024-02-16T00:12:38.579282+0000","last_clean":"2024-02-16T00:12:38.579282+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:12:38.579282+0000","last_undegraded":"2024-02-16T00:12:38.579282+0000","last_fullsized":"2024-02-16T00:12:38.579282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.736968+0000","last_change":"2024-02-16T00:13:08.736968+0000","last_active":"2024-02-16T00:13:08.736968+0000","last_peered":"2024-02-16T00:13:08.736968+0000","last_clean":"2024-02-16T00:13:08.736968+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:13:08.736968+0000","last_undegraded":"2024-02-16T00:13:08.736968+0000","last_fullsized":"2024-02-16T00:13:08.736968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.736845+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:44.033579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.153427+0000","last_change":"2024-02-16T00:13:17.153454+0000","last_active":"2024-02-16T00:13:17.153427+0000","last_peered":"2024-02-16T00:13:17.153427+0000","last_clean":"2024-02-16T00:13:17.153427+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:13:17.153427+0000","last_undegraded":"2024-02-16T00:13:17.153427+0000","last_fullsized":"2024-02-16T00:13:17.153427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.153338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:45.706109+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.556358+0000","last_change":"2024-02-16T00:13:09.556358+0000","last_active":"2024-02-16T00:13:09.556358+0000","last_peered":"2024-02-16T00:13:09.556358+0000","last_clean":"2024-02-16T00:13:09.556358+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:13:09.556358+0000","last_undegraded":"2024-02-16T00:13:09.556358+0000","last_fullsized":"2024-02-16T00:13:09.556358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.556228+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:33.081661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.139986+0000","last_change":"2024-02-16T00:11:02.797604+0000","last_active":"2024-02-16T00:12:38.139986+0000","last_peered":"2024-02-16T00:12:38.139986+0000","last_clean":"2024-02-16T00:12:38.139986+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:12:38.139986+0000","last_undegraded":"2024-02-16T00:12:38.139986+0000","last_fullsized":"2024-02-16T00:12:38.139986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.632483+0000","last_change":"2024-02-16T00:13:18.632508+0000","last_active":"2024-02-16T00:13:18.632483+0000","last_peered":"2024-02-16T00:13:18.632483+0000","last_clean":"2024-02-16T00:13:18.632483+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:13:18.632483+0000","last_undegraded":"2024-02-16T00:13:18.632483+0000","last_fullsized":"2024-02-16T00:13:18.632483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.632397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:36.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456929+0000","last_change":"2024-02-16T00:11:02.820947+0000","last_active":"2024-02-16T00:12:39.456929+0000","last_peered":"2024-02-16T00:12:39.456929+0000","last_clean":"2024-02-16T00:12:39.456929+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:12:39.456929+0000","last_undegraded":"2024-02-16T00:12:39.456929+0000","last_fullsized":"2024-02-16T00:12:39.456929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:27.978024+0000","last_change":"2024-02-16T00:11:04.807293+0000","last_active":"2024-02-16T00:12:27.978024+0000","last_peered":"2024-02-16T00:12:27.978024+0000","last_clean":"2024-02-16T00:12:27.978024+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:12:27.978024+0000","last_undegraded":"2024-02-16T00:12:27.978024+0000","last_fullsized":"2024-02-16T00:12:27.978024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140039+0000","last_change":"2024-02-16T00:11:02.797276+0000","last_active":"2024-02-16T00:12:38.140039+0000","last_peered":"2024-02-16T00:12:38.140039+0000","last_clean":"2024-02-16T00:12:38.140039+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:12:38.140039+0000","last_undegraded":"2024-02-16T00:12:38.140039+0000","last_fullsized":"2024-02-16T00:12:38.140039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.884594+0000","last_change":"2024-02-16T00:13:03.884620+0000","last_active":"2024-02-16T00:13:03.884594+0000","last_peered":"2024-02-16T00:13:03.884594+0000","last_clean":"2024-02-16T00:13:03.884594+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:13:03.884594+0000","last_undegraded":"2024-02-16T00:13:03.884594+0000","last_fullsized":"2024-02-16T00:13:03.884594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.884486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:09.906605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579358+0000","last_change":"2024-02-16T00:11:02.809533+0000","last_active":"2024-02-16T00:12:38.579358+0000","last_peered":"2024-02-16T00:12:38.579358+0000","last_clean":"2024-02-16T00:12:38.579358+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:12:38.579358+0000","last_undegraded":"2024-02-16T00:12:38.579358+0000","last_fullsized":"2024-02-16T00:12:38.579358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.581851+0000","last_change":"2024-02-16T00:13:11.581881+0000","last_active":"2024-02-16T00:13:11.581851+0000","last_peered":"2024-02-16T00:13:11.581851+0000","last_clean":"2024-02-16T00:13:11.581851+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:13:11.581851+0000","last_undegraded":"2024-02-16T00:13:11.581851+0000","last_fullsized":"2024-02-16T00:13:11.581851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.581768+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:19.215064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.579383+0000","last_change":"2024-02-16T00:11:02.796731+0000","last_active":"2024-02-16T00:12:38.579383+0000","last_peered":"2024-02-16T00:12:38.579383+0000","last_clean":"2024-02-16T00:12:38.579383+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:12:38.579383+0000","last_undegraded":"2024-02-16T00:12:38.579383+0000","last_fullsized":"2024-02-16T00:12:38.579383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.642947+0000","last_change":"2024-02-16T00:12:57.642973+0000","last_active":"2024-02-16T00:12:57.642947+0000","last_peered":"2024-02-16T00:12:57.642947+0000","last_clean":"2024-02-16T00:12:57.642947+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:12:57.642947+0000","last_undegraded":"2024-02-16T00:12:57.642947+0000","last_fullsized":"2024-02-16T00:12:57.642947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.642852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:29.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456944+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:12:39.456944+0000","last_peered":"2024-02-16T00:12:39.456944+0000","last_clean":"2024-02-16T00:12:39.456944+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:12:39.456944+0000","last_undegraded":"2024-02-16T00:12:39.456944+0000","last_fullsized":"2024-02-16T00:12:39.456944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.848786+0000","last_change":"2024-02-16T00:11:04.803538+0000","last_active":"2024-02-16T00:11:50.848786+0000","last_peered":"2024-02-16T00:11:50.848786+0000","last_clean":"2024-02-16T00:11:50.848786+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:11:50.848786+0000","last_undegraded":"2024-02-16T00:11:50.848786+0000","last_fullsized":"2024-02-16T00:11:50.848786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:03.779934+0000","last_clean_scrub_stamp":"2024-02-16T00:11:03.779934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456943+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:12:39.456943+0000","last_peered":"2024-02-16T00:12:39.456943+0000","last_clean":"2024-02-16T00:12:39.456943+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:12:39.456943+0000","last_undegraded":"2024-02-16T00:12:39.456943+0000","last_fullsized":"2024-02-16T00:12:39.456943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.984480+0000","last_change":"2024-02-16T00:13:13.984512+0000","last_active":"2024-02-16T00:13:13.984480+0000","last_peered":"2024-02-16T00:13:13.984480+0000","last_clean":"2024-02-16T00:13:13.984480+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:13:13.984480+0000","last_undegraded":"2024-02-16T00:13:13.984480+0000","last_fullsized":"2024-02-16T00:13:13.984480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.984383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:31.856700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.197568+0000","last_change":"2024-02-16T00:13:15.197615+0000","last_active":"2024-02-16T00:13:15.197568+0000","last_peered":"2024-02-16T00:13:15.197568+0000","last_clean":"2024-02-16T00:13:15.197568+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:13:15.197568+0000","last_undegraded":"2024-02-16T00:13:15.197568+0000","last_fullsized":"2024-02-16T00:13:15.197568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.197470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:16.065697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.604882+0000","last_change":"2024-02-16T00:13:14.604882+0000","last_active":"2024-02-16T00:13:14.604882+0000","last_peered":"2024-02-16T00:13:14.604882+0000","last_clean":"2024-02-16T00:13:14.604882+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:13:14.604882+0000","last_undegraded":"2024-02-16T00:13:14.604882+0000","last_fullsized":"2024-02-16T00:13:14.604882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.604766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:57.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.843929+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:11:50.843929+0000","last_peered":"2024-02-16T00:11:50.843929+0000","last_clean":"2024-02-16T00:11:50.843929+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:11:50.843929+0000","last_undegraded":"2024-02-16T00:11:50.843929+0000","last_fullsized":"2024-02-16T00:11:50.843929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:50.840111+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:11:50.840111+0000","last_peered":"2024-02-16T00:11:50.840111+0000","last_clean":"2024-02-16T00:11:50.840111+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:11:50.840111+0000","last_undegraded":"2024-02-16T00:11:50.840111+0000","last_fullsized":"2024-02-16T00:11:50.840111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.783452+0000","last_change":"2024-02-16T00:13:10.783477+0000","last_active":"2024-02-16T00:13:10.783452+0000","last_peered":"2024-02-16T00:13:10.783452+0000","last_clean":"2024-02-16T00:13:10.783452+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:13:10.783452+0000","last_undegraded":"2024-02-16T00:13:10.783452+0000","last_fullsized":"2024-02-16T00:13:10.783452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.783361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:58.244265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.814250+0000","last_change":"2024-02-16T00:13:15.814276+0000","last_active":"2024-02-16T00:13:15.814250+0000","last_peered":"2024-02-16T00:13:15.814250+0000","last_clean":"2024-02-16T00:13:15.814250+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:13:15.814250+0000","last_undegraded":"2024-02-16T00:13:15.814250+0000","last_fullsized":"2024-02-16T00:13:15.814250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.814161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:27.336244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.581341+0000","last_change":"2024-02-16T00:13:04.581370+0000","last_active":"2024-02-16T00:13:04.581341+0000","last_peered":"2024-02-16T00:13:04.581341+0000","last_clean":"2024-02-16T00:13:04.581341+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:13:04.581341+0000","last_undegraded":"2024-02-16T00:13:04.581341+0000","last_fullsized":"2024-02-16T00:13:04.581341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.581244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:47.597212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1820,"num_read_kb":1574,"num_write":771,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1644,"ondisk_log_size":1644,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":425984,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.434},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.26100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.495,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.628,"15min":0.628},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36599999999999999,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.34799999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.39700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.314}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":966656,"data_stored":723796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52700000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48099999999999998,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.312,"15min":0.317},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":0.435,"15min":0.435},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.31900000000000001,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40500000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.23499999999999999}]},{"osd":3,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.38100000000000001,"15min":0.39600000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.374,"5min":1.851,"15min":1.851},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.253}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.314,"15min":0.318},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.42699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33900000000000002,"15min":0.34100000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.40899999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":137181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63900000000000001,"5min":0.753,"15min":0.753},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.5},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.65200000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63900000000000001,"5min":1.506,"15min":1.506},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:13:20.582 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.582 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.582 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.583 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.583 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.583 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.583 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.583 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.584 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.584 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.584 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.584 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.584 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.584 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.585 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.585 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.585 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.585 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.585 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.586 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.586 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.586 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.586 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.586 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.587 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.587 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.587 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.587 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.587 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.588 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.588 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.588 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.588 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.588 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.588 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.589 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.589 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.589 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.589 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.589 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.589 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.590 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.590 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.590 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.591 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.591 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.591 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.591 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.591 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.591 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.592 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.592 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.592 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.592 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.592 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.592 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.593 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.593 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.593 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.593 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.593 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.594 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.594 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.594 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.594 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.594 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.595 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.595 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.595 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.595 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.595 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.595 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.596 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.596 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.596 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.596 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.596 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.597 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.597 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.597 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.597 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.597 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.598 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.598 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.598 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.598 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.598 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.598 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.599 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.599 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.599 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.599 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.599 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.599 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.600 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.600 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.600 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.600 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.600 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.601 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.601 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.601 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.601 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T00:11:03.779934+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=3, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.601 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.602 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.602 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:20.602 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T00:13:40.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:13:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.712+0000 7fa2aba6e640 1 Processor -- start 2024-02-16T00:13:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2aba6e640 1 -- start start 2024-02-16T00:13:40.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2aba6e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2a4071910 0x7fa2a406cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:13:40.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2aba6e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a406e980 con 0x7fa2a406e0f0 2024-02-16T00:13:40.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2aba6e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a4071cf0 con 0x7fa2a4071910 2024-02-16T00:13:40.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2a980a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2a4071910 0x7fa2a406cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:13:40.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2a9009640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa2a406e0f0 0x7fa2a406d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40176/0 (socket says 172.21.15.2:40176) 2024-02-16T00:13:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2a9009640 1 -- 172.21.15.2:0/524593494 learned_addr learned my addr 172.21.15.2:0/524593494 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:13:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.713+0000 7fa2a980a640 1 -- 172.21.15.2:0/524593494 >> v1:172.21.15.2:6789/0 conn(0x7fa2a406e0f0 legacy=0x7fa2a406d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.714+0000 7fa2a8808640 1 -- 172.21.15.2:0/524593494 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118574267 0 0) 0x7fa298001110 con 0x7fa2a406e0f0 2024-02-16T00:13:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.714+0000 7fa2a980a640 1 -- 172.21.15.2:0/524593494 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4066b50 con 0x7fa2a4071910 2024-02-16T00:13:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.714+0000 7fa2a980a640 1 --2- 172.21.15.2:0/524593494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a4071910 0x7fa2a406cd10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009720 tx=0x7fa29c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca4ad260c37f1cc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.714+0000 7fa2a8808640 1 -- 172.21.15.2:0/524593494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c02e070 con 0x7fa2a4071910 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.714+0000 7fa2a8808640 1 -- 172.21.15.2:0/524593494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c0316d0 con 0x7fa2a4071910 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.714+0000 7fa2a8808640 1 -- 172.21.15.2:0/524593494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c031990 con 0x7fa2a4071910 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 -- 172.21.15.2:0/524593494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a4071910 msgr2=0x7fa2a406cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 --2- 172.21.15.2:0/524593494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a4071910 0x7fa2a406cd10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009720 tx=0x7fa29c02b840 comp rx=0 tx=0).stop 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 -- 172.21.15.2:0/524593494 shutdown_connections 2024-02-16T00:13:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 --2- 172.21.15.2:0/524593494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a4071910 0x7fa2a406cd10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 -- 172.21.15.2:0/524593494 >> 172.21.15.2:0/524593494 conn(0x7fa2a40974b0 msgr2=0x7fa2a40978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 -- 172.21.15.2:0/524593494 shutdown_connections 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.715+0000 7fa2aba6e640 1 -- 172.21.15.2:0/524593494 wait complete. 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2aba6e640 1 Processor -- start 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2aba6e640 1 -- start start 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2aba6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 0x7fa2a4090ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2aba6e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40940c0 con 0x7fa2a406e0f0 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2a980a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 0x7fa2a4090ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2a980a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 0x7fa2a4090ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34104/0 (socket says 172.21.15.2:34104) 2024-02-16T00:13:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.716+0000 7fa2a980a640 1 -- 172.21.15.2:0/1072099021 learned_addr learned my addr 172.21.15.2:0/1072099021 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2a980a640 1 -- 172.21.15.2:0/1072099021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c009400 con 0x7fa2a406e0f0 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2a980a640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 0x7fa2a4090ba0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009840 tx=0x7fa29c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c0328b0 con 0x7fa2a406e0f0 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c032a10 con 0x7fa2a406e0f0 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a4094370 con 0x7fa2a406e0f0 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c032cf0 con 0x7fa2a406e0f0 2024-02-16T00:13:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.717+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a4092600 con 0x7fa2a406e0f0 2024-02-16T00:13:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.718+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa29c04d3f0 con 0x7fa2a406e0f0 2024-02-16T00:13:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.718+0000 7fa2a27fc640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa290037ef0 0x7fa29003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:13:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.718+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fa29c06d240 con 0x7fa2a406e0f0 2024-02-16T00:13:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.718+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a4096300 con 0x7fa2a406e0f0 2024-02-16T00:13:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.718+0000 7fa2a9009640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa290037ef0 0x7fa29003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:13:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.719+0000 7fa2a9009640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa290037ef0 0x7fa29003a3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2a406e500 tx=0x7fa298007bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:13:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.723+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa29c0308e0 con 0x7fa2a406e0f0 2024-02-16T00:13:40.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.903+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2a40627b0 con 0x7fa290037ef0 2024-02-16T00:13:40.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.920+0000 7fa2a27fc640 1 -- 172.21.15.2:0/1072099021 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672469 (secure 0 0 0) 0x7fa2a40627b0 con 0x7fa290037ef0 2024-02-16T00:13:40.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:13:40.935 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa290037ef0 msgr2=0x7fa29003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa290037ef0 0x7fa29003a3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa2a406e500 tx=0x7fa298007bb0 comp rx=0 tx=0).stop 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 msgr2=0x7fa2a4090ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 0x7fa2a4090ba0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009840 tx=0x7fa29c0046c0 comp rx=0 tx=0).stop 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 shutdown_connections 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7fa290037ef0 0x7fa29003a3b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 --2- 172.21.15.2:0/1072099021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2a406e0f0 0x7fa2a4090ba0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:13:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 >> 172.21.15.2:0/1072099021 conn(0x7fa2a40974b0 msgr2=0x7fa2a406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:13:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 shutdown_connections 2024-02-16T00:13:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:13:40.925+0000 7fa2aba6e640 1 -- 172.21.15.2:0/1072099021 wait complete. 2024-02-16T00:13:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-02-16T00:13:39.717874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":245,"num_object_clones":0,"num_object_copies":491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":4297,"num_read_kb":3911,"num_write":1709,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4191,"ondisk_log_size":4191,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152372,"kb_used_data":2708,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334988,"statfs":{"total":386547056640,"available":386391027712,"internally_reserved":0,"allocated":2772992,"data_stored":1728024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003689"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.275037+0000","last_change":"2024-02-16T00:13:22.275067+0000","last_active":"2024-02-16T00:13:22.275037+0000","last_peered":"2024-02-16T00:13:22.275037+0000","last_clean":"2024-02-16T00:13:22.275037+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:13:22.275037+0000","last_undegraded":"2024-02-16T00:13:22.275037+0000","last_fullsized":"2024-02-16T00:13:22.275037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:22.274933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:22.274933+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.274933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:12.577631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.703777+0000","last_change":"2024-02-16T00:13:20.703777+0000","last_active":"2024-02-16T00:13:20.703777+0000","last_peered":"2024-02-16T00:13:20.703777+0000","last_clean":"2024-02-16T00:13:20.703777+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:13:20.703777+0000","last_undegraded":"2024-02-16T00:13:20.703777+0000","last_fullsized":"2024-02-16T00:13:20.703777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:20.703642+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:20.703642+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.703642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:21:19.805780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.933810+0000","last_change":"2024-02-16T00:13:29.933837+0000","last_active":"2024-02-16T00:13:29.933810+0000","last_peered":"2024-02-16T00:13:29.933810+0000","last_clean":"2024-02-16T00:13:29.933810+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:13:29.933810+0000","last_undegraded":"2024-02-16T00:13:29.933810+0000","last_fullsized":"2024-02-16T00:13:29.933810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.933716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.933716+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.933716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:38.573518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.086334+0000","last_change":"2024-02-16T00:13:26.086334+0000","last_active":"2024-02-16T00:13:26.086334+0000","last_peered":"2024-02-16T00:13:26.086334+0000","last_clean":"2024-02-16T00:13:26.086334+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:13:26.086334+0000","last_undegraded":"2024-02-16T00:13:26.086334+0000","last_fullsized":"2024-02-16T00:13:26.086334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.086214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.086214+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.086214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:48:00.192005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.026184+0000","last_change":"2024-02-16T00:13:36.026223+0000","last_active":"2024-02-16T00:13:36.026184+0000","last_peered":"2024-02-16T00:13:36.026184+0000","last_clean":"2024-02-16T00:13:36.026184+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:13:36.026184+0000","last_undegraded":"2024-02-16T00:13:36.026184+0000","last_fullsized":"2024-02-16T00:13:36.026184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:36.026092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:36.026092+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.026092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:37.132703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.058556+0000","last_change":"2024-02-16T00:13:18.058556+0000","last_active":"2024-02-16T00:13:18.058556+0000","last_peered":"2024-02-16T00:13:18.058556+0000","last_clean":"2024-02-16T00:13:18.058556+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:13:18.058556+0000","last_undegraded":"2024-02-16T00:13:18.058556+0000","last_fullsized":"2024-02-16T00:13:18.058556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.058378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:23.057832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.241221+0000","last_change":"2024-02-16T00:13:09.241249+0000","last_active":"2024-02-16T00:13:09.241221+0000","last_peered":"2024-02-16T00:13:09.241221+0000","last_clean":"2024-02-16T00:13:09.241221+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:13:09.241221+0000","last_undegraded":"2024-02-16T00:13:09.241221+0000","last_fullsized":"2024-02-16T00:13:09.241221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.241098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:35.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.023923+0000","last_change":"2024-02-16T00:13:16.023923+0000","last_active":"2024-02-16T00:13:16.023923+0000","last_peered":"2024-02-16T00:13:16.023923+0000","last_clean":"2024-02-16T00:13:16.023923+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:13:16.023923+0000","last_undegraded":"2024-02-16T00:13:16.023923+0000","last_fullsized":"2024-02-16T00:13:16.023923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.023799+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:15.106437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457066+0000","last_change":"2024-02-16T00:11:02.823451+0000","last_active":"2024-02-16T00:12:39.457066+0000","last_peered":"2024-02-16T00:12:39.457066+0000","last_clean":"2024-02-16T00:12:39.457066+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:12:39.457066+0000","last_undegraded":"2024-02-16T00:12:39.457066+0000","last_fullsized":"2024-02-16T00:12:39.457066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.550754+0000","last_change":"2024-02-16T00:13:10.550783+0000","last_active":"2024-02-16T00:13:10.550754+0000","last_peered":"2024-02-16T00:13:10.550754+0000","last_clean":"2024-02-16T00:13:10.550754+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:13:10.550754+0000","last_undegraded":"2024-02-16T00:13:10.550754+0000","last_fullsized":"2024-02-16T00:13:10.550754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.550668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:01.925080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.231172+0000","last_change":"2024-02-16T00:13:21.231172+0000","last_active":"2024-02-16T00:13:21.231172+0000","last_peered":"2024-02-16T00:13:21.231172+0000","last_clean":"2024-02-16T00:13:21.231172+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:13:21.231172+0000","last_undegraded":"2024-02-16T00:13:21.231172+0000","last_fullsized":"2024-02-16T00:13:21.231172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:21.231060+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:21.231060+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.231060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:50.713265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.969656+0000","last_change":"2024-02-16T00:13:12.969656+0000","last_active":"2024-02-16T00:13:12.969656+0000","last_peered":"2024-02-16T00:13:12.969656+0000","last_clean":"2024-02-16T00:13:12.969656+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:13:12.969656+0000","last_undegraded":"2024-02-16T00:13:12.969656+0000","last_fullsized":"2024-02-16T00:13:12.969656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.969541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:09.036334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457052+0000","last_change":"2024-02-16T00:11:02.814310+0000","last_active":"2024-02-16T00:12:39.457052+0000","last_peered":"2024-02-16T00:12:39.457052+0000","last_clean":"2024-02-16T00:12:39.457052+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:12:39.457052+0000","last_undegraded":"2024-02-16T00:12:39.457052+0000","last_fullsized":"2024-02-16T00:12:39.457052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.234405+0000","last_change":"2024-02-16T00:13:06.234405+0000","last_active":"2024-02-16T00:13:06.234405+0000","last_peered":"2024-02-16T00:13:06.234405+0000","last_clean":"2024-02-16T00:13:06.234405+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:13:06.234405+0000","last_undegraded":"2024-02-16T00:13:06.234405+0000","last_fullsized":"2024-02-16T00:13:06.234405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.234291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:22.103367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.806168+0000","last_change":"2024-02-16T00:13:13.806168+0000","last_active":"2024-02-16T00:13:13.806168+0000","last_peered":"2024-02-16T00:13:13.806168+0000","last_clean":"2024-02-16T00:13:13.806168+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:13:13.806168+0000","last_undegraded":"2024-02-16T00:13:13.806168+0000","last_fullsized":"2024-02-16T00:13:13.806168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.805990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:04.108688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.179359+0000","last_change":"2024-02-16T00:13:12.179359+0000","last_active":"2024-02-16T00:13:12.179359+0000","last_peered":"2024-02-16T00:13:12.179359+0000","last_clean":"2024-02-16T00:13:12.179359+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:13:12.179359+0000","last_undegraded":"2024-02-16T00:13:12.179359+0000","last_fullsized":"2024-02-16T00:13:12.179359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.179243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:55.195210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.051248+0000","last_change":"2024-02-16T00:13:17.051248+0000","last_active":"2024-02-16T00:13:17.051248+0000","last_peered":"2024-02-16T00:13:17.051248+0000","last_clean":"2024-02-16T00:13:17.051248+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:13:17.051248+0000","last_undegraded":"2024-02-16T00:13:17.051248+0000","last_fullsized":"2024-02-16T00:13:17.051248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.051125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:36.761214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.601554+0000","last_change":"2024-02-16T00:13:17.601554+0000","last_active":"2024-02-16T00:13:17.601554+0000","last_peered":"2024-02-16T00:13:17.601554+0000","last_clean":"2024-02-16T00:13:17.601554+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:13:17.601554+0000","last_undegraded":"2024-02-16T00:13:17.601554+0000","last_fullsized":"2024-02-16T00:13:17.601554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.601433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:29.123516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.577174+0000","last_change":"2024-02-16T00:13:16.577174+0000","last_active":"2024-02-16T00:13:16.577174+0000","last_peered":"2024-02-16T00:13:16.577174+0000","last_clean":"2024-02-16T00:13:16.577174+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:13:16.577174+0000","last_undegraded":"2024-02-16T00:13:16.577174+0000","last_fullsized":"2024-02-16T00:13:16.577174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.577052+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:46.037900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.149364+0000","last_change":"2024-02-16T00:13:13.149364+0000","last_active":"2024-02-16T00:13:13.149364+0000","last_peered":"2024-02-16T00:13:13.149364+0000","last_clean":"2024-02-16T00:13:13.149364+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:13:13.149364+0000","last_undegraded":"2024-02-16T00:13:13.149364+0000","last_fullsized":"2024-02-16T00:13:13.149364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.149246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:19.171364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.628374+0000","last_change":"2024-02-16T00:13:22.628374+0000","last_active":"2024-02-16T00:13:22.628374+0000","last_peered":"2024-02-16T00:13:22.628374+0000","last_clean":"2024-02-16T00:13:22.628374+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:13:22.628374+0000","last_undegraded":"2024-02-16T00:13:22.628374+0000","last_fullsized":"2024-02-16T00:13:22.628374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:22.628266+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:22.628266+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.628266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:51.428396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.690517+0000","last_change":"2024-02-16T00:13:29.690545+0000","last_active":"2024-02-16T00:13:29.690517+0000","last_peered":"2024-02-16T00:13:29.690517+0000","last_clean":"2024-02-16T00:13:29.690517+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:13:29.690517+0000","last_undegraded":"2024-02-16T00:13:29.690517+0000","last_fullsized":"2024-02-16T00:13:29.690517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.690426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.690426+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.690426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:16.938893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.829592+0000","last_change":"2024-02-16T00:13:05.829592+0000","last_active":"2024-02-16T00:13:05.829592+0000","last_peered":"2024-02-16T00:13:05.829592+0000","last_clean":"2024-02-16T00:13:05.829592+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:13:05.829592+0000","last_undegraded":"2024-02-16T00:13:05.829592+0000","last_fullsized":"2024-02-16T00:13:05.829592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.829438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:12.076944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.583128+0000","last_change":"2024-02-16T00:13:13.583128+0000","last_active":"2024-02-16T00:13:13.583128+0000","last_peered":"2024-02-16T00:13:13.583128+0000","last_clean":"2024-02-16T00:13:13.583128+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:13:13.583128+0000","last_undegraded":"2024-02-16T00:13:13.583128+0000","last_fullsized":"2024-02-16T00:13:13.583128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.583017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:43.065222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.259446+0000","last_change":"2024-02-16T00:13:28.259446+0000","last_active":"2024-02-16T00:13:28.259446+0000","last_peered":"2024-02-16T00:13:28.259446+0000","last_clean":"2024-02-16T00:13:28.259446+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:13:28.259446+0000","last_undegraded":"2024-02-16T00:13:28.259446+0000","last_fullsized":"2024-02-16T00:13:28.259446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:28.259327+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:28.259327+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.259327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:51.026448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.961930+0000","last_change":"2024-02-16T00:13:30.961954+0000","last_active":"2024-02-16T00:13:30.961930+0000","last_peered":"2024-02-16T00:13:30.961930+0000","last_clean":"2024-02-16T00:13:30.961930+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:13:30.961930+0000","last_undegraded":"2024-02-16T00:13:30.961930+0000","last_fullsized":"2024-02-16T00:13:30.961930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.961818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.961818+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.961818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:57:04.261490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.565976+0000","last_change":"2024-02-16T00:13:12.565976+0000","last_active":"2024-02-16T00:13:12.565976+0000","last_peered":"2024-02-16T00:13:12.565976+0000","last_clean":"2024-02-16T00:13:12.565976+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:13:12.565976+0000","last_undegraded":"2024-02-16T00:13:12.565976+0000","last_fullsized":"2024-02-16T00:13:12.565976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.565846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:00.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.051463+0000","last_change":"2024-02-16T00:13:35.051495+0000","last_active":"2024-02-16T00:13:35.051463+0000","last_peered":"2024-02-16T00:13:35.051463+0000","last_clean":"2024-02-16T00:13:35.051463+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:13:35.051463+0000","last_undegraded":"2024-02-16T00:13:35.051463+0000","last_fullsized":"2024-02-16T00:13:35.051463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:35.051368+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:35.051368+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.051368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:37:55.653508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'19","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.580432+0000","last_change":"2024-02-16T00:11:12.835599+0000","last_active":"2024-02-16T00:12:38.580432+0000","last_peered":"2024-02-16T00:12:38.580432+0000","last_clean":"2024-02-16T00:12:38.580432+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:12:38.580432+0000","last_undegraded":"2024-02-16T00:12:38.580432+0000","last_fullsized":"2024-02-16T00:12:38.580432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.068242+0000","last_change":"2024-02-16T00:13:24.068242+0000","last_active":"2024-02-16T00:13:24.068242+0000","last_peered":"2024-02-16T00:13:24.068242+0000","last_clean":"2024-02-16T00:13:24.068242+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:13:24.068242+0000","last_undegraded":"2024-02-16T00:13:24.068242+0000","last_fullsized":"2024-02-16T00:13:24.068242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:24.068098+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:24.068098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.068098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:47:00.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.067547+0000","last_change":"2024-02-16T00:13:30.067575+0000","last_active":"2024-02-16T00:13:30.067547+0000","last_peered":"2024-02-16T00:13:30.067547+0000","last_clean":"2024-02-16T00:13:30.067547+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:13:30.067547+0000","last_undegraded":"2024-02-16T00:13:30.067547+0000","last_fullsized":"2024-02-16T00:13:30.067547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.067450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.067450+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.067450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:08:52.271982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.921969+0000","last_change":"2024-02-16T00:12:48.921969+0000","last_active":"2024-02-16T00:12:48.921969+0000","last_peered":"2024-02-16T00:12:48.921969+0000","last_clean":"2024-02-16T00:12:48.921969+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:12:48.921969+0000","last_undegraded":"2024-02-16T00:12:48.921969+0000","last_fullsized":"2024-02-16T00:12:48.921969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.921850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:24.218584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'48","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.004614+0000","last_change":"2024-02-16T00:12:45.004614+0000","last_active":"2024-02-16T00:12:45.004614+0000","last_peered":"2024-02-16T00:12:45.004614+0000","last_clean":"2024-02-16T00:12:45.004614+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:45.004614+0000","last_undegraded":"2024-02-16T00:12:45.004614+0000","last_fullsized":"2024-02-16T00:12:45.004614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.004490+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:25.382346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.647238+0000","last_change":"2024-02-16T00:13:02.647238+0000","last_active":"2024-02-16T00:13:02.647238+0000","last_peered":"2024-02-16T00:13:02.647238+0000","last_clean":"2024-02-16T00:13:02.647238+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:13:02.647238+0000","last_undegraded":"2024-02-16T00:13:02.647238+0000","last_fullsized":"2024-02-16T00:13:02.647238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.647086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:24.329532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.722174+0000","last_change":"2024-02-16T00:13:37.722174+0000","last_active":"2024-02-16T00:13:37.722174+0000","last_peered":"2024-02-16T00:13:37.722174+0000","last_clean":"2024-02-16T00:13:37.722174+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:13:37.722174+0000","last_undegraded":"2024-02-16T00:13:37.722174+0000","last_fullsized":"2024-02-16T00:13:37.722174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:37.722038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:37.722038+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.722038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:42.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.053290+0000","last_change":"2024-02-16T00:12:58.053290+0000","last_active":"2024-02-16T00:12:58.053290+0000","last_peered":"2024-02-16T00:12:58.053290+0000","last_clean":"2024-02-16T00:12:58.053290+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:12:58.053290+0000","last_undegraded":"2024-02-16T00:12:58.053290+0000","last_fullsized":"2024-02-16T00:12:58.053290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.053167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:43:59.274034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.224954+0000","last_change":"2024-02-16T00:13:11.224954+0000","last_active":"2024-02-16T00:13:11.224954+0000","last_peered":"2024-02-16T00:13:11.224954+0000","last_clean":"2024-02-16T00:13:11.224954+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:13:11.224954+0000","last_undegraded":"2024-02-16T00:13:11.224954+0000","last_fullsized":"2024-02-16T00:13:11.224954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.224827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:55.853002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.890717+0000","last_change":"2024-02-16T00:13:01.890717+0000","last_active":"2024-02-16T00:13:01.890717+0000","last_peered":"2024-02-16T00:13:01.890717+0000","last_clean":"2024-02-16T00:13:01.890717+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:13:01.890717+0000","last_undegraded":"2024-02-16T00:13:01.890717+0000","last_fullsized":"2024-02-16T00:13:01.890717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.890582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:01:28.904624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'16","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.427635+0000","last_change":"2024-02-16T00:12:43.427635+0000","last_active":"2024-02-16T00:12:43.427635+0000","last_peered":"2024-02-16T00:12:43.427635+0000","last_clean":"2024-02-16T00:12:43.427635+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:12:43.427635+0000","last_undegraded":"2024-02-16T00:12:43.427635+0000","last_fullsized":"2024-02-16T00:12:43.427635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.427524+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:38.476135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.502479+0000","last_change":"2024-02-16T00:12:46.502479+0000","last_active":"2024-02-16T00:12:46.502479+0000","last_peered":"2024-02-16T00:12:46.502479+0000","last_clean":"2024-02-16T00:12:46.502479+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:12:46.502479+0000","last_undegraded":"2024-02-16T00:12:46.502479+0000","last_fullsized":"2024-02-16T00:12:46.502479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.502371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:24.692093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.929087+0000","last_change":"2024-02-16T00:13:37.929115+0000","last_active":"2024-02-16T00:13:37.929087+0000","last_peered":"2024-02-16T00:13:37.929087+0000","last_clean":"2024-02-16T00:13:37.929087+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:13:37.929087+0000","last_undegraded":"2024-02-16T00:13:37.929087+0000","last_fullsized":"2024-02-16T00:13:37.929087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:37.928993+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:37.928993+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.928993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:49:00.921338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.046782+0000","last_change":"2024-02-16T00:13:25.046782+0000","last_active":"2024-02-16T00:13:25.046782+0000","last_peered":"2024-02-16T00:13:25.046782+0000","last_clean":"2024-02-16T00:13:25.046782+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:13:25.046782+0000","last_undegraded":"2024-02-16T00:13:25.046782+0000","last_fullsized":"2024-02-16T00:13:25.046782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:25.046664+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:25.046664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.046664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:18:14.017471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456796+0000","last_change":"2024-02-16T00:11:02.821905+0000","last_active":"2024-02-16T00:12:39.456796+0000","last_peered":"2024-02-16T00:12:39.456796+0000","last_clean":"2024-02-16T00:12:39.456796+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:12:39.456796+0000","last_undegraded":"2024-02-16T00:12:39.456796+0000","last_fullsized":"2024-02-16T00:12:39.456796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.886683+0000","last_change":"2024-02-16T00:13:00.886683+0000","last_active":"2024-02-16T00:13:00.886683+0000","last_peered":"2024-02-16T00:13:00.886683+0000","last_clean":"2024-02-16T00:13:00.886683+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:13:00.886683+0000","last_undegraded":"2024-02-16T00:13:00.886683+0000","last_fullsized":"2024-02-16T00:13:00.886683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.886566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:06.116856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'29","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.157085+0000","last_change":"2024-02-16T00:12:51.157085+0000","last_active":"2024-02-16T00:12:51.157085+0000","last_peered":"2024-02-16T00:12:51.157085+0000","last_clean":"2024-02-16T00:12:51.157085+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:12:51.157085+0000","last_undegraded":"2024-02-16T00:12:51.157085+0000","last_fullsized":"2024-02-16T00:12:51.157085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.156949+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:01.821119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'244","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.041805+0000","last_change":"2024-02-16T00:13:07.041805+0000","last_active":"2024-02-16T00:13:07.041805+0000","last_peered":"2024-02-16T00:13:07.041805+0000","last_clean":"2024-02-16T00:13:07.041805+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:13:07.041805+0000","last_undegraded":"2024-02-16T00:13:07.041805+0000","last_fullsized":"2024-02-16T00:13:07.041805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'244","last_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_deep_scrub":"29'244","last_deep_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.041669+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:08:31.087156+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.081956+0000","last_change":"2024-02-16T00:12:54.081981+0000","last_active":"2024-02-16T00:12:54.081956+0000","last_peered":"2024-02-16T00:12:54.081956+0000","last_clean":"2024-02-16T00:12:54.081956+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:12:54.081956+0000","last_undegraded":"2024-02-16T00:12:54.081956+0000","last_fullsized":"2024-02-16T00:12:54.081956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.081866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:20.234092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.900259+0000","last_change":"2024-02-16T00:13:32.900259+0000","last_active":"2024-02-16T00:13:32.900259+0000","last_peered":"2024-02-16T00:13:32.900259+0000","last_clean":"2024-02-16T00:13:32.900259+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:13:32.900259+0000","last_undegraded":"2024-02-16T00:13:32.900259+0000","last_fullsized":"2024-02-16T00:13:32.900259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:32.900135+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:32.900135+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.900135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:23:43.008142+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.584199+0000","last_change":"2024-02-16T00:13:15.584199+0000","last_active":"2024-02-16T00:13:15.584199+0000","last_peered":"2024-02-16T00:13:15.584199+0000","last_clean":"2024-02-16T00:13:15.584199+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:13:15.584199+0000","last_undegraded":"2024-02-16T00:13:15.584199+0000","last_fullsized":"2024-02-16T00:13:15.584199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.584073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:18.030880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.040576+0000","last_change":"2024-02-16T00:12:46.040576+0000","last_active":"2024-02-16T00:12:46.040576+0000","last_peered":"2024-02-16T00:12:46.040576+0000","last_clean":"2024-02-16T00:12:46.040576+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:12:46.040576+0000","last_undegraded":"2024-02-16T00:12:46.040576+0000","last_fullsized":"2024-02-16T00:12:46.040576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.040468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:29.717153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'41","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.243662+0000","last_change":"2024-02-16T00:12:49.243662+0000","last_active":"2024-02-16T00:12:49.243662+0000","last_peered":"2024-02-16T00:12:49.243662+0000","last_clean":"2024-02-16T00:12:49.243662+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:49.243662+0000","last_undegraded":"2024-02-16T00:12:49.243662+0000","last_fullsized":"2024-02-16T00:12:49.243662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.243531+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:44.292142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'243","reported_seq":331,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.916116+0000","last_change":"2024-02-16T00:12:42.916116+0000","last_active":"2024-02-16T00:12:42.916116+0000","last_peered":"2024-02-16T00:12:42.916116+0000","last_clean":"2024-02-16T00:12:42.916116+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:42.916116+0000","last_undegraded":"2024-02-16T00:12:42.916116+0000","last_fullsized":"2024-02-16T00:12:42.916116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.916005+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:53.580174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.334990+0000","last_change":"2024-02-16T00:13:33.335047+0000","last_active":"2024-02-16T00:13:33.334990+0000","last_peered":"2024-02-16T00:13:33.334990+0000","last_clean":"2024-02-16T00:13:33.334990+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:13:33.334990+0000","last_undegraded":"2024-02-16T00:13:33.334990+0000","last_fullsized":"2024-02-16T00:13:33.334990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-02-16T00:13:33.334889+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-02-16T00:13:33.334889+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.334889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:17.712622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.298408+0000","last_change":"2024-02-16T00:13:24.298439+0000","last_active":"2024-02-16T00:13:24.298408+0000","last_peered":"2024-02-16T00:13:24.298408+0000","last_clean":"2024-02-16T00:13:24.298408+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:13:24.298408+0000","last_undegraded":"2024-02-16T00:13:24.298408+0000","last_fullsized":"2024-02-16T00:13:24.298408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:24.298312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:24.298312+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.298312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:56.750764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.525828+0000","last_change":"2024-02-16T00:12:48.525828+0000","last_active":"2024-02-16T00:12:48.525828+0000","last_peered":"2024-02-16T00:12:48.525828+0000","last_clean":"2024-02-16T00:12:48.525828+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:12:48.525828+0000","last_undegraded":"2024-02-16T00:12:48.525828+0000","last_fullsized":"2024-02-16T00:12:48.525828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.525719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:11.360728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'58","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.244124+0000","last_change":"2024-02-16T00:12:48.244124+0000","last_active":"2024-02-16T00:12:48.244124+0000","last_peered":"2024-02-16T00:12:48.244124+0000","last_clean":"2024-02-16T00:12:48.244124+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:48.244124+0000","last_undegraded":"2024-02-16T00:12:48.244124+0000","last_fullsized":"2024-02-16T00:12:48.244124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.243982+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:25.939262+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.931903+0000","last_change":"2024-02-16T00:12:46.931903+0000","last_active":"2024-02-16T00:12:46.931903+0000","last_peered":"2024-02-16T00:12:46.931903+0000","last_clean":"2024-02-16T00:12:46.931903+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:12:46.931903+0000","last_undegraded":"2024-02-16T00:12:46.931903+0000","last_fullsized":"2024-02-16T00:12:46.931903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.931775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:08:25.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.070398+0000","last_change":"2024-02-16T00:12:58.070398+0000","last_active":"2024-02-16T00:12:58.070398+0000","last_peered":"2024-02-16T00:12:58.070398+0000","last_clean":"2024-02-16T00:12:58.070398+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:58.070398+0000","last_undegraded":"2024-02-16T00:12:58.070398+0000","last_fullsized":"2024-02-16T00:12:58.070398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.070215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:35.924708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.553664+0000","last_change":"2024-02-16T00:13:08.553664+0000","last_active":"2024-02-16T00:13:08.553664+0000","last_peered":"2024-02-16T00:13:08.553664+0000","last_clean":"2024-02-16T00:13:08.553664+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:13:08.553664+0000","last_undegraded":"2024-02-16T00:13:08.553664+0000","last_fullsized":"2024-02-16T00:13:08.553664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.553541+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:34.676748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.278691+0000","last_change":"2024-02-16T00:13:27.278718+0000","last_active":"2024-02-16T00:13:27.278691+0000","last_peered":"2024-02-16T00:13:27.278691+0000","last_clean":"2024-02-16T00:13:27.278691+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:13:27.278691+0000","last_undegraded":"2024-02-16T00:13:27.278691+0000","last_fullsized":"2024-02-16T00:13:27.278691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:27.278584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:27.278584+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.278584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:44:28.499451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.788791+0000","last_change":"2024-02-16T00:12:55.788791+0000","last_active":"2024-02-16T00:12:55.788791+0000","last_peered":"2024-02-16T00:12:55.788791+0000","last_clean":"2024-02-16T00:12:55.788791+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:12:55.788791+0000","last_undegraded":"2024-02-16T00:12:55.788791+0000","last_fullsized":"2024-02-16T00:12:55.788791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.788644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:03.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'41","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.074769+0000","last_change":"2024-02-16T00:12:43.074769+0000","last_active":"2024-02-16T00:12:43.074769+0000","last_peered":"2024-02-16T00:12:43.074769+0000","last_clean":"2024-02-16T00:12:43.074769+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:43.074769+0000","last_undegraded":"2024-02-16T00:12:43.074769+0000","last_fullsized":"2024-02-16T00:12:43.074769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.074645+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.611584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.938580+0000","last_change":"2024-02-16T00:12:40.938580+0000","last_active":"2024-02-16T00:12:40.938580+0000","last_peered":"2024-02-16T00:12:40.938580+0000","last_clean":"2024-02-16T00:12:40.938580+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:12:40.938580+0000","last_undegraded":"2024-02-16T00:12:40.938580+0000","last_fullsized":"2024-02-16T00:12:40.938580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.938464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:15:55.114937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.741583+0000","last_change":"2024-02-16T00:13:35.741615+0000","last_active":"2024-02-16T00:13:35.741583+0000","last_peered":"2024-02-16T00:13:35.741583+0000","last_clean":"2024-02-16T00:13:35.741583+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:13:35.741583+0000","last_undegraded":"2024-02-16T00:13:35.741583+0000","last_fullsized":"2024-02-16T00:13:35.741583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:35.741499+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:35.741499+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.741499+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:47.657559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.194785+0000","last_change":"2024-02-16T00:13:16.194785+0000","last_active":"2024-02-16T00:13:16.194785+0000","last_peered":"2024-02-16T00:13:16.194785+0000","last_clean":"2024-02-16T00:13:16.194785+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:13:16.194785+0000","last_undegraded":"2024-02-16T00:13:16.194785+0000","last_fullsized":"2024-02-16T00:13:16.194785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.194674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:42.317881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.102986+0000","last_change":"2024-02-16T00:13:38.103017+0000","last_active":"2024-02-16T00:13:38.102986+0000","last_peered":"2024-02-16T00:13:38.102986+0000","last_clean":"2024-02-16T00:13:38.102986+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:13:38.102986+0000","last_undegraded":"2024-02-16T00:13:38.102986+0000","last_fullsized":"2024-02-16T00:13:38.102986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:38.102894+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:38.102894+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.102894+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:10.226023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.864812+0000","last_change":"2024-02-16T00:12:59.864812+0000","last_active":"2024-02-16T00:12:59.864812+0000","last_peered":"2024-02-16T00:12:59.864812+0000","last_clean":"2024-02-16T00:12:59.864812+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:12:59.864812+0000","last_undegraded":"2024-02-16T00:12:59.864812+0000","last_fullsized":"2024-02-16T00:12:59.864812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.864691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:37:20.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'57","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.882918+0000","last_change":"2024-02-16T00:12:50.882918+0000","last_active":"2024-02-16T00:12:50.882918+0000","last_peered":"2024-02-16T00:12:50.882918+0000","last_clean":"2024-02-16T00:12:50.882918+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:50.882918+0000","last_undegraded":"2024-02-16T00:12:50.882918+0000","last_fullsized":"2024-02-16T00:12:50.882918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.882742+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:43.268496+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'243","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.962470+0000","last_change":"2024-02-16T00:12:43.962470+0000","last_active":"2024-02-16T00:12:43.962470+0000","last_peered":"2024-02-16T00:12:43.962470+0000","last_clean":"2024-02-16T00:12:43.962470+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:43.962470+0000","last_undegraded":"2024-02-16T00:12:43.962470+0000","last_fullsized":"2024-02-16T00:12:43.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.962355+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:22.152077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.140845+0000","last_change":"2024-02-16T00:11:12.828514+0000","last_active":"2024-02-16T00:12:38.140845+0000","last_peered":"2024-02-16T00:12:38.140845+0000","last_clean":"2024-02-16T00:12:38.140845+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:12:38.140845+0000","last_undegraded":"2024-02-16T00:12:38.140845+0000","last_fullsized":"2024-02-16T00:12:38.140845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.207275+0000","last_change":"2024-02-16T00:13:08.207275+0000","last_active":"2024-02-16T00:13:08.207275+0000","last_peered":"2024-02-16T00:13:08.207275+0000","last_clean":"2024-02-16T00:13:08.207275+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:13:08.207275+0000","last_undegraded":"2024-02-16T00:13:08.207275+0000","last_fullsized":"2024-02-16T00:13:08.207275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.207150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:18.983700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456735+0000","last_change":"2024-02-16T00:11:02.814941+0000","last_active":"2024-02-16T00:12:39.456735+0000","last_peered":"2024-02-16T00:12:39.456735+0000","last_clean":"2024-02-16T00:12:39.456735+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:12:39.456735+0000","last_undegraded":"2024-02-16T00:12:39.456735+0000","last_fullsized":"2024-02-16T00:12:39.456735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.773405+0000","last_change":"2024-02-16T00:12:56.773405+0000","last_active":"2024-02-16T00:12:56.773405+0000","last_peered":"2024-02-16T00:12:56.773405+0000","last_clean":"2024-02-16T00:12:56.773405+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:12:56.773405+0000","last_undegraded":"2024-02-16T00:12:56.773405+0000","last_fullsized":"2024-02-16T00:12:56.773405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.773281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:12.642357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'73","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.029931+0000","last_change":"2024-02-16T00:13:05.029931+0000","last_active":"2024-02-16T00:13:05.029931+0000","last_peered":"2024-02-16T00:13:05.029931+0000","last_clean":"2024-02-16T00:13:05.029931+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:13:05.029931+0000","last_undegraded":"2024-02-16T00:13:05.029931+0000","last_fullsized":"2024-02-16T00:13:05.029931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.029752+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:42.315448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.833657+0000","last_change":"2024-02-16T00:12:58.833657+0000","last_active":"2024-02-16T00:12:58.833657+0000","last_peered":"2024-02-16T00:12:58.833657+0000","last_clean":"2024-02-16T00:12:58.833657+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:12:58.833657+0000","last_undegraded":"2024-02-16T00:12:58.833657+0000","last_fullsized":"2024-02-16T00:12:58.833657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.833533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:45:54.589076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.870256+0000","last_change":"2024-02-16T00:13:34.870280+0000","last_active":"2024-02-16T00:13:34.870256+0000","last_peered":"2024-02-16T00:13:34.870256+0000","last_clean":"2024-02-16T00:13:34.870256+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:13:34.870256+0000","last_undegraded":"2024-02-16T00:13:34.870256+0000","last_fullsized":"2024-02-16T00:13:34.870256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:34.870168+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:34.870168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.870168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:07.128815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.551036+0000","last_change":"2024-02-16T00:13:07.551036+0000","last_active":"2024-02-16T00:13:07.551036+0000","last_peered":"2024-02-16T00:13:07.551036+0000","last_clean":"2024-02-16T00:13:07.551036+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:13:07.551036+0000","last_undegraded":"2024-02-16T00:13:07.551036+0000","last_fullsized":"2024-02-16T00:13:07.551036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.550917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:08.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.807521+0000","last_change":"2024-02-16T00:13:17.807521+0000","last_active":"2024-02-16T00:13:17.807521+0000","last_peered":"2024-02-16T00:13:17.807521+0000","last_clean":"2024-02-16T00:13:17.807521+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:13:17.807521+0000","last_undegraded":"2024-02-16T00:13:17.807521+0000","last_fullsized":"2024-02-16T00:13:17.807521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.807409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:10.662061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.114782+0000","last_change":"2024-02-16T00:12:59.114782+0000","last_active":"2024-02-16T00:12:59.114782+0000","last_peered":"2024-02-16T00:12:59.114782+0000","last_clean":"2024-02-16T00:12:59.114782+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:12:59.114782+0000","last_undegraded":"2024-02-16T00:12:59.114782+0000","last_fullsized":"2024-02-16T00:12:59.114782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.114637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:06.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.465978+0000","last_change":"2024-02-16T00:12:45.465978+0000","last_active":"2024-02-16T00:12:45.465978+0000","last_peered":"2024-02-16T00:12:45.465978+0000","last_clean":"2024-02-16T00:12:45.465978+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:45.465978+0000","last_undegraded":"2024-02-16T00:12:45.465978+0000","last_fullsized":"2024-02-16T00:12:45.465978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.465843+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:56.130012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.024834+0000","last_change":"2024-02-16T00:13:03.024834+0000","last_active":"2024-02-16T00:13:03.024834+0000","last_peered":"2024-02-16T00:13:03.024834+0000","last_clean":"2024-02-16T00:13:03.024834+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:13:03.024834+0000","last_undegraded":"2024-02-16T00:13:03.024834+0000","last_fullsized":"2024-02-16T00:13:03.024834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.024725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:07.760259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458009+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:12:39.458009+0000","last_peered":"2024-02-16T00:12:39.458009+0000","last_clean":"2024-02-16T00:12:39.458009+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:12:39.458009+0000","last_undegraded":"2024-02-16T00:12:39.458009+0000","last_fullsized":"2024-02-16T00:12:39.458009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.306469+0000","last_change":"2024-02-16T00:13:32.306533+0000","last_active":"2024-02-16T00:13:32.306469+0000","last_peered":"2024-02-16T00:13:32.306469+0000","last_clean":"2024-02-16T00:13:32.306469+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:13:32.306469+0000","last_undegraded":"2024-02-16T00:13:32.306469+0000","last_fullsized":"2024-02-16T00:13:32.306469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:32.306376+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:32.306376+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.306376+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:04:40.109886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.026784+0000","last_change":"2024-02-16T00:13:33.026807+0000","last_active":"2024-02-16T00:13:33.026784+0000","last_peered":"2024-02-16T00:13:33.026784+0000","last_clean":"2024-02-16T00:13:33.026784+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:13:33.026784+0000","last_undegraded":"2024-02-16T00:13:33.026784+0000","last_fullsized":"2024-02-16T00:13:33.026784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:33.026697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:33.026697+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.026697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:02.894770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.335208+0000","last_change":"2024-02-16T00:13:30.335235+0000","last_active":"2024-02-16T00:13:30.335208+0000","last_peered":"2024-02-16T00:13:30.335208+0000","last_clean":"2024-02-16T00:13:30.335208+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:13:30.335208+0000","last_undegraded":"2024-02-16T00:13:30.335208+0000","last_fullsized":"2024-02-16T00:13:30.335208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.335112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.335112+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.335112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:19.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.094367+0000","last_change":"2024-02-16T00:12:55.094367+0000","last_active":"2024-02-16T00:12:55.094367+0000","last_peered":"2024-02-16T00:12:55.094367+0000","last_clean":"2024-02-16T00:12:55.094367+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:55.094367+0000","last_undegraded":"2024-02-16T00:12:55.094367+0000","last_fullsized":"2024-02-16T00:12:55.094367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.094244+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:26.439070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'243","reported_seq":344,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.239506+0000","last_change":"2024-02-16T00:12:39.239506+0000","last_active":"2024-02-16T00:12:39.239506+0000","last_peered":"2024-02-16T00:12:39.239506+0000","last_clean":"2024-02-16T00:12:39.239506+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:39.239506+0000","last_undegraded":"2024-02-16T00:12:39.239506+0000","last_fullsized":"2024-02-16T00:12:39.239506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.239332+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:03:36.377883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.914260+0000","last_change":"2024-02-16T00:13:35.914283+0000","last_active":"2024-02-16T00:13:35.914260+0000","last_peered":"2024-02-16T00:13:35.914260+0000","last_clean":"2024-02-16T00:13:35.914260+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:13:35.914260+0000","last_undegraded":"2024-02-16T00:13:35.914260+0000","last_fullsized":"2024-02-16T00:13:35.914260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-02-16T00:13:35.914177+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-02-16T00:13:35.914177+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.914177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:15.976313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.302481+0000","last_change":"2024-02-16T00:13:35.302506+0000","last_active":"2024-02-16T00:13:35.302481+0000","last_peered":"2024-02-16T00:13:35.302481+0000","last_clean":"2024-02-16T00:13:35.302481+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:13:35.302481+0000","last_undegraded":"2024-02-16T00:13:35.302481+0000","last_fullsized":"2024-02-16T00:13:35.302481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:35.302398+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:35.302398+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.302398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:02.890791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456693+0000","last_change":"2024-02-16T00:11:02.822237+0000","last_active":"2024-02-16T00:12:39.456693+0000","last_peered":"2024-02-16T00:12:39.456693+0000","last_clean":"2024-02-16T00:12:39.456693+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:12:39.456693+0000","last_undegraded":"2024-02-16T00:12:39.456693+0000","last_fullsized":"2024-02-16T00:12:39.456693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'4","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.634659+0000","last_change":"2024-02-16T00:12:53.634659+0000","last_active":"2024-02-16T00:12:53.634659+0000","last_peered":"2024-02-16T00:12:53.634659+0000","last_clean":"2024-02-16T00:12:53.634659+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:53.634659+0000","last_undegraded":"2024-02-16T00:12:53.634659+0000","last_fullsized":"2024-02-16T00:12:53.634659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.634543+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:19.504192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.010930+0000","last_change":"2024-02-16T00:13:06.010930+0000","last_active":"2024-02-16T00:13:06.010930+0000","last_peered":"2024-02-16T00:13:06.010930+0000","last_clean":"2024-02-16T00:13:06.010930+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:13:06.010930+0000","last_undegraded":"2024-02-16T00:13:06.010930+0000","last_fullsized":"2024-02-16T00:13:06.010930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.010796+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:32.982515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'243","reported_seq":347,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.455945+0000","last_change":"2024-02-16T00:12:42.455945+0000","last_active":"2024-02-16T00:12:42.455945+0000","last_peered":"2024-02-16T00:12:42.455945+0000","last_clean":"2024-02-16T00:12:42.455945+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:42.455945+0000","last_undegraded":"2024-02-16T00:12:42.455945+0000","last_fullsized":"2024-02-16T00:12:42.455945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.455835+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.530697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.191670+0000","last_change":"2024-02-16T00:12:50.191670+0000","last_active":"2024-02-16T00:12:50.191670+0000","last_peered":"2024-02-16T00:12:50.191670+0000","last_clean":"2024-02-16T00:12:50.191670+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:12:50.191670+0000","last_undegraded":"2024-02-16T00:12:50.191670+0000","last_fullsized":"2024-02-16T00:12:50.191670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.191478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:27.718003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.608047+0000","last_change":"2024-02-16T00:13:00.608047+0000","last_active":"2024-02-16T00:13:00.608047+0000","last_peered":"2024-02-16T00:13:00.608047+0000","last_clean":"2024-02-16T00:13:00.608047+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:13:00.608047+0000","last_undegraded":"2024-02-16T00:13:00.608047+0000","last_fullsized":"2024-02-16T00:13:00.608047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.607926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:11.384475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456620+0000","last_change":"2024-02-16T00:11:02.822597+0000","last_active":"2024-02-16T00:12:39.456620+0000","last_peered":"2024-02-16T00:12:39.456620+0000","last_clean":"2024-02-16T00:12:39.456620+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:12:39.456620+0000","last_undegraded":"2024-02-16T00:12:39.456620+0000","last_fullsized":"2024-02-16T00:12:39.456620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.956544+0000","last_change":"2024-02-16T00:12:47.956544+0000","last_active":"2024-02-16T00:12:47.956544+0000","last_peered":"2024-02-16T00:12:47.956544+0000","last_clean":"2024-02-16T00:12:47.956544+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:12:47.956544+0000","last_undegraded":"2024-02-16T00:12:47.956544+0000","last_fullsized":"2024-02-16T00:12:47.956544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.956387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:46.994810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'47","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.531411+0000","last_change":"2024-02-16T00:12:39.531411+0000","last_active":"2024-02-16T00:12:39.531411+0000","last_peered":"2024-02-16T00:12:39.531411+0000","last_clean":"2024-02-16T00:12:39.531411+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:39.531411+0000","last_undegraded":"2024-02-16T00:12:39.531411+0000","last_fullsized":"2024-02-16T00:12:39.531411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.531279+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:07.205098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.313251+0000","last_change":"2024-02-16T00:12:41.313251+0000","last_active":"2024-02-16T00:12:41.313251+0000","last_peered":"2024-02-16T00:12:41.313251+0000","last_clean":"2024-02-16T00:12:41.313251+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:12:41.313251+0000","last_undegraded":"2024-02-16T00:12:41.313251+0000","last_fullsized":"2024-02-16T00:12:41.313251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.313091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:34.237575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.551467+0000","last_change":"2024-02-16T00:13:06.551467+0000","last_active":"2024-02-16T00:13:06.551467+0000","last_peered":"2024-02-16T00:13:06.551467+0000","last_clean":"2024-02-16T00:13:06.551467+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:13:06.551467+0000","last_undegraded":"2024-02-16T00:13:06.551467+0000","last_fullsized":"2024-02-16T00:13:06.551467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.551352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:50.228037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.978897+0000","last_change":"2024-02-16T00:12:53.978897+0000","last_active":"2024-02-16T00:12:53.978897+0000","last_peered":"2024-02-16T00:12:53.978897+0000","last_clean":"2024-02-16T00:12:53.978897+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:53.978897+0000","last_undegraded":"2024-02-16T00:12:53.978897+0000","last_fullsized":"2024-02-16T00:12:53.978897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.978770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:56.425577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.709287+0000","last_change":"2024-02-16T00:13:24.709340+0000","last_active":"2024-02-16T00:13:24.709287+0000","last_peered":"2024-02-16T00:13:24.709287+0000","last_clean":"2024-02-16T00:13:24.709287+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:13:24.709287+0000","last_undegraded":"2024-02-16T00:13:24.709287+0000","last_fullsized":"2024-02-16T00:13:24.709287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-02-16T00:13:24.709181+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-02-16T00:13:24.709181+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.709181+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.269456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456522+0000","last_change":"2024-02-16T00:10:55.437876+0000","last_active":"2024-02-16T00:12:39.456522+0000","last_peered":"2024-02-16T00:12:39.456522+0000","last_clean":"2024-02-16T00:12:39.456522+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:12:39.456522+0000","last_undegraded":"2024-02-16T00:12:39.456522+0000","last_fullsized":"2024-02-16T00:12:39.456522+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.985328+0000","last_change":"2024-02-16T00:13:31.985353+0000","last_active":"2024-02-16T00:13:31.985328+0000","last_peered":"2024-02-16T00:13:31.985328+0000","last_clean":"2024-02-16T00:13:31.985328+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:13:31.985328+0000","last_undegraded":"2024-02-16T00:13:31.985328+0000","last_fullsized":"2024-02-16T00:13:31.985328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:31.985241+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:31.985241+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.985241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:06.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.646834+0000","last_change":"2024-02-16T00:12:55.646834+0000","last_active":"2024-02-16T00:12:55.646834+0000","last_peered":"2024-02-16T00:12:55.646834+0000","last_clean":"2024-02-16T00:12:55.646834+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:12:55.646834+0000","last_undegraded":"2024-02-16T00:12:55.646834+0000","last_fullsized":"2024-02-16T00:12:55.646834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.646719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:53.816935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.997697+0000","last_change":"2024-02-16T00:12:46.997697+0000","last_active":"2024-02-16T00:12:46.997697+0000","last_peered":"2024-02-16T00:12:46.997697+0000","last_clean":"2024-02-16T00:12:46.997697+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:46.997697+0000","last_undegraded":"2024-02-16T00:12:46.997697+0000","last_fullsized":"2024-02-16T00:12:46.997697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.997576+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:05:47.865804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.895106+0000","last_change":"2024-02-16T00:12:38.895106+0000","last_active":"2024-02-16T00:12:38.895106+0000","last_peered":"2024-02-16T00:12:38.895106+0000","last_clean":"2024-02-16T00:12:38.895106+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:12:38.895106+0000","last_undegraded":"2024-02-16T00:12:38.895106+0000","last_fullsized":"2024-02-16T00:12:38.895106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_clean_scrub_stamp":"2024-02-16T00:12:38.895009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:07.402769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.287858+0000","last_change":"2024-02-16T00:12:46.287858+0000","last_active":"2024-02-16T00:12:46.287858+0000","last_peered":"2024-02-16T00:12:46.287858+0000","last_clean":"2024-02-16T00:12:46.287858+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:46.287858+0000","last_undegraded":"2024-02-16T00:12:46.287858+0000","last_fullsized":"2024-02-16T00:12:46.287858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.287742+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:27.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.060562+0000","last_change":"2024-02-16T00:13:22.060587+0000","last_active":"2024-02-16T00:13:22.060562+0000","last_peered":"2024-02-16T00:13:22.060562+0000","last_clean":"2024-02-16T00:13:22.060562+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:13:22.060562+0000","last_undegraded":"2024-02-16T00:13:22.060562+0000","last_fullsized":"2024-02-16T00:13:22.060562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:22.060477+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:22.060477+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.060477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:46.570239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456516+0000","last_change":"2024-02-16T00:10:55.437382+0000","last_active":"2024-02-16T00:12:39.456516+0000","last_peered":"2024-02-16T00:12:39.456516+0000","last_clean":"2024-02-16T00:12:39.456516+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:12:39.456516+0000","last_undegraded":"2024-02-16T00:12:39.456516+0000","last_fullsized":"2024-02-16T00:12:39.456516+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.808017+0000","last_change":"2024-02-16T00:13:11.808042+0000","last_active":"2024-02-16T00:13:11.808017+0000","last_peered":"2024-02-16T00:13:11.808017+0000","last_clean":"2024-02-16T00:13:11.808017+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:13:11.808017+0000","last_undegraded":"2024-02-16T00:13:11.808017+0000","last_fullsized":"2024-02-16T00:13:11.808017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.807928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:43.625385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457476+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:12:39.457476+0000","last_peered":"2024-02-16T00:12:39.457476+0000","last_clean":"2024-02-16T00:12:39.457476+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:12:39.457476+0000","last_undegraded":"2024-02-16T00:12:39.457476+0000","last_fullsized":"2024-02-16T00:12:39.457476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'263","reported_seq":460,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.503542+0000","last_change":"2024-02-16T00:12:41.503542+0000","last_active":"2024-02-16T00:12:41.503542+0000","last_peered":"2024-02-16T00:12:41.503542+0000","last_clean":"2024-02-16T00:12:41.503542+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:41.503542+0000","last_undegraded":"2024-02-16T00:12:41.503542+0000","last_fullsized":"2024-02-16T00:12:41.503542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'263","last_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_deep_scrub":"29'263","last_deep_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.503409+0000","objects_scrubbed":11,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:12.672777+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":329,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.038391+0000","last_change":"2024-02-16T00:13:01.038391+0000","last_active":"2024-02-16T00:13:01.038391+0000","last_peered":"2024-02-16T00:13:01.038391+0000","last_clean":"2024-02-16T00:13:01.038391+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:13:01.038391+0000","last_undegraded":"2024-02-16T00:13:01.038391+0000","last_fullsized":"2024-02-16T00:13:01.038391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.038282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:10:49.789079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.730629+0000","last_change":"2024-02-16T00:13:34.730654+0000","last_active":"2024-02-16T00:13:34.730629+0000","last_peered":"2024-02-16T00:13:34.730629+0000","last_clean":"2024-02-16T00:13:34.730629+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:13:34.730629+0000","last_undegraded":"2024-02-16T00:13:34.730629+0000","last_fullsized":"2024-02-16T00:13:34.730629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:13:34.730542+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:13:34.730542+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.730542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:23:44.838549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.757812+0000","last_change":"2024-02-16T00:13:07.757812+0000","last_active":"2024-02-16T00:13:07.757812+0000","last_peered":"2024-02-16T00:13:07.757812+0000","last_clean":"2024-02-16T00:13:07.757812+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:13:07.757812+0000","last_undegraded":"2024-02-16T00:13:07.757812+0000","last_fullsized":"2024-02-16T00:13:07.757812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.757686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:36.310457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.256673+0000","last_change":"2024-02-16T00:13:20.256698+0000","last_active":"2024-02-16T00:13:20.256673+0000","last_peered":"2024-02-16T00:13:20.256673+0000","last_clean":"2024-02-16T00:13:20.256673+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:13:20.256673+0000","last_undegraded":"2024-02-16T00:13:20.256673+0000","last_fullsized":"2024-02-16T00:13:20.256673+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:20.256588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:20.256588+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.256588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:00.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.891449+0000","last_change":"2024-02-16T00:13:21.891474+0000","last_active":"2024-02-16T00:13:21.891449+0000","last_peered":"2024-02-16T00:13:21.891449+0000","last_clean":"2024-02-16T00:13:21.891449+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:13:21.891449+0000","last_undegraded":"2024-02-16T00:13:21.891449+0000","last_fullsized":"2024-02-16T00:13:21.891449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:21.891363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:21.891363+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.891363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:16:18.993601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.171880+0000","last_change":"2024-02-16T00:13:01.171880+0000","last_active":"2024-02-16T00:13:01.171880+0000","last_peered":"2024-02-16T00:13:01.171880+0000","last_clean":"2024-02-16T00:13:01.171880+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:13:01.171880+0000","last_undegraded":"2024-02-16T00:13:01.171880+0000","last_fullsized":"2024-02-16T00:13:01.171880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.171761+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:27.041410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.284740+0000","last_change":"2024-02-16T00:12:47.284740+0000","last_active":"2024-02-16T00:12:47.284740+0000","last_peered":"2024-02-16T00:12:47.284740+0000","last_clean":"2024-02-16T00:12:47.284740+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:47.284740+0000","last_undegraded":"2024-02-16T00:12:47.284740+0000","last_fullsized":"2024-02-16T00:12:47.284740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.284612+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:18.453979+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.908420+0000","last_change":"2024-02-16T00:12:39.908420+0000","last_active":"2024-02-16T00:12:39.908420+0000","last_peered":"2024-02-16T00:12:39.908420+0000","last_clean":"2024-02-16T00:12:39.908420+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:12:39.908420+0000","last_undegraded":"2024-02-16T00:12:39.908420+0000","last_fullsized":"2024-02-16T00:12:39.908420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.908319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:17.603599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458022+0000","last_change":"2024-02-16T00:11:12.832658+0000","last_active":"2024-02-16T00:12:39.458022+0000","last_peered":"2024-02-16T00:12:39.458022+0000","last_clean":"2024-02-16T00:12:39.458022+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:12:39.458022+0000","last_undegraded":"2024-02-16T00:12:39.458022+0000","last_fullsized":"2024-02-16T00:12:39.458022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.824008+0000","last_change":"2024-02-16T00:13:16.824040+0000","last_active":"2024-02-16T00:13:16.824008+0000","last_peered":"2024-02-16T00:13:16.824008+0000","last_clean":"2024-02-16T00:13:16.824008+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:13:16.824008+0000","last_undegraded":"2024-02-16T00:13:16.824008+0000","last_fullsized":"2024-02-16T00:13:16.824008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.823910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:40.976221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456538+0000","last_change":"2024-02-16T00:10:55.436539+0000","last_active":"2024-02-16T00:12:39.456538+0000","last_peered":"2024-02-16T00:12:39.456538+0000","last_clean":"2024-02-16T00:12:39.456538+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:12:39.456538+0000","last_undegraded":"2024-02-16T00:12:39.456538+0000","last_fullsized":"2024-02-16T00:12:39.456538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.300088+0000","last_change":"2024-02-16T00:13:26.300114+0000","last_active":"2024-02-16T00:13:26.300088+0000","last_peered":"2024-02-16T00:13:26.300088+0000","last_clean":"2024-02-16T00:13:26.300088+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:13:26.300088+0000","last_undegraded":"2024-02-16T00:13:26.300088+0000","last_fullsized":"2024-02-16T00:13:26.300088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.299989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.299989+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.299989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:19.154640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.295808+0000","last_change":"2024-02-16T00:13:31.295833+0000","last_active":"2024-02-16T00:13:31.295808+0000","last_peered":"2024-02-16T00:13:31.295808+0000","last_clean":"2024-02-16T00:13:31.295808+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:13:31.295808+0000","last_undegraded":"2024-02-16T00:13:31.295808+0000","last_fullsized":"2024-02-16T00:13:31.295808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.295719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.295719+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.295719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:04:51.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.935999+0000","last_change":"2024-02-16T00:12:52.935999+0000","last_active":"2024-02-16T00:12:52.935999+0000","last_peered":"2024-02-16T00:12:52.935999+0000","last_clean":"2024-02-16T00:12:52.935999+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:12:52.935999+0000","last_undegraded":"2024-02-16T00:12:52.935999+0000","last_fullsized":"2024-02-16T00:12:52.935999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.935867+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:29.245202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.060701+0000","last_change":"2024-02-16T00:13:02.060701+0000","last_active":"2024-02-16T00:13:02.060701+0000","last_peered":"2024-02-16T00:13:02.060701+0000","last_clean":"2024-02-16T00:13:02.060701+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:13:02.060701+0000","last_undegraded":"2024-02-16T00:13:02.060701+0000","last_fullsized":"2024-02-16T00:13:02.060701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.060586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:22.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.708762+0000","last_change":"2024-02-16T00:13:38.708793+0000","last_active":"2024-02-16T00:13:38.708762+0000","last_peered":"2024-02-16T00:13:38.708762+0000","last_clean":"2024-02-16T00:13:38.708762+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:13:38.708762+0000","last_undegraded":"2024-02-16T00:13:38.708762+0000","last_fullsized":"2024-02-16T00:13:38.708762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:38.708646+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:38.708646+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.708646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:56.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.631131+0000","last_change":"2024-02-16T00:13:03.631131+0000","last_active":"2024-02-16T00:13:03.631131+0000","last_peered":"2024-02-16T00:13:03.631131+0000","last_clean":"2024-02-16T00:13:03.631131+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:13:03.631131+0000","last_undegraded":"2024-02-16T00:13:03.631131+0000","last_fullsized":"2024-02-16T00:13:03.631131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.630995+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:48.259171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.261488+0000","last_change":"2024-02-16T00:13:25.261516+0000","last_active":"2024-02-16T00:13:25.261488+0000","last_peered":"2024-02-16T00:13:25.261488+0000","last_clean":"2024-02-16T00:13:25.261488+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:13:25.261488+0000","last_undegraded":"2024-02-16T00:13:25.261488+0000","last_fullsized":"2024-02-16T00:13:25.261488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.261400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.261400+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.261400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:49.413711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.918057+0000","last_change":"2024-02-16T00:13:24.918084+0000","last_active":"2024-02-16T00:13:24.918057+0000","last_peered":"2024-02-16T00:13:24.918057+0000","last_clean":"2024-02-16T00:13:24.918057+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:13:24.918057+0000","last_undegraded":"2024-02-16T00:13:24.918057+0000","last_fullsized":"2024-02-16T00:13:24.918057+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:24.917971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:24.917971+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.917971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:46.516651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.830866+0000","last_change":"2024-02-16T00:12:53.830866+0000","last_active":"2024-02-16T00:12:53.830866+0000","last_peered":"2024-02-16T00:12:53.830866+0000","last_clean":"2024-02-16T00:12:53.830866+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:12:53.830866+0000","last_undegraded":"2024-02-16T00:12:53.830866+0000","last_fullsized":"2024-02-16T00:12:53.830866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.830730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:52.000946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'82","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.898405+0000","last_change":"2024-02-16T00:12:49.898405+0000","last_active":"2024-02-16T00:12:49.898405+0000","last_peered":"2024-02-16T00:12:49.898405+0000","last_clean":"2024-02-16T00:12:49.898405+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:49.898405+0000","last_undegraded":"2024-02-16T00:12:49.898405+0000","last_fullsized":"2024-02-16T00:12:49.898405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.898247+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:43:05.900172+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":88,"num_read_kb":74,"num_write":40,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.271734+0000","last_change":"2024-02-16T00:12:40.271734+0000","last_active":"2024-02-16T00:12:40.271734+0000","last_peered":"2024-02-16T00:12:40.271734+0000","last_clean":"2024-02-16T00:12:40.271734+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:12:40.271734+0000","last_undegraded":"2024-02-16T00:12:40.271734+0000","last_fullsized":"2024-02-16T00:12:40.271734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.271589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:58.621135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.881341+0000","last_change":"2024-02-16T00:13:33.881365+0000","last_active":"2024-02-16T00:13:33.881341+0000","last_peered":"2024-02-16T00:13:33.881341+0000","last_clean":"2024-02-16T00:13:33.881341+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:13:33.881341+0000","last_undegraded":"2024-02-16T00:13:33.881341+0000","last_fullsized":"2024-02-16T00:13:33.881341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-02-16T00:13:33.881259+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-02-16T00:13:33.881259+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.881259+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:45.797319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.602576+0000","last_change":"2024-02-16T00:12:59.602576+0000","last_active":"2024-02-16T00:12:59.602576+0000","last_peered":"2024-02-16T00:12:59.602576+0000","last_clean":"2024-02-16T00:12:59.602576+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:12:59.602576+0000","last_undegraded":"2024-02-16T00:12:59.602576+0000","last_fullsized":"2024-02-16T00:12:59.602576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.602467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:39.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.940733+0000","last_change":"2024-02-16T00:13:31.940759+0000","last_active":"2024-02-16T00:13:31.940733+0000","last_peered":"2024-02-16T00:13:31.940733+0000","last_clean":"2024-02-16T00:13:31.940733+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:13:31.940733+0000","last_undegraded":"2024-02-16T00:13:31.940733+0000","last_fullsized":"2024-02-16T00:13:31.940733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.940638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.940638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.940638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:29.880557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456618+0000","last_change":"2024-02-16T00:10:55.436302+0000","last_active":"2024-02-16T00:12:39.456618+0000","last_peered":"2024-02-16T00:12:39.456618+0000","last_clean":"2024-02-16T00:12:39.456618+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:12:39.456618+0000","last_undegraded":"2024-02-16T00:12:39.456618+0000","last_fullsized":"2024-02-16T00:12:39.456618+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.038166+0000","last_change":"2024-02-16T00:12:44.038166+0000","last_active":"2024-02-16T00:12:44.038166+0000","last_peered":"2024-02-16T00:12:44.038166+0000","last_clean":"2024-02-16T00:12:44.038166+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:12:44.038166+0000","last_undegraded":"2024-02-16T00:12:44.038166+0000","last_fullsized":"2024-02-16T00:12:44.038166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.038018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:35.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'28","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.546695+0000","last_change":"2024-02-16T00:12:40.546695+0000","last_active":"2024-02-16T00:12:40.546695+0000","last_peered":"2024-02-16T00:12:40.546695+0000","last_clean":"2024-02-16T00:12:40.546695+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:12:40.546695+0000","last_undegraded":"2024-02-16T00:12:40.546695+0000","last_fullsized":"2024-02-16T00:12:40.546695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.546560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:21.906524+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'243","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.683178+0000","last_change":"2024-02-16T00:12:54.683178+0000","last_active":"2024-02-16T00:12:54.683178+0000","last_peered":"2024-02-16T00:12:54.683178+0000","last_clean":"2024-02-16T00:12:54.683178+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:54.683178+0000","last_undegraded":"2024-02-16T00:12:54.683178+0000","last_fullsized":"2024-02-16T00:12:54.683178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.683065+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:10.032872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458116+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:12:39.458116+0000","last_peered":"2024-02-16T00:12:39.458116+0000","last_clean":"2024-02-16T00:12:39.458116+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:12:39.458116+0000","last_undegraded":"2024-02-16T00:12:39.458116+0000","last_fullsized":"2024-02-16T00:12:39.458116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.036881+0000","last_change":"2024-02-16T00:12:56.036881+0000","last_active":"2024-02-16T00:12:56.036881+0000","last_peered":"2024-02-16T00:12:56.036881+0000","last_clean":"2024-02-16T00:12:56.036881+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:56.036881+0000","last_undegraded":"2024-02-16T00:12:56.036881+0000","last_fullsized":"2024-02-16T00:12:56.036881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.036766+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:37:08.513561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456628+0000","last_change":"2024-02-16T00:11:02.812808+0000","last_active":"2024-02-16T00:12:39.456628+0000","last_peered":"2024-02-16T00:12:39.456628+0000","last_clean":"2024-02-16T00:12:39.456628+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:12:39.456628+0000","last_undegraded":"2024-02-16T00:12:39.456628+0000","last_fullsized":"2024-02-16T00:12:39.456628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.950979+0000","last_change":"2024-02-16T00:13:25.951007+0000","last_active":"2024-02-16T00:13:25.950979+0000","last_peered":"2024-02-16T00:13:25.950979+0000","last_clean":"2024-02-16T00:13:25.950979+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:13:25.950979+0000","last_undegraded":"2024-02-16T00:13:25.950979+0000","last_fullsized":"2024-02-16T00:13:25.950979+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.950886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.950886+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.950886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:53.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.031737+0000","last_change":"2024-02-16T00:12:42.031737+0000","last_active":"2024-02-16T00:12:42.031737+0000","last_peered":"2024-02-16T00:12:42.031737+0000","last_clean":"2024-02-16T00:12:42.031737+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:12:42.031737+0000","last_undegraded":"2024-02-16T00:12:42.031737+0000","last_fullsized":"2024-02-16T00:12:42.031737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.031605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:03.714051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.979307+0000","last_change":"2024-02-16T00:13:11.979307+0000","last_active":"2024-02-16T00:13:11.979307+0000","last_peered":"2024-02-16T00:13:11.979307+0000","last_clean":"2024-02-16T00:13:11.979307+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:13:11.979307+0000","last_undegraded":"2024-02-16T00:13:11.979307+0000","last_fullsized":"2024-02-16T00:13:11.979307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.979168+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.839816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'243","reported_seq":323,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.867290+0000","last_change":"2024-02-16T00:12:50.867290+0000","last_active":"2024-02-16T00:12:50.867290+0000","last_peered":"2024-02-16T00:12:50.867290+0000","last_clean":"2024-02-16T00:12:50.867290+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:50.867290+0000","last_undegraded":"2024-02-16T00:12:50.867290+0000","last_fullsized":"2024-02-16T00:12:50.867290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.867173+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:57.352373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.761485+0000","last_change":"2024-02-16T00:13:36.761541+0000","last_active":"2024-02-16T00:13:36.761485+0000","last_peered":"2024-02-16T00:13:36.761485+0000","last_clean":"2024-02-16T00:13:36.761485+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:13:36.761485+0000","last_undegraded":"2024-02-16T00:13:36.761485+0000","last_fullsized":"2024-02-16T00:13:36.761485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:36.761373+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:36.761373+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.761373+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:09.020019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.178067+0000","last_change":"2024-02-16T00:13:14.178092+0000","last_active":"2024-02-16T00:13:14.178067+0000","last_peered":"2024-02-16T00:13:14.178067+0000","last_clean":"2024-02-16T00:13:14.178067+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:13:14.178067+0000","last_undegraded":"2024-02-16T00:13:14.178067+0000","last_fullsized":"2024-02-16T00:13:14.178067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.177977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:57.854662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.707210+0000","last_change":"2024-02-16T00:13:27.707247+0000","last_active":"2024-02-16T00:13:27.707210+0000","last_peered":"2024-02-16T00:13:27.707210+0000","last_clean":"2024-02-16T00:13:27.707210+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:13:27.707210+0000","last_undegraded":"2024-02-16T00:13:27.707210+0000","last_fullsized":"2024-02-16T00:13:27.707210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:27.707110+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:27.707110+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.707110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:55.295504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456594+0000","last_change":"2024-02-16T00:10:55.436912+0000","last_active":"2024-02-16T00:12:39.456594+0000","last_peered":"2024-02-16T00:12:39.456594+0000","last_clean":"2024-02-16T00:12:39.456594+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:12:39.456594+0000","last_undegraded":"2024-02-16T00:12:39.456594+0000","last_fullsized":"2024-02-16T00:12:39.456594+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:10:54.428237+0000","last_clean_scrub_stamp":"2024-02-16T00:10:54.428237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.021889+0000","last_change":"2024-02-16T00:12:41.021889+0000","last_active":"2024-02-16T00:12:41.021889+0000","last_peered":"2024-02-16T00:12:41.021889+0000","last_clean":"2024-02-16T00:12:41.021889+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:12:41.021889+0000","last_undegraded":"2024-02-16T00:12:41.021889+0000","last_fullsized":"2024-02-16T00:12:41.021889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.021775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:07.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'97","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.111041+0000","last_change":"2024-02-16T00:12:52.111041+0000","last_active":"2024-02-16T00:12:52.111041+0000","last_peered":"2024-02-16T00:12:52.111041+0000","last_clean":"2024-02-16T00:12:52.111041+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:52.111041+0000","last_undegraded":"2024-02-16T00:12:52.111041+0000","last_fullsized":"2024-02-16T00:12:52.111041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'97","last_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_deep_scrub":"29'97","last_deep_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.110898+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:30.300620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.913378+0000","last_change":"2024-02-16T00:13:02.913378+0000","last_active":"2024-02-16T00:13:02.913378+0000","last_peered":"2024-02-16T00:13:02.913378+0000","last_clean":"2024-02-16T00:13:02.913378+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:13:02.913378+0000","last_undegraded":"2024-02-16T00:13:02.913378+0000","last_fullsized":"2024-02-16T00:13:02.913378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.913264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:45.929231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.193822+0000","last_change":"2024-02-16T00:13:02.193822+0000","last_active":"2024-02-16T00:13:02.193822+0000","last_peered":"2024-02-16T00:13:02.193822+0000","last_clean":"2024-02-16T00:13:02.193822+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:13:02.193822+0000","last_undegraded":"2024-02-16T00:13:02.193822+0000","last_fullsized":"2024-02-16T00:13:02.193822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.193681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:17.543487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.291822+0000","last_change":"2024-02-16T00:13:29.291852+0000","last_active":"2024-02-16T00:13:29.291822+0000","last_peered":"2024-02-16T00:13:29.291822+0000","last_clean":"2024-02-16T00:13:29.291822+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:13:29.291822+0000","last_undegraded":"2024-02-16T00:13:29.291822+0000","last_fullsized":"2024-02-16T00:13:29.291822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:29.291739+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:29.291739+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.291739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:54.517083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.185628+0000","last_change":"2024-02-16T00:13:18.185628+0000","last_active":"2024-02-16T00:13:18.185628+0000","last_peered":"2024-02-16T00:13:18.185628+0000","last_clean":"2024-02-16T00:13:18.185628+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:13:18.185628+0000","last_undegraded":"2024-02-16T00:13:18.185628+0000","last_fullsized":"2024-02-16T00:13:18.185628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.185505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:49.777334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456757+0000","last_change":"2024-02-16T00:11:02.814635+0000","last_active":"2024-02-16T00:12:39.456757+0000","last_peered":"2024-02-16T00:12:39.456757+0000","last_clean":"2024-02-16T00:12:39.456757+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:12:39.456757+0000","last_undegraded":"2024-02-16T00:12:39.456757+0000","last_fullsized":"2024-02-16T00:12:39.456757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"29'2","reported_seq":204,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.629040+0000","last_change":"2024-02-16T00:12:52.629040+0000","last_active":"2024-02-16T00:12:52.629040+0000","last_peered":"2024-02-16T00:12:52.629040+0000","last_clean":"2024-02-16T00:12:52.629040+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:52.629040+0000","last_undegraded":"2024-02-16T00:12:52.629040+0000","last_fullsized":"2024-02-16T00:12:52.629040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.628926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:49.990836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'45","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.017778+0000","last_change":"2024-02-16T00:13:09.017778+0000","last_active":"2024-02-16T00:13:09.017778+0000","last_peered":"2024-02-16T00:13:09.017778+0000","last_clean":"2024-02-16T00:13:09.017778+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:13:09.017778+0000","last_undegraded":"2024-02-16T00:13:09.017778+0000","last_fullsized":"2024-02-16T00:13:09.017778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.017638+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:00.113238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.985144+0000","last_change":"2024-02-16T00:13:14.985144+0000","last_active":"2024-02-16T00:13:14.985144+0000","last_peered":"2024-02-16T00:13:14.985144+0000","last_clean":"2024-02-16T00:13:14.985144+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:13:14.985144+0000","last_undegraded":"2024-02-16T00:13:14.985144+0000","last_fullsized":"2024-02-16T00:13:14.985144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.985010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:26.901071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.788597+0000","last_change":"2024-02-16T00:13:06.788597+0000","last_active":"2024-02-16T00:13:06.788597+0000","last_peered":"2024-02-16T00:13:06.788597+0000","last_clean":"2024-02-16T00:13:06.788597+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:13:06.788597+0000","last_undegraded":"2024-02-16T00:13:06.788597+0000","last_fullsized":"2024-02-16T00:13:06.788597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.788487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:05.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.329252+0000","last_change":"2024-02-16T00:13:34.329280+0000","last_active":"2024-02-16T00:13:34.329252+0000","last_peered":"2024-02-16T00:13:34.329252+0000","last_clean":"2024-02-16T00:13:34.329252+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:13:34.329252+0000","last_undegraded":"2024-02-16T00:13:34.329252+0000","last_fullsized":"2024-02-16T00:13:34.329252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-02-16T00:13:34.329155+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-02-16T00:13:34.329155+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.329155+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:55.927835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.263698+0000","last_change":"2024-02-16T00:13:23.263698+0000","last_active":"2024-02-16T00:13:23.263698+0000","last_peered":"2024-02-16T00:13:23.263698+0000","last_clean":"2024-02-16T00:13:23.263698+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:13:23.263698+0000","last_undegraded":"2024-02-16T00:13:23.263698+0000","last_fullsized":"2024-02-16T00:13:23.263698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.263575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.263575+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.263575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:11.087871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.045412+0000","last_change":"2024-02-16T00:12:40.045412+0000","last_active":"2024-02-16T00:12:40.045412+0000","last_peered":"2024-02-16T00:12:40.045412+0000","last_clean":"2024-02-16T00:12:40.045412+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:12:40.045412+0000","last_undegraded":"2024-02-16T00:12:40.045412+0000","last_fullsized":"2024-02-16T00:12:40.045412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.045296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:50.821845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.941093+0000","last_change":"2024-02-16T00:12:45.941093+0000","last_active":"2024-02-16T00:12:45.941093+0000","last_peered":"2024-02-16T00:12:45.941093+0000","last_clean":"2024-02-16T00:12:45.941093+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:45.941093+0000","last_undegraded":"2024-02-16T00:12:45.941093+0000","last_fullsized":"2024-02-16T00:12:45.941093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.940956+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:12.093182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.279177+0000","last_change":"2024-02-16T00:12:43.279177+0000","last_active":"2024-02-16T00:12:43.279177+0000","last_peered":"2024-02-16T00:12:43.279177+0000","last_clean":"2024-02-16T00:12:43.279177+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:12:43.279177+0000","last_undegraded":"2024-02-16T00:12:43.279177+0000","last_fullsized":"2024-02-16T00:12:43.279177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.279059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:05.341803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:11:51.830302+0000","last_change":"2024-02-16T00:11:12.828469+0000","last_active":"2024-02-16T00:11:51.830302+0000","last_peered":"2024-02-16T00:11:51.830302+0000","last_clean":"2024-02-16T00:11:51.830302+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:11:51.830302+0000","last_undegraded":"2024-02-16T00:11:51.830302+0000","last_fullsized":"2024-02-16T00:11:51.830302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.767257+0000","last_change":"2024-02-16T00:13:14.767257+0000","last_active":"2024-02-16T00:13:14.767257+0000","last_peered":"2024-02-16T00:13:14.767257+0000","last_clean":"2024-02-16T00:13:14.767257+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:13:14.767257+0000","last_undegraded":"2024-02-16T00:13:14.767257+0000","last_fullsized":"2024-02-16T00:13:14.767257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.767144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:02.591440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.213509+0000","last_change":"2024-02-16T00:13:19.213509+0000","last_active":"2024-02-16T00:13:19.213509+0000","last_peered":"2024-02-16T00:13:19.213509+0000","last_clean":"2024-02-16T00:13:19.213509+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:13:19.213509+0000","last_undegraded":"2024-02-16T00:13:19.213509+0000","last_fullsized":"2024-02-16T00:13:19.213509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.213392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.213392+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.213392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:11.599146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.057565+0000","last_change":"2024-02-16T00:12:56.057565+0000","last_active":"2024-02-16T00:12:56.057565+0000","last_peered":"2024-02-16T00:12:56.057565+0000","last_clean":"2024-02-16T00:12:56.057565+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:12:56.057565+0000","last_undegraded":"2024-02-16T00:12:56.057565+0000","last_fullsized":"2024-02-16T00:12:56.057565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.057413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:26.439361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.803076+0000","last_change":"2024-02-16T00:12:52.803076+0000","last_active":"2024-02-16T00:12:52.803076+0000","last_peered":"2024-02-16T00:12:52.803076+0000","last_clean":"2024-02-16T00:12:52.803076+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:52.803076+0000","last_undegraded":"2024-02-16T00:12:52.803076+0000","last_fullsized":"2024-02-16T00:12:52.803076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.802940+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:55.924565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.555567+0000","last_change":"2024-02-16T00:12:50.555567+0000","last_active":"2024-02-16T00:12:50.555567+0000","last_peered":"2024-02-16T00:12:50.555567+0000","last_clean":"2024-02-16T00:12:50.555567+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:12:50.555567+0000","last_undegraded":"2024-02-16T00:12:50.555567+0000","last_fullsized":"2024-02-16T00:12:50.555567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.555443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:51.432013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.079505+0000","last_change":"2024-02-16T00:13:27.079543+0000","last_active":"2024-02-16T00:13:27.079505+0000","last_peered":"2024-02-16T00:13:27.079505+0000","last_clean":"2024-02-16T00:13:27.079505+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:13:27.079505+0000","last_undegraded":"2024-02-16T00:13:27.079505+0000","last_fullsized":"2024-02-16T00:13:27.079505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:27.079415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:27.079415+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.079415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:34:32.883445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.080743+0000","last_change":"2024-02-16T00:12:57.080743+0000","last_active":"2024-02-16T00:12:57.080743+0000","last_peered":"2024-02-16T00:12:57.080743+0000","last_clean":"2024-02-16T00:12:57.080743+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:12:57.080743+0000","last_undegraded":"2024-02-16T00:12:57.080743+0000","last_fullsized":"2024-02-16T00:12:57.080743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.080604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:49.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.661262+0000","last_change":"2024-02-16T00:13:23.661262+0000","last_active":"2024-02-16T00:13:23.661262+0000","last_peered":"2024-02-16T00:13:23.661262+0000","last_clean":"2024-02-16T00:13:23.661262+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:13:23.661262+0000","last_undegraded":"2024-02-16T00:13:23.661262+0000","last_fullsized":"2024-02-16T00:13:23.661262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:23.661125+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:23.661125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.661125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:43.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.884373+0000","last_change":"2024-02-16T00:12:49.884373+0000","last_active":"2024-02-16T00:12:49.884373+0000","last_peered":"2024-02-16T00:12:49.884373+0000","last_clean":"2024-02-16T00:12:49.884373+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:12:49.884373+0000","last_undegraded":"2024-02-16T00:12:49.884373+0000","last_fullsized":"2024-02-16T00:12:49.884373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.884258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:21.476087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'34","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.114102+0000","last_change":"2024-02-16T00:12:53.114102+0000","last_active":"2024-02-16T00:12:53.114102+0000","last_peered":"2024-02-16T00:12:53.114102+0000","last_clean":"2024-02-16T00:12:53.114102+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:53.114102+0000","last_undegraded":"2024-02-16T00:12:53.114102+0000","last_fullsized":"2024-02-16T00:12:53.114102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.113947+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:53.697900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.267908+0000","last_change":"2024-02-16T00:12:44.267908+0000","last_active":"2024-02-16T00:12:44.267908+0000","last_peered":"2024-02-16T00:12:44.267908+0000","last_clean":"2024-02-16T00:12:44.267908+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:12:44.267908+0000","last_undegraded":"2024-02-16T00:12:44.267908+0000","last_fullsized":"2024-02-16T00:12:44.267908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.267784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:28:21.260343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.096086+0000","last_change":"2024-02-16T00:13:28.096116+0000","last_active":"2024-02-16T00:13:28.096086+0000","last_peered":"2024-02-16T00:13:28.096086+0000","last_clean":"2024-02-16T00:13:28.096086+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:13:28.096086+0000","last_undegraded":"2024-02-16T00:13:28.096086+0000","last_fullsized":"2024-02-16T00:13:28.096086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-02-16T00:13:28.095997+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-02-16T00:13:28.095997+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.095997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:51.772323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456808+0000","last_change":"2024-02-16T00:11:02.822997+0000","last_active":"2024-02-16T00:12:39.456808+0000","last_peered":"2024-02-16T00:12:39.456808+0000","last_clean":"2024-02-16T00:12:39.456808+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:12:39.456808+0000","last_undegraded":"2024-02-16T00:12:39.456808+0000","last_fullsized":"2024-02-16T00:12:39.456808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.805078+0000","last_change":"2024-02-16T00:12:57.805078+0000","last_active":"2024-02-16T00:12:57.805078+0000","last_peered":"2024-02-16T00:12:57.805078+0000","last_clean":"2024-02-16T00:12:57.805078+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:12:57.805078+0000","last_undegraded":"2024-02-16T00:12:57.805078+0000","last_fullsized":"2024-02-16T00:12:57.805078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.804963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:37.236667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'67","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.901456+0000","last_change":"2024-02-16T00:12:47.901456+0000","last_active":"2024-02-16T00:12:47.901456+0000","last_peered":"2024-02-16T00:12:47.901456+0000","last_clean":"2024-02-16T00:12:47.901456+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:47.901456+0000","last_undegraded":"2024-02-16T00:12:47.901456+0000","last_fullsized":"2024-02-16T00:12:47.901456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.901291+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:48.763246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.239732+0000","last_change":"2024-02-16T00:12:45.239756+0000","last_active":"2024-02-16T00:12:45.239732+0000","last_peered":"2024-02-16T00:12:45.239732+0000","last_clean":"2024-02-16T00:12:45.239732+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:12:45.239732+0000","last_undegraded":"2024-02-16T00:12:45.239732+0000","last_fullsized":"2024-02-16T00:12:45.239732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.239638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:12.913457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.903756+0000","last_change":"2024-02-16T00:13:36.903783+0000","last_active":"2024-02-16T00:13:36.903756+0000","last_peered":"2024-02-16T00:13:36.903756+0000","last_clean":"2024-02-16T00:13:36.903756+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:13:36.903756+0000","last_undegraded":"2024-02-16T00:13:36.903756+0000","last_fullsized":"2024-02-16T00:13:36.903756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:36.903666+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:36.903666+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.903666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:54.251517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.800160+0000","last_change":"2024-02-16T00:13:12.800216+0000","last_active":"2024-02-16T00:13:12.800160+0000","last_peered":"2024-02-16T00:13:12.800160+0000","last_clean":"2024-02-16T00:13:12.800160+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:13:12.800160+0000","last_undegraded":"2024-02-16T00:13:12.800160+0000","last_fullsized":"2024-02-16T00:13:12.800160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.800049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:49.109384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.660012+0000","last_change":"2024-02-16T00:13:19.660012+0000","last_active":"2024-02-16T00:13:19.660012+0000","last_peered":"2024-02-16T00:13:19.660012+0000","last_clean":"2024-02-16T00:13:19.660012+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:13:19.660012+0000","last_undegraded":"2024-02-16T00:13:19.660012+0000","last_fullsized":"2024-02-16T00:13:19.660012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.659900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.659900+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.659900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:41.558813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.155308+0000","last_change":"2024-02-16T00:13:00.155308+0000","last_active":"2024-02-16T00:13:00.155308+0000","last_peered":"2024-02-16T00:13:00.155308+0000","last_clean":"2024-02-16T00:13:00.155308+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:13:00.155308+0000","last_undegraded":"2024-02-16T00:13:00.155308+0000","last_fullsized":"2024-02-16T00:13:00.155308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.155119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:57.517028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.019925+0000","last_change":"2024-02-16T00:13:08.019925+0000","last_active":"2024-02-16T00:13:08.019925+0000","last_peered":"2024-02-16T00:13:08.019925+0000","last_clean":"2024-02-16T00:13:08.019925+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:13:08.019925+0000","last_undegraded":"2024-02-16T00:13:08.019925+0000","last_fullsized":"2024-02-16T00:13:08.019925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.019795+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:01.526130+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.644016+0000","last_change":"2024-02-16T00:12:58.644040+0000","last_active":"2024-02-16T00:12:58.644016+0000","last_peered":"2024-02-16T00:12:58.644016+0000","last_clean":"2024-02-16T00:12:58.644016+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:12:58.644016+0000","last_undegraded":"2024-02-16T00:12:58.644016+0000","last_fullsized":"2024-02-16T00:12:58.644016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.643930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:14.513005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458139+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:12:39.458139+0000","last_peered":"2024-02-16T00:12:39.458139+0000","last_clean":"2024-02-16T00:12:39.458139+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:12:39.458139+0000","last_undegraded":"2024-02-16T00:12:39.458139+0000","last_fullsized":"2024-02-16T00:12:39.458139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.909416+0000","last_change":"2024-02-16T00:12:51.909416+0000","last_active":"2024-02-16T00:12:51.909416+0000","last_peered":"2024-02-16T00:12:51.909416+0000","last_clean":"2024-02-16T00:12:51.909416+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:12:51.909416+0000","last_undegraded":"2024-02-16T00:12:51.909416+0000","last_fullsized":"2024-02-16T00:12:51.909416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.909268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:23.726726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.724889+0000","last_change":"2024-02-16T00:13:25.724889+0000","last_active":"2024-02-16T00:13:25.724889+0000","last_peered":"2024-02-16T00:13:25.724889+0000","last_clean":"2024-02-16T00:13:25.724889+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:13:25.724889+0000","last_undegraded":"2024-02-16T00:13:25.724889+0000","last_fullsized":"2024-02-16T00:13:25.724889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.724773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.724773+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.724773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.014119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.196573+0000","last_change":"2024-02-16T00:13:03.196573+0000","last_active":"2024-02-16T00:13:03.196573+0000","last_peered":"2024-02-16T00:13:03.196573+0000","last_clean":"2024-02-16T00:13:03.196573+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:13:03.196573+0000","last_undegraded":"2024-02-16T00:13:03.196573+0000","last_fullsized":"2024-02-16T00:13:03.196573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.196453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:01.366669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.821474+0000","last_change":"2024-02-16T00:12:51.821474+0000","last_active":"2024-02-16T00:12:51.821474+0000","last_peered":"2024-02-16T00:12:51.821474+0000","last_clean":"2024-02-16T00:12:51.821474+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:51.821474+0000","last_undegraded":"2024-02-16T00:12:51.821474+0000","last_fullsized":"2024-02-16T00:12:51.821474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.821350+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:13:29.475897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.806808+0000","last_change":"2024-02-16T00:12:54.806808+0000","last_active":"2024-02-16T00:12:54.806808+0000","last_peered":"2024-02-16T00:12:54.806808+0000","last_clean":"2024-02-16T00:12:54.806808+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:12:54.806808+0000","last_undegraded":"2024-02-16T00:12:54.806808+0000","last_fullsized":"2024-02-16T00:12:54.806808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.806699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:52.208925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458122+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:12:39.458122+0000","last_peered":"2024-02-16T00:12:39.458122+0000","last_clean":"2024-02-16T00:12:39.458122+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:12:39.458122+0000","last_undegraded":"2024-02-16T00:12:39.458122+0000","last_fullsized":"2024-02-16T00:12:39.458122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.850574+0000","last_change":"2024-02-16T00:13:20.850574+0000","last_active":"2024-02-16T00:13:20.850574+0000","last_peered":"2024-02-16T00:13:20.850574+0000","last_clean":"2024-02-16T00:13:20.850574+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:13:20.850574+0000","last_undegraded":"2024-02-16T00:13:20.850574+0000","last_fullsized":"2024-02-16T00:13:20.850574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:20.850447+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:20.850447+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.850447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:49.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456812+0000","last_change":"2024-02-16T00:11:02.813457+0000","last_active":"2024-02-16T00:12:39.456812+0000","last_peered":"2024-02-16T00:12:39.456812+0000","last_clean":"2024-02-16T00:12:39.456812+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:12:39.456812+0000","last_undegraded":"2024-02-16T00:12:39.456812+0000","last_fullsized":"2024-02-16T00:12:39.456812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.635127+0000","last_change":"2024-02-16T00:12:56.635127+0000","last_active":"2024-02-16T00:12:56.635127+0000","last_peered":"2024-02-16T00:12:56.635127+0000","last_clean":"2024-02-16T00:12:56.635127+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:12:56.635127+0000","last_undegraded":"2024-02-16T00:12:56.635127+0000","last_fullsized":"2024-02-16T00:12:56.635127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.634994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:54.037220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.029345+0000","last_change":"2024-02-16T00:12:59.029345+0000","last_active":"2024-02-16T00:12:59.029345+0000","last_peered":"2024-02-16T00:12:59.029345+0000","last_clean":"2024-02-16T00:12:59.029345+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:12:59.029345+0000","last_undegraded":"2024-02-16T00:12:59.029345+0000","last_fullsized":"2024-02-16T00:12:59.029345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.029179+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:59.276538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'243","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.288308+0000","last_change":"2024-02-16T00:12:42.288308+0000","last_active":"2024-02-16T00:12:42.288308+0000","last_peered":"2024-02-16T00:12:42.288308+0000","last_clean":"2024-02-16T00:12:42.288308+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:42.288308+0000","last_undegraded":"2024-02-16T00:12:42.288308+0000","last_fullsized":"2024-02-16T00:12:42.288308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.288179+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:49.835119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.027246+0000","last_change":"2024-02-16T00:13:31.027246+0000","last_active":"2024-02-16T00:13:31.027246+0000","last_peered":"2024-02-16T00:13:31.027246+0000","last_clean":"2024-02-16T00:13:31.027246+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:13:31.027246+0000","last_undegraded":"2024-02-16T00:13:31.027246+0000","last_fullsized":"2024-02-16T00:13:31.027246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.027119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.027119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.027119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.388109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.183094+0000","last_change":"2024-02-16T00:13:04.183094+0000","last_active":"2024-02-16T00:13:04.183094+0000","last_peered":"2024-02-16T00:13:04.183094+0000","last_clean":"2024-02-16T00:13:04.183094+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:13:04.183094+0000","last_undegraded":"2024-02-16T00:13:04.183094+0000","last_fullsized":"2024-02-16T00:13:04.183094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.182975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:01.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.721955+0000","last_change":"2024-02-16T00:13:31.721955+0000","last_active":"2024-02-16T00:13:31.721955+0000","last_peered":"2024-02-16T00:13:31.721955+0000","last_clean":"2024-02-16T00:13:31.721955+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:13:31.721955+0000","last_undegraded":"2024-02-16T00:13:31.721955+0000","last_fullsized":"2024-02-16T00:13:31.721955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:31.721779+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:31.721779+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.721779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:40.361580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.582387+0000","last_change":"2024-02-16T00:12:51.582387+0000","last_active":"2024-02-16T00:12:51.582387+0000","last_peered":"2024-02-16T00:12:51.582387+0000","last_clean":"2024-02-16T00:12:51.582387+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:12:51.582387+0000","last_undegraded":"2024-02-16T00:12:51.582387+0000","last_fullsized":"2024-02-16T00:12:51.582387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.582242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:29.436735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'73","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.419632+0000","last_change":"2024-02-16T00:12:44.419632+0000","last_active":"2024-02-16T00:12:44.419632+0000","last_peered":"2024-02-16T00:12:44.419632+0000","last_clean":"2024-02-16T00:12:44.419632+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:44.419632+0000","last_undegraded":"2024-02-16T00:12:44.419632+0000","last_fullsized":"2024-02-16T00:12:44.419632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.419516+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:22.507611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.985037+0000","last_change":"2024-02-16T00:12:44.985037+0000","last_active":"2024-02-16T00:12:44.985037+0000","last_peered":"2024-02-16T00:12:44.985037+0000","last_clean":"2024-02-16T00:12:44.985037+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:12:44.985037+0000","last_undegraded":"2024-02-16T00:12:44.985037+0000","last_fullsized":"2024-02-16T00:12:44.985037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.984923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.568877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.725049+0000","last_change":"2024-02-16T00:13:33.725049+0000","last_active":"2024-02-16T00:13:33.725049+0000","last_peered":"2024-02-16T00:13:33.725049+0000","last_clean":"2024-02-16T00:13:33.725049+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:13:33.725049+0000","last_undegraded":"2024-02-16T00:13:33.725049+0000","last_fullsized":"2024-02-16T00:13:33.725049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:33.724914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:33.724914+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.724914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:31.664833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.234145+0000","last_change":"2024-02-16T00:13:10.234145+0000","last_active":"2024-02-16T00:13:10.234145+0000","last_peered":"2024-02-16T00:13:10.234145+0000","last_clean":"2024-02-16T00:13:10.234145+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:13:10.234145+0000","last_undegraded":"2024-02-16T00:13:10.234145+0000","last_fullsized":"2024-02-16T00:13:10.234145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.234022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.916468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.010682+0000","last_change":"2024-02-16T00:13:34.010708+0000","last_active":"2024-02-16T00:13:34.010682+0000","last_peered":"2024-02-16T00:13:34.010682+0000","last_clean":"2024-02-16T00:13:34.010682+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:13:34.010682+0000","last_undegraded":"2024-02-16T00:13:34.010682+0000","last_fullsized":"2024-02-16T00:13:34.010682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:34.010590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:34.010590+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.010590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:26.871007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"29'5","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.021341+0000","last_change":"2024-02-16T00:12:57.021341+0000","last_active":"2024-02-16T00:12:57.021341+0000","last_peered":"2024-02-16T00:12:57.021341+0000","last_clean":"2024-02-16T00:12:57.021341+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:57.021341+0000","last_undegraded":"2024-02-16T00:12:57.021341+0000","last_fullsized":"2024-02-16T00:12:57.021341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.021207+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:57.897777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'43","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.929840+0000","last_change":"2024-02-16T00:12:48.929840+0000","last_active":"2024-02-16T00:12:48.929840+0000","last_peered":"2024-02-16T00:12:48.929840+0000","last_clean":"2024-02-16T00:12:48.929840+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:48.929840+0000","last_undegraded":"2024-02-16T00:12:48.929840+0000","last_fullsized":"2024-02-16T00:12:48.929840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.929717+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:22:28.327582+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.044584+0000","last_change":"2024-02-16T00:13:04.044584+0000","last_active":"2024-02-16T00:13:04.044584+0000","last_peered":"2024-02-16T00:13:04.044584+0000","last_clean":"2024-02-16T00:13:04.044584+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:13:04.044584+0000","last_undegraded":"2024-02-16T00:13:04.044584+0000","last_fullsized":"2024-02-16T00:13:04.044584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.044474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:49.333820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.064655+0000","last_change":"2024-02-16T00:13:19.064655+0000","last_active":"2024-02-16T00:13:19.064655+0000","last_peered":"2024-02-16T00:13:19.064655+0000","last_clean":"2024-02-16T00:13:19.064655+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:13:19.064655+0000","last_undegraded":"2024-02-16T00:13:19.064655+0000","last_fullsized":"2024-02-16T00:13:19.064655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.064537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.064537+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.064537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:36.412388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.067648+0000","last_change":"2024-02-16T00:13:21.067648+0000","last_active":"2024-02-16T00:13:21.067648+0000","last_peered":"2024-02-16T00:13:21.067648+0000","last_clean":"2024-02-16T00:13:21.067648+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:13:21.067648+0000","last_undegraded":"2024-02-16T00:13:21.067648+0000","last_fullsized":"2024-02-16T00:13:21.067648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:21.067525+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:21.067525+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.067525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:11.711126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.888247+0000","last_change":"2024-02-16T00:13:19.888276+0000","last_active":"2024-02-16T00:13:19.888247+0000","last_peered":"2024-02-16T00:13:19.888247+0000","last_clean":"2024-02-16T00:13:19.888247+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:13:19.888247+0000","last_undegraded":"2024-02-16T00:13:19.888247+0000","last_fullsized":"2024-02-16T00:13:19.888247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.888155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.888155+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.888155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.113499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.487257+0000","last_change":"2024-02-16T00:12:47.487257+0000","last_active":"2024-02-16T00:12:47.487257+0000","last_peered":"2024-02-16T00:12:47.487257+0000","last_clean":"2024-02-16T00:12:47.487257+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:12:47.487257+0000","last_undegraded":"2024-02-16T00:12:47.487257+0000","last_fullsized":"2024-02-16T00:12:47.487257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.487142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:48.071095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'36","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.996296+0000","last_change":"2024-02-16T00:12:54.996296+0000","last_active":"2024-02-16T00:12:54.996296+0000","last_peered":"2024-02-16T00:12:54.996296+0000","last_clean":"2024-02-16T00:12:54.996296+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:54.996296+0000","last_undegraded":"2024-02-16T00:12:54.996296+0000","last_fullsized":"2024-02-16T00:12:54.996296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.996158+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:24.457006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.981978+0000","last_change":"2024-02-16T00:13:10.982002+0000","last_active":"2024-02-16T00:13:10.981978+0000","last_peered":"2024-02-16T00:13:10.981978+0000","last_clean":"2024-02-16T00:13:10.981978+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:13:10.981978+0000","last_undegraded":"2024-02-16T00:13:10.981978+0000","last_fullsized":"2024-02-16T00:13:10.981978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:09.819667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458188+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:12:39.458188+0000","last_peered":"2024-02-16T00:12:39.458188+0000","last_clean":"2024-02-16T00:12:39.458188+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:12:39.458188+0000","last_undegraded":"2024-02-16T00:12:39.458188+0000","last_fullsized":"2024-02-16T00:12:39.458188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.188599+0000","last_change":"2024-02-16T00:13:05.188599+0000","last_active":"2024-02-16T00:13:05.188599+0000","last_peered":"2024-02-16T00:13:05.188599+0000","last_clean":"2024-02-16T00:13:05.188599+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:13:05.188599+0000","last_undegraded":"2024-02-16T00:13:05.188599+0000","last_fullsized":"2024-02-16T00:13:05.188599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.188488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:37.525070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.673914+0000","last_change":"2024-02-16T00:13:21.673945+0000","last_active":"2024-02-16T00:13:21.673914+0000","last_peered":"2024-02-16T00:13:21.673914+0000","last_clean":"2024-02-16T00:13:21.673914+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:13:21.673914+0000","last_undegraded":"2024-02-16T00:13:21.673914+0000","last_fullsized":"2024-02-16T00:13:21.673914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:21.673810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:21.673810+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.673810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:21.921169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.549032+0000","last_change":"2024-02-16T00:12:49.549032+0000","last_active":"2024-02-16T00:12:49.549032+0000","last_peered":"2024-02-16T00:12:49.549032+0000","last_clean":"2024-02-16T00:12:49.549032+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:12:49.549032+0000","last_undegraded":"2024-02-16T00:12:49.549032+0000","last_fullsized":"2024-02-16T00:12:49.549032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.548866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:23:44.002627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'51","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.986591+0000","last_change":"2024-02-16T00:13:09.986591+0000","last_active":"2024-02-16T00:13:09.986591+0000","last_peered":"2024-02-16T00:13:09.986591+0000","last_clean":"2024-02-16T00:13:09.986591+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:13:09.986591+0000","last_undegraded":"2024-02-16T00:13:09.986591+0000","last_fullsized":"2024-02-16T00:13:09.986591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.986464+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:29:21.387242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.919210+0000","last_change":"2024-02-16T00:12:41.919234+0000","last_active":"2024-02-16T00:12:41.919210+0000","last_peered":"2024-02-16T00:12:41.919210+0000","last_clean":"2024-02-16T00:12:41.919210+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:12:41.919210+0000","last_undegraded":"2024-02-16T00:12:41.919210+0000","last_fullsized":"2024-02-16T00:12:41.919210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.919121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:20.007216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.085957+0000","last_change":"2024-02-16T00:13:23.085957+0000","last_active":"2024-02-16T00:13:23.085957+0000","last_peered":"2024-02-16T00:13:23.085957+0000","last_clean":"2024-02-16T00:13:23.085957+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:13:23.085957+0000","last_undegraded":"2024-02-16T00:13:23.085957+0000","last_fullsized":"2024-02-16T00:13:23.085957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.085805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.085805+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.085805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:48.122611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.556771+0000","last_change":"2024-02-16T00:13:05.556771+0000","last_active":"2024-02-16T00:13:05.556771+0000","last_peered":"2024-02-16T00:13:05.556771+0000","last_clean":"2024-02-16T00:13:05.556771+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:13:05.556771+0000","last_undegraded":"2024-02-16T00:13:05.556771+0000","last_fullsized":"2024-02-16T00:13:05.556771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.556664+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:11.578783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.247747+0000","last_change":"2024-02-16T00:13:07.247747+0000","last_active":"2024-02-16T00:13:07.247747+0000","last_peered":"2024-02-16T00:13:07.247747+0000","last_clean":"2024-02-16T00:13:07.247747+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:13:07.247747+0000","last_undegraded":"2024-02-16T00:13:07.247747+0000","last_fullsized":"2024-02-16T00:13:07.247747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.247620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:46.679324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.927236+0000","last_change":"2024-02-16T00:13:22.927266+0000","last_active":"2024-02-16T00:13:22.927236+0000","last_peered":"2024-02-16T00:13:22.927236+0000","last_clean":"2024-02-16T00:13:22.927236+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:13:22.927236+0000","last_undegraded":"2024-02-16T00:13:22.927236+0000","last_fullsized":"2024-02-16T00:13:22.927236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:22.927156+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:22.927156+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.927156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:35.487431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.776378+0000","last_change":"2024-02-16T00:13:09.776405+0000","last_active":"2024-02-16T00:13:09.776378+0000","last_peered":"2024-02-16T00:13:09.776378+0000","last_clean":"2024-02-16T00:13:09.776378+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:13:09.776378+0000","last_undegraded":"2024-02-16T00:13:09.776378+0000","last_fullsized":"2024-02-16T00:13:09.776378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.776278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:41.368106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.999252+0000","last_change":"2024-02-16T00:12:59.999252+0000","last_active":"2024-02-16T00:12:59.999252+0000","last_peered":"2024-02-16T00:12:59.999252+0000","last_clean":"2024-02-16T00:12:59.999252+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:59.999252+0000","last_undegraded":"2024-02-16T00:12:59.999252+0000","last_fullsized":"2024-02-16T00:12:59.999252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.999131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.804655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.099286+0000","last_change":"2024-02-16T00:13:29.099321+0000","last_active":"2024-02-16T00:13:29.099286+0000","last_peered":"2024-02-16T00:13:29.099286+0000","last_clean":"2024-02-16T00:13:29.099286+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:13:29.099286+0000","last_undegraded":"2024-02-16T00:13:29.099286+0000","last_fullsized":"2024-02-16T00:13:29.099286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.099164+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:51.091195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.853688+0000","last_change":"2024-02-16T00:13:18.853728+0000","last_active":"2024-02-16T00:13:18.853688+0000","last_peered":"2024-02-16T00:13:18.853688+0000","last_clean":"2024-02-16T00:13:18.853688+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:13:18.853688+0000","last_undegraded":"2024-02-16T00:13:18.853688+0000","last_fullsized":"2024-02-16T00:13:18.853688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:18.853579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:18.853579+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.853579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:21:17.955716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.959937+0000","last_change":"2024-02-16T00:13:27.959965+0000","last_active":"2024-02-16T00:13:27.959937+0000","last_peered":"2024-02-16T00:13:27.959937+0000","last_clean":"2024-02-16T00:13:27.959937+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:13:27.959937+0000","last_undegraded":"2024-02-16T00:13:27.959937+0000","last_fullsized":"2024-02-16T00:13:27.959937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:27.959842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:27.959842+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.959842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:15.208309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.878278+0000","last_change":"2024-02-16T00:13:04.878278+0000","last_active":"2024-02-16T00:13:04.878278+0000","last_peered":"2024-02-16T00:13:04.878278+0000","last_clean":"2024-02-16T00:13:04.878278+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:13:04.878278+0000","last_undegraded":"2024-02-16T00:13:04.878278+0000","last_fullsized":"2024-02-16T00:13:04.878278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.878154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.624777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.945083+0000","last_change":"2024-02-16T00:13:23.945108+0000","last_active":"2024-02-16T00:13:23.945083+0000","last_peered":"2024-02-16T00:13:23.945083+0000","last_clean":"2024-02-16T00:13:23.945083+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:13:23.945083+0000","last_undegraded":"2024-02-16T00:13:23.945083+0000","last_fullsized":"2024-02-16T00:13:23.945083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.944993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.944993+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.944993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:09.234339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.624499+0000","last_change":"2024-02-16T00:13:01.624499+0000","last_active":"2024-02-16T00:13:01.624499+0000","last_peered":"2024-02-16T00:13:01.624499+0000","last_clean":"2024-02-16T00:13:01.624499+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:13:01.624499+0000","last_undegraded":"2024-02-16T00:13:01.624499+0000","last_fullsized":"2024-02-16T00:13:01.624499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.624385+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:27.761857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.735349+0000","last_change":"2024-02-16T00:13:30.735377+0000","last_active":"2024-02-16T00:13:30.735349+0000","last_peered":"2024-02-16T00:13:30.735349+0000","last_clean":"2024-02-16T00:13:30.735349+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:13:30.735349+0000","last_undegraded":"2024-02-16T00:13:30.735349+0000","last_fullsized":"2024-02-16T00:13:30.735349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.735261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.735261+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.735261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:36.718371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.736968+0000","last_change":"2024-02-16T00:13:08.736968+0000","last_active":"2024-02-16T00:13:08.736968+0000","last_peered":"2024-02-16T00:13:08.736968+0000","last_clean":"2024-02-16T00:13:08.736968+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:13:08.736968+0000","last_undegraded":"2024-02-16T00:13:08.736968+0000","last_fullsized":"2024-02-16T00:13:08.736968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.736845+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:44.033579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.153427+0000","last_change":"2024-02-16T00:13:17.153454+0000","last_active":"2024-02-16T00:13:17.153427+0000","last_peered":"2024-02-16T00:13:17.153427+0000","last_clean":"2024-02-16T00:13:17.153427+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:13:17.153427+0000","last_undegraded":"2024-02-16T00:13:17.153427+0000","last_fullsized":"2024-02-16T00:13:17.153427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.153338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:45.706109+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.556358+0000","last_change":"2024-02-16T00:13:09.556358+0000","last_active":"2024-02-16T00:13:09.556358+0000","last_peered":"2024-02-16T00:13:09.556358+0000","last_clean":"2024-02-16T00:13:09.556358+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:13:09.556358+0000","last_undegraded":"2024-02-16T00:13:09.556358+0000","last_fullsized":"2024-02-16T00:13:09.556358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.556228+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:33.081661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.945782+0000","last_change":"2024-02-16T00:13:28.945842+0000","last_active":"2024-02-16T00:13:28.945782+0000","last_peered":"2024-02-16T00:13:28.945782+0000","last_clean":"2024-02-16T00:13:28.945782+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:13:28.945782+0000","last_undegraded":"2024-02-16T00:13:28.945782+0000","last_fullsized":"2024-02-16T00:13:28.945782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:28.945668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:28.945668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.945668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:34.928777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.632508+0000","last_change":"2024-02-16T00:13:18.632508+0000","last_active":"2024-02-16T00:13:18.632508+0000","last_peered":"2024-02-16T00:13:18.632508+0000","last_clean":"2024-02-16T00:13:18.632508+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:13:18.632508+0000","last_undegraded":"2024-02-16T00:13:18.632508+0000","last_fullsized":"2024-02-16T00:13:18.632508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.632397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:36.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.070899+0000","last_change":"2024-02-16T00:13:37.070930+0000","last_active":"2024-02-16T00:13:37.070899+0000","last_peered":"2024-02-16T00:13:37.070899+0000","last_clean":"2024-02-16T00:13:37.070899+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:13:37.070899+0000","last_undegraded":"2024-02-16T00:13:37.070899+0000","last_fullsized":"2024-02-16T00:13:37.070899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:37.070808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:37.070808+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.070808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:32.756372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.058665+0000","last_change":"2024-02-16T00:13:20.058665+0000","last_active":"2024-02-16T00:13:20.058665+0000","last_peered":"2024-02-16T00:13:20.058665+0000","last_clean":"2024-02-16T00:13:20.058665+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:13:20.058665+0000","last_undegraded":"2024-02-16T00:13:20.058665+0000","last_fullsized":"2024-02-16T00:13:20.058665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:20.058539+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:20.058539+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.058539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:48:43.050884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.959088+0000","last_change":"2024-02-16T00:13:26.959116+0000","last_active":"2024-02-16T00:13:26.959088+0000","last_peered":"2024-02-16T00:13:26.959088+0000","last_clean":"2024-02-16T00:13:26.959088+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:13:26.959088+0000","last_undegraded":"2024-02-16T00:13:26.959088+0000","last_fullsized":"2024-02-16T00:13:26.959088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.958995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.958995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.958995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:41.755010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.884620+0000","last_change":"2024-02-16T00:13:03.884620+0000","last_active":"2024-02-16T00:13:03.884620+0000","last_peered":"2024-02-16T00:13:03.884620+0000","last_clean":"2024-02-16T00:13:03.884620+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:13:03.884620+0000","last_undegraded":"2024-02-16T00:13:03.884620+0000","last_fullsized":"2024-02-16T00:13:03.884620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.884486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:09.906605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.726085+0000","last_change":"2024-02-16T00:13:28.726111+0000","last_active":"2024-02-16T00:13:28.726085+0000","last_peered":"2024-02-16T00:13:28.726085+0000","last_clean":"2024-02-16T00:13:28.726085+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:13:28.726085+0000","last_undegraded":"2024-02-16T00:13:28.726085+0000","last_fullsized":"2024-02-16T00:13:28.726085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:28.725987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:28.725987+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.725987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:43.522003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.581881+0000","last_change":"2024-02-16T00:13:11.581881+0000","last_active":"2024-02-16T00:13:11.581881+0000","last_peered":"2024-02-16T00:13:11.581881+0000","last_clean":"2024-02-16T00:13:11.581881+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:13:11.581881+0000","last_undegraded":"2024-02-16T00:13:11.581881+0000","last_fullsized":"2024-02-16T00:13:11.581881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.581768+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:19.215064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.683499+0000","last_change":"2024-02-16T00:13:26.683524+0000","last_active":"2024-02-16T00:13:26.683499+0000","last_peered":"2024-02-16T00:13:26.683499+0000","last_clean":"2024-02-16T00:13:26.683499+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:13:26.683499+0000","last_undegraded":"2024-02-16T00:13:26.683499+0000","last_fullsized":"2024-02-16T00:13:26.683499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.683411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.683411+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.683411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:48.282091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.642973+0000","last_change":"2024-02-16T00:12:57.642973+0000","last_active":"2024-02-16T00:12:57.642973+0000","last_peered":"2024-02-16T00:12:57.642973+0000","last_clean":"2024-02-16T00:12:57.642973+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:12:57.642973+0000","last_undegraded":"2024-02-16T00:12:57.642973+0000","last_fullsized":"2024-02-16T00:12:57.642973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.642852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:29.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456944+0000","last_change":"2024-02-16T00:11:02.814973+0000","last_active":"2024-02-16T00:12:39.456944+0000","last_peered":"2024-02-16T00:12:39.456944+0000","last_clean":"2024-02-16T00:12:39.456944+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:12:39.456944+0000","last_undegraded":"2024-02-16T00:12:39.456944+0000","last_fullsized":"2024-02-16T00:12:39.456944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.734544+0000","last_change":"2024-02-16T00:13:32.734570+0000","last_active":"2024-02-16T00:13:32.734544+0000","last_peered":"2024-02-16T00:13:32.734544+0000","last_clean":"2024-02-16T00:13:32.734544+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:13:32.734544+0000","last_undegraded":"2024-02-16T00:13:32.734544+0000","last_fullsized":"2024-02-16T00:13:32.734544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:32.734457+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:32.734457+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.734457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:57:06.034129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456943+0000","last_change":"2024-02-16T00:11:02.812239+0000","last_active":"2024-02-16T00:12:39.456943+0000","last_peered":"2024-02-16T00:12:39.456943+0000","last_clean":"2024-02-16T00:12:39.456943+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:12:39.456943+0000","last_undegraded":"2024-02-16T00:12:39.456943+0000","last_fullsized":"2024-02-16T00:12:39.456943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.984512+0000","last_change":"2024-02-16T00:13:13.984512+0000","last_active":"2024-02-16T00:13:13.984512+0000","last_peered":"2024-02-16T00:13:13.984512+0000","last_clean":"2024-02-16T00:13:13.984512+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:13:13.984512+0000","last_undegraded":"2024-02-16T00:13:13.984512+0000","last_fullsized":"2024-02-16T00:13:13.984512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.984383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:31.856700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.197615+0000","last_change":"2024-02-16T00:13:15.197615+0000","last_active":"2024-02-16T00:13:15.197615+0000","last_peered":"2024-02-16T00:13:15.197615+0000","last_clean":"2024-02-16T00:13:15.197615+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:13:15.197615+0000","last_undegraded":"2024-02-16T00:13:15.197615+0000","last_fullsized":"2024-02-16T00:13:15.197615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.197470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:16.065697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.604882+0000","last_change":"2024-02-16T00:13:14.604882+0000","last_active":"2024-02-16T00:13:14.604882+0000","last_peered":"2024-02-16T00:13:14.604882+0000","last_clean":"2024-02-16T00:13:14.604882+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:13:14.604882+0000","last_undegraded":"2024-02-16T00:13:14.604882+0000","last_fullsized":"2024-02-16T00:13:14.604882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.604766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:57.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456958+0000","last_change":"2024-02-16T00:11:02.813535+0000","last_active":"2024-02-16T00:12:39.456958+0000","last_peered":"2024-02-16T00:12:39.456958+0000","last_clean":"2024-02-16T00:12:39.456958+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:12:39.456958+0000","last_undegraded":"2024-02-16T00:12:39.456958+0000","last_fullsized":"2024-02-16T00:12:39.456958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.456960+0000","last_change":"2024-02-16T00:11:02.823053+0000","last_active":"2024-02-16T00:12:39.456960+0000","last_peered":"2024-02-16T00:12:39.456960+0000","last_clean":"2024-02-16T00:12:39.456960+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:12:39.456960+0000","last_undegraded":"2024-02-16T00:12:39.456960+0000","last_fullsized":"2024-02-16T00:12:39.456960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:01.773583+0000","last_clean_scrub_stamp":"2024-02-16T00:11:01.773583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.783477+0000","last_change":"2024-02-16T00:13:10.783477+0000","last_active":"2024-02-16T00:13:10.783477+0000","last_peered":"2024-02-16T00:13:10.783477+0000","last_clean":"2024-02-16T00:13:10.783477+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:13:10.783477+0000","last_undegraded":"2024-02-16T00:13:10.783477+0000","last_fullsized":"2024-02-16T00:13:10.783477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.783361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:58.244265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.814276+0000","last_change":"2024-02-16T00:13:15.814276+0000","last_active":"2024-02-16T00:13:15.814276+0000","last_peered":"2024-02-16T00:13:15.814276+0000","last_clean":"2024-02-16T00:13:15.814276+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:13:15.814276+0000","last_undegraded":"2024-02-16T00:13:15.814276+0000","last_fullsized":"2024-02-16T00:13:15.814276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.814161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:27.336244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.581370+0000","last_change":"2024-02-16T00:13:04.581370+0000","last_active":"2024-02-16T00:13:04.581370+0000","last_peered":"2024-02-16T00:13:04.581370+0000","last_clean":"2024-02-16T00:13:04.581370+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:13:04.581370+0000","last_undegraded":"2024-02-16T00:13:04.581370+0000","last_fullsized":"2024-02-16T00:13:04.581370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.581244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:47.597212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1820,"num_read_kb":1574,"num_write":771,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1644,"ondisk_log_size":1644,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705699,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44072,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327768,"statfs":{"total":96636764160,"available":96591634432,"internally_reserved":0,"allocated":425984,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.26100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.495,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.628,"15min":0.628},"last":0.29599999999999999}]},{"osd":2,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36599999999999999,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.34799999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.39700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27600000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705700,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":966656,"data_stored":723796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52700000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48099999999999998,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.312,"15min":0.317},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":0.435,"15min":0.435},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.31900000000000001,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40500000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.374}]},{"osd":3,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.38100000000000001,"15min":0.39600000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.374,"5min":1.851,"15min":1.851},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.40699999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705699,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.314,"15min":0.318},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.42699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.23599999999999999}]},{"osd":3,"last update":"Fri Feb 16 00:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33900000000000002,"15min":0.34100000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.26400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.29599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":137181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63900000000000001,"5min":0.753,"15min":0.753},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.5},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.65200000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63900000000000001,"5min":1.506,"15min":1.506},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:13:40.948 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.949 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.949 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.949 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.950 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.950 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.950 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.951 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.951 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.951 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.951 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.952 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.952 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.952 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.952 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.953 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.953 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T00:10:54.428237+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=10, tm_sec=54, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.953 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.954 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.954 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.954 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.954 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.955 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.955 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.956 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.956 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.956 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.956 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T00:11:01.773583+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=1, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:13:40.956 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T00:14:00.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:14:01.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.068+0000 7f04aeaa8640 1 Processor -- start 2024-02-16T00:14:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.068+0000 7f04aeaa8640 1 -- start start 2024-02-16T00:14:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04aeaa8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04a80993f0 0x7f04a8133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04aeaa8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a809dc90 con 0x7f04a8098900 2024-02-16T00:14:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04aeaa8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a809a170 con 0x7f04a80993f0 2024-02-16T00:14:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04a7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04a80993f0 0x7f04a8133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04ac844640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f04a8098900 0x7f04a8098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53468/0 (socket says 172.21.15.2:53468) 2024-02-16T00:14:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04ac844640 1 -- 172.21.15.2:0/2845729895 learned_addr learned my addr 172.21.15.2:0/2845729895 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:14:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04a7fff640 1 -- 172.21.15.2:0/2845729895 >> v1:172.21.15.2:6789/0 conn(0x7f04a8098900 legacy=0x7f04a8098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:01.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.069+0000 7f04a7fff640 1 -- 172.21.15.2:0/2845729895 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8099d30 con 0x7f04a80993f0 2024-02-16T00:14:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.070+0000 7f04a7fff640 1 --2- 172.21.15.2:0/2845729895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a80993f0 0x7f04a8133350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f049c009720 tx=0x7f049c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f046046b4f5ca server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.070+0000 7f04a77fe640 1 -- 172.21.15.2:0/2845729895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f049c02e070 con 0x7f04a80993f0 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.070+0000 7f04a77fe640 1 -- 172.21.15.2:0/2845729895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c0316d0 con 0x7f04a80993f0 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.070+0000 7f04a77fe640 1 -- 172.21.15.2:0/2845729895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f049c031990 con 0x7f04a80993f0 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 -- 172.21.15.2:0/2845729895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a80993f0 msgr2=0x7f04a8133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 --2- 172.21.15.2:0/2845729895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a80993f0 0x7f04a8133350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f049c009720 tx=0x7f049c02b840 comp rx=0 tx=0).stop 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 -- 172.21.15.2:0/2845729895 shutdown_connections 2024-02-16T00:14:01.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 --2- 172.21.15.2:0/2845729895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a80993f0 0x7f04a8133350 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 -- 172.21.15.2:0/2845729895 >> 172.21.15.2:0/2845729895 conn(0x7f04a80a0a20 msgr2=0x7f04a809cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 -- 172.21.15.2:0/2845729895 shutdown_connections 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.071+0000 7f04aeaa8640 1 -- 172.21.15.2:0/2845729895 wait complete. 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04aeaa8640 1 Processor -- start 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04aeaa8640 1 -- start start 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04aeaa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 0x7f04a81c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04aeaa8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a812cc50 con 0x7f04a8098900 2024-02-16T00:14:01.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04ac844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 0x7f04a81c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04ac844640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 0x7f04a81c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47906/0 (socket says 172.21.15.2:47906) 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.072+0000 7f04ac844640 1 -- 172.21.15.2:0/1937622579 learned_addr learned my addr 172.21.15.2:0/1937622579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04ac844640 1 -- 172.21.15.2:0/1937622579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c009400 con 0x7f04a8098900 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04ac844640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 0x7f04a81c2a30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f04a000cb20 tx=0x7f04a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04a000abf0 con 0x7f04a8098900 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000ad50 con 0x7f04a8098900 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a812ce50 con 0x7f04a8098900 2024-02-16T00:14:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04a0012400 con 0x7f04a8098900 2024-02-16T00:14:01.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.073+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a8132e40 con 0x7f04a8098900 2024-02-16T00:14:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.074+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f04a0012560 con 0x7f04a8098900 2024-02-16T00:14:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.074+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a80627b0 con 0x7f04a8098900 2024-02-16T00:14:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.074+0000 7f04a57fa640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0494037ef0 0x7f049403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.074+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f04a004b340 con 0x7f04a8098900 2024-02-16T00:14:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.074+0000 7f04a7fff640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0494037ef0 0x7f049403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.075+0000 7f04a7fff640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0494037ef0 0x7f049403a3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f049c036000 tx=0x7f049c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:01.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.079+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04a0010710 con 0x7f04a8098900 2024-02-16T00:14:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.256+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04a809d7e0 con 0x7f0494037ef0 2024-02-16T00:14:01.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.272+0000 7f04a57fa640 1 -- 172.21.15.2:0/1937622579 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673215 (secure 0 0 0) 0x7f049c031ba0 con 0x7f0494037ef0 2024-02-16T00:14:01.283 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:14:01.288 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.276+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0494037ef0 msgr2=0x7f049403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.276+0000 7f04aeaa8640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0494037ef0 0x7f049403a3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f049c036000 tx=0x7f049c008030 comp rx=0 tx=0).stop 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 msgr2=0x7f04a81c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 0x7f04a81c2a30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f04a000cb20 tx=0x7f04a000a060 comp rx=0 tx=0).stop 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 shutdown_connections 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f0494037ef0 0x7f049403a3b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 --2- 172.21.15.2:0/1937622579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a8098900 0x7f04a81c2a30 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:01.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 >> 172.21.15.2:0/1937622579 conn(0x7f04a80a0a20 msgr2=0x7f04a809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:14:01.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 shutdown_connections 2024-02-16T00:14:01.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:01.277+0000 7f04aeaa8640 1 -- 172.21.15.2:0/1937622579 wait complete. 2024-02-16T00:14:01.292 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-02-16T00:13:59.724448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":245,"num_object_clones":0,"num_object_copies":491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":4297,"num_read_kb":3911,"num_write":1709,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4192,"ondisk_log_size":4192,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152372,"kb_used_data":2708,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334988,"statfs":{"total":386547056640,"available":386391027712,"internally_reserved":0,"allocated":2772992,"data_stored":1728024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003695"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.275037+0000","last_change":"2024-02-16T00:13:22.275067+0000","last_active":"2024-02-16T00:13:22.275037+0000","last_peered":"2024-02-16T00:13:22.275037+0000","last_clean":"2024-02-16T00:13:22.275037+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:13:22.275037+0000","last_undegraded":"2024-02-16T00:13:22.275037+0000","last_fullsized":"2024-02-16T00:13:22.275037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:22.274933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:22.274933+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.274933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:12.577631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.703777+0000","last_change":"2024-02-16T00:13:20.703777+0000","last_active":"2024-02-16T00:13:20.703777+0000","last_peered":"2024-02-16T00:13:20.703777+0000","last_clean":"2024-02-16T00:13:20.703777+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:13:20.703777+0000","last_undegraded":"2024-02-16T00:13:20.703777+0000","last_fullsized":"2024-02-16T00:13:20.703777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:20.703642+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:20.703642+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.703642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:21:19.805780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.933810+0000","last_change":"2024-02-16T00:13:29.933837+0000","last_active":"2024-02-16T00:13:29.933810+0000","last_peered":"2024-02-16T00:13:29.933810+0000","last_clean":"2024-02-16T00:13:29.933810+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:13:29.933810+0000","last_undegraded":"2024-02-16T00:13:29.933810+0000","last_fullsized":"2024-02-16T00:13:29.933810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.933716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.933716+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.933716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:38.573518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.086334+0000","last_change":"2024-02-16T00:13:26.086334+0000","last_active":"2024-02-16T00:13:26.086334+0000","last_peered":"2024-02-16T00:13:26.086334+0000","last_clean":"2024-02-16T00:13:26.086334+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:13:26.086334+0000","last_undegraded":"2024-02-16T00:13:26.086334+0000","last_fullsized":"2024-02-16T00:13:26.086334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.086214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.086214+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.086214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:48:00.192005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.026184+0000","last_change":"2024-02-16T00:13:36.026223+0000","last_active":"2024-02-16T00:13:36.026184+0000","last_peered":"2024-02-16T00:13:36.026184+0000","last_clean":"2024-02-16T00:13:36.026184+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:13:36.026184+0000","last_undegraded":"2024-02-16T00:13:36.026184+0000","last_fullsized":"2024-02-16T00:13:36.026184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:36.026092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:36.026092+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.026092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:37.132703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.058556+0000","last_change":"2024-02-16T00:13:18.058556+0000","last_active":"2024-02-16T00:13:18.058556+0000","last_peered":"2024-02-16T00:13:18.058556+0000","last_clean":"2024-02-16T00:13:18.058556+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:13:18.058556+0000","last_undegraded":"2024-02-16T00:13:18.058556+0000","last_fullsized":"2024-02-16T00:13:18.058556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.058378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:23.057832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.241221+0000","last_change":"2024-02-16T00:13:09.241249+0000","last_active":"2024-02-16T00:13:09.241221+0000","last_peered":"2024-02-16T00:13:09.241221+0000","last_clean":"2024-02-16T00:13:09.241221+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:13:09.241221+0000","last_undegraded":"2024-02-16T00:13:09.241221+0000","last_fullsized":"2024-02-16T00:13:09.241221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.241098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:35.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.023923+0000","last_change":"2024-02-16T00:13:16.023923+0000","last_active":"2024-02-16T00:13:16.023923+0000","last_peered":"2024-02-16T00:13:16.023923+0000","last_clean":"2024-02-16T00:13:16.023923+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:13:16.023923+0000","last_undegraded":"2024-02-16T00:13:16.023923+0000","last_fullsized":"2024-02-16T00:13:16.023923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.023799+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:15.106437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:56.902776+0000","last_change":"2024-02-16T00:13:56.902831+0000","last_active":"2024-02-16T00:13:56.902776+0000","last_peered":"2024-02-16T00:13:56.902776+0000","last_clean":"2024-02-16T00:13:56.902776+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:13:56.902776+0000","last_undegraded":"2024-02-16T00:13:56.902776+0000","last_fullsized":"2024-02-16T00:13:56.902776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:56.902670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:56.902670+0000","last_clean_scrub_stamp":"2024-02-16T00:13:56.902670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:03:07.396031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.550754+0000","last_change":"2024-02-16T00:13:10.550783+0000","last_active":"2024-02-16T00:13:10.550754+0000","last_peered":"2024-02-16T00:13:10.550754+0000","last_clean":"2024-02-16T00:13:10.550754+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:13:10.550754+0000","last_undegraded":"2024-02-16T00:13:10.550754+0000","last_fullsized":"2024-02-16T00:13:10.550754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.550668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:01.925080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.231172+0000","last_change":"2024-02-16T00:13:21.231172+0000","last_active":"2024-02-16T00:13:21.231172+0000","last_peered":"2024-02-16T00:13:21.231172+0000","last_clean":"2024-02-16T00:13:21.231172+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:13:21.231172+0000","last_undegraded":"2024-02-16T00:13:21.231172+0000","last_fullsized":"2024-02-16T00:13:21.231172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:21.231060+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:21.231060+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.231060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:50.713265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.969656+0000","last_change":"2024-02-16T00:13:12.969656+0000","last_active":"2024-02-16T00:13:12.969656+0000","last_peered":"2024-02-16T00:13:12.969656+0000","last_clean":"2024-02-16T00:13:12.969656+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:13:12.969656+0000","last_undegraded":"2024-02-16T00:13:12.969656+0000","last_fullsized":"2024-02-16T00:13:12.969656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.969541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:09.036334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:45.945033+0000","last_change":"2024-02-16T00:13:45.945061+0000","last_active":"2024-02-16T00:13:45.945033+0000","last_peered":"2024-02-16T00:13:45.945033+0000","last_clean":"2024-02-16T00:13:45.945033+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:13:45.945033+0000","last_undegraded":"2024-02-16T00:13:45.945033+0000","last_fullsized":"2024-02-16T00:13:45.945033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:45.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:45.944944+0000","last_clean_scrub_stamp":"2024-02-16T00:13:45.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:34.263555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.234405+0000","last_change":"2024-02-16T00:13:06.234405+0000","last_active":"2024-02-16T00:13:06.234405+0000","last_peered":"2024-02-16T00:13:06.234405+0000","last_clean":"2024-02-16T00:13:06.234405+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:13:06.234405+0000","last_undegraded":"2024-02-16T00:13:06.234405+0000","last_fullsized":"2024-02-16T00:13:06.234405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.234291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:22.103367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.806168+0000","last_change":"2024-02-16T00:13:13.806168+0000","last_active":"2024-02-16T00:13:13.806168+0000","last_peered":"2024-02-16T00:13:13.806168+0000","last_clean":"2024-02-16T00:13:13.806168+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:13:13.806168+0000","last_undegraded":"2024-02-16T00:13:13.806168+0000","last_fullsized":"2024-02-16T00:13:13.806168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.805990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:04.108688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.179359+0000","last_change":"2024-02-16T00:13:12.179359+0000","last_active":"2024-02-16T00:13:12.179359+0000","last_peered":"2024-02-16T00:13:12.179359+0000","last_clean":"2024-02-16T00:13:12.179359+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:13:12.179359+0000","last_undegraded":"2024-02-16T00:13:12.179359+0000","last_fullsized":"2024-02-16T00:13:12.179359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.179243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:55.195210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.051248+0000","last_change":"2024-02-16T00:13:17.051248+0000","last_active":"2024-02-16T00:13:17.051248+0000","last_peered":"2024-02-16T00:13:17.051248+0000","last_clean":"2024-02-16T00:13:17.051248+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:13:17.051248+0000","last_undegraded":"2024-02-16T00:13:17.051248+0000","last_fullsized":"2024-02-16T00:13:17.051248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.051125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:36.761214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.601554+0000","last_change":"2024-02-16T00:13:17.601554+0000","last_active":"2024-02-16T00:13:17.601554+0000","last_peered":"2024-02-16T00:13:17.601554+0000","last_clean":"2024-02-16T00:13:17.601554+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:13:17.601554+0000","last_undegraded":"2024-02-16T00:13:17.601554+0000","last_fullsized":"2024-02-16T00:13:17.601554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.601433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:29.123516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.577174+0000","last_change":"2024-02-16T00:13:16.577174+0000","last_active":"2024-02-16T00:13:16.577174+0000","last_peered":"2024-02-16T00:13:16.577174+0000","last_clean":"2024-02-16T00:13:16.577174+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:13:16.577174+0000","last_undegraded":"2024-02-16T00:13:16.577174+0000","last_fullsized":"2024-02-16T00:13:16.577174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.577052+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:46.037900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.149364+0000","last_change":"2024-02-16T00:13:13.149364+0000","last_active":"2024-02-16T00:13:13.149364+0000","last_peered":"2024-02-16T00:13:13.149364+0000","last_clean":"2024-02-16T00:13:13.149364+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:13:13.149364+0000","last_undegraded":"2024-02-16T00:13:13.149364+0000","last_fullsized":"2024-02-16T00:13:13.149364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.149246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:19.171364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.628374+0000","last_change":"2024-02-16T00:13:22.628374+0000","last_active":"2024-02-16T00:13:22.628374+0000","last_peered":"2024-02-16T00:13:22.628374+0000","last_clean":"2024-02-16T00:13:22.628374+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:13:22.628374+0000","last_undegraded":"2024-02-16T00:13:22.628374+0000","last_fullsized":"2024-02-16T00:13:22.628374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:22.628266+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:22.628266+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.628266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:51.428396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.690517+0000","last_change":"2024-02-16T00:13:29.690545+0000","last_active":"2024-02-16T00:13:29.690517+0000","last_peered":"2024-02-16T00:13:29.690517+0000","last_clean":"2024-02-16T00:13:29.690517+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:13:29.690517+0000","last_undegraded":"2024-02-16T00:13:29.690517+0000","last_fullsized":"2024-02-16T00:13:29.690517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.690426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.690426+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.690426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:16.938893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.829592+0000","last_change":"2024-02-16T00:13:05.829592+0000","last_active":"2024-02-16T00:13:05.829592+0000","last_peered":"2024-02-16T00:13:05.829592+0000","last_clean":"2024-02-16T00:13:05.829592+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:13:05.829592+0000","last_undegraded":"2024-02-16T00:13:05.829592+0000","last_fullsized":"2024-02-16T00:13:05.829592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.829438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:12.076944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.583128+0000","last_change":"2024-02-16T00:13:13.583128+0000","last_active":"2024-02-16T00:13:13.583128+0000","last_peered":"2024-02-16T00:13:13.583128+0000","last_clean":"2024-02-16T00:13:13.583128+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:13:13.583128+0000","last_undegraded":"2024-02-16T00:13:13.583128+0000","last_fullsized":"2024-02-16T00:13:13.583128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.583017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:43.065222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.259446+0000","last_change":"2024-02-16T00:13:28.259446+0000","last_active":"2024-02-16T00:13:28.259446+0000","last_peered":"2024-02-16T00:13:28.259446+0000","last_clean":"2024-02-16T00:13:28.259446+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:13:28.259446+0000","last_undegraded":"2024-02-16T00:13:28.259446+0000","last_fullsized":"2024-02-16T00:13:28.259446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:28.259327+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:28.259327+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.259327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:51.026448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.961930+0000","last_change":"2024-02-16T00:13:30.961954+0000","last_active":"2024-02-16T00:13:30.961930+0000","last_peered":"2024-02-16T00:13:30.961930+0000","last_clean":"2024-02-16T00:13:30.961930+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:13:30.961930+0000","last_undegraded":"2024-02-16T00:13:30.961930+0000","last_fullsized":"2024-02-16T00:13:30.961930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.961818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.961818+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.961818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:57:04.261490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.565976+0000","last_change":"2024-02-16T00:13:12.565976+0000","last_active":"2024-02-16T00:13:12.565976+0000","last_peered":"2024-02-16T00:13:12.565976+0000","last_clean":"2024-02-16T00:13:12.565976+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:13:12.565976+0000","last_undegraded":"2024-02-16T00:13:12.565976+0000","last_fullsized":"2024-02-16T00:13:12.565976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.565846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:00.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.051463+0000","last_change":"2024-02-16T00:13:35.051495+0000","last_active":"2024-02-16T00:13:35.051463+0000","last_peered":"2024-02-16T00:13:35.051463+0000","last_clean":"2024-02-16T00:13:35.051463+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:13:35.051463+0000","last_undegraded":"2024-02-16T00:13:35.051463+0000","last_fullsized":"2024-02-16T00:13:35.051463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:35.051368+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:35.051368+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.051368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:37:55.653508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'20","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:39.724574+0000","last_change":"2024-02-16T00:13:39.724601+0000","last_active":"2024-02-16T00:13:39.724574+0000","last_peered":"2024-02-16T00:13:39.724574+0000","last_clean":"2024-02-16T00:13:39.724574+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:13:39.724574+0000","last_undegraded":"2024-02-16T00:13:39.724574+0000","last_fullsized":"2024-02-16T00:13:39.724574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:13:39.724487+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:13:39.724487+0000","last_clean_scrub_stamp":"2024-02-16T00:13:39.724487+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:49:02.716832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.068242+0000","last_change":"2024-02-16T00:13:24.068242+0000","last_active":"2024-02-16T00:13:24.068242+0000","last_peered":"2024-02-16T00:13:24.068242+0000","last_clean":"2024-02-16T00:13:24.068242+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:13:24.068242+0000","last_undegraded":"2024-02-16T00:13:24.068242+0000","last_fullsized":"2024-02-16T00:13:24.068242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:24.068098+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:24.068098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.068098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:47:00.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.067547+0000","last_change":"2024-02-16T00:13:30.067575+0000","last_active":"2024-02-16T00:13:30.067547+0000","last_peered":"2024-02-16T00:13:30.067547+0000","last_clean":"2024-02-16T00:13:30.067547+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:13:30.067547+0000","last_undegraded":"2024-02-16T00:13:30.067547+0000","last_fullsized":"2024-02-16T00:13:30.067547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.067450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.067450+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.067450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:08:52.271982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.921969+0000","last_change":"2024-02-16T00:12:48.921969+0000","last_active":"2024-02-16T00:12:48.921969+0000","last_peered":"2024-02-16T00:12:48.921969+0000","last_clean":"2024-02-16T00:12:48.921969+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:12:48.921969+0000","last_undegraded":"2024-02-16T00:12:48.921969+0000","last_fullsized":"2024-02-16T00:12:48.921969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.921850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:24.218584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'48","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.004614+0000","last_change":"2024-02-16T00:12:45.004614+0000","last_active":"2024-02-16T00:12:45.004614+0000","last_peered":"2024-02-16T00:12:45.004614+0000","last_clean":"2024-02-16T00:12:45.004614+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:45.004614+0000","last_undegraded":"2024-02-16T00:12:45.004614+0000","last_fullsized":"2024-02-16T00:12:45.004614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.004490+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:25.382346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.647238+0000","last_change":"2024-02-16T00:13:02.647238+0000","last_active":"2024-02-16T00:13:02.647238+0000","last_peered":"2024-02-16T00:13:02.647238+0000","last_clean":"2024-02-16T00:13:02.647238+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:13:02.647238+0000","last_undegraded":"2024-02-16T00:13:02.647238+0000","last_fullsized":"2024-02-16T00:13:02.647238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.647086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:24.329532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.722174+0000","last_change":"2024-02-16T00:13:37.722174+0000","last_active":"2024-02-16T00:13:37.722174+0000","last_peered":"2024-02-16T00:13:37.722174+0000","last_clean":"2024-02-16T00:13:37.722174+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:13:37.722174+0000","last_undegraded":"2024-02-16T00:13:37.722174+0000","last_fullsized":"2024-02-16T00:13:37.722174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:37.722038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:37.722038+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.722038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:42.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.053290+0000","last_change":"2024-02-16T00:12:58.053290+0000","last_active":"2024-02-16T00:12:58.053290+0000","last_peered":"2024-02-16T00:12:58.053290+0000","last_clean":"2024-02-16T00:12:58.053290+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:12:58.053290+0000","last_undegraded":"2024-02-16T00:12:58.053290+0000","last_fullsized":"2024-02-16T00:12:58.053290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.053167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:43:59.274034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.224954+0000","last_change":"2024-02-16T00:13:11.224954+0000","last_active":"2024-02-16T00:13:11.224954+0000","last_peered":"2024-02-16T00:13:11.224954+0000","last_clean":"2024-02-16T00:13:11.224954+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:13:11.224954+0000","last_undegraded":"2024-02-16T00:13:11.224954+0000","last_fullsized":"2024-02-16T00:13:11.224954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.224827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:55.853002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.890717+0000","last_change":"2024-02-16T00:13:01.890717+0000","last_active":"2024-02-16T00:13:01.890717+0000","last_peered":"2024-02-16T00:13:01.890717+0000","last_clean":"2024-02-16T00:13:01.890717+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:13:01.890717+0000","last_undegraded":"2024-02-16T00:13:01.890717+0000","last_fullsized":"2024-02-16T00:13:01.890717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.890582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:01:28.904624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'16","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.427635+0000","last_change":"2024-02-16T00:12:43.427635+0000","last_active":"2024-02-16T00:12:43.427635+0000","last_peered":"2024-02-16T00:12:43.427635+0000","last_clean":"2024-02-16T00:12:43.427635+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:12:43.427635+0000","last_undegraded":"2024-02-16T00:12:43.427635+0000","last_fullsized":"2024-02-16T00:12:43.427635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.427524+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:38.476135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.502479+0000","last_change":"2024-02-16T00:12:46.502479+0000","last_active":"2024-02-16T00:12:46.502479+0000","last_peered":"2024-02-16T00:12:46.502479+0000","last_clean":"2024-02-16T00:12:46.502479+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:12:46.502479+0000","last_undegraded":"2024-02-16T00:12:46.502479+0000","last_fullsized":"2024-02-16T00:12:46.502479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.502371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:24.692093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.929115+0000","last_change":"2024-02-16T00:13:37.929115+0000","last_active":"2024-02-16T00:13:37.929115+0000","last_peered":"2024-02-16T00:13:37.929115+0000","last_clean":"2024-02-16T00:13:37.929115+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:13:37.929115+0000","last_undegraded":"2024-02-16T00:13:37.929115+0000","last_fullsized":"2024-02-16T00:13:37.929115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:37.928993+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:37.928993+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.928993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:49:00.921338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.046782+0000","last_change":"2024-02-16T00:13:25.046782+0000","last_active":"2024-02-16T00:13:25.046782+0000","last_peered":"2024-02-16T00:13:25.046782+0000","last_clean":"2024-02-16T00:13:25.046782+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:13:25.046782+0000","last_undegraded":"2024-02-16T00:13:25.046782+0000","last_fullsized":"2024-02-16T00:13:25.046782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:25.046664+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:25.046664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.046664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:18:14.017471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:39.066563+0000","last_change":"2024-02-16T00:13:39.066626+0000","last_active":"2024-02-16T00:13:39.066563+0000","last_peered":"2024-02-16T00:13:39.066563+0000","last_clean":"2024-02-16T00:13:39.066563+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:13:39.066563+0000","last_undegraded":"2024-02-16T00:13:39.066563+0000","last_fullsized":"2024-02-16T00:13:39.066563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:39.066463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:39.066463+0000","last_clean_scrub_stamp":"2024-02-16T00:13:39.066463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:22.922352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.886683+0000","last_change":"2024-02-16T00:13:00.886683+0000","last_active":"2024-02-16T00:13:00.886683+0000","last_peered":"2024-02-16T00:13:00.886683+0000","last_clean":"2024-02-16T00:13:00.886683+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:13:00.886683+0000","last_undegraded":"2024-02-16T00:13:00.886683+0000","last_fullsized":"2024-02-16T00:13:00.886683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.886566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:06.116856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'29","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.157085+0000","last_change":"2024-02-16T00:12:51.157085+0000","last_active":"2024-02-16T00:12:51.157085+0000","last_peered":"2024-02-16T00:12:51.157085+0000","last_clean":"2024-02-16T00:12:51.157085+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:12:51.157085+0000","last_undegraded":"2024-02-16T00:12:51.157085+0000","last_fullsized":"2024-02-16T00:12:51.157085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.156949+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:01.821119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'244","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.041805+0000","last_change":"2024-02-16T00:13:07.041805+0000","last_active":"2024-02-16T00:13:07.041805+0000","last_peered":"2024-02-16T00:13:07.041805+0000","last_clean":"2024-02-16T00:13:07.041805+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:13:07.041805+0000","last_undegraded":"2024-02-16T00:13:07.041805+0000","last_fullsized":"2024-02-16T00:13:07.041805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'244","last_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_deep_scrub":"29'244","last_deep_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.041669+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:08:31.087156+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.081981+0000","last_change":"2024-02-16T00:12:54.081981+0000","last_active":"2024-02-16T00:12:54.081981+0000","last_peered":"2024-02-16T00:12:54.081981+0000","last_clean":"2024-02-16T00:12:54.081981+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:12:54.081981+0000","last_undegraded":"2024-02-16T00:12:54.081981+0000","last_fullsized":"2024-02-16T00:12:54.081981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.081866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:20.234092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.900259+0000","last_change":"2024-02-16T00:13:32.900259+0000","last_active":"2024-02-16T00:13:32.900259+0000","last_peered":"2024-02-16T00:13:32.900259+0000","last_clean":"2024-02-16T00:13:32.900259+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:13:32.900259+0000","last_undegraded":"2024-02-16T00:13:32.900259+0000","last_fullsized":"2024-02-16T00:13:32.900259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:32.900135+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:32.900135+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.900135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:23:43.008142+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.584199+0000","last_change":"2024-02-16T00:13:15.584199+0000","last_active":"2024-02-16T00:13:15.584199+0000","last_peered":"2024-02-16T00:13:15.584199+0000","last_clean":"2024-02-16T00:13:15.584199+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:13:15.584199+0000","last_undegraded":"2024-02-16T00:13:15.584199+0000","last_fullsized":"2024-02-16T00:13:15.584199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.584073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:18.030880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.040576+0000","last_change":"2024-02-16T00:12:46.040576+0000","last_active":"2024-02-16T00:12:46.040576+0000","last_peered":"2024-02-16T00:12:46.040576+0000","last_clean":"2024-02-16T00:12:46.040576+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:12:46.040576+0000","last_undegraded":"2024-02-16T00:12:46.040576+0000","last_fullsized":"2024-02-16T00:12:46.040576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.040468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:29.717153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'41","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.243662+0000","last_change":"2024-02-16T00:12:49.243662+0000","last_active":"2024-02-16T00:12:49.243662+0000","last_peered":"2024-02-16T00:12:49.243662+0000","last_clean":"2024-02-16T00:12:49.243662+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:49.243662+0000","last_undegraded":"2024-02-16T00:12:49.243662+0000","last_fullsized":"2024-02-16T00:12:49.243662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.243531+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:44.292142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'243","reported_seq":331,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.916116+0000","last_change":"2024-02-16T00:12:42.916116+0000","last_active":"2024-02-16T00:12:42.916116+0000","last_peered":"2024-02-16T00:12:42.916116+0000","last_clean":"2024-02-16T00:12:42.916116+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:42.916116+0000","last_undegraded":"2024-02-16T00:12:42.916116+0000","last_fullsized":"2024-02-16T00:12:42.916116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.916005+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:53.580174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.334990+0000","last_change":"2024-02-16T00:13:33.335047+0000","last_active":"2024-02-16T00:13:33.334990+0000","last_peered":"2024-02-16T00:13:33.334990+0000","last_clean":"2024-02-16T00:13:33.334990+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:13:33.334990+0000","last_undegraded":"2024-02-16T00:13:33.334990+0000","last_fullsized":"2024-02-16T00:13:33.334990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-02-16T00:13:33.334889+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-02-16T00:13:33.334889+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.334889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:17.712622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.298408+0000","last_change":"2024-02-16T00:13:24.298439+0000","last_active":"2024-02-16T00:13:24.298408+0000","last_peered":"2024-02-16T00:13:24.298408+0000","last_clean":"2024-02-16T00:13:24.298408+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:13:24.298408+0000","last_undegraded":"2024-02-16T00:13:24.298408+0000","last_fullsized":"2024-02-16T00:13:24.298408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:24.298312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:24.298312+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.298312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:56.750764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.525828+0000","last_change":"2024-02-16T00:12:48.525828+0000","last_active":"2024-02-16T00:12:48.525828+0000","last_peered":"2024-02-16T00:12:48.525828+0000","last_clean":"2024-02-16T00:12:48.525828+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:12:48.525828+0000","last_undegraded":"2024-02-16T00:12:48.525828+0000","last_fullsized":"2024-02-16T00:12:48.525828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.525719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:11.360728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'58","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.244124+0000","last_change":"2024-02-16T00:12:48.244124+0000","last_active":"2024-02-16T00:12:48.244124+0000","last_peered":"2024-02-16T00:12:48.244124+0000","last_clean":"2024-02-16T00:12:48.244124+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:48.244124+0000","last_undegraded":"2024-02-16T00:12:48.244124+0000","last_fullsized":"2024-02-16T00:12:48.244124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.243982+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:25.939262+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.931903+0000","last_change":"2024-02-16T00:12:46.931903+0000","last_active":"2024-02-16T00:12:46.931903+0000","last_peered":"2024-02-16T00:12:46.931903+0000","last_clean":"2024-02-16T00:12:46.931903+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:12:46.931903+0000","last_undegraded":"2024-02-16T00:12:46.931903+0000","last_fullsized":"2024-02-16T00:12:46.931903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.931775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:08:25.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.070398+0000","last_change":"2024-02-16T00:12:58.070398+0000","last_active":"2024-02-16T00:12:58.070398+0000","last_peered":"2024-02-16T00:12:58.070398+0000","last_clean":"2024-02-16T00:12:58.070398+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:58.070398+0000","last_undegraded":"2024-02-16T00:12:58.070398+0000","last_fullsized":"2024-02-16T00:12:58.070398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.070215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:35.924708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.553664+0000","last_change":"2024-02-16T00:13:08.553664+0000","last_active":"2024-02-16T00:13:08.553664+0000","last_peered":"2024-02-16T00:13:08.553664+0000","last_clean":"2024-02-16T00:13:08.553664+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:13:08.553664+0000","last_undegraded":"2024-02-16T00:13:08.553664+0000","last_fullsized":"2024-02-16T00:13:08.553664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.553541+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:34.676748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.278691+0000","last_change":"2024-02-16T00:13:27.278718+0000","last_active":"2024-02-16T00:13:27.278691+0000","last_peered":"2024-02-16T00:13:27.278691+0000","last_clean":"2024-02-16T00:13:27.278691+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:13:27.278691+0000","last_undegraded":"2024-02-16T00:13:27.278691+0000","last_fullsized":"2024-02-16T00:13:27.278691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:27.278584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:27.278584+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.278584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:44:28.499451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.788791+0000","last_change":"2024-02-16T00:12:55.788791+0000","last_active":"2024-02-16T00:12:55.788791+0000","last_peered":"2024-02-16T00:12:55.788791+0000","last_clean":"2024-02-16T00:12:55.788791+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:12:55.788791+0000","last_undegraded":"2024-02-16T00:12:55.788791+0000","last_fullsized":"2024-02-16T00:12:55.788791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.788644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:03.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'41","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.074769+0000","last_change":"2024-02-16T00:12:43.074769+0000","last_active":"2024-02-16T00:12:43.074769+0000","last_peered":"2024-02-16T00:12:43.074769+0000","last_clean":"2024-02-16T00:12:43.074769+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:43.074769+0000","last_undegraded":"2024-02-16T00:12:43.074769+0000","last_fullsized":"2024-02-16T00:12:43.074769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.074645+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.611584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.938580+0000","last_change":"2024-02-16T00:12:40.938580+0000","last_active":"2024-02-16T00:12:40.938580+0000","last_peered":"2024-02-16T00:12:40.938580+0000","last_clean":"2024-02-16T00:12:40.938580+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:12:40.938580+0000","last_undegraded":"2024-02-16T00:12:40.938580+0000","last_fullsized":"2024-02-16T00:12:40.938580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.938464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:15:55.114937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.741583+0000","last_change":"2024-02-16T00:13:35.741615+0000","last_active":"2024-02-16T00:13:35.741583+0000","last_peered":"2024-02-16T00:13:35.741583+0000","last_clean":"2024-02-16T00:13:35.741583+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:13:35.741583+0000","last_undegraded":"2024-02-16T00:13:35.741583+0000","last_fullsized":"2024-02-16T00:13:35.741583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:35.741499+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:35.741499+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.741499+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:47.657559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.194785+0000","last_change":"2024-02-16T00:13:16.194785+0000","last_active":"2024-02-16T00:13:16.194785+0000","last_peered":"2024-02-16T00:13:16.194785+0000","last_clean":"2024-02-16T00:13:16.194785+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:13:16.194785+0000","last_undegraded":"2024-02-16T00:13:16.194785+0000","last_fullsized":"2024-02-16T00:13:16.194785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.194674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:42.317881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.102986+0000","last_change":"2024-02-16T00:13:38.103017+0000","last_active":"2024-02-16T00:13:38.102986+0000","last_peered":"2024-02-16T00:13:38.102986+0000","last_clean":"2024-02-16T00:13:38.102986+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:13:38.102986+0000","last_undegraded":"2024-02-16T00:13:38.102986+0000","last_fullsized":"2024-02-16T00:13:38.102986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:38.102894+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:38.102894+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.102894+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:10.226023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.864812+0000","last_change":"2024-02-16T00:12:59.864812+0000","last_active":"2024-02-16T00:12:59.864812+0000","last_peered":"2024-02-16T00:12:59.864812+0000","last_clean":"2024-02-16T00:12:59.864812+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:12:59.864812+0000","last_undegraded":"2024-02-16T00:12:59.864812+0000","last_fullsized":"2024-02-16T00:12:59.864812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.864691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:37:20.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'57","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.882918+0000","last_change":"2024-02-16T00:12:50.882918+0000","last_active":"2024-02-16T00:12:50.882918+0000","last_peered":"2024-02-16T00:12:50.882918+0000","last_clean":"2024-02-16T00:12:50.882918+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:50.882918+0000","last_undegraded":"2024-02-16T00:12:50.882918+0000","last_fullsized":"2024-02-16T00:12:50.882918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.882742+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:43.268496+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'243","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.962470+0000","last_change":"2024-02-16T00:12:43.962470+0000","last_active":"2024-02-16T00:12:43.962470+0000","last_peered":"2024-02-16T00:12:43.962470+0000","last_clean":"2024-02-16T00:12:43.962470+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:43.962470+0000","last_undegraded":"2024-02-16T00:12:43.962470+0000","last_fullsized":"2024-02-16T00:12:43.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.962355+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:22.152077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:39.862241+0000","last_change":"2024-02-16T00:13:39.862284+0000","last_active":"2024-02-16T00:13:39.862241+0000","last_peered":"2024-02-16T00:13:39.862241+0000","last_clean":"2024-02-16T00:13:39.862241+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:13:39.862241+0000","last_undegraded":"2024-02-16T00:13:39.862241+0000","last_fullsized":"2024-02-16T00:13:39.862241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:39.862150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:39.862150+0000","last_clean_scrub_stamp":"2024-02-16T00:13:39.862150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:24.012086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.207275+0000","last_change":"2024-02-16T00:13:08.207275+0000","last_active":"2024-02-16T00:13:08.207275+0000","last_peered":"2024-02-16T00:13:08.207275+0000","last_clean":"2024-02-16T00:13:08.207275+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:13:08.207275+0000","last_undegraded":"2024-02-16T00:13:08.207275+0000","last_fullsized":"2024-02-16T00:13:08.207275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.207150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:18.983700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:42.104246+0000","last_change":"2024-02-16T00:13:42.104272+0000","last_active":"2024-02-16T00:13:42.104246+0000","last_peered":"2024-02-16T00:13:42.104246+0000","last_clean":"2024-02-16T00:13:42.104246+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:13:42.104246+0000","last_undegraded":"2024-02-16T00:13:42.104246+0000","last_fullsized":"2024-02-16T00:13:42.104246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:42.104143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:42.104143+0000","last_clean_scrub_stamp":"2024-02-16T00:13:42.104143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:18:04.502703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.773405+0000","last_change":"2024-02-16T00:12:56.773405+0000","last_active":"2024-02-16T00:12:56.773405+0000","last_peered":"2024-02-16T00:12:56.773405+0000","last_clean":"2024-02-16T00:12:56.773405+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:12:56.773405+0000","last_undegraded":"2024-02-16T00:12:56.773405+0000","last_fullsized":"2024-02-16T00:12:56.773405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.773281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:12.642357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'73","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.029931+0000","last_change":"2024-02-16T00:13:05.029931+0000","last_active":"2024-02-16T00:13:05.029931+0000","last_peered":"2024-02-16T00:13:05.029931+0000","last_clean":"2024-02-16T00:13:05.029931+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:13:05.029931+0000","last_undegraded":"2024-02-16T00:13:05.029931+0000","last_fullsized":"2024-02-16T00:13:05.029931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.029752+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:42.315448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.833657+0000","last_change":"2024-02-16T00:12:58.833657+0000","last_active":"2024-02-16T00:12:58.833657+0000","last_peered":"2024-02-16T00:12:58.833657+0000","last_clean":"2024-02-16T00:12:58.833657+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:12:58.833657+0000","last_undegraded":"2024-02-16T00:12:58.833657+0000","last_fullsized":"2024-02-16T00:12:58.833657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.833533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:45:54.589076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.870256+0000","last_change":"2024-02-16T00:13:34.870280+0000","last_active":"2024-02-16T00:13:34.870256+0000","last_peered":"2024-02-16T00:13:34.870256+0000","last_clean":"2024-02-16T00:13:34.870256+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:13:34.870256+0000","last_undegraded":"2024-02-16T00:13:34.870256+0000","last_fullsized":"2024-02-16T00:13:34.870256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:34.870168+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:34.870168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.870168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:07.128815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.551036+0000","last_change":"2024-02-16T00:13:07.551036+0000","last_active":"2024-02-16T00:13:07.551036+0000","last_peered":"2024-02-16T00:13:07.551036+0000","last_clean":"2024-02-16T00:13:07.551036+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:13:07.551036+0000","last_undegraded":"2024-02-16T00:13:07.551036+0000","last_fullsized":"2024-02-16T00:13:07.551036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.550917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:08.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.807521+0000","last_change":"2024-02-16T00:13:17.807521+0000","last_active":"2024-02-16T00:13:17.807521+0000","last_peered":"2024-02-16T00:13:17.807521+0000","last_clean":"2024-02-16T00:13:17.807521+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:13:17.807521+0000","last_undegraded":"2024-02-16T00:13:17.807521+0000","last_fullsized":"2024-02-16T00:13:17.807521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.807409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:10.662061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.114782+0000","last_change":"2024-02-16T00:12:59.114782+0000","last_active":"2024-02-16T00:12:59.114782+0000","last_peered":"2024-02-16T00:12:59.114782+0000","last_clean":"2024-02-16T00:12:59.114782+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:12:59.114782+0000","last_undegraded":"2024-02-16T00:12:59.114782+0000","last_fullsized":"2024-02-16T00:12:59.114782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.114637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:06.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.465978+0000","last_change":"2024-02-16T00:12:45.465978+0000","last_active":"2024-02-16T00:12:45.465978+0000","last_peered":"2024-02-16T00:12:45.465978+0000","last_clean":"2024-02-16T00:12:45.465978+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:45.465978+0000","last_undegraded":"2024-02-16T00:12:45.465978+0000","last_fullsized":"2024-02-16T00:12:45.465978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.465843+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:56.130012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.024834+0000","last_change":"2024-02-16T00:13:03.024834+0000","last_active":"2024-02-16T00:13:03.024834+0000","last_peered":"2024-02-16T00:13:03.024834+0000","last_clean":"2024-02-16T00:13:03.024834+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:13:03.024834+0000","last_undegraded":"2024-02-16T00:13:03.024834+0000","last_fullsized":"2024-02-16T00:13:03.024834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.024725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:07.760259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458009+0000","last_change":"2024-02-16T00:11:12.833779+0000","last_active":"2024-02-16T00:12:39.458009+0000","last_peered":"2024-02-16T00:12:39.458009+0000","last_clean":"2024-02-16T00:12:39.458009+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:12:39.458009+0000","last_undegraded":"2024-02-16T00:12:39.458009+0000","last_fullsized":"2024-02-16T00:12:39.458009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.306469+0000","last_change":"2024-02-16T00:13:32.306533+0000","last_active":"2024-02-16T00:13:32.306469+0000","last_peered":"2024-02-16T00:13:32.306469+0000","last_clean":"2024-02-16T00:13:32.306469+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:13:32.306469+0000","last_undegraded":"2024-02-16T00:13:32.306469+0000","last_fullsized":"2024-02-16T00:13:32.306469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:32.306376+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:32.306376+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.306376+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:04:40.109886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.026784+0000","last_change":"2024-02-16T00:13:33.026807+0000","last_active":"2024-02-16T00:13:33.026784+0000","last_peered":"2024-02-16T00:13:33.026784+0000","last_clean":"2024-02-16T00:13:33.026784+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:13:33.026784+0000","last_undegraded":"2024-02-16T00:13:33.026784+0000","last_fullsized":"2024-02-16T00:13:33.026784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:33.026697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:33.026697+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.026697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:02.894770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.335208+0000","last_change":"2024-02-16T00:13:30.335235+0000","last_active":"2024-02-16T00:13:30.335208+0000","last_peered":"2024-02-16T00:13:30.335208+0000","last_clean":"2024-02-16T00:13:30.335208+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:13:30.335208+0000","last_undegraded":"2024-02-16T00:13:30.335208+0000","last_fullsized":"2024-02-16T00:13:30.335208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.335112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.335112+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.335112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:19.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.094367+0000","last_change":"2024-02-16T00:12:55.094367+0000","last_active":"2024-02-16T00:12:55.094367+0000","last_peered":"2024-02-16T00:12:55.094367+0000","last_clean":"2024-02-16T00:12:55.094367+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:55.094367+0000","last_undegraded":"2024-02-16T00:12:55.094367+0000","last_fullsized":"2024-02-16T00:12:55.094367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.094244+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:26.439070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'243","reported_seq":344,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.239506+0000","last_change":"2024-02-16T00:12:39.239506+0000","last_active":"2024-02-16T00:12:39.239506+0000","last_peered":"2024-02-16T00:12:39.239506+0000","last_clean":"2024-02-16T00:12:39.239506+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:39.239506+0000","last_undegraded":"2024-02-16T00:12:39.239506+0000","last_fullsized":"2024-02-16T00:12:39.239506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.239332+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:03:36.377883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.914260+0000","last_change":"2024-02-16T00:13:35.914283+0000","last_active":"2024-02-16T00:13:35.914260+0000","last_peered":"2024-02-16T00:13:35.914260+0000","last_clean":"2024-02-16T00:13:35.914260+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:13:35.914260+0000","last_undegraded":"2024-02-16T00:13:35.914260+0000","last_fullsized":"2024-02-16T00:13:35.914260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-02-16T00:13:35.914177+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-02-16T00:13:35.914177+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.914177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:15.976313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.302481+0000","last_change":"2024-02-16T00:13:35.302506+0000","last_active":"2024-02-16T00:13:35.302481+0000","last_peered":"2024-02-16T00:13:35.302481+0000","last_clean":"2024-02-16T00:13:35.302481+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:13:35.302481+0000","last_undegraded":"2024-02-16T00:13:35.302481+0000","last_fullsized":"2024-02-16T00:13:35.302481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:35.302398+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:35.302398+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.302398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:02.890791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:41.074485+0000","last_change":"2024-02-16T00:13:41.074554+0000","last_active":"2024-02-16T00:13:41.074485+0000","last_peered":"2024-02-16T00:13:41.074485+0000","last_clean":"2024-02-16T00:13:41.074485+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:13:41.074485+0000","last_undegraded":"2024-02-16T00:13:41.074485+0000","last_fullsized":"2024-02-16T00:13:41.074485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:41.074344+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:41.074344+0000","last_clean_scrub_stamp":"2024-02-16T00:13:41.074344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:38:21.916929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'4","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.634659+0000","last_change":"2024-02-16T00:12:53.634659+0000","last_active":"2024-02-16T00:12:53.634659+0000","last_peered":"2024-02-16T00:12:53.634659+0000","last_clean":"2024-02-16T00:12:53.634659+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:53.634659+0000","last_undegraded":"2024-02-16T00:12:53.634659+0000","last_fullsized":"2024-02-16T00:12:53.634659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.634543+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:19.504192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.010930+0000","last_change":"2024-02-16T00:13:06.010930+0000","last_active":"2024-02-16T00:13:06.010930+0000","last_peered":"2024-02-16T00:13:06.010930+0000","last_clean":"2024-02-16T00:13:06.010930+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:13:06.010930+0000","last_undegraded":"2024-02-16T00:13:06.010930+0000","last_fullsized":"2024-02-16T00:13:06.010930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.010796+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:32.982515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'243","reported_seq":347,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.455945+0000","last_change":"2024-02-16T00:12:42.455945+0000","last_active":"2024-02-16T00:12:42.455945+0000","last_peered":"2024-02-16T00:12:42.455945+0000","last_clean":"2024-02-16T00:12:42.455945+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:42.455945+0000","last_undegraded":"2024-02-16T00:12:42.455945+0000","last_fullsized":"2024-02-16T00:12:42.455945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.455835+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.530697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.191670+0000","last_change":"2024-02-16T00:12:50.191670+0000","last_active":"2024-02-16T00:12:50.191670+0000","last_peered":"2024-02-16T00:12:50.191670+0000","last_clean":"2024-02-16T00:12:50.191670+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:12:50.191670+0000","last_undegraded":"2024-02-16T00:12:50.191670+0000","last_fullsized":"2024-02-16T00:12:50.191670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.191478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:27.718003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.608047+0000","last_change":"2024-02-16T00:13:00.608047+0000","last_active":"2024-02-16T00:13:00.608047+0000","last_peered":"2024-02-16T00:13:00.608047+0000","last_clean":"2024-02-16T00:13:00.608047+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:13:00.608047+0000","last_undegraded":"2024-02-16T00:13:00.608047+0000","last_fullsized":"2024-02-16T00:13:00.608047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.607926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:11.384475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:43.069464+0000","last_change":"2024-02-16T00:13:43.069493+0000","last_active":"2024-02-16T00:13:43.069464+0000","last_peered":"2024-02-16T00:13:43.069464+0000","last_clean":"2024-02-16T00:13:43.069464+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:13:43.069464+0000","last_undegraded":"2024-02-16T00:13:43.069464+0000","last_fullsized":"2024-02-16T00:13:43.069464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:43.069346+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:43.069346+0000","last_clean_scrub_stamp":"2024-02-16T00:13:43.069346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.060929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.956544+0000","last_change":"2024-02-16T00:12:47.956544+0000","last_active":"2024-02-16T00:12:47.956544+0000","last_peered":"2024-02-16T00:12:47.956544+0000","last_clean":"2024-02-16T00:12:47.956544+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:12:47.956544+0000","last_undegraded":"2024-02-16T00:12:47.956544+0000","last_fullsized":"2024-02-16T00:12:47.956544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.956387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:46.994810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'47","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.531411+0000","last_change":"2024-02-16T00:12:39.531411+0000","last_active":"2024-02-16T00:12:39.531411+0000","last_peered":"2024-02-16T00:12:39.531411+0000","last_clean":"2024-02-16T00:12:39.531411+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:39.531411+0000","last_undegraded":"2024-02-16T00:12:39.531411+0000","last_fullsized":"2024-02-16T00:12:39.531411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.531279+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:07.205098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.313251+0000","last_change":"2024-02-16T00:12:41.313251+0000","last_active":"2024-02-16T00:12:41.313251+0000","last_peered":"2024-02-16T00:12:41.313251+0000","last_clean":"2024-02-16T00:12:41.313251+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:12:41.313251+0000","last_undegraded":"2024-02-16T00:12:41.313251+0000","last_fullsized":"2024-02-16T00:12:41.313251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.313091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:34.237575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.551467+0000","last_change":"2024-02-16T00:13:06.551467+0000","last_active":"2024-02-16T00:13:06.551467+0000","last_peered":"2024-02-16T00:13:06.551467+0000","last_clean":"2024-02-16T00:13:06.551467+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:13:06.551467+0000","last_undegraded":"2024-02-16T00:13:06.551467+0000","last_fullsized":"2024-02-16T00:13:06.551467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.551352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:50.228037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.978897+0000","last_change":"2024-02-16T00:12:53.978897+0000","last_active":"2024-02-16T00:12:53.978897+0000","last_peered":"2024-02-16T00:12:53.978897+0000","last_clean":"2024-02-16T00:12:53.978897+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:53.978897+0000","last_undegraded":"2024-02-16T00:12:53.978897+0000","last_fullsized":"2024-02-16T00:12:53.978897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.978770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:56.425577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.709287+0000","last_change":"2024-02-16T00:13:24.709340+0000","last_active":"2024-02-16T00:13:24.709287+0000","last_peered":"2024-02-16T00:13:24.709287+0000","last_clean":"2024-02-16T00:13:24.709287+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:13:24.709287+0000","last_undegraded":"2024-02-16T00:13:24.709287+0000","last_fullsized":"2024-02-16T00:13:24.709287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-02-16T00:13:24.709181+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-02-16T00:13:24.709181+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.709181+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.269456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:52.807668+0000","last_change":"2024-02-16T00:13:52.807692+0000","last_active":"2024-02-16T00:13:52.807668+0000","last_peered":"2024-02-16T00:13:52.807668+0000","last_clean":"2024-02-16T00:13:52.807668+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:13:52.807668+0000","last_undegraded":"2024-02-16T00:13:52.807668+0000","last_fullsized":"2024-02-16T00:13:52.807668+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:52.807581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:52.807581+0000","last_clean_scrub_stamp":"2024-02-16T00:13:52.807581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:14.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.985328+0000","last_change":"2024-02-16T00:13:31.985353+0000","last_active":"2024-02-16T00:13:31.985328+0000","last_peered":"2024-02-16T00:13:31.985328+0000","last_clean":"2024-02-16T00:13:31.985328+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:13:31.985328+0000","last_undegraded":"2024-02-16T00:13:31.985328+0000","last_fullsized":"2024-02-16T00:13:31.985328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:31.985241+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:31.985241+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.985241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:06.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.646834+0000","last_change":"2024-02-16T00:12:55.646834+0000","last_active":"2024-02-16T00:12:55.646834+0000","last_peered":"2024-02-16T00:12:55.646834+0000","last_clean":"2024-02-16T00:12:55.646834+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:12:55.646834+0000","last_undegraded":"2024-02-16T00:12:55.646834+0000","last_fullsized":"2024-02-16T00:12:55.646834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.646719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:53.816935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.997697+0000","last_change":"2024-02-16T00:12:46.997697+0000","last_active":"2024-02-16T00:12:46.997697+0000","last_peered":"2024-02-16T00:12:46.997697+0000","last_clean":"2024-02-16T00:12:46.997697+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:46.997697+0000","last_undegraded":"2024-02-16T00:12:46.997697+0000","last_fullsized":"2024-02-16T00:12:46.997697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.997576+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:05:47.865804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.895106+0000","last_change":"2024-02-16T00:12:38.895106+0000","last_active":"2024-02-16T00:12:38.895106+0000","last_peered":"2024-02-16T00:12:38.895106+0000","last_clean":"2024-02-16T00:12:38.895106+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:12:38.895106+0000","last_undegraded":"2024-02-16T00:12:38.895106+0000","last_fullsized":"2024-02-16T00:12:38.895106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_clean_scrub_stamp":"2024-02-16T00:12:38.895009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:07.402769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.287858+0000","last_change":"2024-02-16T00:12:46.287858+0000","last_active":"2024-02-16T00:12:46.287858+0000","last_peered":"2024-02-16T00:12:46.287858+0000","last_clean":"2024-02-16T00:12:46.287858+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:46.287858+0000","last_undegraded":"2024-02-16T00:12:46.287858+0000","last_fullsized":"2024-02-16T00:12:46.287858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.287742+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:27.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.060562+0000","last_change":"2024-02-16T00:13:22.060587+0000","last_active":"2024-02-16T00:13:22.060562+0000","last_peered":"2024-02-16T00:13:22.060562+0000","last_clean":"2024-02-16T00:13:22.060562+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:13:22.060562+0000","last_undegraded":"2024-02-16T00:13:22.060562+0000","last_fullsized":"2024-02-16T00:13:22.060562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:22.060477+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:22.060477+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.060477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:46.570239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:51.793093+0000","last_change":"2024-02-16T00:13:51.793119+0000","last_active":"2024-02-16T00:13:51.793093+0000","last_peered":"2024-02-16T00:13:51.793093+0000","last_clean":"2024-02-16T00:13:51.793093+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:13:51.793093+0000","last_undegraded":"2024-02-16T00:13:51.793093+0000","last_fullsized":"2024-02-16T00:13:51.793093+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:51.793000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:51.793000+0000","last_clean_scrub_stamp":"2024-02-16T00:13:51.793000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:50.224219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.808017+0000","last_change":"2024-02-16T00:13:11.808042+0000","last_active":"2024-02-16T00:13:11.808017+0000","last_peered":"2024-02-16T00:13:11.808017+0000","last_clean":"2024-02-16T00:13:11.808017+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:13:11.808017+0000","last_undegraded":"2024-02-16T00:13:11.808017+0000","last_fullsized":"2024-02-16T00:13:11.808017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.807928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:43.625385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.457476+0000","last_change":"2024-02-16T00:11:50.849902+0000","last_active":"2024-02-16T00:12:39.457476+0000","last_peered":"2024-02-16T00:12:39.457476+0000","last_clean":"2024-02-16T00:12:39.457476+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:12:39.457476+0000","last_undegraded":"2024-02-16T00:12:39.457476+0000","last_fullsized":"2024-02-16T00:12:39.457476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:05.787497+0000","last_clean_scrub_stamp":"2024-02-16T00:11:05.787497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'263","reported_seq":460,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.503542+0000","last_change":"2024-02-16T00:12:41.503542+0000","last_active":"2024-02-16T00:12:41.503542+0000","last_peered":"2024-02-16T00:12:41.503542+0000","last_clean":"2024-02-16T00:12:41.503542+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:41.503542+0000","last_undegraded":"2024-02-16T00:12:41.503542+0000","last_fullsized":"2024-02-16T00:12:41.503542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'263","last_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_deep_scrub":"29'263","last_deep_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.503409+0000","objects_scrubbed":11,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:12.672777+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":329,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.038391+0000","last_change":"2024-02-16T00:13:01.038391+0000","last_active":"2024-02-16T00:13:01.038391+0000","last_peered":"2024-02-16T00:13:01.038391+0000","last_clean":"2024-02-16T00:13:01.038391+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:13:01.038391+0000","last_undegraded":"2024-02-16T00:13:01.038391+0000","last_fullsized":"2024-02-16T00:13:01.038391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.038282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:10:49.789079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.730629+0000","last_change":"2024-02-16T00:13:34.730654+0000","last_active":"2024-02-16T00:13:34.730629+0000","last_peered":"2024-02-16T00:13:34.730629+0000","last_clean":"2024-02-16T00:13:34.730629+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:13:34.730629+0000","last_undegraded":"2024-02-16T00:13:34.730629+0000","last_fullsized":"2024-02-16T00:13:34.730629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:13:34.730542+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:13:34.730542+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.730542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:23:44.838549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.757812+0000","last_change":"2024-02-16T00:13:07.757812+0000","last_active":"2024-02-16T00:13:07.757812+0000","last_peered":"2024-02-16T00:13:07.757812+0000","last_clean":"2024-02-16T00:13:07.757812+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:13:07.757812+0000","last_undegraded":"2024-02-16T00:13:07.757812+0000","last_fullsized":"2024-02-16T00:13:07.757812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.757686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:36.310457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.256673+0000","last_change":"2024-02-16T00:13:20.256698+0000","last_active":"2024-02-16T00:13:20.256673+0000","last_peered":"2024-02-16T00:13:20.256673+0000","last_clean":"2024-02-16T00:13:20.256673+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:13:20.256673+0000","last_undegraded":"2024-02-16T00:13:20.256673+0000","last_fullsized":"2024-02-16T00:13:20.256673+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:20.256588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:20.256588+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.256588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:00.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.891449+0000","last_change":"2024-02-16T00:13:21.891474+0000","last_active":"2024-02-16T00:13:21.891449+0000","last_peered":"2024-02-16T00:13:21.891449+0000","last_clean":"2024-02-16T00:13:21.891449+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:13:21.891449+0000","last_undegraded":"2024-02-16T00:13:21.891449+0000","last_fullsized":"2024-02-16T00:13:21.891449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:21.891363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:21.891363+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.891363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:16:18.993601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.171880+0000","last_change":"2024-02-16T00:13:01.171880+0000","last_active":"2024-02-16T00:13:01.171880+0000","last_peered":"2024-02-16T00:13:01.171880+0000","last_clean":"2024-02-16T00:13:01.171880+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:13:01.171880+0000","last_undegraded":"2024-02-16T00:13:01.171880+0000","last_fullsized":"2024-02-16T00:13:01.171880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.171761+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:27.041410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.284740+0000","last_change":"2024-02-16T00:12:47.284740+0000","last_active":"2024-02-16T00:12:47.284740+0000","last_peered":"2024-02-16T00:12:47.284740+0000","last_clean":"2024-02-16T00:12:47.284740+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:47.284740+0000","last_undegraded":"2024-02-16T00:12:47.284740+0000","last_fullsized":"2024-02-16T00:12:47.284740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.284612+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:18.453979+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.908420+0000","last_change":"2024-02-16T00:12:39.908420+0000","last_active":"2024-02-16T00:12:39.908420+0000","last_peered":"2024-02-16T00:12:39.908420+0000","last_clean":"2024-02-16T00:12:39.908420+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:12:39.908420+0000","last_undegraded":"2024-02-16T00:12:39.908420+0000","last_fullsized":"2024-02-16T00:12:39.908420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.908319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:17.603599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:57.929361+0000","last_change":"2024-02-16T00:13:57.929403+0000","last_active":"2024-02-16T00:13:57.929361+0000","last_peered":"2024-02-16T00:13:57.929361+0000","last_clean":"2024-02-16T00:13:57.929361+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:13:57.929361+0000","last_undegraded":"2024-02-16T00:13:57.929361+0000","last_fullsized":"2024-02-16T00:13:57.929361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:57.929267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:57.929267+0000","last_clean_scrub_stamp":"2024-02-16T00:13:57.929267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:35.224978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.824008+0000","last_change":"2024-02-16T00:13:16.824040+0000","last_active":"2024-02-16T00:13:16.824008+0000","last_peered":"2024-02-16T00:13:16.824008+0000","last_clean":"2024-02-16T00:13:16.824008+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:13:16.824008+0000","last_undegraded":"2024-02-16T00:13:16.824008+0000","last_fullsized":"2024-02-16T00:13:16.824008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.823910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:40.976221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:49.875032+0000","last_change":"2024-02-16T00:13:49.875072+0000","last_active":"2024-02-16T00:13:49.875032+0000","last_peered":"2024-02-16T00:13:49.875032+0000","last_clean":"2024-02-16T00:13:49.875032+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:13:49.875032+0000","last_undegraded":"2024-02-16T00:13:49.875032+0000","last_fullsized":"2024-02-16T00:13:49.875032+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:49.874905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:49.874905+0000","last_clean_scrub_stamp":"2024-02-16T00:13:49.874905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:41:36.900597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.300088+0000","last_change":"2024-02-16T00:13:26.300114+0000","last_active":"2024-02-16T00:13:26.300088+0000","last_peered":"2024-02-16T00:13:26.300088+0000","last_clean":"2024-02-16T00:13:26.300088+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:13:26.300088+0000","last_undegraded":"2024-02-16T00:13:26.300088+0000","last_fullsized":"2024-02-16T00:13:26.300088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.299989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.299989+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.299989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:19.154640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.295833+0000","last_change":"2024-02-16T00:13:31.295833+0000","last_active":"2024-02-16T00:13:31.295833+0000","last_peered":"2024-02-16T00:13:31.295833+0000","last_clean":"2024-02-16T00:13:31.295833+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:13:31.295833+0000","last_undegraded":"2024-02-16T00:13:31.295833+0000","last_fullsized":"2024-02-16T00:13:31.295833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.295719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.295719+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.295719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:04:51.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.935999+0000","last_change":"2024-02-16T00:12:52.935999+0000","last_active":"2024-02-16T00:12:52.935999+0000","last_peered":"2024-02-16T00:12:52.935999+0000","last_clean":"2024-02-16T00:12:52.935999+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:12:52.935999+0000","last_undegraded":"2024-02-16T00:12:52.935999+0000","last_fullsized":"2024-02-16T00:12:52.935999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.935867+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:29.245202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.060701+0000","last_change":"2024-02-16T00:13:02.060701+0000","last_active":"2024-02-16T00:13:02.060701+0000","last_peered":"2024-02-16T00:13:02.060701+0000","last_clean":"2024-02-16T00:13:02.060701+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:13:02.060701+0000","last_undegraded":"2024-02-16T00:13:02.060701+0000","last_fullsized":"2024-02-16T00:13:02.060701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.060586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:22.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.708762+0000","last_change":"2024-02-16T00:13:38.708793+0000","last_active":"2024-02-16T00:13:38.708762+0000","last_peered":"2024-02-16T00:13:38.708762+0000","last_clean":"2024-02-16T00:13:38.708762+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:13:38.708762+0000","last_undegraded":"2024-02-16T00:13:38.708762+0000","last_fullsized":"2024-02-16T00:13:38.708762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:38.708646+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:38.708646+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.708646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:56.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.631131+0000","last_change":"2024-02-16T00:13:03.631131+0000","last_active":"2024-02-16T00:13:03.631131+0000","last_peered":"2024-02-16T00:13:03.631131+0000","last_clean":"2024-02-16T00:13:03.631131+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:13:03.631131+0000","last_undegraded":"2024-02-16T00:13:03.631131+0000","last_fullsized":"2024-02-16T00:13:03.631131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.630995+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:48.259171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.261488+0000","last_change":"2024-02-16T00:13:25.261516+0000","last_active":"2024-02-16T00:13:25.261488+0000","last_peered":"2024-02-16T00:13:25.261488+0000","last_clean":"2024-02-16T00:13:25.261488+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:13:25.261488+0000","last_undegraded":"2024-02-16T00:13:25.261488+0000","last_fullsized":"2024-02-16T00:13:25.261488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.261400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.261400+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.261400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:49.413711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.918057+0000","last_change":"2024-02-16T00:13:24.918084+0000","last_active":"2024-02-16T00:13:24.918057+0000","last_peered":"2024-02-16T00:13:24.918057+0000","last_clean":"2024-02-16T00:13:24.918057+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:13:24.918057+0000","last_undegraded":"2024-02-16T00:13:24.918057+0000","last_fullsized":"2024-02-16T00:13:24.918057+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:24.917971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:24.917971+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.917971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:46.516651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.830866+0000","last_change":"2024-02-16T00:12:53.830866+0000","last_active":"2024-02-16T00:12:53.830866+0000","last_peered":"2024-02-16T00:12:53.830866+0000","last_clean":"2024-02-16T00:12:53.830866+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:12:53.830866+0000","last_undegraded":"2024-02-16T00:12:53.830866+0000","last_fullsized":"2024-02-16T00:12:53.830866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.830730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:52.000946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'82","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.898405+0000","last_change":"2024-02-16T00:12:49.898405+0000","last_active":"2024-02-16T00:12:49.898405+0000","last_peered":"2024-02-16T00:12:49.898405+0000","last_clean":"2024-02-16T00:12:49.898405+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:49.898405+0000","last_undegraded":"2024-02-16T00:12:49.898405+0000","last_fullsized":"2024-02-16T00:12:49.898405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.898247+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:43:05.900172+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":88,"num_read_kb":74,"num_write":40,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.271734+0000","last_change":"2024-02-16T00:12:40.271734+0000","last_active":"2024-02-16T00:12:40.271734+0000","last_peered":"2024-02-16T00:12:40.271734+0000","last_clean":"2024-02-16T00:12:40.271734+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:12:40.271734+0000","last_undegraded":"2024-02-16T00:12:40.271734+0000","last_fullsized":"2024-02-16T00:12:40.271734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.271589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:58.621135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.881341+0000","last_change":"2024-02-16T00:13:33.881365+0000","last_active":"2024-02-16T00:13:33.881341+0000","last_peered":"2024-02-16T00:13:33.881341+0000","last_clean":"2024-02-16T00:13:33.881341+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:13:33.881341+0000","last_undegraded":"2024-02-16T00:13:33.881341+0000","last_fullsized":"2024-02-16T00:13:33.881341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-02-16T00:13:33.881259+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-02-16T00:13:33.881259+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.881259+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:45.797319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.602576+0000","last_change":"2024-02-16T00:12:59.602576+0000","last_active":"2024-02-16T00:12:59.602576+0000","last_peered":"2024-02-16T00:12:59.602576+0000","last_clean":"2024-02-16T00:12:59.602576+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:12:59.602576+0000","last_undegraded":"2024-02-16T00:12:59.602576+0000","last_fullsized":"2024-02-16T00:12:59.602576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.602467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:39.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.940733+0000","last_change":"2024-02-16T00:13:31.940759+0000","last_active":"2024-02-16T00:13:31.940733+0000","last_peered":"2024-02-16T00:13:31.940733+0000","last_clean":"2024-02-16T00:13:31.940733+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:13:31.940733+0000","last_undegraded":"2024-02-16T00:13:31.940733+0000","last_fullsized":"2024-02-16T00:13:31.940733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.940638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.940638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.940638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:29.880557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:48.920129+0000","last_change":"2024-02-16T00:13:48.920155+0000","last_active":"2024-02-16T00:13:48.920129+0000","last_peered":"2024-02-16T00:13:48.920129+0000","last_clean":"2024-02-16T00:13:48.920129+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:13:48.920129+0000","last_undegraded":"2024-02-16T00:13:48.920129+0000","last_fullsized":"2024-02-16T00:13:48.920129+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:48.920037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:48.920037+0000","last_clean_scrub_stamp":"2024-02-16T00:13:48.920037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:12:00.747801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.038166+0000","last_change":"2024-02-16T00:12:44.038166+0000","last_active":"2024-02-16T00:12:44.038166+0000","last_peered":"2024-02-16T00:12:44.038166+0000","last_clean":"2024-02-16T00:12:44.038166+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:12:44.038166+0000","last_undegraded":"2024-02-16T00:12:44.038166+0000","last_fullsized":"2024-02-16T00:12:44.038166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.038018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:35.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'28","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.546695+0000","last_change":"2024-02-16T00:12:40.546695+0000","last_active":"2024-02-16T00:12:40.546695+0000","last_peered":"2024-02-16T00:12:40.546695+0000","last_clean":"2024-02-16T00:12:40.546695+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:12:40.546695+0000","last_undegraded":"2024-02-16T00:12:40.546695+0000","last_fullsized":"2024-02-16T00:12:40.546695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.546560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:21.906524+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'243","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.683178+0000","last_change":"2024-02-16T00:12:54.683178+0000","last_active":"2024-02-16T00:12:54.683178+0000","last_peered":"2024-02-16T00:12:54.683178+0000","last_clean":"2024-02-16T00:12:54.683178+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:54.683178+0000","last_undegraded":"2024-02-16T00:12:54.683178+0000","last_fullsized":"2024-02-16T00:12:54.683178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.683065+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:10.032872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458116+0000","last_change":"2024-02-16T00:11:12.833751+0000","last_active":"2024-02-16T00:12:39.458116+0000","last_peered":"2024-02-16T00:12:39.458116+0000","last_clean":"2024-02-16T00:12:39.458116+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:12:39.458116+0000","last_undegraded":"2024-02-16T00:12:39.458116+0000","last_fullsized":"2024-02-16T00:12:39.458116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.036881+0000","last_change":"2024-02-16T00:12:56.036881+0000","last_active":"2024-02-16T00:12:56.036881+0000","last_peered":"2024-02-16T00:12:56.036881+0000","last_clean":"2024-02-16T00:12:56.036881+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:56.036881+0000","last_undegraded":"2024-02-16T00:12:56.036881+0000","last_fullsized":"2024-02-16T00:12:56.036881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.036766+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:37:08.513561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:54.817958+0000","last_change":"2024-02-16T00:13:54.817982+0000","last_active":"2024-02-16T00:13:54.817958+0000","last_peered":"2024-02-16T00:13:54.817958+0000","last_clean":"2024-02-16T00:13:54.817958+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:13:54.817958+0000","last_undegraded":"2024-02-16T00:13:54.817958+0000","last_fullsized":"2024-02-16T00:13:54.817958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:54.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:54.817871+0000","last_clean_scrub_stamp":"2024-02-16T00:13:54.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:10:32.193736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.950979+0000","last_change":"2024-02-16T00:13:25.951007+0000","last_active":"2024-02-16T00:13:25.950979+0000","last_peered":"2024-02-16T00:13:25.950979+0000","last_clean":"2024-02-16T00:13:25.950979+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:13:25.950979+0000","last_undegraded":"2024-02-16T00:13:25.950979+0000","last_fullsized":"2024-02-16T00:13:25.950979+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.950886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.950886+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.950886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:53.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.031737+0000","last_change":"2024-02-16T00:12:42.031737+0000","last_active":"2024-02-16T00:12:42.031737+0000","last_peered":"2024-02-16T00:12:42.031737+0000","last_clean":"2024-02-16T00:12:42.031737+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:12:42.031737+0000","last_undegraded":"2024-02-16T00:12:42.031737+0000","last_fullsized":"2024-02-16T00:12:42.031737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.031605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:03.714051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.979307+0000","last_change":"2024-02-16T00:13:11.979307+0000","last_active":"2024-02-16T00:13:11.979307+0000","last_peered":"2024-02-16T00:13:11.979307+0000","last_clean":"2024-02-16T00:13:11.979307+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:13:11.979307+0000","last_undegraded":"2024-02-16T00:13:11.979307+0000","last_fullsized":"2024-02-16T00:13:11.979307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.979168+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.839816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'243","reported_seq":323,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.867290+0000","last_change":"2024-02-16T00:12:50.867290+0000","last_active":"2024-02-16T00:12:50.867290+0000","last_peered":"2024-02-16T00:12:50.867290+0000","last_clean":"2024-02-16T00:12:50.867290+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:50.867290+0000","last_undegraded":"2024-02-16T00:12:50.867290+0000","last_fullsized":"2024-02-16T00:12:50.867290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.867173+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:57.352373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.761485+0000","last_change":"2024-02-16T00:13:36.761541+0000","last_active":"2024-02-16T00:13:36.761485+0000","last_peered":"2024-02-16T00:13:36.761485+0000","last_clean":"2024-02-16T00:13:36.761485+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:13:36.761485+0000","last_undegraded":"2024-02-16T00:13:36.761485+0000","last_fullsized":"2024-02-16T00:13:36.761485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:36.761373+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:36.761373+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.761373+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:09.020019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.178067+0000","last_change":"2024-02-16T00:13:14.178092+0000","last_active":"2024-02-16T00:13:14.178067+0000","last_peered":"2024-02-16T00:13:14.178067+0000","last_clean":"2024-02-16T00:13:14.178067+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:13:14.178067+0000","last_undegraded":"2024-02-16T00:13:14.178067+0000","last_fullsized":"2024-02-16T00:13:14.178067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.177977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:57.854662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.707210+0000","last_change":"2024-02-16T00:13:27.707247+0000","last_active":"2024-02-16T00:13:27.707210+0000","last_peered":"2024-02-16T00:13:27.707210+0000","last_clean":"2024-02-16T00:13:27.707210+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:13:27.707210+0000","last_undegraded":"2024-02-16T00:13:27.707210+0000","last_fullsized":"2024-02-16T00:13:27.707210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:27.707110+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:27.707110+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.707110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:55.295504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:50.839763+0000","last_change":"2024-02-16T00:13:50.839785+0000","last_active":"2024-02-16T00:13:50.839763+0000","last_peered":"2024-02-16T00:13:50.839763+0000","last_clean":"2024-02-16T00:13:50.839763+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:13:50.839763+0000","last_undegraded":"2024-02-16T00:13:50.839763+0000","last_fullsized":"2024-02-16T00:13:50.839763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:50.839675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:50.839675+0000","last_clean_scrub_stamp":"2024-02-16T00:13:50.839675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:32.750449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.021889+0000","last_change":"2024-02-16T00:12:41.021889+0000","last_active":"2024-02-16T00:12:41.021889+0000","last_peered":"2024-02-16T00:12:41.021889+0000","last_clean":"2024-02-16T00:12:41.021889+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:12:41.021889+0000","last_undegraded":"2024-02-16T00:12:41.021889+0000","last_fullsized":"2024-02-16T00:12:41.021889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.021775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:07.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'97","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.111041+0000","last_change":"2024-02-16T00:12:52.111041+0000","last_active":"2024-02-16T00:12:52.111041+0000","last_peered":"2024-02-16T00:12:52.111041+0000","last_clean":"2024-02-16T00:12:52.111041+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:52.111041+0000","last_undegraded":"2024-02-16T00:12:52.111041+0000","last_fullsized":"2024-02-16T00:12:52.111041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'97","last_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_deep_scrub":"29'97","last_deep_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.110898+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:30.300620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.913378+0000","last_change":"2024-02-16T00:13:02.913378+0000","last_active":"2024-02-16T00:13:02.913378+0000","last_peered":"2024-02-16T00:13:02.913378+0000","last_clean":"2024-02-16T00:13:02.913378+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:13:02.913378+0000","last_undegraded":"2024-02-16T00:13:02.913378+0000","last_fullsized":"2024-02-16T00:13:02.913378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.913264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:45.929231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.193822+0000","last_change":"2024-02-16T00:13:02.193822+0000","last_active":"2024-02-16T00:13:02.193822+0000","last_peered":"2024-02-16T00:13:02.193822+0000","last_clean":"2024-02-16T00:13:02.193822+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:13:02.193822+0000","last_undegraded":"2024-02-16T00:13:02.193822+0000","last_fullsized":"2024-02-16T00:13:02.193822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.193681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:17.543487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.291822+0000","last_change":"2024-02-16T00:13:29.291852+0000","last_active":"2024-02-16T00:13:29.291822+0000","last_peered":"2024-02-16T00:13:29.291822+0000","last_clean":"2024-02-16T00:13:29.291822+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:13:29.291822+0000","last_undegraded":"2024-02-16T00:13:29.291822+0000","last_fullsized":"2024-02-16T00:13:29.291822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:29.291739+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:29.291739+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.291739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:54.517083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.185628+0000","last_change":"2024-02-16T00:13:18.185628+0000","last_active":"2024-02-16T00:13:18.185628+0000","last_peered":"2024-02-16T00:13:18.185628+0000","last_clean":"2024-02-16T00:13:18.185628+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:13:18.185628+0000","last_undegraded":"2024-02-16T00:13:18.185628+0000","last_fullsized":"2024-02-16T00:13:18.185628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.185505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:49.777334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:44.025093+0000","last_change":"2024-02-16T00:13:44.025116+0000","last_active":"2024-02-16T00:13:44.025093+0000","last_peered":"2024-02-16T00:13:44.025093+0000","last_clean":"2024-02-16T00:13:44.025093+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:13:44.025093+0000","last_undegraded":"2024-02-16T00:13:44.025093+0000","last_fullsized":"2024-02-16T00:13:44.025093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:44.025000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:44.025000+0000","last_clean_scrub_stamp":"2024-02-16T00:13:44.025000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:05:41.110252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"29'2","reported_seq":204,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.629040+0000","last_change":"2024-02-16T00:12:52.629040+0000","last_active":"2024-02-16T00:12:52.629040+0000","last_peered":"2024-02-16T00:12:52.629040+0000","last_clean":"2024-02-16T00:12:52.629040+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:52.629040+0000","last_undegraded":"2024-02-16T00:12:52.629040+0000","last_fullsized":"2024-02-16T00:12:52.629040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.628926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:49.990836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'45","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.017778+0000","last_change":"2024-02-16T00:13:09.017778+0000","last_active":"2024-02-16T00:13:09.017778+0000","last_peered":"2024-02-16T00:13:09.017778+0000","last_clean":"2024-02-16T00:13:09.017778+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:13:09.017778+0000","last_undegraded":"2024-02-16T00:13:09.017778+0000","last_fullsized":"2024-02-16T00:13:09.017778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.017638+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:00.113238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.985144+0000","last_change":"2024-02-16T00:13:14.985144+0000","last_active":"2024-02-16T00:13:14.985144+0000","last_peered":"2024-02-16T00:13:14.985144+0000","last_clean":"2024-02-16T00:13:14.985144+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:13:14.985144+0000","last_undegraded":"2024-02-16T00:13:14.985144+0000","last_fullsized":"2024-02-16T00:13:14.985144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.985010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:26.901071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.788597+0000","last_change":"2024-02-16T00:13:06.788597+0000","last_active":"2024-02-16T00:13:06.788597+0000","last_peered":"2024-02-16T00:13:06.788597+0000","last_clean":"2024-02-16T00:13:06.788597+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:13:06.788597+0000","last_undegraded":"2024-02-16T00:13:06.788597+0000","last_fullsized":"2024-02-16T00:13:06.788597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.788487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:05.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.329252+0000","last_change":"2024-02-16T00:13:34.329280+0000","last_active":"2024-02-16T00:13:34.329252+0000","last_peered":"2024-02-16T00:13:34.329252+0000","last_clean":"2024-02-16T00:13:34.329252+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:13:34.329252+0000","last_undegraded":"2024-02-16T00:13:34.329252+0000","last_fullsized":"2024-02-16T00:13:34.329252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-02-16T00:13:34.329155+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-02-16T00:13:34.329155+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.329155+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:55.927835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.263698+0000","last_change":"2024-02-16T00:13:23.263698+0000","last_active":"2024-02-16T00:13:23.263698+0000","last_peered":"2024-02-16T00:13:23.263698+0000","last_clean":"2024-02-16T00:13:23.263698+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:13:23.263698+0000","last_undegraded":"2024-02-16T00:13:23.263698+0000","last_fullsized":"2024-02-16T00:13:23.263698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.263575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.263575+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.263575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:11.087871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.045412+0000","last_change":"2024-02-16T00:12:40.045412+0000","last_active":"2024-02-16T00:12:40.045412+0000","last_peered":"2024-02-16T00:12:40.045412+0000","last_clean":"2024-02-16T00:12:40.045412+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:12:40.045412+0000","last_undegraded":"2024-02-16T00:12:40.045412+0000","last_fullsized":"2024-02-16T00:12:40.045412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.045296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:50.821845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.941093+0000","last_change":"2024-02-16T00:12:45.941093+0000","last_active":"2024-02-16T00:12:45.941093+0000","last_peered":"2024-02-16T00:12:45.941093+0000","last_clean":"2024-02-16T00:12:45.941093+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:45.941093+0000","last_undegraded":"2024-02-16T00:12:45.941093+0000","last_fullsized":"2024-02-16T00:12:45.941093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.940956+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:12.093182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.279177+0000","last_change":"2024-02-16T00:12:43.279177+0000","last_active":"2024-02-16T00:12:43.279177+0000","last_peered":"2024-02-16T00:12:43.279177+0000","last_clean":"2024-02-16T00:12:43.279177+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:12:43.279177+0000","last_undegraded":"2024-02-16T00:12:43.279177+0000","last_fullsized":"2024-02-16T00:12:43.279177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.279059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:05.341803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.908872+0000","last_change":"2024-02-16T00:13:38.908872+0000","last_active":"2024-02-16T00:13:38.908872+0000","last_peered":"2024-02-16T00:13:38.908872+0000","last_clean":"2024-02-16T00:13:38.908872+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:13:38.908872+0000","last_undegraded":"2024-02-16T00:13:38.908872+0000","last_fullsized":"2024-02-16T00:13:38.908872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:38.908707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:38.908707+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.908707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:16.697067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.767257+0000","last_change":"2024-02-16T00:13:14.767257+0000","last_active":"2024-02-16T00:13:14.767257+0000","last_peered":"2024-02-16T00:13:14.767257+0000","last_clean":"2024-02-16T00:13:14.767257+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:13:14.767257+0000","last_undegraded":"2024-02-16T00:13:14.767257+0000","last_fullsized":"2024-02-16T00:13:14.767257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.767144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:02.591440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.213509+0000","last_change":"2024-02-16T00:13:19.213509+0000","last_active":"2024-02-16T00:13:19.213509+0000","last_peered":"2024-02-16T00:13:19.213509+0000","last_clean":"2024-02-16T00:13:19.213509+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:13:19.213509+0000","last_undegraded":"2024-02-16T00:13:19.213509+0000","last_fullsized":"2024-02-16T00:13:19.213509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.213392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.213392+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.213392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:11.599146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.057565+0000","last_change":"2024-02-16T00:12:56.057565+0000","last_active":"2024-02-16T00:12:56.057565+0000","last_peered":"2024-02-16T00:12:56.057565+0000","last_clean":"2024-02-16T00:12:56.057565+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:12:56.057565+0000","last_undegraded":"2024-02-16T00:12:56.057565+0000","last_fullsized":"2024-02-16T00:12:56.057565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.057413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:26.439361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.803076+0000","last_change":"2024-02-16T00:12:52.803076+0000","last_active":"2024-02-16T00:12:52.803076+0000","last_peered":"2024-02-16T00:12:52.803076+0000","last_clean":"2024-02-16T00:12:52.803076+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:52.803076+0000","last_undegraded":"2024-02-16T00:12:52.803076+0000","last_fullsized":"2024-02-16T00:12:52.803076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.802940+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:55.924565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.555567+0000","last_change":"2024-02-16T00:12:50.555567+0000","last_active":"2024-02-16T00:12:50.555567+0000","last_peered":"2024-02-16T00:12:50.555567+0000","last_clean":"2024-02-16T00:12:50.555567+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:12:50.555567+0000","last_undegraded":"2024-02-16T00:12:50.555567+0000","last_fullsized":"2024-02-16T00:12:50.555567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.555443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:51.432013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.079543+0000","last_change":"2024-02-16T00:13:27.079543+0000","last_active":"2024-02-16T00:13:27.079543+0000","last_peered":"2024-02-16T00:13:27.079543+0000","last_clean":"2024-02-16T00:13:27.079543+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:13:27.079543+0000","last_undegraded":"2024-02-16T00:13:27.079543+0000","last_fullsized":"2024-02-16T00:13:27.079543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:27.079415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:27.079415+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.079415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:34:32.883445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.080743+0000","last_change":"2024-02-16T00:12:57.080743+0000","last_active":"2024-02-16T00:12:57.080743+0000","last_peered":"2024-02-16T00:12:57.080743+0000","last_clean":"2024-02-16T00:12:57.080743+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:12:57.080743+0000","last_undegraded":"2024-02-16T00:12:57.080743+0000","last_fullsized":"2024-02-16T00:12:57.080743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.080604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:49.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.661262+0000","last_change":"2024-02-16T00:13:23.661262+0000","last_active":"2024-02-16T00:13:23.661262+0000","last_peered":"2024-02-16T00:13:23.661262+0000","last_clean":"2024-02-16T00:13:23.661262+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:13:23.661262+0000","last_undegraded":"2024-02-16T00:13:23.661262+0000","last_fullsized":"2024-02-16T00:13:23.661262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:23.661125+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:23.661125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.661125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:43.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.884373+0000","last_change":"2024-02-16T00:12:49.884373+0000","last_active":"2024-02-16T00:12:49.884373+0000","last_peered":"2024-02-16T00:12:49.884373+0000","last_clean":"2024-02-16T00:12:49.884373+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:12:49.884373+0000","last_undegraded":"2024-02-16T00:12:49.884373+0000","last_fullsized":"2024-02-16T00:12:49.884373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.884258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:21.476087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'34","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.114102+0000","last_change":"2024-02-16T00:12:53.114102+0000","last_active":"2024-02-16T00:12:53.114102+0000","last_peered":"2024-02-16T00:12:53.114102+0000","last_clean":"2024-02-16T00:12:53.114102+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:53.114102+0000","last_undegraded":"2024-02-16T00:12:53.114102+0000","last_fullsized":"2024-02-16T00:12:53.114102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.113947+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:53.697900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.267908+0000","last_change":"2024-02-16T00:12:44.267908+0000","last_active":"2024-02-16T00:12:44.267908+0000","last_peered":"2024-02-16T00:12:44.267908+0000","last_clean":"2024-02-16T00:12:44.267908+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:12:44.267908+0000","last_undegraded":"2024-02-16T00:12:44.267908+0000","last_fullsized":"2024-02-16T00:12:44.267908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.267784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:28:21.260343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.096086+0000","last_change":"2024-02-16T00:13:28.096116+0000","last_active":"2024-02-16T00:13:28.096086+0000","last_peered":"2024-02-16T00:13:28.096086+0000","last_clean":"2024-02-16T00:13:28.096086+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:13:28.096086+0000","last_undegraded":"2024-02-16T00:13:28.096086+0000","last_fullsized":"2024-02-16T00:13:28.096086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-02-16T00:13:28.095997+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-02-16T00:13:28.095997+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.095997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:51.772323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:44.987426+0000","last_change":"2024-02-16T00:13:44.987456+0000","last_active":"2024-02-16T00:13:44.987426+0000","last_peered":"2024-02-16T00:13:44.987426+0000","last_clean":"2024-02-16T00:13:44.987426+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:13:44.987426+0000","last_undegraded":"2024-02-16T00:13:44.987426+0000","last_fullsized":"2024-02-16T00:13:44.987426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:44.987331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:44.987331+0000","last_clean_scrub_stamp":"2024-02-16T00:13:44.987331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:03.437870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.805078+0000","last_change":"2024-02-16T00:12:57.805078+0000","last_active":"2024-02-16T00:12:57.805078+0000","last_peered":"2024-02-16T00:12:57.805078+0000","last_clean":"2024-02-16T00:12:57.805078+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:12:57.805078+0000","last_undegraded":"2024-02-16T00:12:57.805078+0000","last_fullsized":"2024-02-16T00:12:57.805078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.804963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:37.236667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'67","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.901456+0000","last_change":"2024-02-16T00:12:47.901456+0000","last_active":"2024-02-16T00:12:47.901456+0000","last_peered":"2024-02-16T00:12:47.901456+0000","last_clean":"2024-02-16T00:12:47.901456+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:47.901456+0000","last_undegraded":"2024-02-16T00:12:47.901456+0000","last_fullsized":"2024-02-16T00:12:47.901456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.901291+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:48.763246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.239756+0000","last_change":"2024-02-16T00:12:45.239756+0000","last_active":"2024-02-16T00:12:45.239756+0000","last_peered":"2024-02-16T00:12:45.239756+0000","last_clean":"2024-02-16T00:12:45.239756+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:12:45.239756+0000","last_undegraded":"2024-02-16T00:12:45.239756+0000","last_fullsized":"2024-02-16T00:12:45.239756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.239638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:12.913457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.903756+0000","last_change":"2024-02-16T00:13:36.903783+0000","last_active":"2024-02-16T00:13:36.903756+0000","last_peered":"2024-02-16T00:13:36.903756+0000","last_clean":"2024-02-16T00:13:36.903756+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:13:36.903756+0000","last_undegraded":"2024-02-16T00:13:36.903756+0000","last_fullsized":"2024-02-16T00:13:36.903756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:36.903666+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:36.903666+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.903666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:54.251517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.800160+0000","last_change":"2024-02-16T00:13:12.800216+0000","last_active":"2024-02-16T00:13:12.800160+0000","last_peered":"2024-02-16T00:13:12.800160+0000","last_clean":"2024-02-16T00:13:12.800160+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:13:12.800160+0000","last_undegraded":"2024-02-16T00:13:12.800160+0000","last_fullsized":"2024-02-16T00:13:12.800160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.800049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:49.109384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.660012+0000","last_change":"2024-02-16T00:13:19.660012+0000","last_active":"2024-02-16T00:13:19.660012+0000","last_peered":"2024-02-16T00:13:19.660012+0000","last_clean":"2024-02-16T00:13:19.660012+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:13:19.660012+0000","last_undegraded":"2024-02-16T00:13:19.660012+0000","last_fullsized":"2024-02-16T00:13:19.660012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.659900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.659900+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.659900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:41.558813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.155308+0000","last_change":"2024-02-16T00:13:00.155308+0000","last_active":"2024-02-16T00:13:00.155308+0000","last_peered":"2024-02-16T00:13:00.155308+0000","last_clean":"2024-02-16T00:13:00.155308+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:13:00.155308+0000","last_undegraded":"2024-02-16T00:13:00.155308+0000","last_fullsized":"2024-02-16T00:13:00.155308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.155119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:57.517028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.019925+0000","last_change":"2024-02-16T00:13:08.019925+0000","last_active":"2024-02-16T00:13:08.019925+0000","last_peered":"2024-02-16T00:13:08.019925+0000","last_clean":"2024-02-16T00:13:08.019925+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:13:08.019925+0000","last_undegraded":"2024-02-16T00:13:08.019925+0000","last_fullsized":"2024-02-16T00:13:08.019925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.019795+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:01.526130+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.644040+0000","last_change":"2024-02-16T00:12:58.644040+0000","last_active":"2024-02-16T00:12:58.644040+0000","last_peered":"2024-02-16T00:12:58.644040+0000","last_clean":"2024-02-16T00:12:58.644040+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:12:58.644040+0000","last_undegraded":"2024-02-16T00:12:58.644040+0000","last_fullsized":"2024-02-16T00:12:58.644040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.643930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:14.513005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458139+0000","last_change":"2024-02-16T00:11:12.832677+0000","last_active":"2024-02-16T00:12:39.458139+0000","last_peered":"2024-02-16T00:12:39.458139+0000","last_clean":"2024-02-16T00:12:39.458139+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:12:39.458139+0000","last_undegraded":"2024-02-16T00:12:39.458139+0000","last_fullsized":"2024-02-16T00:12:39.458139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.909416+0000","last_change":"2024-02-16T00:12:51.909416+0000","last_active":"2024-02-16T00:12:51.909416+0000","last_peered":"2024-02-16T00:12:51.909416+0000","last_clean":"2024-02-16T00:12:51.909416+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:12:51.909416+0000","last_undegraded":"2024-02-16T00:12:51.909416+0000","last_fullsized":"2024-02-16T00:12:51.909416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.909268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:23.726726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.724889+0000","last_change":"2024-02-16T00:13:25.724889+0000","last_active":"2024-02-16T00:13:25.724889+0000","last_peered":"2024-02-16T00:13:25.724889+0000","last_clean":"2024-02-16T00:13:25.724889+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:13:25.724889+0000","last_undegraded":"2024-02-16T00:13:25.724889+0000","last_fullsized":"2024-02-16T00:13:25.724889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.724773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.724773+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.724773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.014119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.196573+0000","last_change":"2024-02-16T00:13:03.196573+0000","last_active":"2024-02-16T00:13:03.196573+0000","last_peered":"2024-02-16T00:13:03.196573+0000","last_clean":"2024-02-16T00:13:03.196573+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:13:03.196573+0000","last_undegraded":"2024-02-16T00:13:03.196573+0000","last_fullsized":"2024-02-16T00:13:03.196573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.196453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:01.366669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.821474+0000","last_change":"2024-02-16T00:12:51.821474+0000","last_active":"2024-02-16T00:12:51.821474+0000","last_peered":"2024-02-16T00:12:51.821474+0000","last_clean":"2024-02-16T00:12:51.821474+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:51.821474+0000","last_undegraded":"2024-02-16T00:12:51.821474+0000","last_fullsized":"2024-02-16T00:12:51.821474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.821350+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:13:29.475897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.806808+0000","last_change":"2024-02-16T00:12:54.806808+0000","last_active":"2024-02-16T00:12:54.806808+0000","last_peered":"2024-02-16T00:12:54.806808+0000","last_clean":"2024-02-16T00:12:54.806808+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:12:54.806808+0000","last_undegraded":"2024-02-16T00:12:54.806808+0000","last_fullsized":"2024-02-16T00:12:54.806808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.806699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:52.208925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458122+0000","last_change":"2024-02-16T00:11:12.832827+0000","last_active":"2024-02-16T00:12:39.458122+0000","last_peered":"2024-02-16T00:12:39.458122+0000","last_clean":"2024-02-16T00:12:39.458122+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:12:39.458122+0000","last_undegraded":"2024-02-16T00:12:39.458122+0000","last_fullsized":"2024-02-16T00:12:39.458122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.850574+0000","last_change":"2024-02-16T00:13:20.850574+0000","last_active":"2024-02-16T00:13:20.850574+0000","last_peered":"2024-02-16T00:13:20.850574+0000","last_clean":"2024-02-16T00:13:20.850574+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:13:20.850574+0000","last_undegraded":"2024-02-16T00:13:20.850574+0000","last_fullsized":"2024-02-16T00:13:20.850574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:20.850447+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:20.850447+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.850447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:49.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:55.860553+0000","last_change":"2024-02-16T00:13:55.860587+0000","last_active":"2024-02-16T00:13:55.860553+0000","last_peered":"2024-02-16T00:13:55.860553+0000","last_clean":"2024-02-16T00:13:55.860553+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:13:55.860553+0000","last_undegraded":"2024-02-16T00:13:55.860553+0000","last_fullsized":"2024-02-16T00:13:55.860553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:55.860434+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:55.860434+0000","last_clean_scrub_stamp":"2024-02-16T00:13:55.860434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:31.029705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.635127+0000","last_change":"2024-02-16T00:12:56.635127+0000","last_active":"2024-02-16T00:12:56.635127+0000","last_peered":"2024-02-16T00:12:56.635127+0000","last_clean":"2024-02-16T00:12:56.635127+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:12:56.635127+0000","last_undegraded":"2024-02-16T00:12:56.635127+0000","last_fullsized":"2024-02-16T00:12:56.635127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.634994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:54.037220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.029345+0000","last_change":"2024-02-16T00:12:59.029345+0000","last_active":"2024-02-16T00:12:59.029345+0000","last_peered":"2024-02-16T00:12:59.029345+0000","last_clean":"2024-02-16T00:12:59.029345+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:12:59.029345+0000","last_undegraded":"2024-02-16T00:12:59.029345+0000","last_fullsized":"2024-02-16T00:12:59.029345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.029179+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:59.276538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'243","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.288308+0000","last_change":"2024-02-16T00:12:42.288308+0000","last_active":"2024-02-16T00:12:42.288308+0000","last_peered":"2024-02-16T00:12:42.288308+0000","last_clean":"2024-02-16T00:12:42.288308+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:42.288308+0000","last_undegraded":"2024-02-16T00:12:42.288308+0000","last_fullsized":"2024-02-16T00:12:42.288308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.288179+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:49.835119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.027246+0000","last_change":"2024-02-16T00:13:31.027246+0000","last_active":"2024-02-16T00:13:31.027246+0000","last_peered":"2024-02-16T00:13:31.027246+0000","last_clean":"2024-02-16T00:13:31.027246+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:13:31.027246+0000","last_undegraded":"2024-02-16T00:13:31.027246+0000","last_fullsized":"2024-02-16T00:13:31.027246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.027119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.027119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.027119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.388109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.183094+0000","last_change":"2024-02-16T00:13:04.183094+0000","last_active":"2024-02-16T00:13:04.183094+0000","last_peered":"2024-02-16T00:13:04.183094+0000","last_clean":"2024-02-16T00:13:04.183094+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:13:04.183094+0000","last_undegraded":"2024-02-16T00:13:04.183094+0000","last_fullsized":"2024-02-16T00:13:04.183094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.182975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:01.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.721955+0000","last_change":"2024-02-16T00:13:31.721955+0000","last_active":"2024-02-16T00:13:31.721955+0000","last_peered":"2024-02-16T00:13:31.721955+0000","last_clean":"2024-02-16T00:13:31.721955+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:13:31.721955+0000","last_undegraded":"2024-02-16T00:13:31.721955+0000","last_fullsized":"2024-02-16T00:13:31.721955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:31.721779+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:31.721779+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.721779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:40.361580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.582387+0000","last_change":"2024-02-16T00:12:51.582387+0000","last_active":"2024-02-16T00:12:51.582387+0000","last_peered":"2024-02-16T00:12:51.582387+0000","last_clean":"2024-02-16T00:12:51.582387+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:12:51.582387+0000","last_undegraded":"2024-02-16T00:12:51.582387+0000","last_fullsized":"2024-02-16T00:12:51.582387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.582242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:29.436735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'73","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.419632+0000","last_change":"2024-02-16T00:12:44.419632+0000","last_active":"2024-02-16T00:12:44.419632+0000","last_peered":"2024-02-16T00:12:44.419632+0000","last_clean":"2024-02-16T00:12:44.419632+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:44.419632+0000","last_undegraded":"2024-02-16T00:12:44.419632+0000","last_fullsized":"2024-02-16T00:12:44.419632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.419516+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:22.507611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.985037+0000","last_change":"2024-02-16T00:12:44.985037+0000","last_active":"2024-02-16T00:12:44.985037+0000","last_peered":"2024-02-16T00:12:44.985037+0000","last_clean":"2024-02-16T00:12:44.985037+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:12:44.985037+0000","last_undegraded":"2024-02-16T00:12:44.985037+0000","last_fullsized":"2024-02-16T00:12:44.985037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.984923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.568877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.725049+0000","last_change":"2024-02-16T00:13:33.725049+0000","last_active":"2024-02-16T00:13:33.725049+0000","last_peered":"2024-02-16T00:13:33.725049+0000","last_clean":"2024-02-16T00:13:33.725049+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:13:33.725049+0000","last_undegraded":"2024-02-16T00:13:33.725049+0000","last_fullsized":"2024-02-16T00:13:33.725049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:33.724914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:33.724914+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.724914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:31.664833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.234145+0000","last_change":"2024-02-16T00:13:10.234145+0000","last_active":"2024-02-16T00:13:10.234145+0000","last_peered":"2024-02-16T00:13:10.234145+0000","last_clean":"2024-02-16T00:13:10.234145+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:13:10.234145+0000","last_undegraded":"2024-02-16T00:13:10.234145+0000","last_fullsized":"2024-02-16T00:13:10.234145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.234022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.916468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.010682+0000","last_change":"2024-02-16T00:13:34.010708+0000","last_active":"2024-02-16T00:13:34.010682+0000","last_peered":"2024-02-16T00:13:34.010682+0000","last_clean":"2024-02-16T00:13:34.010682+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:13:34.010682+0000","last_undegraded":"2024-02-16T00:13:34.010682+0000","last_fullsized":"2024-02-16T00:13:34.010682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:34.010590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:34.010590+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.010590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:26.871007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"29'5","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.021341+0000","last_change":"2024-02-16T00:12:57.021341+0000","last_active":"2024-02-16T00:12:57.021341+0000","last_peered":"2024-02-16T00:12:57.021341+0000","last_clean":"2024-02-16T00:12:57.021341+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:57.021341+0000","last_undegraded":"2024-02-16T00:12:57.021341+0000","last_fullsized":"2024-02-16T00:12:57.021341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.021207+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:57.897777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'43","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.929840+0000","last_change":"2024-02-16T00:12:48.929840+0000","last_active":"2024-02-16T00:12:48.929840+0000","last_peered":"2024-02-16T00:12:48.929840+0000","last_clean":"2024-02-16T00:12:48.929840+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:48.929840+0000","last_undegraded":"2024-02-16T00:12:48.929840+0000","last_fullsized":"2024-02-16T00:12:48.929840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.929717+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:22:28.327582+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.044584+0000","last_change":"2024-02-16T00:13:04.044584+0000","last_active":"2024-02-16T00:13:04.044584+0000","last_peered":"2024-02-16T00:13:04.044584+0000","last_clean":"2024-02-16T00:13:04.044584+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:13:04.044584+0000","last_undegraded":"2024-02-16T00:13:04.044584+0000","last_fullsized":"2024-02-16T00:13:04.044584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.044474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:49.333820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.064655+0000","last_change":"2024-02-16T00:13:19.064655+0000","last_active":"2024-02-16T00:13:19.064655+0000","last_peered":"2024-02-16T00:13:19.064655+0000","last_clean":"2024-02-16T00:13:19.064655+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:13:19.064655+0000","last_undegraded":"2024-02-16T00:13:19.064655+0000","last_fullsized":"2024-02-16T00:13:19.064655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.064537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.064537+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.064537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:36.412388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.067648+0000","last_change":"2024-02-16T00:13:21.067648+0000","last_active":"2024-02-16T00:13:21.067648+0000","last_peered":"2024-02-16T00:13:21.067648+0000","last_clean":"2024-02-16T00:13:21.067648+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:13:21.067648+0000","last_undegraded":"2024-02-16T00:13:21.067648+0000","last_fullsized":"2024-02-16T00:13:21.067648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:21.067525+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:21.067525+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.067525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:11.711126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.888247+0000","last_change":"2024-02-16T00:13:19.888276+0000","last_active":"2024-02-16T00:13:19.888247+0000","last_peered":"2024-02-16T00:13:19.888247+0000","last_clean":"2024-02-16T00:13:19.888247+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:13:19.888247+0000","last_undegraded":"2024-02-16T00:13:19.888247+0000","last_fullsized":"2024-02-16T00:13:19.888247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.888155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.888155+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.888155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.113499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.487257+0000","last_change":"2024-02-16T00:12:47.487257+0000","last_active":"2024-02-16T00:12:47.487257+0000","last_peered":"2024-02-16T00:12:47.487257+0000","last_clean":"2024-02-16T00:12:47.487257+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:12:47.487257+0000","last_undegraded":"2024-02-16T00:12:47.487257+0000","last_fullsized":"2024-02-16T00:12:47.487257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.487142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:48.071095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'36","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.996296+0000","last_change":"2024-02-16T00:12:54.996296+0000","last_active":"2024-02-16T00:12:54.996296+0000","last_peered":"2024-02-16T00:12:54.996296+0000","last_clean":"2024-02-16T00:12:54.996296+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:54.996296+0000","last_undegraded":"2024-02-16T00:12:54.996296+0000","last_fullsized":"2024-02-16T00:12:54.996296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.996158+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:24.457006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.982002+0000","last_change":"2024-02-16T00:13:10.982002+0000","last_active":"2024-02-16T00:13:10.982002+0000","last_peered":"2024-02-16T00:13:10.982002+0000","last_clean":"2024-02-16T00:13:10.982002+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:13:10.982002+0000","last_undegraded":"2024-02-16T00:13:10.982002+0000","last_fullsized":"2024-02-16T00:13:10.982002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:09.819667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.458188+0000","last_change":"2024-02-16T00:11:12.833775+0000","last_active":"2024-02-16T00:12:39.458188+0000","last_peered":"2024-02-16T00:12:39.458188+0000","last_clean":"2024-02-16T00:12:39.458188+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:12:39.458188+0000","last_undegraded":"2024-02-16T00:12:39.458188+0000","last_fullsized":"2024-02-16T00:12:39.458188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:11:11.806372+0000","last_clean_scrub_stamp":"2024-02-16T00:11:11.806372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.188599+0000","last_change":"2024-02-16T00:13:05.188599+0000","last_active":"2024-02-16T00:13:05.188599+0000","last_peered":"2024-02-16T00:13:05.188599+0000","last_clean":"2024-02-16T00:13:05.188599+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:13:05.188599+0000","last_undegraded":"2024-02-16T00:13:05.188599+0000","last_fullsized":"2024-02-16T00:13:05.188599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.188488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:37.525070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.673914+0000","last_change":"2024-02-16T00:13:21.673945+0000","last_active":"2024-02-16T00:13:21.673914+0000","last_peered":"2024-02-16T00:13:21.673914+0000","last_clean":"2024-02-16T00:13:21.673914+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:13:21.673914+0000","last_undegraded":"2024-02-16T00:13:21.673914+0000","last_fullsized":"2024-02-16T00:13:21.673914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:21.673810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:21.673810+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.673810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:21.921169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.549032+0000","last_change":"2024-02-16T00:12:49.549032+0000","last_active":"2024-02-16T00:12:49.549032+0000","last_peered":"2024-02-16T00:12:49.549032+0000","last_clean":"2024-02-16T00:12:49.549032+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:12:49.549032+0000","last_undegraded":"2024-02-16T00:12:49.549032+0000","last_fullsized":"2024-02-16T00:12:49.549032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.548866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:23:44.002627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'51","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.986591+0000","last_change":"2024-02-16T00:13:09.986591+0000","last_active":"2024-02-16T00:13:09.986591+0000","last_peered":"2024-02-16T00:13:09.986591+0000","last_clean":"2024-02-16T00:13:09.986591+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:13:09.986591+0000","last_undegraded":"2024-02-16T00:13:09.986591+0000","last_fullsized":"2024-02-16T00:13:09.986591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.986464+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:29:21.387242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.919234+0000","last_change":"2024-02-16T00:12:41.919234+0000","last_active":"2024-02-16T00:12:41.919234+0000","last_peered":"2024-02-16T00:12:41.919234+0000","last_clean":"2024-02-16T00:12:41.919234+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:12:41.919234+0000","last_undegraded":"2024-02-16T00:12:41.919234+0000","last_fullsized":"2024-02-16T00:12:41.919234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.919121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:20.007216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.085957+0000","last_change":"2024-02-16T00:13:23.085957+0000","last_active":"2024-02-16T00:13:23.085957+0000","last_peered":"2024-02-16T00:13:23.085957+0000","last_clean":"2024-02-16T00:13:23.085957+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:13:23.085957+0000","last_undegraded":"2024-02-16T00:13:23.085957+0000","last_fullsized":"2024-02-16T00:13:23.085957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.085805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.085805+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.085805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:48.122611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.556771+0000","last_change":"2024-02-16T00:13:05.556771+0000","last_active":"2024-02-16T00:13:05.556771+0000","last_peered":"2024-02-16T00:13:05.556771+0000","last_clean":"2024-02-16T00:13:05.556771+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:13:05.556771+0000","last_undegraded":"2024-02-16T00:13:05.556771+0000","last_fullsized":"2024-02-16T00:13:05.556771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.556664+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:11.578783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.247747+0000","last_change":"2024-02-16T00:13:07.247747+0000","last_active":"2024-02-16T00:13:07.247747+0000","last_peered":"2024-02-16T00:13:07.247747+0000","last_clean":"2024-02-16T00:13:07.247747+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:13:07.247747+0000","last_undegraded":"2024-02-16T00:13:07.247747+0000","last_fullsized":"2024-02-16T00:13:07.247747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.247620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:46.679324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.927236+0000","last_change":"2024-02-16T00:13:22.927266+0000","last_active":"2024-02-16T00:13:22.927236+0000","last_peered":"2024-02-16T00:13:22.927236+0000","last_clean":"2024-02-16T00:13:22.927236+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:13:22.927236+0000","last_undegraded":"2024-02-16T00:13:22.927236+0000","last_fullsized":"2024-02-16T00:13:22.927236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:22.927156+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:22.927156+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.927156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:35.487431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.776378+0000","last_change":"2024-02-16T00:13:09.776405+0000","last_active":"2024-02-16T00:13:09.776378+0000","last_peered":"2024-02-16T00:13:09.776378+0000","last_clean":"2024-02-16T00:13:09.776378+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:13:09.776378+0000","last_undegraded":"2024-02-16T00:13:09.776378+0000","last_fullsized":"2024-02-16T00:13:09.776378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.776278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:41.368106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.999252+0000","last_change":"2024-02-16T00:12:59.999252+0000","last_active":"2024-02-16T00:12:59.999252+0000","last_peered":"2024-02-16T00:12:59.999252+0000","last_clean":"2024-02-16T00:12:59.999252+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:59.999252+0000","last_undegraded":"2024-02-16T00:12:59.999252+0000","last_fullsized":"2024-02-16T00:12:59.999252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.999131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.804655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.099286+0000","last_change":"2024-02-16T00:13:29.099321+0000","last_active":"2024-02-16T00:13:29.099286+0000","last_peered":"2024-02-16T00:13:29.099286+0000","last_clean":"2024-02-16T00:13:29.099286+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:13:29.099286+0000","last_undegraded":"2024-02-16T00:13:29.099286+0000","last_fullsized":"2024-02-16T00:13:29.099286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.099164+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:51.091195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.853688+0000","last_change":"2024-02-16T00:13:18.853728+0000","last_active":"2024-02-16T00:13:18.853688+0000","last_peered":"2024-02-16T00:13:18.853688+0000","last_clean":"2024-02-16T00:13:18.853688+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:13:18.853688+0000","last_undegraded":"2024-02-16T00:13:18.853688+0000","last_fullsized":"2024-02-16T00:13:18.853688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:18.853579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:18.853579+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.853579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:21:17.955716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.959937+0000","last_change":"2024-02-16T00:13:27.959965+0000","last_active":"2024-02-16T00:13:27.959937+0000","last_peered":"2024-02-16T00:13:27.959937+0000","last_clean":"2024-02-16T00:13:27.959937+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:13:27.959937+0000","last_undegraded":"2024-02-16T00:13:27.959937+0000","last_fullsized":"2024-02-16T00:13:27.959937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:27.959842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:27.959842+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.959842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:15.208309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.878278+0000","last_change":"2024-02-16T00:13:04.878278+0000","last_active":"2024-02-16T00:13:04.878278+0000","last_peered":"2024-02-16T00:13:04.878278+0000","last_clean":"2024-02-16T00:13:04.878278+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:13:04.878278+0000","last_undegraded":"2024-02-16T00:13:04.878278+0000","last_fullsized":"2024-02-16T00:13:04.878278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.878154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.624777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.945083+0000","last_change":"2024-02-16T00:13:23.945108+0000","last_active":"2024-02-16T00:13:23.945083+0000","last_peered":"2024-02-16T00:13:23.945083+0000","last_clean":"2024-02-16T00:13:23.945083+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:13:23.945083+0000","last_undegraded":"2024-02-16T00:13:23.945083+0000","last_fullsized":"2024-02-16T00:13:23.945083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.944993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.944993+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.944993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:09.234339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.624499+0000","last_change":"2024-02-16T00:13:01.624499+0000","last_active":"2024-02-16T00:13:01.624499+0000","last_peered":"2024-02-16T00:13:01.624499+0000","last_clean":"2024-02-16T00:13:01.624499+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:13:01.624499+0000","last_undegraded":"2024-02-16T00:13:01.624499+0000","last_fullsized":"2024-02-16T00:13:01.624499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.624385+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:27.761857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.735349+0000","last_change":"2024-02-16T00:13:30.735377+0000","last_active":"2024-02-16T00:13:30.735349+0000","last_peered":"2024-02-16T00:13:30.735349+0000","last_clean":"2024-02-16T00:13:30.735349+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:13:30.735349+0000","last_undegraded":"2024-02-16T00:13:30.735349+0000","last_fullsized":"2024-02-16T00:13:30.735349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.735261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.735261+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.735261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:36.718371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.736968+0000","last_change":"2024-02-16T00:13:08.736968+0000","last_active":"2024-02-16T00:13:08.736968+0000","last_peered":"2024-02-16T00:13:08.736968+0000","last_clean":"2024-02-16T00:13:08.736968+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:13:08.736968+0000","last_undegraded":"2024-02-16T00:13:08.736968+0000","last_fullsized":"2024-02-16T00:13:08.736968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.736845+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:44.033579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.153427+0000","last_change":"2024-02-16T00:13:17.153454+0000","last_active":"2024-02-16T00:13:17.153427+0000","last_peered":"2024-02-16T00:13:17.153427+0000","last_clean":"2024-02-16T00:13:17.153427+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:13:17.153427+0000","last_undegraded":"2024-02-16T00:13:17.153427+0000","last_fullsized":"2024-02-16T00:13:17.153427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.153338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:45.706109+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.556358+0000","last_change":"2024-02-16T00:13:09.556358+0000","last_active":"2024-02-16T00:13:09.556358+0000","last_peered":"2024-02-16T00:13:09.556358+0000","last_clean":"2024-02-16T00:13:09.556358+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:13:09.556358+0000","last_undegraded":"2024-02-16T00:13:09.556358+0000","last_fullsized":"2024-02-16T00:13:09.556358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.556228+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:33.081661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.945782+0000","last_change":"2024-02-16T00:13:28.945842+0000","last_active":"2024-02-16T00:13:28.945782+0000","last_peered":"2024-02-16T00:13:28.945782+0000","last_clean":"2024-02-16T00:13:28.945782+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:13:28.945782+0000","last_undegraded":"2024-02-16T00:13:28.945782+0000","last_fullsized":"2024-02-16T00:13:28.945782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:28.945668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:28.945668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.945668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:34.928777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.632508+0000","last_change":"2024-02-16T00:13:18.632508+0000","last_active":"2024-02-16T00:13:18.632508+0000","last_peered":"2024-02-16T00:13:18.632508+0000","last_clean":"2024-02-16T00:13:18.632508+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:13:18.632508+0000","last_undegraded":"2024-02-16T00:13:18.632508+0000","last_fullsized":"2024-02-16T00:13:18.632508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.632397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:36.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.070899+0000","last_change":"2024-02-16T00:13:37.070930+0000","last_active":"2024-02-16T00:13:37.070899+0000","last_peered":"2024-02-16T00:13:37.070899+0000","last_clean":"2024-02-16T00:13:37.070899+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:13:37.070899+0000","last_undegraded":"2024-02-16T00:13:37.070899+0000","last_fullsized":"2024-02-16T00:13:37.070899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:37.070808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:37.070808+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.070808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:32.756372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.058665+0000","last_change":"2024-02-16T00:13:20.058665+0000","last_active":"2024-02-16T00:13:20.058665+0000","last_peered":"2024-02-16T00:13:20.058665+0000","last_clean":"2024-02-16T00:13:20.058665+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:13:20.058665+0000","last_undegraded":"2024-02-16T00:13:20.058665+0000","last_fullsized":"2024-02-16T00:13:20.058665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:20.058539+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:20.058539+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.058539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:48:43.050884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.959088+0000","last_change":"2024-02-16T00:13:26.959116+0000","last_active":"2024-02-16T00:13:26.959088+0000","last_peered":"2024-02-16T00:13:26.959088+0000","last_clean":"2024-02-16T00:13:26.959088+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:13:26.959088+0000","last_undegraded":"2024-02-16T00:13:26.959088+0000","last_fullsized":"2024-02-16T00:13:26.959088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.958995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.958995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.958995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:41.755010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.884620+0000","last_change":"2024-02-16T00:13:03.884620+0000","last_active":"2024-02-16T00:13:03.884620+0000","last_peered":"2024-02-16T00:13:03.884620+0000","last_clean":"2024-02-16T00:13:03.884620+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:13:03.884620+0000","last_undegraded":"2024-02-16T00:13:03.884620+0000","last_fullsized":"2024-02-16T00:13:03.884620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.884486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:09.906605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.726085+0000","last_change":"2024-02-16T00:13:28.726111+0000","last_active":"2024-02-16T00:13:28.726085+0000","last_peered":"2024-02-16T00:13:28.726085+0000","last_clean":"2024-02-16T00:13:28.726085+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:13:28.726085+0000","last_undegraded":"2024-02-16T00:13:28.726085+0000","last_fullsized":"2024-02-16T00:13:28.726085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:28.725987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:28.725987+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.725987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:43.522003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.581881+0000","last_change":"2024-02-16T00:13:11.581881+0000","last_active":"2024-02-16T00:13:11.581881+0000","last_peered":"2024-02-16T00:13:11.581881+0000","last_clean":"2024-02-16T00:13:11.581881+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:13:11.581881+0000","last_undegraded":"2024-02-16T00:13:11.581881+0000","last_fullsized":"2024-02-16T00:13:11.581881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.581768+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:19.215064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.683499+0000","last_change":"2024-02-16T00:13:26.683524+0000","last_active":"2024-02-16T00:13:26.683499+0000","last_peered":"2024-02-16T00:13:26.683499+0000","last_clean":"2024-02-16T00:13:26.683499+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:13:26.683499+0000","last_undegraded":"2024-02-16T00:13:26.683499+0000","last_fullsized":"2024-02-16T00:13:26.683499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.683411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.683411+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.683411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:48.282091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.642973+0000","last_change":"2024-02-16T00:12:57.642973+0000","last_active":"2024-02-16T00:12:57.642973+0000","last_peered":"2024-02-16T00:12:57.642973+0000","last_clean":"2024-02-16T00:12:57.642973+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:12:57.642973+0000","last_undegraded":"2024-02-16T00:12:57.642973+0000","last_fullsized":"2024-02-16T00:12:57.642973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.642852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:29.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:40.046065+0000","last_change":"2024-02-16T00:13:40.046094+0000","last_active":"2024-02-16T00:13:40.046065+0000","last_peered":"2024-02-16T00:13:40.046065+0000","last_clean":"2024-02-16T00:13:40.046065+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:13:40.046065+0000","last_undegraded":"2024-02-16T00:13:40.046065+0000","last_fullsized":"2024-02-16T00:13:40.046065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:40.045982+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:40.045982+0000","last_clean_scrub_stamp":"2024-02-16T00:13:40.045982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:27.710357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.734544+0000","last_change":"2024-02-16T00:13:32.734570+0000","last_active":"2024-02-16T00:13:32.734544+0000","last_peered":"2024-02-16T00:13:32.734544+0000","last_clean":"2024-02-16T00:13:32.734544+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:13:32.734544+0000","last_undegraded":"2024-02-16T00:13:32.734544+0000","last_fullsized":"2024-02-16T00:13:32.734544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:32.734457+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:32.734457+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.734457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:57:06.034129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:53.809680+0000","last_change":"2024-02-16T00:13:53.809705+0000","last_active":"2024-02-16T00:13:53.809680+0000","last_peered":"2024-02-16T00:13:53.809680+0000","last_clean":"2024-02-16T00:13:53.809680+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:13:53.809680+0000","last_undegraded":"2024-02-16T00:13:53.809680+0000","last_fullsized":"2024-02-16T00:13:53.809680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:53.809589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:53.809589+0000","last_clean_scrub_stamp":"2024-02-16T00:13:53.809589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:50.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.984512+0000","last_change":"2024-02-16T00:13:13.984512+0000","last_active":"2024-02-16T00:13:13.984512+0000","last_peered":"2024-02-16T00:13:13.984512+0000","last_clean":"2024-02-16T00:13:13.984512+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:13:13.984512+0000","last_undegraded":"2024-02-16T00:13:13.984512+0000","last_fullsized":"2024-02-16T00:13:13.984512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.984383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:31.856700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.197615+0000","last_change":"2024-02-16T00:13:15.197615+0000","last_active":"2024-02-16T00:13:15.197615+0000","last_peered":"2024-02-16T00:13:15.197615+0000","last_clean":"2024-02-16T00:13:15.197615+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:13:15.197615+0000","last_undegraded":"2024-02-16T00:13:15.197615+0000","last_fullsized":"2024-02-16T00:13:15.197615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.197470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:16.065697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.604882+0000","last_change":"2024-02-16T00:13:14.604882+0000","last_active":"2024-02-16T00:13:14.604882+0000","last_peered":"2024-02-16T00:13:14.604882+0000","last_clean":"2024-02-16T00:13:14.604882+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:13:14.604882+0000","last_undegraded":"2024-02-16T00:13:14.604882+0000","last_fullsized":"2024-02-16T00:13:14.604882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.604766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:57.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:47.915444+0000","last_change":"2024-02-16T00:13:47.915470+0000","last_active":"2024-02-16T00:13:47.915444+0000","last_peered":"2024-02-16T00:13:47.915444+0000","last_clean":"2024-02-16T00:13:47.915444+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:13:47.915444+0000","last_undegraded":"2024-02-16T00:13:47.915444+0000","last_fullsized":"2024-02-16T00:13:47.915444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:47.915352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:47.915352+0000","last_clean_scrub_stamp":"2024-02-16T00:13:47.915352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:47.570930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:46.903411+0000","last_change":"2024-02-16T00:13:46.903441+0000","last_active":"2024-02-16T00:13:46.903411+0000","last_peered":"2024-02-16T00:13:46.903411+0000","last_clean":"2024-02-16T00:13:46.903411+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:13:46.903411+0000","last_undegraded":"2024-02-16T00:13:46.903411+0000","last_fullsized":"2024-02-16T00:13:46.903411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:46.903316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:46.903316+0000","last_clean_scrub_stamp":"2024-02-16T00:13:46.903316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:08.574812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.783477+0000","last_change":"2024-02-16T00:13:10.783477+0000","last_active":"2024-02-16T00:13:10.783477+0000","last_peered":"2024-02-16T00:13:10.783477+0000","last_clean":"2024-02-16T00:13:10.783477+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:13:10.783477+0000","last_undegraded":"2024-02-16T00:13:10.783477+0000","last_fullsized":"2024-02-16T00:13:10.783477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.783361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:58.244265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.814276+0000","last_change":"2024-02-16T00:13:15.814276+0000","last_active":"2024-02-16T00:13:15.814276+0000","last_peered":"2024-02-16T00:13:15.814276+0000","last_clean":"2024-02-16T00:13:15.814276+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:13:15.814276+0000","last_undegraded":"2024-02-16T00:13:15.814276+0000","last_fullsized":"2024-02-16T00:13:15.814276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.814161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:27.336244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.581370+0000","last_change":"2024-02-16T00:13:04.581370+0000","last_active":"2024-02-16T00:13:04.581370+0000","last_peered":"2024-02-16T00:13:04.581370+0000","last_clean":"2024-02-16T00:13:04.581370+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:13:04.581370+0000","last_undegraded":"2024-02-16T00:13:04.581370+0000","last_fullsized":"2024-02-16T00:13:04.581370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.581244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:47.597212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1820,"num_read_kb":1574,"num_write":771,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1644,"ondisk_log_size":1644,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705703,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44072,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327768,"statfs":{"total":96636764160,"available":96591634432,"internally_reserved":0,"allocated":425984,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.33500000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.26100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.495,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.438},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.628,"15min":0.628},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Feb 16 00:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36599999999999999,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.34799999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.39700000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40600000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":966656,"data_stored":723796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52700000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.378,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48099999999999998,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.311}]},{"osd":1,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.312,"15min":0.317},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39100000000000001,"5min":0.435,"15min":0.435},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.31900000000000001,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40500000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.23200000000000001}]},{"osd":3,"last update":"Fri Feb 16 00:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.38100000000000001,"15min":0.39600000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.374,"5min":1.851,"15min":1.851},"last":0.252},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705703,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.434},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.33300000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.5,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.308,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.377,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.374},{"interface":"front","average":{"1min":0.307,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.41399999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Feb 16 00:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.33200000000000002,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.38700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.31},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.495,"15min":0.495},"last":0.34499999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":137181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63900000000000001,"5min":0.753,"15min":0.753},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.5},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63200000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.434}]},{"osd":2,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.65200000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Feb 16 00:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63900000000000001,"5min":1.506,"15min":1.506},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.376}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:14:01.304 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:14:01.305 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T00:11:05.787497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=5, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:14:01.305 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:14:01.306 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:14:01.306 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:14:01.307 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T00:11:11.806372+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=11, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=0, tm_min=12, tm_sec=36, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T00:14:01.307 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T00:14:21.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T00:14:21.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.420+0000 7f4530a06640 1 Processor -- start 2024-02-16T00:14:21.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.420+0000 7f4530a06640 1 -- start start 2024-02-16T00:14:21.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4530a06640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f452c098910 0x7f452c133060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:21.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4530a06640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c09a4b0 con 0x7f452c097e20 2024-02-16T00:14:21.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4530a06640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452c072750 con 0x7f452c098910 2024-02-16T00:14:21.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f452a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f452c097e20 0x7f452c098200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60824/0 (socket says 172.21.15.2:60824) 2024-02-16T00:14:21.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f452a59c640 1 -- 172.21.15.2:0/1310449771 learned_addr learned my addr 172.21.15.2:0/1310449771 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:14:21.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4523fff640 1 --2- 172.21.15.2:0/1310449771 >> v2:172.21.15.2:3300/0 conn(0x7f452c098910 0x7f452c133060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:21.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4529d9b640 1 -- 172.21.15.2:0/1310449771 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164764748 0 0) 0x7f452c09a4b0 con 0x7f452c097e20 2024-02-16T00:14:21.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4529d9b640 1 -- 172.21.15.2:0/1310449771 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4518003520 con 0x7f452c097e20 2024-02-16T00:14:21.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4523fff640 1 -- 172.21.15.2:0/1310449771 >> v1:172.21.15.2:6789/0 conn(0x7f452c097e20 legacy=0x7f452c098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.421+0000 7f4523fff640 1 -- 172.21.15.2:0/1310449771 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c09a7f0 con 0x7f452c098910 2024-02-16T00:14:21.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.422+0000 7f4523fff640 1 --2- 172.21.15.2:0/1310449771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c098910 0x7f452c133060 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4514009720 tx=0x7f451402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9136245aafbaa0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.422+0000 7f4529d9b640 1 -- 172.21.15.2:0/1310449771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4514031760 con 0x7f452c098910 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.422+0000 7f4529d9b640 1 -- 172.21.15.2:0/1310449771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140318c0 con 0x7f452c098910 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.422+0000 7f4529d9b640 1 -- 172.21.15.2:0/1310449771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4514031b80 con 0x7f452c098910 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 -- 172.21.15.2:0/1310449771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c098910 msgr2=0x7f452c133060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 --2- 172.21.15.2:0/1310449771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c098910 0x7f452c133060 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4514009720 tx=0x7f451402b8d0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 -- 172.21.15.2:0/1310449771 shutdown_connections 2024-02-16T00:14:21.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 --2- 172.21.15.2:0/1310449771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c098910 0x7f452c133060 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 -- 172.21.15.2:0/1310449771 >> 172.21.15.2:0/1310449771 conn(0x7f452c0a0730 msgr2=0x7f452c0a0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 -- 172.21.15.2:0/1310449771 shutdown_connections 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.423+0000 7f4530a06640 1 -- 172.21.15.2:0/1310449771 wait complete. 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f4530a06640 1 Processor -- start 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f4530a06640 1 -- start start 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f4530a06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 0x7f452c1c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f4530a06640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c06d070 con 0x7f452c097e20 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f452a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 0x7f452c1c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:21.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f452a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 0x7f452c1c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47592/0 (socket says 172.21.15.2:47592) 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.424+0000 7f452a59c640 1 -- 172.21.15.2:0/142756916 learned_addr learned my addr 172.21.15.2:0/142756916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f452a59c640 1 -- 172.21.15.2:0/142756916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514009400 con 0x7f452c097e20 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f452a59c640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 0x7f452c1c2950 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c390 tx=0x7f451c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f451c005c10 con 0x7f452c097e20 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c005d70 con 0x7f452c097e20 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f451c007220 con 0x7f452c097e20 2024-02-16T00:14:21.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c132760 con 0x7f452c097e20 2024-02-16T00:14:21.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.425+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c132b30 con 0x7f452c097e20 2024-02-16T00:14:21.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.426+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f451c007380 con 0x7f452c097e20 2024-02-16T00:14:21.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.426+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c09d9e0 con 0x7f452c097e20 2024-02-16T00:14:21.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.426+0000 7f4522ffd640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f450c037ef0 0x7f450c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:21.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.426+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f451c04a9e0 con 0x7f452c097e20 2024-02-16T00:14:21.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.426+0000 7f4523fff640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f450c037ef0 0x7f450c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:21.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.427+0000 7f4523fff640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f450c037ef0 0x7f450c03a3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4514036000 tx=0x7f4514008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:21.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.431+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f451c019be0 con 0x7f452c097e20 2024-02-16T00:14:21.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.607+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 --> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f452c0627b0 con 0x7f450c037ef0 2024-02-16T00:14:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.624+0000 7f4522ffd640 1 -- 172.21.15.2:0/142756916 <== mgr.4100 v2:172.21.15.42:6824/1216866101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673542 (secure 0 0 0) 0x7f452c0627b0 con 0x7f450c037ef0 2024-02-16T00:14:21.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-02-16T00:14:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f450c037ef0 msgr2=0x7f450c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f450c037ef0 0x7f450c03a3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4514036000 tx=0x7f4514008030 comp rx=0 tx=0).stop 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 msgr2=0x7f452c1c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 0x7f452c1c2950 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c390 tx=0x7f451c00c850 comp rx=0 tx=0).stop 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 shutdown_connections 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f450c037ef0 0x7f450c03a3b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 --2- 172.21.15.2:0/142756916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452c097e20 0x7f452c1c2950 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 >> 172.21.15.2:0/142756916 conn(0x7f452c0a0730 msgr2=0x7f452c126800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:14:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 shutdown_connections 2024-02-16T00:14:21.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.628+0000 7f4530a06640 1 -- 172.21.15.2:0/142756916 wait complete. 2024-02-16T00:14:21.645 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-02-16T00:14:19.731185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":245,"num_object_clones":0,"num_object_copies":491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":4297,"num_read_kb":3911,"num_write":1709,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4192,"ondisk_log_size":4192,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152372,"kb_used_data":2708,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334988,"statfs":{"total":386547056640,"available":386391027712,"internally_reserved":0,"allocated":2772992,"data_stored":1728024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003795"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.275037+0000","last_change":"2024-02-16T00:13:22.275067+0000","last_active":"2024-02-16T00:13:22.275037+0000","last_peered":"2024-02-16T00:13:22.275037+0000","last_clean":"2024-02-16T00:13:22.275037+0000","last_became_active":"2024-02-16T00:11:02.803663+0000","last_became_peered":"2024-02-16T00:11:02.803663+0000","last_unstale":"2024-02-16T00:13:22.275037+0000","last_undegraded":"2024-02-16T00:13:22.275037+0000","last_fullsized":"2024-02-16T00:13:22.275037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:22.274933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:22.274933+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.274933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:12.577631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.703777+0000","last_change":"2024-02-16T00:13:20.703777+0000","last_active":"2024-02-16T00:13:20.703777+0000","last_peered":"2024-02-16T00:13:20.703777+0000","last_clean":"2024-02-16T00:13:20.703777+0000","last_became_active":"2024-02-16T00:11:04.802843+0000","last_became_peered":"2024-02-16T00:11:04.802843+0000","last_unstale":"2024-02-16T00:13:20.703777+0000","last_undegraded":"2024-02-16T00:13:20.703777+0000","last_fullsized":"2024-02-16T00:13:20.703777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:20.703642+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:20.703642+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.703642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:21:19.805780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.933810+0000","last_change":"2024-02-16T00:13:29.933837+0000","last_active":"2024-02-16T00:13:29.933810+0000","last_peered":"2024-02-16T00:13:29.933810+0000","last_clean":"2024-02-16T00:13:29.933810+0000","last_became_active":"2024-02-16T00:11:02.797183+0000","last_became_peered":"2024-02-16T00:11:02.797183+0000","last_unstale":"2024-02-16T00:13:29.933810+0000","last_undegraded":"2024-02-16T00:13:29.933810+0000","last_fullsized":"2024-02-16T00:13:29.933810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.933716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.933716+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.933716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:38.573518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.086334+0000","last_change":"2024-02-16T00:13:26.086334+0000","last_active":"2024-02-16T00:13:26.086334+0000","last_peered":"2024-02-16T00:13:26.086334+0000","last_clean":"2024-02-16T00:13:26.086334+0000","last_became_active":"2024-02-16T00:11:04.803559+0000","last_became_peered":"2024-02-16T00:11:04.803559+0000","last_unstale":"2024-02-16T00:13:26.086334+0000","last_undegraded":"2024-02-16T00:13:26.086334+0000","last_fullsized":"2024-02-16T00:13:26.086334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.086214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.086214+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.086214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:48:00.192005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.026184+0000","last_change":"2024-02-16T00:13:36.026223+0000","last_active":"2024-02-16T00:13:36.026184+0000","last_peered":"2024-02-16T00:13:36.026184+0000","last_clean":"2024-02-16T00:13:36.026184+0000","last_became_active":"2024-02-16T00:11:02.814329+0000","last_became_peered":"2024-02-16T00:11:02.814329+0000","last_unstale":"2024-02-16T00:13:36.026184+0000","last_undegraded":"2024-02-16T00:13:36.026184+0000","last_fullsized":"2024-02-16T00:13:36.026184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:36.026092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:36.026092+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.026092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:53:37.132703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.058556+0000","last_change":"2024-02-16T00:13:18.058556+0000","last_active":"2024-02-16T00:13:18.058556+0000","last_peered":"2024-02-16T00:13:18.058556+0000","last_clean":"2024-02-16T00:13:18.058556+0000","last_became_active":"2024-02-16T00:11:04.807090+0000","last_became_peered":"2024-02-16T00:11:04.807090+0000","last_unstale":"2024-02-16T00:13:18.058556+0000","last_undegraded":"2024-02-16T00:13:18.058556+0000","last_fullsized":"2024-02-16T00:13:18.058556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.058378+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.058378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:23.057832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.241221+0000","last_change":"2024-02-16T00:13:09.241249+0000","last_active":"2024-02-16T00:13:09.241221+0000","last_peered":"2024-02-16T00:13:09.241221+0000","last_clean":"2024-02-16T00:13:09.241221+0000","last_became_active":"2024-02-16T00:11:02.817607+0000","last_became_peered":"2024-02-16T00:11:02.817607+0000","last_unstale":"2024-02-16T00:13:09.241221+0000","last_undegraded":"2024-02-16T00:13:09.241221+0000","last_fullsized":"2024-02-16T00:13:09.241221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.241098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.241098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:35.378570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.023923+0000","last_change":"2024-02-16T00:13:16.023923+0000","last_active":"2024-02-16T00:13:16.023923+0000","last_peered":"2024-02-16T00:13:16.023923+0000","last_clean":"2024-02-16T00:13:16.023923+0000","last_became_active":"2024-02-16T00:11:04.807613+0000","last_became_peered":"2024-02-16T00:11:04.807613+0000","last_unstale":"2024-02-16T00:13:16.023923+0000","last_undegraded":"2024-02-16T00:13:16.023923+0000","last_fullsized":"2024-02-16T00:13:16.023923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.023799+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.023799+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:19:15.106437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:56.902776+0000","last_change":"2024-02-16T00:13:56.902831+0000","last_active":"2024-02-16T00:13:56.902776+0000","last_peered":"2024-02-16T00:13:56.902776+0000","last_clean":"2024-02-16T00:13:56.902776+0000","last_became_active":"2024-02-16T00:11:02.820463+0000","last_became_peered":"2024-02-16T00:11:02.820463+0000","last_unstale":"2024-02-16T00:13:56.902776+0000","last_undegraded":"2024-02-16T00:13:56.902776+0000","last_fullsized":"2024-02-16T00:13:56.902776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:56.902670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:56.902670+0000","last_clean_scrub_stamp":"2024-02-16T00:13:56.902670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:03:07.396031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.550754+0000","last_change":"2024-02-16T00:13:10.550783+0000","last_active":"2024-02-16T00:13:10.550754+0000","last_peered":"2024-02-16T00:13:10.550754+0000","last_clean":"2024-02-16T00:13:10.550754+0000","last_became_active":"2024-02-16T00:11:04.796389+0000","last_became_peered":"2024-02-16T00:11:04.796389+0000","last_unstale":"2024-02-16T00:13:10.550754+0000","last_undegraded":"2024-02-16T00:13:10.550754+0000","last_fullsized":"2024-02-16T00:13:10.550754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.550668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.550668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:01.925080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.231172+0000","last_change":"2024-02-16T00:13:21.231172+0000","last_active":"2024-02-16T00:13:21.231172+0000","last_peered":"2024-02-16T00:13:21.231172+0000","last_clean":"2024-02-16T00:13:21.231172+0000","last_became_active":"2024-02-16T00:11:02.803033+0000","last_became_peered":"2024-02-16T00:11:02.803033+0000","last_unstale":"2024-02-16T00:13:21.231172+0000","last_undegraded":"2024-02-16T00:13:21.231172+0000","last_fullsized":"2024-02-16T00:13:21.231172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:21.231060+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:21.231060+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.231060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:50.713265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.969656+0000","last_change":"2024-02-16T00:13:12.969656+0000","last_active":"2024-02-16T00:13:12.969656+0000","last_peered":"2024-02-16T00:13:12.969656+0000","last_clean":"2024-02-16T00:13:12.969656+0000","last_became_active":"2024-02-16T00:11:04.808593+0000","last_became_peered":"2024-02-16T00:11:04.808593+0000","last_unstale":"2024-02-16T00:13:12.969656+0000","last_undegraded":"2024-02-16T00:13:12.969656+0000","last_fullsized":"2024-02-16T00:13:12.969656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.969541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.969541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:17:09.036334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:45.945033+0000","last_change":"2024-02-16T00:13:45.945061+0000","last_active":"2024-02-16T00:13:45.945033+0000","last_peered":"2024-02-16T00:13:45.945033+0000","last_clean":"2024-02-16T00:13:45.945033+0000","last_became_active":"2024-02-16T00:11:02.813953+0000","last_became_peered":"2024-02-16T00:11:02.813953+0000","last_unstale":"2024-02-16T00:13:45.945033+0000","last_undegraded":"2024-02-16T00:13:45.945033+0000","last_fullsized":"2024-02-16T00:13:45.945033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:45.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:45.944944+0000","last_clean_scrub_stamp":"2024-02-16T00:13:45.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:14:34.263555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.234405+0000","last_change":"2024-02-16T00:13:06.234405+0000","last_active":"2024-02-16T00:13:06.234405+0000","last_peered":"2024-02-16T00:13:06.234405+0000","last_clean":"2024-02-16T00:13:06.234405+0000","last_became_active":"2024-02-16T00:11:04.797959+0000","last_became_peered":"2024-02-16T00:11:04.797959+0000","last_unstale":"2024-02-16T00:13:06.234405+0000","last_undegraded":"2024-02-16T00:13:06.234405+0000","last_fullsized":"2024-02-16T00:13:06.234405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.234291+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.234291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:22.103367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.806168+0000","last_change":"2024-02-16T00:13:13.806168+0000","last_active":"2024-02-16T00:13:13.806168+0000","last_peered":"2024-02-16T00:13:13.806168+0000","last_clean":"2024-02-16T00:13:13.806168+0000","last_became_active":"2024-02-16T00:11:02.807699+0000","last_became_peered":"2024-02-16T00:11:02.807699+0000","last_unstale":"2024-02-16T00:13:13.806168+0000","last_undegraded":"2024-02-16T00:13:13.806168+0000","last_fullsized":"2024-02-16T00:13:13.806168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.805990+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.805990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:06:04.108688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.179359+0000","last_change":"2024-02-16T00:13:12.179359+0000","last_active":"2024-02-16T00:13:12.179359+0000","last_peered":"2024-02-16T00:13:12.179359+0000","last_clean":"2024-02-16T00:13:12.179359+0000","last_became_active":"2024-02-16T00:11:04.808439+0000","last_became_peered":"2024-02-16T00:11:04.808439+0000","last_unstale":"2024-02-16T00:13:12.179359+0000","last_undegraded":"2024-02-16T00:13:12.179359+0000","last_fullsized":"2024-02-16T00:13:12.179359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.179243+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.179243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:55.195210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.051248+0000","last_change":"2024-02-16T00:13:17.051248+0000","last_active":"2024-02-16T00:13:17.051248+0000","last_peered":"2024-02-16T00:13:17.051248+0000","last_clean":"2024-02-16T00:13:17.051248+0000","last_became_active":"2024-02-16T00:11:04.807388+0000","last_became_peered":"2024-02-16T00:11:04.807388+0000","last_unstale":"2024-02-16T00:13:17.051248+0000","last_undegraded":"2024-02-16T00:13:17.051248+0000","last_fullsized":"2024-02-16T00:13:17.051248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.051125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.051125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:56:36.761214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.601554+0000","last_change":"2024-02-16T00:13:17.601554+0000","last_active":"2024-02-16T00:13:17.601554+0000","last_peered":"2024-02-16T00:13:17.601554+0000","last_clean":"2024-02-16T00:13:17.601554+0000","last_became_active":"2024-02-16T00:11:02.820045+0000","last_became_peered":"2024-02-16T00:11:02.820045+0000","last_unstale":"2024-02-16T00:13:17.601554+0000","last_undegraded":"2024-02-16T00:13:17.601554+0000","last_fullsized":"2024-02-16T00:13:17.601554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.601433+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.601433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:29.123516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.577174+0000","last_change":"2024-02-16T00:13:16.577174+0000","last_active":"2024-02-16T00:13:16.577174+0000","last_peered":"2024-02-16T00:13:16.577174+0000","last_clean":"2024-02-16T00:13:16.577174+0000","last_became_active":"2024-02-16T00:11:04.798493+0000","last_became_peered":"2024-02-16T00:11:04.798493+0000","last_unstale":"2024-02-16T00:13:16.577174+0000","last_undegraded":"2024-02-16T00:13:16.577174+0000","last_fullsized":"2024-02-16T00:13:16.577174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:16.577052+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.577052+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:46.037900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.149364+0000","last_change":"2024-02-16T00:13:13.149364+0000","last_active":"2024-02-16T00:13:13.149364+0000","last_peered":"2024-02-16T00:13:13.149364+0000","last_clean":"2024-02-16T00:13:13.149364+0000","last_became_active":"2024-02-16T00:11:02.817008+0000","last_became_peered":"2024-02-16T00:11:02.817008+0000","last_unstale":"2024-02-16T00:13:13.149364+0000","last_undegraded":"2024-02-16T00:13:13.149364+0000","last_fullsized":"2024-02-16T00:13:13.149364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:13.149246+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.149246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:19.171364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.628374+0000","last_change":"2024-02-16T00:13:22.628374+0000","last_active":"2024-02-16T00:13:22.628374+0000","last_peered":"2024-02-16T00:13:22.628374+0000","last_clean":"2024-02-16T00:13:22.628374+0000","last_became_active":"2024-02-16T00:11:04.803369+0000","last_became_peered":"2024-02-16T00:11:04.803369+0000","last_unstale":"2024-02-16T00:13:22.628374+0000","last_undegraded":"2024-02-16T00:13:22.628374+0000","last_fullsized":"2024-02-16T00:13:22.628374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:22.628266+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:22.628266+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.628266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:51.428396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.690517+0000","last_change":"2024-02-16T00:13:29.690545+0000","last_active":"2024-02-16T00:13:29.690517+0000","last_peered":"2024-02-16T00:13:29.690517+0000","last_clean":"2024-02-16T00:13:29.690517+0000","last_became_active":"2024-02-16T00:11:02.810011+0000","last_became_peered":"2024-02-16T00:11:02.810011+0000","last_unstale":"2024-02-16T00:13:29.690517+0000","last_undegraded":"2024-02-16T00:13:29.690517+0000","last_fullsized":"2024-02-16T00:13:29.690517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.690426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.690426+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.690426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:16.938893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.829592+0000","last_change":"2024-02-16T00:13:05.829592+0000","last_active":"2024-02-16T00:13:05.829592+0000","last_peered":"2024-02-16T00:13:05.829592+0000","last_clean":"2024-02-16T00:13:05.829592+0000","last_became_active":"2024-02-16T00:11:04.809956+0000","last_became_peered":"2024-02-16T00:11:04.809956+0000","last_unstale":"2024-02-16T00:13:05.829592+0000","last_undegraded":"2024-02-16T00:13:05.829592+0000","last_fullsized":"2024-02-16T00:13:05.829592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:05.829438+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.829438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:01:12.076944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.583128+0000","last_change":"2024-02-16T00:13:13.583128+0000","last_active":"2024-02-16T00:13:13.583128+0000","last_peered":"2024-02-16T00:13:13.583128+0000","last_clean":"2024-02-16T00:13:13.583128+0000","last_became_active":"2024-02-16T00:11:02.824763+0000","last_became_peered":"2024-02-16T00:11:02.824763+0000","last_unstale":"2024-02-16T00:13:13.583128+0000","last_undegraded":"2024-02-16T00:13:13.583128+0000","last_fullsized":"2024-02-16T00:13:13.583128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.583017+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.583017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:41:43.065222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.259446+0000","last_change":"2024-02-16T00:13:28.259446+0000","last_active":"2024-02-16T00:13:28.259446+0000","last_peered":"2024-02-16T00:13:28.259446+0000","last_clean":"2024-02-16T00:13:28.259446+0000","last_became_active":"2024-02-16T00:11:04.811786+0000","last_became_peered":"2024-02-16T00:11:04.811786+0000","last_unstale":"2024-02-16T00:13:28.259446+0000","last_undegraded":"2024-02-16T00:13:28.259446+0000","last_fullsized":"2024-02-16T00:13:28.259446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:28.259327+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:28.259327+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.259327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:33:51.026448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.961930+0000","last_change":"2024-02-16T00:13:30.961954+0000","last_active":"2024-02-16T00:13:30.961930+0000","last_peered":"2024-02-16T00:13:30.961930+0000","last_clean":"2024-02-16T00:13:30.961930+0000","last_became_active":"2024-02-16T00:11:02.797142+0000","last_became_peered":"2024-02-16T00:11:02.797142+0000","last_unstale":"2024-02-16T00:13:30.961930+0000","last_undegraded":"2024-02-16T00:13:30.961930+0000","last_fullsized":"2024-02-16T00:13:30.961930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.961818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.961818+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.961818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:57:04.261490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.565976+0000","last_change":"2024-02-16T00:13:12.565976+0000","last_active":"2024-02-16T00:13:12.565976+0000","last_peered":"2024-02-16T00:13:12.565976+0000","last_clean":"2024-02-16T00:13:12.565976+0000","last_became_active":"2024-02-16T00:11:04.796334+0000","last_became_peered":"2024-02-16T00:11:04.796334+0000","last_unstale":"2024-02-16T00:13:12.565976+0000","last_undegraded":"2024-02-16T00:13:12.565976+0000","last_fullsized":"2024-02-16T00:13:12.565976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:12.565846+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.565846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:13:00.026750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.051463+0000","last_change":"2024-02-16T00:13:35.051495+0000","last_active":"2024-02-16T00:13:35.051463+0000","last_peered":"2024-02-16T00:13:35.051463+0000","last_clean":"2024-02-16T00:13:35.051463+0000","last_became_active":"2024-02-16T00:11:02.817028+0000","last_became_peered":"2024-02-16T00:11:02.817028+0000","last_unstale":"2024-02-16T00:13:35.051463+0000","last_undegraded":"2024-02-16T00:13:35.051463+0000","last_fullsized":"2024-02-16T00:13:35.051463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:35.051368+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:35.051368+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.051368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:37:55.653508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'20","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:39.724574+0000","last_change":"2024-02-16T00:13:39.724601+0000","last_active":"2024-02-16T00:13:39.724574+0000","last_peered":"2024-02-16T00:13:39.724574+0000","last_clean":"2024-02-16T00:13:39.724574+0000","last_became_active":"2024-02-16T00:11:12.835046+0000","last_became_peered":"2024-02-16T00:11:12.835046+0000","last_unstale":"2024-02-16T00:13:39.724574+0000","last_undegraded":"2024-02-16T00:13:39.724574+0000","last_fullsized":"2024-02-16T00:13:39.724574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:13:39.724487+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:13:39.724487+0000","last_clean_scrub_stamp":"2024-02-16T00:13:39.724487+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:49:02.716832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":140,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.068242+0000","last_change":"2024-02-16T00:13:24.068242+0000","last_active":"2024-02-16T00:13:24.068242+0000","last_peered":"2024-02-16T00:13:24.068242+0000","last_clean":"2024-02-16T00:13:24.068242+0000","last_became_active":"2024-02-16T00:11:04.802104+0000","last_became_peered":"2024-02-16T00:11:04.802104+0000","last_unstale":"2024-02-16T00:13:24.068242+0000","last_undegraded":"2024-02-16T00:13:24.068242+0000","last_fullsized":"2024-02-16T00:13:24.068242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:24.068098+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:24.068098+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.068098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:47:00.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.067547+0000","last_change":"2024-02-16T00:13:30.067575+0000","last_active":"2024-02-16T00:13:30.067547+0000","last_peered":"2024-02-16T00:13:30.067547+0000","last_clean":"2024-02-16T00:13:30.067547+0000","last_became_active":"2024-02-16T00:11:02.822188+0000","last_became_peered":"2024-02-16T00:11:02.822188+0000","last_unstale":"2024-02-16T00:13:30.067547+0000","last_undegraded":"2024-02-16T00:13:30.067547+0000","last_fullsized":"2024-02-16T00:13:30.067547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.067450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.067450+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.067450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:08:52.271982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.921969+0000","last_change":"2024-02-16T00:12:48.921969+0000","last_active":"2024-02-16T00:12:48.921969+0000","last_peered":"2024-02-16T00:12:48.921969+0000","last_clean":"2024-02-16T00:12:48.921969+0000","last_became_active":"2024-02-16T00:11:06.805383+0000","last_became_peered":"2024-02-16T00:11:06.805383+0000","last_unstale":"2024-02-16T00:12:48.921969+0000","last_undegraded":"2024-02-16T00:12:48.921969+0000","last_fullsized":"2024-02-16T00:12:48.921969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.921850+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.921850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:24.218584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'48","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.004614+0000","last_change":"2024-02-16T00:12:45.004614+0000","last_active":"2024-02-16T00:12:45.004614+0000","last_peered":"2024-02-16T00:12:45.004614+0000","last_clean":"2024-02-16T00:12:45.004614+0000","last_became_active":"2024-02-16T00:11:08.811859+0000","last_became_peered":"2024-02-16T00:11:08.811859+0000","last_unstale":"2024-02-16T00:12:45.004614+0000","last_undegraded":"2024-02-16T00:12:45.004614+0000","last_fullsized":"2024-02-16T00:12:45.004614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-02-16T00:12:45.004490+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.004490+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:08:25.382346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.647238+0000","last_change":"2024-02-16T00:13:02.647238+0000","last_active":"2024-02-16T00:13:02.647238+0000","last_peered":"2024-02-16T00:13:02.647238+0000","last_clean":"2024-02-16T00:13:02.647238+0000","last_became_active":"2024-02-16T00:11:10.827330+0000","last_became_peered":"2024-02-16T00:11:10.827330+0000","last_unstale":"2024-02-16T00:13:02.647238+0000","last_undegraded":"2024-02-16T00:13:02.647238+0000","last_fullsized":"2024-02-16T00:13:02.647238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.647086+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.647086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:24.329532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.722174+0000","last_change":"2024-02-16T00:13:37.722174+0000","last_active":"2024-02-16T00:13:37.722174+0000","last_peered":"2024-02-16T00:13:37.722174+0000","last_clean":"2024-02-16T00:13:37.722174+0000","last_became_active":"2024-02-16T00:11:12.834948+0000","last_became_peered":"2024-02-16T00:11:12.834948+0000","last_unstale":"2024-02-16T00:13:37.722174+0000","last_undegraded":"2024-02-16T00:13:37.722174+0000","last_fullsized":"2024-02-16T00:13:37.722174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:37.722038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:37.722038+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.722038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:33:42.721492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.053290+0000","last_change":"2024-02-16T00:12:58.053290+0000","last_active":"2024-02-16T00:12:58.053290+0000","last_peered":"2024-02-16T00:12:58.053290+0000","last_clean":"2024-02-16T00:12:58.053290+0000","last_became_active":"2024-02-16T00:11:04.810100+0000","last_became_peered":"2024-02-16T00:11:04.810100+0000","last_unstale":"2024-02-16T00:12:58.053290+0000","last_undegraded":"2024-02-16T00:12:58.053290+0000","last_fullsized":"2024-02-16T00:12:58.053290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:58.053167+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.053167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:43:59.274034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.224954+0000","last_change":"2024-02-16T00:13:11.224954+0000","last_active":"2024-02-16T00:13:11.224954+0000","last_peered":"2024-02-16T00:13:11.224954+0000","last_clean":"2024-02-16T00:13:11.224954+0000","last_became_active":"2024-02-16T00:11:02.817585+0000","last_became_peered":"2024-02-16T00:11:02.817585+0000","last_unstale":"2024-02-16T00:13:11.224954+0000","last_undegraded":"2024-02-16T00:13:11.224954+0000","last_fullsized":"2024-02-16T00:13:11.224954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.224827+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.224827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:55.853002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.890717+0000","last_change":"2024-02-16T00:13:01.890717+0000","last_active":"2024-02-16T00:13:01.890717+0000","last_peered":"2024-02-16T00:13:01.890717+0000","last_clean":"2024-02-16T00:13:01.890717+0000","last_became_active":"2024-02-16T00:11:06.803081+0000","last_became_peered":"2024-02-16T00:11:06.803081+0000","last_unstale":"2024-02-16T00:13:01.890717+0000","last_undegraded":"2024-02-16T00:13:01.890717+0000","last_fullsized":"2024-02-16T00:13:01.890717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.890582+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.890582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:01:28.904624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'16","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.427635+0000","last_change":"2024-02-16T00:12:43.427635+0000","last_active":"2024-02-16T00:12:43.427635+0000","last_peered":"2024-02-16T00:12:43.427635+0000","last_clean":"2024-02-16T00:12:43.427635+0000","last_became_active":"2024-02-16T00:11:08.812139+0000","last_became_peered":"2024-02-16T00:11:08.812139+0000","last_unstale":"2024-02-16T00:12:43.427635+0000","last_undegraded":"2024-02-16T00:12:43.427635+0000","last_fullsized":"2024-02-16T00:12:43.427635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-02-16T00:12:43.427524+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.427524+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:38.476135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.502479+0000","last_change":"2024-02-16T00:12:46.502479+0000","last_active":"2024-02-16T00:12:46.502479+0000","last_peered":"2024-02-16T00:12:46.502479+0000","last_clean":"2024-02-16T00:12:46.502479+0000","last_became_active":"2024-02-16T00:11:10.823520+0000","last_became_peered":"2024-02-16T00:11:10.823520+0000","last_unstale":"2024-02-16T00:12:46.502479+0000","last_undegraded":"2024-02-16T00:12:46.502479+0000","last_fullsized":"2024-02-16T00:12:46.502479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.502371+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.502371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:24.692093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.929115+0000","last_change":"2024-02-16T00:13:37.929115+0000","last_active":"2024-02-16T00:13:37.929115+0000","last_peered":"2024-02-16T00:13:37.929115+0000","last_clean":"2024-02-16T00:13:37.929115+0000","last_became_active":"2024-02-16T00:11:12.828104+0000","last_became_peered":"2024-02-16T00:11:12.828104+0000","last_unstale":"2024-02-16T00:13:37.929115+0000","last_undegraded":"2024-02-16T00:13:37.929115+0000","last_fullsized":"2024-02-16T00:13:37.929115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:37.928993+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:37.928993+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.928993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:49:00.921338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.046782+0000","last_change":"2024-02-16T00:13:25.046782+0000","last_active":"2024-02-16T00:13:25.046782+0000","last_peered":"2024-02-16T00:13:25.046782+0000","last_clean":"2024-02-16T00:13:25.046782+0000","last_became_active":"2024-02-16T00:11:04.800257+0000","last_became_peered":"2024-02-16T00:11:04.800257+0000","last_unstale":"2024-02-16T00:13:25.046782+0000","last_undegraded":"2024-02-16T00:13:25.046782+0000","last_fullsized":"2024-02-16T00:13:25.046782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:25.046664+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:25.046664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.046664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:18:14.017471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:39.066563+0000","last_change":"2024-02-16T00:13:39.066626+0000","last_active":"2024-02-16T00:13:39.066563+0000","last_peered":"2024-02-16T00:13:39.066563+0000","last_clean":"2024-02-16T00:13:39.066563+0000","last_became_active":"2024-02-16T00:11:02.820747+0000","last_became_peered":"2024-02-16T00:11:02.820747+0000","last_unstale":"2024-02-16T00:13:39.066563+0000","last_undegraded":"2024-02-16T00:13:39.066563+0000","last_fullsized":"2024-02-16T00:13:39.066563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:39.066463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:39.066463+0000","last_clean_scrub_stamp":"2024-02-16T00:13:39.066463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:22.922352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.886683+0000","last_change":"2024-02-16T00:13:00.886683+0000","last_active":"2024-02-16T00:13:00.886683+0000","last_peered":"2024-02-16T00:13:00.886683+0000","last_clean":"2024-02-16T00:13:00.886683+0000","last_became_active":"2024-02-16T00:11:06.804580+0000","last_became_peered":"2024-02-16T00:11:06.804580+0000","last_unstale":"2024-02-16T00:13:00.886683+0000","last_undegraded":"2024-02-16T00:13:00.886683+0000","last_fullsized":"2024-02-16T00:13:00.886683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.886566+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.886566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:42:06.116856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'29","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.157085+0000","last_change":"2024-02-16T00:12:51.157085+0000","last_active":"2024-02-16T00:12:51.157085+0000","last_peered":"2024-02-16T00:12:51.157085+0000","last_clean":"2024-02-16T00:12:51.157085+0000","last_became_active":"2024-02-16T00:11:08.813247+0000","last_became_peered":"2024-02-16T00:11:08.813247+0000","last_unstale":"2024-02-16T00:12:51.157085+0000","last_undegraded":"2024-02-16T00:12:51.157085+0000","last_fullsized":"2024-02-16T00:12:51.157085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-02-16T00:12:51.156949+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.156949+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:40:01.821119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'244","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.041805+0000","last_change":"2024-02-16T00:13:07.041805+0000","last_active":"2024-02-16T00:13:07.041805+0000","last_peered":"2024-02-16T00:13:07.041805+0000","last_clean":"2024-02-16T00:13:07.041805+0000","last_became_active":"2024-02-16T00:11:10.830283+0000","last_became_peered":"2024-02-16T00:11:10.830283+0000","last_unstale":"2024-02-16T00:13:07.041805+0000","last_undegraded":"2024-02-16T00:13:07.041805+0000","last_fullsized":"2024-02-16T00:13:07.041805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'244","last_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_deep_scrub":"29'244","last_deep_scrub_stamp":"2024-02-16T00:13:07.041669+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.041669+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:08:31.087156+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.081981+0000","last_change":"2024-02-16T00:12:54.081981+0000","last_active":"2024-02-16T00:12:54.081981+0000","last_peered":"2024-02-16T00:12:54.081981+0000","last_clean":"2024-02-16T00:12:54.081981+0000","last_became_active":"2024-02-16T00:11:12.820988+0000","last_became_peered":"2024-02-16T00:11:12.820988+0000","last_unstale":"2024-02-16T00:12:54.081981+0000","last_undegraded":"2024-02-16T00:12:54.081981+0000","last_fullsized":"2024-02-16T00:12:54.081981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.081866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.081866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:20.234092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.900259+0000","last_change":"2024-02-16T00:13:32.900259+0000","last_active":"2024-02-16T00:13:32.900259+0000","last_peered":"2024-02-16T00:13:32.900259+0000","last_clean":"2024-02-16T00:13:32.900259+0000","last_became_active":"2024-02-16T00:11:04.803225+0000","last_became_peered":"2024-02-16T00:11:04.803225+0000","last_unstale":"2024-02-16T00:13:32.900259+0000","last_undegraded":"2024-02-16T00:13:32.900259+0000","last_fullsized":"2024-02-16T00:13:32.900259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:32.900135+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:32.900135+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.900135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:23:43.008142+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.584199+0000","last_change":"2024-02-16T00:13:15.584199+0000","last_active":"2024-02-16T00:13:15.584199+0000","last_peered":"2024-02-16T00:13:15.584199+0000","last_clean":"2024-02-16T00:13:15.584199+0000","last_became_active":"2024-02-16T00:11:02.820494+0000","last_became_peered":"2024-02-16T00:11:02.820494+0000","last_unstale":"2024-02-16T00:13:15.584199+0000","last_undegraded":"2024-02-16T00:13:15.584199+0000","last_fullsized":"2024-02-16T00:13:15.584199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.584073+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.584073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:18.030880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.040576+0000","last_change":"2024-02-16T00:12:46.040576+0000","last_active":"2024-02-16T00:12:46.040576+0000","last_peered":"2024-02-16T00:12:46.040576+0000","last_clean":"2024-02-16T00:12:46.040576+0000","last_became_active":"2024-02-16T00:11:06.806262+0000","last_became_peered":"2024-02-16T00:11:06.806262+0000","last_unstale":"2024-02-16T00:12:46.040576+0000","last_undegraded":"2024-02-16T00:12:46.040576+0000","last_fullsized":"2024-02-16T00:12:46.040576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.040468+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.040468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:29.717153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'41","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.243662+0000","last_change":"2024-02-16T00:12:49.243662+0000","last_active":"2024-02-16T00:12:49.243662+0000","last_peered":"2024-02-16T00:12:49.243662+0000","last_clean":"2024-02-16T00:12:49.243662+0000","last_became_active":"2024-02-16T00:11:08.814943+0000","last_became_peered":"2024-02-16T00:11:08.814943+0000","last_unstale":"2024-02-16T00:12:49.243662+0000","last_undegraded":"2024-02-16T00:12:49.243662+0000","last_fullsized":"2024-02-16T00:12:49.243662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:49.243531+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.243531+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:44.292142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'243","reported_seq":331,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.916116+0000","last_change":"2024-02-16T00:12:42.916116+0000","last_active":"2024-02-16T00:12:42.916116+0000","last_peered":"2024-02-16T00:12:42.916116+0000","last_clean":"2024-02-16T00:12:42.916116+0000","last_became_active":"2024-02-16T00:11:10.820000+0000","last_became_peered":"2024-02-16T00:11:10.820000+0000","last_unstale":"2024-02-16T00:12:42.916116+0000","last_undegraded":"2024-02-16T00:12:42.916116+0000","last_fullsized":"2024-02-16T00:12:42.916116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.916005+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.916005+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:53.580174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'10","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.335047+0000","last_change":"2024-02-16T00:13:33.335047+0000","last_active":"2024-02-16T00:13:33.335047+0000","last_peered":"2024-02-16T00:13:33.335047+0000","last_clean":"2024-02-16T00:13:33.335047+0000","last_became_active":"2024-02-16T00:11:50.849854+0000","last_became_peered":"2024-02-16T00:11:50.849854+0000","last_unstale":"2024-02-16T00:13:33.335047+0000","last_undegraded":"2024-02-16T00:13:33.335047+0000","last_fullsized":"2024-02-16T00:13:33.335047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-02-16T00:13:33.334889+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-02-16T00:13:33.334889+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.334889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:17.712622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.298408+0000","last_change":"2024-02-16T00:13:24.298439+0000","last_active":"2024-02-16T00:13:24.298408+0000","last_peered":"2024-02-16T00:13:24.298408+0000","last_clean":"2024-02-16T00:13:24.298408+0000","last_became_active":"2024-02-16T00:11:02.805508+0000","last_became_peered":"2024-02-16T00:11:02.805508+0000","last_unstale":"2024-02-16T00:13:24.298408+0000","last_undegraded":"2024-02-16T00:13:24.298408+0000","last_fullsized":"2024-02-16T00:13:24.298408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:24.298312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:24.298312+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.298312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:26:56.750764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.525828+0000","last_change":"2024-02-16T00:12:48.525828+0000","last_active":"2024-02-16T00:12:48.525828+0000","last_peered":"2024-02-16T00:12:48.525828+0000","last_clean":"2024-02-16T00:12:48.525828+0000","last_became_active":"2024-02-16T00:11:06.808620+0000","last_became_peered":"2024-02-16T00:11:06.808620+0000","last_unstale":"2024-02-16T00:12:48.525828+0000","last_undegraded":"2024-02-16T00:12:48.525828+0000","last_fullsized":"2024-02-16T00:12:48.525828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:48.525719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.525719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:11.360728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'58","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.244124+0000","last_change":"2024-02-16T00:12:48.244124+0000","last_active":"2024-02-16T00:12:48.244124+0000","last_peered":"2024-02-16T00:12:48.244124+0000","last_clean":"2024-02-16T00:12:48.244124+0000","last_became_active":"2024-02-16T00:11:08.815897+0000","last_became_peered":"2024-02-16T00:11:08.815897+0000","last_unstale":"2024-02-16T00:12:48.244124+0000","last_undegraded":"2024-02-16T00:12:48.244124+0000","last_fullsized":"2024-02-16T00:12:48.244124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-02-16T00:12:48.243982+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.243982+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:25.939262+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.931903+0000","last_change":"2024-02-16T00:12:46.931903+0000","last_active":"2024-02-16T00:12:46.931903+0000","last_peered":"2024-02-16T00:12:46.931903+0000","last_clean":"2024-02-16T00:12:46.931903+0000","last_became_active":"2024-02-16T00:11:10.820073+0000","last_became_peered":"2024-02-16T00:11:10.820073+0000","last_unstale":"2024-02-16T00:12:46.931903+0000","last_undegraded":"2024-02-16T00:12:46.931903+0000","last_fullsized":"2024-02-16T00:12:46.931903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:46.931775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.931775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:08:25.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.070398+0000","last_change":"2024-02-16T00:12:58.070398+0000","last_active":"2024-02-16T00:12:58.070398+0000","last_peered":"2024-02-16T00:12:58.070398+0000","last_clean":"2024-02-16T00:12:58.070398+0000","last_became_active":"2024-02-16T00:11:12.823399+0000","last_became_peered":"2024-02-16T00:11:12.823399+0000","last_unstale":"2024-02-16T00:12:58.070398+0000","last_undegraded":"2024-02-16T00:12:58.070398+0000","last_fullsized":"2024-02-16T00:12:58.070398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:58.070215+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.070215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:35.924708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.553664+0000","last_change":"2024-02-16T00:13:08.553664+0000","last_active":"2024-02-16T00:13:08.553664+0000","last_peered":"2024-02-16T00:13:08.553664+0000","last_clean":"2024-02-16T00:13:08.553664+0000","last_became_active":"2024-02-16T00:11:04.796045+0000","last_became_peered":"2024-02-16T00:11:04.796045+0000","last_unstale":"2024-02-16T00:13:08.553664+0000","last_undegraded":"2024-02-16T00:13:08.553664+0000","last_fullsized":"2024-02-16T00:13:08.553664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:08.553541+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.553541+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:34.676748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.278691+0000","last_change":"2024-02-16T00:13:27.278718+0000","last_active":"2024-02-16T00:13:27.278691+0000","last_peered":"2024-02-16T00:13:27.278691+0000","last_clean":"2024-02-16T00:13:27.278691+0000","last_became_active":"2024-02-16T00:11:02.814104+0000","last_became_peered":"2024-02-16T00:11:02.814104+0000","last_unstale":"2024-02-16T00:13:27.278691+0000","last_undegraded":"2024-02-16T00:13:27.278691+0000","last_fullsized":"2024-02-16T00:13:27.278691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:27.278584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:27.278584+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.278584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:44:28.499451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.788791+0000","last_change":"2024-02-16T00:12:55.788791+0000","last_active":"2024-02-16T00:12:55.788791+0000","last_peered":"2024-02-16T00:12:55.788791+0000","last_clean":"2024-02-16T00:12:55.788791+0000","last_became_active":"2024-02-16T00:11:06.808580+0000","last_became_peered":"2024-02-16T00:11:06.808580+0000","last_unstale":"2024-02-16T00:12:55.788791+0000","last_undegraded":"2024-02-16T00:12:55.788791+0000","last_fullsized":"2024-02-16T00:12:55.788791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.788644+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.788644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:01:03.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'41","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.074769+0000","last_change":"2024-02-16T00:12:43.074769+0000","last_active":"2024-02-16T00:12:43.074769+0000","last_peered":"2024-02-16T00:12:43.074769+0000","last_clean":"2024-02-16T00:12:43.074769+0000","last_became_active":"2024-02-16T00:11:08.810402+0000","last_became_peered":"2024-02-16T00:11:08.810402+0000","last_unstale":"2024-02-16T00:12:43.074769+0000","last_undegraded":"2024-02-16T00:12:43.074769+0000","last_fullsized":"2024-02-16T00:12:43.074769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:43.074645+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.074645+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:58:42.611584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.938580+0000","last_change":"2024-02-16T00:12:40.938580+0000","last_active":"2024-02-16T00:12:40.938580+0000","last_peered":"2024-02-16T00:12:40.938580+0000","last_clean":"2024-02-16T00:12:40.938580+0000","last_became_active":"2024-02-16T00:11:10.819090+0000","last_became_peered":"2024-02-16T00:11:10.819090+0000","last_unstale":"2024-02-16T00:12:40.938580+0000","last_undegraded":"2024-02-16T00:12:40.938580+0000","last_fullsized":"2024-02-16T00:12:40.938580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.938464+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.938464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:15:55.114937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.741583+0000","last_change":"2024-02-16T00:13:35.741615+0000","last_active":"2024-02-16T00:13:35.741583+0000","last_peered":"2024-02-16T00:13:35.741583+0000","last_clean":"2024-02-16T00:13:35.741583+0000","last_became_active":"2024-02-16T00:11:12.827921+0000","last_became_peered":"2024-02-16T00:11:12.827921+0000","last_unstale":"2024-02-16T00:13:35.741583+0000","last_undegraded":"2024-02-16T00:13:35.741583+0000","last_fullsized":"2024-02-16T00:13:35.741583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:35.741499+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:35.741499+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.741499+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:47.657559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.194785+0000","last_change":"2024-02-16T00:13:16.194785+0000","last_active":"2024-02-16T00:13:16.194785+0000","last_peered":"2024-02-16T00:13:16.194785+0000","last_clean":"2024-02-16T00:13:16.194785+0000","last_became_active":"2024-02-16T00:11:04.809728+0000","last_became_peered":"2024-02-16T00:11:04.809728+0000","last_unstale":"2024-02-16T00:13:16.194785+0000","last_undegraded":"2024-02-16T00:13:16.194785+0000","last_fullsized":"2024-02-16T00:13:16.194785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:16.194674+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.194674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:57:42.317881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.102986+0000","last_change":"2024-02-16T00:13:38.103017+0000","last_active":"2024-02-16T00:13:38.102986+0000","last_peered":"2024-02-16T00:13:38.102986+0000","last_clean":"2024-02-16T00:13:38.102986+0000","last_became_active":"2024-02-16T00:11:02.815216+0000","last_became_peered":"2024-02-16T00:11:02.815216+0000","last_unstale":"2024-02-16T00:13:38.102986+0000","last_undegraded":"2024-02-16T00:13:38.102986+0000","last_fullsized":"2024-02-16T00:13:38.102986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:38.102894+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:38.102894+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.102894+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:10.226023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.864812+0000","last_change":"2024-02-16T00:12:59.864812+0000","last_active":"2024-02-16T00:12:59.864812+0000","last_peered":"2024-02-16T00:12:59.864812+0000","last_clean":"2024-02-16T00:12:59.864812+0000","last_became_active":"2024-02-16T00:11:06.805919+0000","last_became_peered":"2024-02-16T00:11:06.805919+0000","last_unstale":"2024-02-16T00:12:59.864812+0000","last_undegraded":"2024-02-16T00:12:59.864812+0000","last_fullsized":"2024-02-16T00:12:59.864812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.864691+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.864691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:37:20.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'57","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.882918+0000","last_change":"2024-02-16T00:12:50.882918+0000","last_active":"2024-02-16T00:12:50.882918+0000","last_peered":"2024-02-16T00:12:50.882918+0000","last_clean":"2024-02-16T00:12:50.882918+0000","last_became_active":"2024-02-16T00:11:08.811265+0000","last_became_peered":"2024-02-16T00:11:08.811265+0000","last_unstale":"2024-02-16T00:12:50.882918+0000","last_undegraded":"2024-02-16T00:12:50.882918+0000","last_fullsized":"2024-02-16T00:12:50.882918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-02-16T00:12:50.882742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.882742+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:27:43.268496+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'243","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.962470+0000","last_change":"2024-02-16T00:12:43.962470+0000","last_active":"2024-02-16T00:12:43.962470+0000","last_peered":"2024-02-16T00:12:43.962470+0000","last_clean":"2024-02-16T00:12:43.962470+0000","last_became_active":"2024-02-16T00:11:10.815768+0000","last_became_peered":"2024-02-16T00:11:10.815768+0000","last_unstale":"2024-02-16T00:12:43.962470+0000","last_undegraded":"2024-02-16T00:12:43.962470+0000","last_fullsized":"2024-02-16T00:12:43.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:43.962355+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.962355+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:22.152077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:39.862241+0000","last_change":"2024-02-16T00:13:39.862284+0000","last_active":"2024-02-16T00:13:39.862241+0000","last_peered":"2024-02-16T00:13:39.862241+0000","last_clean":"2024-02-16T00:13:39.862241+0000","last_became_active":"2024-02-16T00:11:12.828170+0000","last_became_peered":"2024-02-16T00:11:12.828170+0000","last_unstale":"2024-02-16T00:13:39.862241+0000","last_undegraded":"2024-02-16T00:13:39.862241+0000","last_fullsized":"2024-02-16T00:13:39.862241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:39.862150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:39.862150+0000","last_clean_scrub_stamp":"2024-02-16T00:13:39.862150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:08:24.012086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.207275+0000","last_change":"2024-02-16T00:13:08.207275+0000","last_active":"2024-02-16T00:13:08.207275+0000","last_peered":"2024-02-16T00:13:08.207275+0000","last_clean":"2024-02-16T00:13:08.207275+0000","last_became_active":"2024-02-16T00:11:04.797992+0000","last_became_peered":"2024-02-16T00:11:04.797992+0000","last_unstale":"2024-02-16T00:13:08.207275+0000","last_undegraded":"2024-02-16T00:13:08.207275+0000","last_fullsized":"2024-02-16T00:13:08.207275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:08.207150+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.207150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:18.983700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:42.104246+0000","last_change":"2024-02-16T00:13:42.104272+0000","last_active":"2024-02-16T00:13:42.104246+0000","last_peered":"2024-02-16T00:13:42.104246+0000","last_clean":"2024-02-16T00:13:42.104246+0000","last_became_active":"2024-02-16T00:11:02.813267+0000","last_became_peered":"2024-02-16T00:11:02.813267+0000","last_unstale":"2024-02-16T00:13:42.104246+0000","last_undegraded":"2024-02-16T00:13:42.104246+0000","last_fullsized":"2024-02-16T00:13:42.104246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:42.104143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:42.104143+0000","last_clean_scrub_stamp":"2024-02-16T00:13:42.104143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:18:04.502703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.773405+0000","last_change":"2024-02-16T00:12:56.773405+0000","last_active":"2024-02-16T00:12:56.773405+0000","last_peered":"2024-02-16T00:12:56.773405+0000","last_clean":"2024-02-16T00:12:56.773405+0000","last_became_active":"2024-02-16T00:11:06.808558+0000","last_became_peered":"2024-02-16T00:11:06.808558+0000","last_unstale":"2024-02-16T00:12:56.773405+0000","last_undegraded":"2024-02-16T00:12:56.773405+0000","last_fullsized":"2024-02-16T00:12:56.773405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.773281+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.773281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:12.642357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'73","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.029931+0000","last_change":"2024-02-16T00:13:05.029931+0000","last_active":"2024-02-16T00:13:05.029931+0000","last_peered":"2024-02-16T00:13:05.029931+0000","last_clean":"2024-02-16T00:13:05.029931+0000","last_became_active":"2024-02-16T00:11:08.819088+0000","last_became_peered":"2024-02-16T00:11:08.819088+0000","last_unstale":"2024-02-16T00:13:05.029931+0000","last_undegraded":"2024-02-16T00:13:05.029931+0000","last_fullsized":"2024-02-16T00:13:05.029931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:13:05.029752+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.029752+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:42.315448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.833657+0000","last_change":"2024-02-16T00:12:58.833657+0000","last_active":"2024-02-16T00:12:58.833657+0000","last_peered":"2024-02-16T00:12:58.833657+0000","last_clean":"2024-02-16T00:12:58.833657+0000","last_became_active":"2024-02-16T00:11:10.821749+0000","last_became_peered":"2024-02-16T00:11:10.821749+0000","last_unstale":"2024-02-16T00:12:58.833657+0000","last_undegraded":"2024-02-16T00:12:58.833657+0000","last_fullsized":"2024-02-16T00:12:58.833657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.833533+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.833533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:45:54.589076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.870256+0000","last_change":"2024-02-16T00:13:34.870280+0000","last_active":"2024-02-16T00:13:34.870256+0000","last_peered":"2024-02-16T00:13:34.870256+0000","last_clean":"2024-02-16T00:13:34.870256+0000","last_became_active":"2024-02-16T00:11:12.823294+0000","last_became_peered":"2024-02-16T00:11:12.823294+0000","last_unstale":"2024-02-16T00:13:34.870256+0000","last_undegraded":"2024-02-16T00:13:34.870256+0000","last_fullsized":"2024-02-16T00:13:34.870256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:34.870168+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:34.870168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.870168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:07.128815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.551036+0000","last_change":"2024-02-16T00:13:07.551036+0000","last_active":"2024-02-16T00:13:07.551036+0000","last_peered":"2024-02-16T00:13:07.551036+0000","last_clean":"2024-02-16T00:13:07.551036+0000","last_became_active":"2024-02-16T00:11:04.812154+0000","last_became_peered":"2024-02-16T00:11:04.812154+0000","last_unstale":"2024-02-16T00:13:07.551036+0000","last_undegraded":"2024-02-16T00:13:07.551036+0000","last_fullsized":"2024-02-16T00:13:07.551036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:07.550917+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.550917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:08.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.807521+0000","last_change":"2024-02-16T00:13:17.807521+0000","last_active":"2024-02-16T00:13:17.807521+0000","last_peered":"2024-02-16T00:13:17.807521+0000","last_clean":"2024-02-16T00:13:17.807521+0000","last_became_active":"2024-02-16T00:11:02.807027+0000","last_became_peered":"2024-02-16T00:11:02.807027+0000","last_unstale":"2024-02-16T00:13:17.807521+0000","last_undegraded":"2024-02-16T00:13:17.807521+0000","last_fullsized":"2024-02-16T00:13:17.807521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.807409+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.807409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:10.662061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.114782+0000","last_change":"2024-02-16T00:12:59.114782+0000","last_active":"2024-02-16T00:12:59.114782+0000","last_peered":"2024-02-16T00:12:59.114782+0000","last_clean":"2024-02-16T00:12:59.114782+0000","last_became_active":"2024-02-16T00:11:06.806937+0000","last_became_peered":"2024-02-16T00:11:06.806937+0000","last_unstale":"2024-02-16T00:12:59.114782+0000","last_undegraded":"2024-02-16T00:12:59.114782+0000","last_fullsized":"2024-02-16T00:12:59.114782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.114637+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.114637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:39:06.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.465978+0000","last_change":"2024-02-16T00:12:45.465978+0000","last_active":"2024-02-16T00:12:45.465978+0000","last_peered":"2024-02-16T00:12:45.465978+0000","last_clean":"2024-02-16T00:12:45.465978+0000","last_became_active":"2024-02-16T00:11:08.809372+0000","last_became_peered":"2024-02-16T00:11:08.809372+0000","last_unstale":"2024-02-16T00:12:45.465978+0000","last_undegraded":"2024-02-16T00:12:45.465978+0000","last_fullsized":"2024-02-16T00:12:45.465978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:45.465843+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.465843+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:39:56.130012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.024834+0000","last_change":"2024-02-16T00:13:03.024834+0000","last_active":"2024-02-16T00:13:03.024834+0000","last_peered":"2024-02-16T00:13:03.024834+0000","last_clean":"2024-02-16T00:13:03.024834+0000","last_became_active":"2024-02-16T00:11:10.829689+0000","last_became_peered":"2024-02-16T00:11:10.829689+0000","last_unstale":"2024-02-16T00:13:03.024834+0000","last_undegraded":"2024-02-16T00:13:03.024834+0000","last_fullsized":"2024-02-16T00:13:03.024834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.024725+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.024725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:21:07.760259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:14:02.966308+0000","last_change":"2024-02-16T00:14:02.966335+0000","last_active":"2024-02-16T00:14:02.966308+0000","last_peered":"2024-02-16T00:14:02.966308+0000","last_clean":"2024-02-16T00:14:02.966308+0000","last_became_active":"2024-02-16T00:11:12.832653+0000","last_became_peered":"2024-02-16T00:11:12.832653+0000","last_unstale":"2024-02-16T00:14:02.966308+0000","last_undegraded":"2024-02-16T00:14:02.966308+0000","last_fullsized":"2024-02-16T00:14:02.966308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:14:02.966208+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:14:02.966208+0000","last_clean_scrub_stamp":"2024-02-16T00:14:02.966208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:35.136419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.306533+0000","last_change":"2024-02-16T00:13:32.306533+0000","last_active":"2024-02-16T00:13:32.306533+0000","last_peered":"2024-02-16T00:13:32.306533+0000","last_clean":"2024-02-16T00:13:32.306533+0000","last_became_active":"2024-02-16T00:11:50.848212+0000","last_became_peered":"2024-02-16T00:11:50.848212+0000","last_unstale":"2024-02-16T00:13:32.306533+0000","last_undegraded":"2024-02-16T00:13:32.306533+0000","last_fullsized":"2024-02-16T00:13:32.306533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:32.306376+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:32.306376+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.306376+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:04:40.109886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.026784+0000","last_change":"2024-02-16T00:13:33.026807+0000","last_active":"2024-02-16T00:13:33.026784+0000","last_peered":"2024-02-16T00:13:33.026784+0000","last_clean":"2024-02-16T00:13:33.026784+0000","last_became_active":"2024-02-16T00:11:02.815684+0000","last_became_peered":"2024-02-16T00:11:02.815684+0000","last_unstale":"2024-02-16T00:13:33.026784+0000","last_undegraded":"2024-02-16T00:13:33.026784+0000","last_fullsized":"2024-02-16T00:13:33.026784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:33.026697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:33.026697+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.026697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:57:02.894770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.335235+0000","last_change":"2024-02-16T00:13:30.335235+0000","last_active":"2024-02-16T00:13:30.335235+0000","last_peered":"2024-02-16T00:13:30.335235+0000","last_clean":"2024-02-16T00:13:30.335235+0000","last_became_active":"2024-02-16T00:11:50.848131+0000","last_became_peered":"2024-02-16T00:11:50.848131+0000","last_unstale":"2024-02-16T00:13:30.335235+0000","last_undegraded":"2024-02-16T00:13:30.335235+0000","last_fullsized":"2024-02-16T00:13:30.335235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.335112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.335112+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.335112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:11:19.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.094367+0000","last_change":"2024-02-16T00:12:55.094367+0000","last_active":"2024-02-16T00:12:55.094367+0000","last_peered":"2024-02-16T00:12:55.094367+0000","last_clean":"2024-02-16T00:12:55.094367+0000","last_became_active":"2024-02-16T00:11:08.810409+0000","last_became_peered":"2024-02-16T00:11:08.810409+0000","last_unstale":"2024-02-16T00:12:55.094367+0000","last_undegraded":"2024-02-16T00:12:55.094367+0000","last_fullsized":"2024-02-16T00:12:55.094367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:55.094244+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.094244+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:26.439070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'243","reported_seq":344,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.239506+0000","last_change":"2024-02-16T00:12:39.239506+0000","last_active":"2024-02-16T00:12:39.239506+0000","last_peered":"2024-02-16T00:12:39.239506+0000","last_clean":"2024-02-16T00:12:39.239506+0000","last_became_active":"2024-02-16T00:11:10.824766+0000","last_became_peered":"2024-02-16T00:11:10.824766+0000","last_unstale":"2024-02-16T00:12:39.239506+0000","last_undegraded":"2024-02-16T00:12:39.239506+0000","last_fullsized":"2024-02-16T00:12:39.239506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:39.239332+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.239332+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:03:36.377883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.914260+0000","last_change":"2024-02-16T00:13:35.914283+0000","last_active":"2024-02-16T00:13:35.914260+0000","last_peered":"2024-02-16T00:13:35.914260+0000","last_clean":"2024-02-16T00:13:35.914260+0000","last_became_active":"2024-02-16T00:11:12.826094+0000","last_became_peered":"2024-02-16T00:11:12.826094+0000","last_unstale":"2024-02-16T00:13:35.914260+0000","last_undegraded":"2024-02-16T00:13:35.914260+0000","last_fullsized":"2024-02-16T00:13:35.914260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-02-16T00:13:35.914177+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-02-16T00:13:35.914177+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.914177+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:39:15.976313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:35.302481+0000","last_change":"2024-02-16T00:13:35.302506+0000","last_active":"2024-02-16T00:13:35.302481+0000","last_peered":"2024-02-16T00:13:35.302481+0000","last_clean":"2024-02-16T00:13:35.302481+0000","last_became_active":"2024-02-16T00:11:51.830509+0000","last_became_peered":"2024-02-16T00:11:51.830509+0000","last_unstale":"2024-02-16T00:13:35.302481+0000","last_undegraded":"2024-02-16T00:13:35.302481+0000","last_fullsized":"2024-02-16T00:13:35.302481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:35.302398+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:35.302398+0000","last_clean_scrub_stamp":"2024-02-16T00:13:35.302398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:02.890791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:41.074485+0000","last_change":"2024-02-16T00:13:41.074554+0000","last_active":"2024-02-16T00:13:41.074485+0000","last_peered":"2024-02-16T00:13:41.074485+0000","last_clean":"2024-02-16T00:13:41.074485+0000","last_became_active":"2024-02-16T00:11:02.821203+0000","last_became_peered":"2024-02-16T00:11:02.821203+0000","last_unstale":"2024-02-16T00:13:41.074485+0000","last_undegraded":"2024-02-16T00:13:41.074485+0000","last_fullsized":"2024-02-16T00:13:41.074485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:41.074344+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:41.074344+0000","last_clean_scrub_stamp":"2024-02-16T00:13:41.074344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:38:21.916929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'4","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.634659+0000","last_change":"2024-02-16T00:12:53.634659+0000","last_active":"2024-02-16T00:12:53.634659+0000","last_peered":"2024-02-16T00:12:53.634659+0000","last_clean":"2024-02-16T00:12:53.634659+0000","last_became_active":"2024-02-16T00:11:06.803058+0000","last_became_peered":"2024-02-16T00:11:06.803058+0000","last_unstale":"2024-02-16T00:12:53.634659+0000","last_undegraded":"2024-02-16T00:12:53.634659+0000","last_fullsized":"2024-02-16T00:12:53.634659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:12:53.634543+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.634543+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:19.504192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.010930+0000","last_change":"2024-02-16T00:13:06.010930+0000","last_active":"2024-02-16T00:13:06.010930+0000","last_peered":"2024-02-16T00:13:06.010930+0000","last_clean":"2024-02-16T00:13:06.010930+0000","last_became_active":"2024-02-16T00:11:08.818029+0000","last_became_peered":"2024-02-16T00:11:08.818029+0000","last_unstale":"2024-02-16T00:13:06.010930+0000","last_undegraded":"2024-02-16T00:13:06.010930+0000","last_fullsized":"2024-02-16T00:13:06.010930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-02-16T00:13:06.010796+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.010796+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:22:32.982515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'243","reported_seq":347,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.455945+0000","last_change":"2024-02-16T00:12:42.455945+0000","last_active":"2024-02-16T00:12:42.455945+0000","last_peered":"2024-02-16T00:12:42.455945+0000","last_clean":"2024-02-16T00:12:42.455945+0000","last_became_active":"2024-02-16T00:11:10.820891+0000","last_became_peered":"2024-02-16T00:11:10.820891+0000","last_unstale":"2024-02-16T00:12:42.455945+0000","last_undegraded":"2024-02-16T00:12:42.455945+0000","last_fullsized":"2024-02-16T00:12:42.455945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.455835+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.455835+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:52:39.530697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.191670+0000","last_change":"2024-02-16T00:12:50.191670+0000","last_active":"2024-02-16T00:12:50.191670+0000","last_peered":"2024-02-16T00:12:50.191670+0000","last_clean":"2024-02-16T00:12:50.191670+0000","last_became_active":"2024-02-16T00:11:12.820632+0000","last_became_peered":"2024-02-16T00:11:12.820632+0000","last_unstale":"2024-02-16T00:12:50.191670+0000","last_undegraded":"2024-02-16T00:12:50.191670+0000","last_fullsized":"2024-02-16T00:12:50.191670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:50.191478+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.191478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:37:27.718003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.608047+0000","last_change":"2024-02-16T00:13:00.608047+0000","last_active":"2024-02-16T00:13:00.608047+0000","last_peered":"2024-02-16T00:13:00.608047+0000","last_clean":"2024-02-16T00:13:00.608047+0000","last_became_active":"2024-02-16T00:11:04.814212+0000","last_became_peered":"2024-02-16T00:11:04.814212+0000","last_unstale":"2024-02-16T00:13:00.608047+0000","last_undegraded":"2024-02-16T00:13:00.608047+0000","last_fullsized":"2024-02-16T00:13:00.608047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.607926+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.607926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:31:11.384475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:43.069464+0000","last_change":"2024-02-16T00:13:43.069493+0000","last_active":"2024-02-16T00:13:43.069464+0000","last_peered":"2024-02-16T00:13:43.069464+0000","last_clean":"2024-02-16T00:13:43.069464+0000","last_became_active":"2024-02-16T00:11:02.821862+0000","last_became_peered":"2024-02-16T00:11:02.821862+0000","last_unstale":"2024-02-16T00:13:43.069464+0000","last_undegraded":"2024-02-16T00:13:43.069464+0000","last_fullsized":"2024-02-16T00:13:43.069464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:43.069346+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:43.069346+0000","last_clean_scrub_stamp":"2024-02-16T00:13:43.069346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:33.060929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.956544+0000","last_change":"2024-02-16T00:12:47.956544+0000","last_active":"2024-02-16T00:12:47.956544+0000","last_peered":"2024-02-16T00:12:47.956544+0000","last_clean":"2024-02-16T00:12:47.956544+0000","last_became_active":"2024-02-16T00:11:06.805333+0000","last_became_peered":"2024-02-16T00:11:06.805333+0000","last_unstale":"2024-02-16T00:12:47.956544+0000","last_undegraded":"2024-02-16T00:12:47.956544+0000","last_fullsized":"2024-02-16T00:12:47.956544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.956387+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.956387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:46.994810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'47","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.531411+0000","last_change":"2024-02-16T00:12:39.531411+0000","last_active":"2024-02-16T00:12:39.531411+0000","last_peered":"2024-02-16T00:12:39.531411+0000","last_clean":"2024-02-16T00:12:39.531411+0000","last_became_active":"2024-02-16T00:11:08.816690+0000","last_became_peered":"2024-02-16T00:11:08.816690+0000","last_unstale":"2024-02-16T00:12:39.531411+0000","last_undegraded":"2024-02-16T00:12:39.531411+0000","last_fullsized":"2024-02-16T00:12:39.531411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-02-16T00:12:39.531279+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.531279+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:07.205098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.313251+0000","last_change":"2024-02-16T00:12:41.313251+0000","last_active":"2024-02-16T00:12:41.313251+0000","last_peered":"2024-02-16T00:12:41.313251+0000","last_clean":"2024-02-16T00:12:41.313251+0000","last_became_active":"2024-02-16T00:11:10.820539+0000","last_became_peered":"2024-02-16T00:11:10.820539+0000","last_unstale":"2024-02-16T00:12:41.313251+0000","last_undegraded":"2024-02-16T00:12:41.313251+0000","last_fullsized":"2024-02-16T00:12:41.313251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.313091+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.313091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:34.237575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.551467+0000","last_change":"2024-02-16T00:13:06.551467+0000","last_active":"2024-02-16T00:13:06.551467+0000","last_peered":"2024-02-16T00:13:06.551467+0000","last_clean":"2024-02-16T00:13:06.551467+0000","last_became_active":"2024-02-16T00:11:12.820127+0000","last_became_peered":"2024-02-16T00:11:12.820127+0000","last_unstale":"2024-02-16T00:13:06.551467+0000","last_undegraded":"2024-02-16T00:13:06.551467+0000","last_fullsized":"2024-02-16T00:13:06.551467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:06.551352+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.551352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:50.228037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.978897+0000","last_change":"2024-02-16T00:12:53.978897+0000","last_active":"2024-02-16T00:12:53.978897+0000","last_peered":"2024-02-16T00:12:53.978897+0000","last_clean":"2024-02-16T00:12:53.978897+0000","last_became_active":"2024-02-16T00:11:04.814397+0000","last_became_peered":"2024-02-16T00:11:04.814397+0000","last_unstale":"2024-02-16T00:12:53.978897+0000","last_undegraded":"2024-02-16T00:12:53.978897+0000","last_fullsized":"2024-02-16T00:12:53.978897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:53.978770+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.978770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:29:56.425577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.709287+0000","last_change":"2024-02-16T00:13:24.709340+0000","last_active":"2024-02-16T00:13:24.709287+0000","last_peered":"2024-02-16T00:13:24.709287+0000","last_clean":"2024-02-16T00:13:24.709287+0000","last_became_active":"2024-02-16T00:10:55.436836+0000","last_became_peered":"2024-02-16T00:10:55.436836+0000","last_unstale":"2024-02-16T00:13:24.709287+0000","last_undegraded":"2024-02-16T00:13:24.709287+0000","last_fullsized":"2024-02-16T00:13:24.709287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-02-16T00:13:24.709181+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-02-16T00:13:24.709181+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.709181+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:37.269456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:52.807668+0000","last_change":"2024-02-16T00:13:52.807692+0000","last_active":"2024-02-16T00:13:52.807668+0000","last_peered":"2024-02-16T00:13:52.807668+0000","last_clean":"2024-02-16T00:13:52.807668+0000","last_became_active":"2024-02-16T00:10:55.437329+0000","last_became_peered":"2024-02-16T00:10:55.437329+0000","last_unstale":"2024-02-16T00:13:52.807668+0000","last_undegraded":"2024-02-16T00:13:52.807668+0000","last_fullsized":"2024-02-16T00:13:52.807668+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:52.807581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:52.807581+0000","last_clean_scrub_stamp":"2024-02-16T00:13:52.807581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:14.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.985328+0000","last_change":"2024-02-16T00:13:31.985353+0000","last_active":"2024-02-16T00:13:31.985328+0000","last_peered":"2024-02-16T00:13:31.985328+0000","last_clean":"2024-02-16T00:13:31.985328+0000","last_became_active":"2024-02-16T00:11:02.823028+0000","last_became_peered":"2024-02-16T00:11:02.823028+0000","last_unstale":"2024-02-16T00:13:31.985328+0000","last_undegraded":"2024-02-16T00:13:31.985328+0000","last_fullsized":"2024-02-16T00:13:31.985328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:31.985241+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:31.985241+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.985241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:40:06.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:55.646834+0000","last_change":"2024-02-16T00:12:55.646834+0000","last_active":"2024-02-16T00:12:55.646834+0000","last_peered":"2024-02-16T00:12:55.646834+0000","last_clean":"2024-02-16T00:12:55.646834+0000","last_became_active":"2024-02-16T00:11:06.802478+0000","last_became_peered":"2024-02-16T00:11:06.802478+0000","last_unstale":"2024-02-16T00:12:55.646834+0000","last_undegraded":"2024-02-16T00:12:55.646834+0000","last_fullsized":"2024-02-16T00:12:55.646834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:55.646719+0000","last_clean_scrub_stamp":"2024-02-16T00:12:55.646719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:53.816935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'88","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.997697+0000","last_change":"2024-02-16T00:12:46.997697+0000","last_active":"2024-02-16T00:12:46.997697+0000","last_peered":"2024-02-16T00:12:46.997697+0000","last_clean":"2024-02-16T00:12:46.997697+0000","last_became_active":"2024-02-16T00:11:08.811806+0000","last_became_peered":"2024-02-16T00:11:08.811806+0000","last_unstale":"2024-02-16T00:12:46.997697+0000","last_undegraded":"2024-02-16T00:12:46.997697+0000","last_fullsized":"2024-02-16T00:12:46.997697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'88","last_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_deep_scrub":"29'88","last_deep_scrub_stamp":"2024-02-16T00:12:46.997576+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.997576+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:05:47.865804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:38.895106+0000","last_change":"2024-02-16T00:12:38.895106+0000","last_active":"2024-02-16T00:12:38.895106+0000","last_peered":"2024-02-16T00:12:38.895106+0000","last_clean":"2024-02-16T00:12:38.895106+0000","last_became_active":"2024-02-16T00:11:10.819476+0000","last_became_peered":"2024-02-16T00:11:10.819476+0000","last_unstale":"2024-02-16T00:12:38.895106+0000","last_undegraded":"2024-02-16T00:12:38.895106+0000","last_fullsized":"2024-02-16T00:12:38.895106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:38.895009+0000","last_clean_scrub_stamp":"2024-02-16T00:12:38.895009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:28:07.402769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'49","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:46.287858+0000","last_change":"2024-02-16T00:12:46.287858+0000","last_active":"2024-02-16T00:12:46.287858+0000","last_peered":"2024-02-16T00:12:46.287858+0000","last_clean":"2024-02-16T00:12:46.287858+0000","last_became_active":"2024-02-16T00:11:12.817230+0000","last_became_peered":"2024-02-16T00:11:12.817230+0000","last_unstale":"2024-02-16T00:12:46.287858+0000","last_undegraded":"2024-02-16T00:12:46.287858+0000","last_fullsized":"2024-02-16T00:12:46.287858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-02-16T00:12:46.287742+0000","last_clean_scrub_stamp":"2024-02-16T00:12:46.287742+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:27.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.060562+0000","last_change":"2024-02-16T00:13:22.060587+0000","last_active":"2024-02-16T00:13:22.060562+0000","last_peered":"2024-02-16T00:13:22.060562+0000","last_clean":"2024-02-16T00:13:22.060562+0000","last_became_active":"2024-02-16T00:11:04.800085+0000","last_became_peered":"2024-02-16T00:11:04.800085+0000","last_unstale":"2024-02-16T00:13:22.060562+0000","last_undegraded":"2024-02-16T00:13:22.060562+0000","last_fullsized":"2024-02-16T00:13:22.060562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:22.060477+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:22.060477+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.060477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:43:46.570239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:51.793093+0000","last_change":"2024-02-16T00:13:51.793119+0000","last_active":"2024-02-16T00:13:51.793093+0000","last_peered":"2024-02-16T00:13:51.793093+0000","last_clean":"2024-02-16T00:13:51.793093+0000","last_became_active":"2024-02-16T00:10:55.436931+0000","last_became_peered":"2024-02-16T00:10:55.436931+0000","last_unstale":"2024-02-16T00:13:51.793093+0000","last_undegraded":"2024-02-16T00:13:51.793093+0000","last_fullsized":"2024-02-16T00:13:51.793093+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:51.793000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:51.793000+0000","last_clean_scrub_stamp":"2024-02-16T00:13:51.793000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:18:50.224219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.808017+0000","last_change":"2024-02-16T00:13:11.808042+0000","last_active":"2024-02-16T00:13:11.808017+0000","last_peered":"2024-02-16T00:13:11.808017+0000","last_clean":"2024-02-16T00:13:11.808017+0000","last_became_active":"2024-02-16T00:11:02.807724+0000","last_became_peered":"2024-02-16T00:11:02.807724+0000","last_unstale":"2024-02-16T00:13:11.808017+0000","last_undegraded":"2024-02-16T00:13:11.808017+0000","last_fullsized":"2024-02-16T00:13:11.808017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:11.807928+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.807928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:43.625385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:14:03.999406+0000","last_change":"2024-02-16T00:14:03.999431+0000","last_active":"2024-02-16T00:14:03.999406+0000","last_peered":"2024-02-16T00:14:03.999406+0000","last_clean":"2024-02-16T00:14:03.999406+0000","last_became_active":"2024-02-16T00:11:50.849584+0000","last_became_peered":"2024-02-16T00:11:50.849584+0000","last_unstale":"2024-02-16T00:14:03.999406+0000","last_undegraded":"2024-02-16T00:14:03.999406+0000","last_fullsized":"2024-02-16T00:14:03.999406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:14:03.999316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:14:03.999316+0000","last_clean_scrub_stamp":"2024-02-16T00:14:03.999316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:38:31.060849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'263","reported_seq":460,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.503542+0000","last_change":"2024-02-16T00:12:41.503542+0000","last_active":"2024-02-16T00:12:41.503542+0000","last_peered":"2024-02-16T00:12:41.503542+0000","last_clean":"2024-02-16T00:12:41.503542+0000","last_became_active":"2024-02-16T00:11:08.816520+0000","last_became_peered":"2024-02-16T00:11:08.816520+0000","last_unstale":"2024-02-16T00:12:41.503542+0000","last_undegraded":"2024-02-16T00:12:41.503542+0000","last_fullsized":"2024-02-16T00:12:41.503542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'263","last_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_deep_scrub":"29'263","last_deep_scrub_stamp":"2024-02-16T00:12:41.503409+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.503409+0000","objects_scrubbed":11,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:12.672777+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":329,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.038391+0000","last_change":"2024-02-16T00:13:01.038391+0000","last_active":"2024-02-16T00:13:01.038391+0000","last_peered":"2024-02-16T00:13:01.038391+0000","last_clean":"2024-02-16T00:13:01.038391+0000","last_became_active":"2024-02-16T00:11:10.829146+0000","last_became_peered":"2024-02-16T00:11:10.829146+0000","last_unstale":"2024-02-16T00:13:01.038391+0000","last_undegraded":"2024-02-16T00:13:01.038391+0000","last_fullsized":"2024-02-16T00:13:01.038391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:01.038282+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.038282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:10:49.789079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.730629+0000","last_change":"2024-02-16T00:13:34.730654+0000","last_active":"2024-02-16T00:13:34.730629+0000","last_peered":"2024-02-16T00:13:34.730629+0000","last_clean":"2024-02-16T00:13:34.730629+0000","last_became_active":"2024-02-16T00:11:12.828011+0000","last_became_peered":"2024-02-16T00:11:12.828011+0000","last_unstale":"2024-02-16T00:13:34.730629+0000","last_undegraded":"2024-02-16T00:13:34.730629+0000","last_fullsized":"2024-02-16T00:13:34.730629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:13:34.730542+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:13:34.730542+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.730542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:23:44.838549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.757812+0000","last_change":"2024-02-16T00:13:07.757812+0000","last_active":"2024-02-16T00:13:07.757812+0000","last_peered":"2024-02-16T00:13:07.757812+0000","last_clean":"2024-02-16T00:13:07.757812+0000","last_became_active":"2024-02-16T00:11:04.803269+0000","last_became_peered":"2024-02-16T00:11:04.803269+0000","last_unstale":"2024-02-16T00:13:07.757812+0000","last_undegraded":"2024-02-16T00:13:07.757812+0000","last_fullsized":"2024-02-16T00:13:07.757812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.757686+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.757686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:36.310457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.256673+0000","last_change":"2024-02-16T00:13:20.256698+0000","last_active":"2024-02-16T00:13:20.256673+0000","last_peered":"2024-02-16T00:13:20.256673+0000","last_clean":"2024-02-16T00:13:20.256673+0000","last_became_active":"2024-02-16T00:10:55.436302+0000","last_became_peered":"2024-02-16T00:10:55.436302+0000","last_unstale":"2024-02-16T00:13:20.256673+0000","last_undegraded":"2024-02-16T00:13:20.256673+0000","last_fullsized":"2024-02-16T00:13:20.256673+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:20.256588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:20.256588+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.256588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:42:00.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.891449+0000","last_change":"2024-02-16T00:13:21.891474+0000","last_active":"2024-02-16T00:13:21.891449+0000","last_peered":"2024-02-16T00:13:21.891449+0000","last_clean":"2024-02-16T00:13:21.891449+0000","last_became_active":"2024-02-16T00:11:02.801515+0000","last_became_peered":"2024-02-16T00:11:02.801515+0000","last_unstale":"2024-02-16T00:13:21.891449+0000","last_undegraded":"2024-02-16T00:13:21.891449+0000","last_fullsized":"2024-02-16T00:13:21.891449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:21.891363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:21.891363+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.891363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:16:18.993601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.171880+0000","last_change":"2024-02-16T00:13:01.171880+0000","last_active":"2024-02-16T00:13:01.171880+0000","last_peered":"2024-02-16T00:13:01.171880+0000","last_clean":"2024-02-16T00:13:01.171880+0000","last_became_active":"2024-02-16T00:11:06.802971+0000","last_became_peered":"2024-02-16T00:11:06.802971+0000","last_unstale":"2024-02-16T00:13:01.171880+0000","last_undegraded":"2024-02-16T00:13:01.171880+0000","last_fullsized":"2024-02-16T00:13:01.171880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:01.171761+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.171761+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:05:27.041410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.284740+0000","last_change":"2024-02-16T00:12:47.284740+0000","last_active":"2024-02-16T00:12:47.284740+0000","last_peered":"2024-02-16T00:12:47.284740+0000","last_clean":"2024-02-16T00:12:47.284740+0000","last_became_active":"2024-02-16T00:11:08.817633+0000","last_became_peered":"2024-02-16T00:11:08.817633+0000","last_unstale":"2024-02-16T00:12:47.284740+0000","last_undegraded":"2024-02-16T00:12:47.284740+0000","last_fullsized":"2024-02-16T00:12:47.284740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-02-16T00:12:47.284612+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.284612+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:47:18.453979+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:39.908420+0000","last_change":"2024-02-16T00:12:39.908420+0000","last_active":"2024-02-16T00:12:39.908420+0000","last_peered":"2024-02-16T00:12:39.908420+0000","last_clean":"2024-02-16T00:12:39.908420+0000","last_became_active":"2024-02-16T00:11:10.819005+0000","last_became_peered":"2024-02-16T00:11:10.819005+0000","last_unstale":"2024-02-16T00:12:39.908420+0000","last_undegraded":"2024-02-16T00:12:39.908420+0000","last_fullsized":"2024-02-16T00:12:39.908420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:39.908319+0000","last_clean_scrub_stamp":"2024-02-16T00:12:39.908319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:17.603599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:57.929361+0000","last_change":"2024-02-16T00:13:57.929403+0000","last_active":"2024-02-16T00:13:57.929361+0000","last_peered":"2024-02-16T00:13:57.929361+0000","last_clean":"2024-02-16T00:13:57.929361+0000","last_became_active":"2024-02-16T00:11:12.832325+0000","last_became_peered":"2024-02-16T00:11:12.832325+0000","last_unstale":"2024-02-16T00:13:57.929361+0000","last_undegraded":"2024-02-16T00:13:57.929361+0000","last_fullsized":"2024-02-16T00:13:57.929361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:57.929267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:57.929267+0000","last_clean_scrub_stamp":"2024-02-16T00:13:57.929267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:35.224978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:16.824008+0000","last_change":"2024-02-16T00:13:16.824040+0000","last_active":"2024-02-16T00:13:16.824008+0000","last_peered":"2024-02-16T00:13:16.824008+0000","last_clean":"2024-02-16T00:13:16.824008+0000","last_became_active":"2024-02-16T00:11:04.801022+0000","last_became_peered":"2024-02-16T00:11:04.801022+0000","last_unstale":"2024-02-16T00:13:16.824008+0000","last_undegraded":"2024-02-16T00:13:16.824008+0000","last_fullsized":"2024-02-16T00:13:16.824008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:16.823910+0000","last_clean_scrub_stamp":"2024-02-16T00:13:16.823910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:40.976221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:49.875032+0000","last_change":"2024-02-16T00:13:49.875072+0000","last_active":"2024-02-16T00:13:49.875032+0000","last_peered":"2024-02-16T00:13:49.875032+0000","last_clean":"2024-02-16T00:13:49.875032+0000","last_became_active":"2024-02-16T00:10:55.436093+0000","last_became_peered":"2024-02-16T00:10:55.436093+0000","last_unstale":"2024-02-16T00:13:49.875032+0000","last_undegraded":"2024-02-16T00:13:49.875032+0000","last_fullsized":"2024-02-16T00:13:49.875032+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:49.874905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:49.874905+0000","last_clean_scrub_stamp":"2024-02-16T00:13:49.874905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:41:36.900597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.300088+0000","last_change":"2024-02-16T00:13:26.300114+0000","last_active":"2024-02-16T00:13:26.300088+0000","last_peered":"2024-02-16T00:13:26.300088+0000","last_clean":"2024-02-16T00:13:26.300088+0000","last_became_active":"2024-02-16T00:11:02.811472+0000","last_became_peered":"2024-02-16T00:11:02.811472+0000","last_unstale":"2024-02-16T00:13:26.300088+0000","last_undegraded":"2024-02-16T00:13:26.300088+0000","last_fullsized":"2024-02-16T00:13:26.300088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.299989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.299989+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.299989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:33:19.154640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.295833+0000","last_change":"2024-02-16T00:13:31.295833+0000","last_active":"2024-02-16T00:13:31.295833+0000","last_peered":"2024-02-16T00:13:31.295833+0000","last_clean":"2024-02-16T00:13:31.295833+0000","last_became_active":"2024-02-16T00:11:50.850752+0000","last_became_peered":"2024-02-16T00:11:50.850752+0000","last_unstale":"2024-02-16T00:13:31.295833+0000","last_undegraded":"2024-02-16T00:13:31.295833+0000","last_fullsized":"2024-02-16T00:13:31.295833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.295719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.295719+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.295719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:04:51.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.935999+0000","last_change":"2024-02-16T00:12:52.935999+0000","last_active":"2024-02-16T00:12:52.935999+0000","last_peered":"2024-02-16T00:12:52.935999+0000","last_clean":"2024-02-16T00:12:52.935999+0000","last_became_active":"2024-02-16T00:11:08.812090+0000","last_became_peered":"2024-02-16T00:11:08.812090+0000","last_unstale":"2024-02-16T00:12:52.935999+0000","last_undegraded":"2024-02-16T00:12:52.935999+0000","last_fullsized":"2024-02-16T00:12:52.935999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-02-16T00:12:52.935867+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.935867+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:29.245202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.060701+0000","last_change":"2024-02-16T00:13:02.060701+0000","last_active":"2024-02-16T00:13:02.060701+0000","last_peered":"2024-02-16T00:13:02.060701+0000","last_clean":"2024-02-16T00:13:02.060701+0000","last_became_active":"2024-02-16T00:11:10.829250+0000","last_became_peered":"2024-02-16T00:11:10.829250+0000","last_unstale":"2024-02-16T00:13:02.060701+0000","last_undegraded":"2024-02-16T00:13:02.060701+0000","last_fullsized":"2024-02-16T00:13:02.060701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.060586+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.060586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:22.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.708762+0000","last_change":"2024-02-16T00:13:38.708793+0000","last_active":"2024-02-16T00:13:38.708762+0000","last_peered":"2024-02-16T00:13:38.708762+0000","last_clean":"2024-02-16T00:13:38.708762+0000","last_became_active":"2024-02-16T00:11:12.835027+0000","last_became_peered":"2024-02-16T00:11:12.835027+0000","last_unstale":"2024-02-16T00:13:38.708762+0000","last_undegraded":"2024-02-16T00:13:38.708762+0000","last_fullsized":"2024-02-16T00:13:38.708762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:38.708646+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:38.708646+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.708646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:56.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.631131+0000","last_change":"2024-02-16T00:13:03.631131+0000","last_active":"2024-02-16T00:13:03.631131+0000","last_peered":"2024-02-16T00:13:03.631131+0000","last_clean":"2024-02-16T00:13:03.631131+0000","last_became_active":"2024-02-16T00:11:04.813834+0000","last_became_peered":"2024-02-16T00:11:04.813834+0000","last_unstale":"2024-02-16T00:13:03.631131+0000","last_undegraded":"2024-02-16T00:13:03.631131+0000","last_fullsized":"2024-02-16T00:13:03.631131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:03.630995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.630995+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:51:48.259171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.261488+0000","last_change":"2024-02-16T00:13:25.261516+0000","last_active":"2024-02-16T00:13:25.261488+0000","last_peered":"2024-02-16T00:13:25.261488+0000","last_clean":"2024-02-16T00:13:25.261488+0000","last_became_active":"2024-02-16T00:11:02.805588+0000","last_became_peered":"2024-02-16T00:11:02.805588+0000","last_unstale":"2024-02-16T00:13:25.261488+0000","last_undegraded":"2024-02-16T00:13:25.261488+0000","last_fullsized":"2024-02-16T00:13:25.261488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.261400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.261400+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.261400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:31:49.413711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:24.918057+0000","last_change":"2024-02-16T00:13:24.918084+0000","last_active":"2024-02-16T00:13:24.918057+0000","last_peered":"2024-02-16T00:13:24.918057+0000","last_clean":"2024-02-16T00:13:24.918057+0000","last_became_active":"2024-02-16T00:10:55.436352+0000","last_became_peered":"2024-02-16T00:10:55.436352+0000","last_unstale":"2024-02-16T00:13:24.918057+0000","last_undegraded":"2024-02-16T00:13:24.918057+0000","last_fullsized":"2024-02-16T00:13:24.918057+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:24.917971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:24.917971+0000","last_clean_scrub_stamp":"2024-02-16T00:13:24.917971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:46.516651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.830866+0000","last_change":"2024-02-16T00:12:53.830866+0000","last_active":"2024-02-16T00:12:53.830866+0000","last_peered":"2024-02-16T00:12:53.830866+0000","last_clean":"2024-02-16T00:12:53.830866+0000","last_became_active":"2024-02-16T00:11:06.808731+0000","last_became_peered":"2024-02-16T00:11:06.808731+0000","last_unstale":"2024-02-16T00:12:53.830866+0000","last_undegraded":"2024-02-16T00:12:53.830866+0000","last_fullsized":"2024-02-16T00:12:53.830866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:53.830730+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.830730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:52.000946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'82","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.898405+0000","last_change":"2024-02-16T00:12:49.898405+0000","last_active":"2024-02-16T00:12:49.898405+0000","last_peered":"2024-02-16T00:12:49.898405+0000","last_clean":"2024-02-16T00:12:49.898405+0000","last_became_active":"2024-02-16T00:11:08.812634+0000","last_became_peered":"2024-02-16T00:11:08.812634+0000","last_unstale":"2024-02-16T00:12:49.898405+0000","last_undegraded":"2024-02-16T00:12:49.898405+0000","last_fullsized":"2024-02-16T00:12:49.898405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-02-16T00:12:49.898247+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.898247+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:43:05.900172+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":88,"num_read_kb":74,"num_write":40,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.271734+0000","last_change":"2024-02-16T00:12:40.271734+0000","last_active":"2024-02-16T00:12:40.271734+0000","last_peered":"2024-02-16T00:12:40.271734+0000","last_clean":"2024-02-16T00:12:40.271734+0000","last_became_active":"2024-02-16T00:11:10.824686+0000","last_became_peered":"2024-02-16T00:11:10.824686+0000","last_unstale":"2024-02-16T00:12:40.271734+0000","last_undegraded":"2024-02-16T00:12:40.271734+0000","last_fullsized":"2024-02-16T00:12:40.271734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.271589+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.271589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:16:58.621135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.881341+0000","last_change":"2024-02-16T00:13:33.881365+0000","last_active":"2024-02-16T00:13:33.881341+0000","last_peered":"2024-02-16T00:13:33.881341+0000","last_clean":"2024-02-16T00:13:33.881341+0000","last_became_active":"2024-02-16T00:11:12.821764+0000","last_became_peered":"2024-02-16T00:11:12.821764+0000","last_unstale":"2024-02-16T00:13:33.881341+0000","last_undegraded":"2024-02-16T00:13:33.881341+0000","last_fullsized":"2024-02-16T00:13:33.881341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-02-16T00:13:33.881259+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-02-16T00:13:33.881259+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.881259+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:45.797319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.602576+0000","last_change":"2024-02-16T00:12:59.602576+0000","last_active":"2024-02-16T00:12:59.602576+0000","last_peered":"2024-02-16T00:12:59.602576+0000","last_clean":"2024-02-16T00:12:59.602576+0000","last_became_active":"2024-02-16T00:11:04.814283+0000","last_became_peered":"2024-02-16T00:11:04.814283+0000","last_unstale":"2024-02-16T00:12:59.602576+0000","last_undegraded":"2024-02-16T00:12:59.602576+0000","last_fullsized":"2024-02-16T00:12:59.602576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:59.602467+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.602467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:39.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.940733+0000","last_change":"2024-02-16T00:13:31.940759+0000","last_active":"2024-02-16T00:13:31.940733+0000","last_peered":"2024-02-16T00:13:31.940733+0000","last_clean":"2024-02-16T00:13:31.940733+0000","last_became_active":"2024-02-16T00:11:02.800870+0000","last_became_peered":"2024-02-16T00:11:02.800870+0000","last_unstale":"2024-02-16T00:13:31.940733+0000","last_undegraded":"2024-02-16T00:13:31.940733+0000","last_fullsized":"2024-02-16T00:13:31.940733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.940638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.940638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.940638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:29.880557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:48.920129+0000","last_change":"2024-02-16T00:13:48.920155+0000","last_active":"2024-02-16T00:13:48.920129+0000","last_peered":"2024-02-16T00:13:48.920129+0000","last_clean":"2024-02-16T00:13:48.920129+0000","last_became_active":"2024-02-16T00:10:55.435977+0000","last_became_peered":"2024-02-16T00:10:55.435977+0000","last_unstale":"2024-02-16T00:13:48.920129+0000","last_undegraded":"2024-02-16T00:13:48.920129+0000","last_fullsized":"2024-02-16T00:13:48.920129+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:48.920037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:48.920037+0000","last_clean_scrub_stamp":"2024-02-16T00:13:48.920037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:12:00.747801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.038166+0000","last_change":"2024-02-16T00:12:44.038166+0000","last_active":"2024-02-16T00:12:44.038166+0000","last_peered":"2024-02-16T00:12:44.038166+0000","last_clean":"2024-02-16T00:12:44.038166+0000","last_became_active":"2024-02-16T00:11:06.806383+0000","last_became_peered":"2024-02-16T00:11:06.806383+0000","last_unstale":"2024-02-16T00:12:44.038166+0000","last_undegraded":"2024-02-16T00:12:44.038166+0000","last_fullsized":"2024-02-16T00:12:44.038166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.038018+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.038018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:17:35.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'28","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.546695+0000","last_change":"2024-02-16T00:12:40.546695+0000","last_active":"2024-02-16T00:12:40.546695+0000","last_peered":"2024-02-16T00:12:40.546695+0000","last_clean":"2024-02-16T00:12:40.546695+0000","last_became_active":"2024-02-16T00:11:08.816596+0000","last_became_peered":"2024-02-16T00:11:08.816596+0000","last_unstale":"2024-02-16T00:12:40.546695+0000","last_undegraded":"2024-02-16T00:12:40.546695+0000","last_fullsized":"2024-02-16T00:12:40.546695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-02-16T00:12:40.546560+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.546560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:19:21.906524+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'243","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.683178+0000","last_change":"2024-02-16T00:12:54.683178+0000","last_active":"2024-02-16T00:12:54.683178+0000","last_peered":"2024-02-16T00:12:54.683178+0000","last_clean":"2024-02-16T00:12:54.683178+0000","last_became_active":"2024-02-16T00:11:10.821520+0000","last_became_peered":"2024-02-16T00:11:10.821520+0000","last_unstale":"2024-02-16T00:12:54.683178+0000","last_undegraded":"2024-02-16T00:12:54.683178+0000","last_fullsized":"2024-02-16T00:12:54.683178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:54.683065+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.683065+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:10.032872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:14:00.912554+0000","last_change":"2024-02-16T00:14:00.912577+0000","last_active":"2024-02-16T00:14:00.912554+0000","last_peered":"2024-02-16T00:14:00.912554+0000","last_clean":"2024-02-16T00:14:00.912554+0000","last_became_active":"2024-02-16T00:11:12.833359+0000","last_became_peered":"2024-02-16T00:11:12.833359+0000","last_unstale":"2024-02-16T00:14:00.912554+0000","last_undegraded":"2024-02-16T00:14:00.912554+0000","last_fullsized":"2024-02-16T00:14:00.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:14:00.912466+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:14:00.912466+0000","last_clean_scrub_stamp":"2024-02-16T00:14:00.912466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:43:13.142853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.036881+0000","last_change":"2024-02-16T00:12:56.036881+0000","last_active":"2024-02-16T00:12:56.036881+0000","last_peered":"2024-02-16T00:12:56.036881+0000","last_clean":"2024-02-16T00:12:56.036881+0000","last_became_active":"2024-02-16T00:11:04.813526+0000","last_became_peered":"2024-02-16T00:11:04.813526+0000","last_unstale":"2024-02-16T00:12:56.036881+0000","last_undegraded":"2024-02-16T00:12:56.036881+0000","last_fullsized":"2024-02-16T00:12:56.036881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:56.036766+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.036766+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:37:08.513561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:54.817958+0000","last_change":"2024-02-16T00:13:54.817982+0000","last_active":"2024-02-16T00:13:54.817958+0000","last_peered":"2024-02-16T00:13:54.817958+0000","last_clean":"2024-02-16T00:13:54.817958+0000","last_became_active":"2024-02-16T00:11:02.812445+0000","last_became_peered":"2024-02-16T00:11:02.812445+0000","last_unstale":"2024-02-16T00:13:54.817958+0000","last_undegraded":"2024-02-16T00:13:54.817958+0000","last_fullsized":"2024-02-16T00:13:54.817958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:54.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:54.817871+0000","last_clean_scrub_stamp":"2024-02-16T00:13:54.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:10:32.193736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.950979+0000","last_change":"2024-02-16T00:13:25.951007+0000","last_active":"2024-02-16T00:13:25.950979+0000","last_peered":"2024-02-16T00:13:25.950979+0000","last_clean":"2024-02-16T00:13:25.950979+0000","last_became_active":"2024-02-16T00:10:55.437381+0000","last_became_peered":"2024-02-16T00:10:55.437381+0000","last_unstale":"2024-02-16T00:13:25.950979+0000","last_undegraded":"2024-02-16T00:13:25.950979+0000","last_fullsized":"2024-02-16T00:13:25.950979+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.950886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.950886+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.950886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:53.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.031737+0000","last_change":"2024-02-16T00:12:42.031737+0000","last_active":"2024-02-16T00:12:42.031737+0000","last_peered":"2024-02-16T00:12:42.031737+0000","last_clean":"2024-02-16T00:12:42.031737+0000","last_became_active":"2024-02-16T00:11:06.807788+0000","last_became_peered":"2024-02-16T00:11:06.807788+0000","last_unstale":"2024-02-16T00:12:42.031737+0000","last_undegraded":"2024-02-16T00:12:42.031737+0000","last_fullsized":"2024-02-16T00:12:42.031737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:42.031605+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.031605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:03.714051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.979307+0000","last_change":"2024-02-16T00:13:11.979307+0000","last_active":"2024-02-16T00:13:11.979307+0000","last_peered":"2024-02-16T00:13:11.979307+0000","last_clean":"2024-02-16T00:13:11.979307+0000","last_became_active":"2024-02-16T00:11:08.813760+0000","last_became_peered":"2024-02-16T00:11:08.813760+0000","last_unstale":"2024-02-16T00:13:11.979307+0000","last_undegraded":"2024-02-16T00:13:11.979307+0000","last_fullsized":"2024-02-16T00:13:11.979307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:13:11.979168+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.979168+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.839816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'243","reported_seq":323,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.867290+0000","last_change":"2024-02-16T00:12:50.867290+0000","last_active":"2024-02-16T00:12:50.867290+0000","last_peered":"2024-02-16T00:12:50.867290+0000","last_clean":"2024-02-16T00:12:50.867290+0000","last_became_active":"2024-02-16T00:11:10.820036+0000","last_became_peered":"2024-02-16T00:11:10.820036+0000","last_unstale":"2024-02-16T00:12:50.867290+0000","last_undegraded":"2024-02-16T00:12:50.867290+0000","last_fullsized":"2024-02-16T00:12:50.867290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:50.867173+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.867173+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:38:57.352373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.761485+0000","last_change":"2024-02-16T00:13:36.761541+0000","last_active":"2024-02-16T00:13:36.761485+0000","last_peered":"2024-02-16T00:13:36.761485+0000","last_clean":"2024-02-16T00:13:36.761485+0000","last_became_active":"2024-02-16T00:11:12.832608+0000","last_became_peered":"2024-02-16T00:11:12.832608+0000","last_unstale":"2024-02-16T00:13:36.761485+0000","last_undegraded":"2024-02-16T00:13:36.761485+0000","last_fullsized":"2024-02-16T00:13:36.761485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:36.761373+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:36.761373+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.761373+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:48:09.020019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":66,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.178067+0000","last_change":"2024-02-16T00:13:14.178092+0000","last_active":"2024-02-16T00:13:14.178067+0000","last_peered":"2024-02-16T00:13:14.178067+0000","last_clean":"2024-02-16T00:13:14.178067+0000","last_became_active":"2024-02-16T00:11:04.809001+0000","last_became_peered":"2024-02-16T00:11:04.809001+0000","last_unstale":"2024-02-16T00:13:14.178067+0000","last_undegraded":"2024-02-16T00:13:14.178067+0000","last_fullsized":"2024-02-16T00:13:14.178067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:14.177977+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.177977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:25:57.854662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.707210+0000","last_change":"2024-02-16T00:13:27.707247+0000","last_active":"2024-02-16T00:13:27.707210+0000","last_peered":"2024-02-16T00:13:27.707210+0000","last_clean":"2024-02-16T00:13:27.707210+0000","last_became_active":"2024-02-16T00:11:02.796000+0000","last_became_peered":"2024-02-16T00:11:02.796000+0000","last_unstale":"2024-02-16T00:13:27.707210+0000","last_undegraded":"2024-02-16T00:13:27.707210+0000","last_fullsized":"2024-02-16T00:13:27.707210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:27.707110+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:27.707110+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.707110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:25:55.295504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:50.839763+0000","last_change":"2024-02-16T00:13:50.839785+0000","last_active":"2024-02-16T00:13:50.839763+0000","last_peered":"2024-02-16T00:13:50.839763+0000","last_clean":"2024-02-16T00:13:50.839763+0000","last_became_active":"2024-02-16T00:10:55.436584+0000","last_became_peered":"2024-02-16T00:10:55.436584+0000","last_unstale":"2024-02-16T00:13:50.839763+0000","last_undegraded":"2024-02-16T00:13:50.839763+0000","last_fullsized":"2024-02-16T00:13:50.839763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:50.839675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:50.839675+0000","last_clean_scrub_stamp":"2024-02-16T00:13:50.839675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:20:32.750449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.021889+0000","last_change":"2024-02-16T00:12:41.021889+0000","last_active":"2024-02-16T00:12:41.021889+0000","last_peered":"2024-02-16T00:12:41.021889+0000","last_clean":"2024-02-16T00:12:41.021889+0000","last_became_active":"2024-02-16T00:11:06.807669+0000","last_became_peered":"2024-02-16T00:11:06.807669+0000","last_unstale":"2024-02-16T00:12:41.021889+0000","last_undegraded":"2024-02-16T00:12:41.021889+0000","last_fullsized":"2024-02-16T00:12:41.021889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.021775+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.021775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:07.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'97","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.111041+0000","last_change":"2024-02-16T00:12:52.111041+0000","last_active":"2024-02-16T00:12:52.111041+0000","last_peered":"2024-02-16T00:12:52.111041+0000","last_clean":"2024-02-16T00:12:52.111041+0000","last_became_active":"2024-02-16T00:11:08.813304+0000","last_became_peered":"2024-02-16T00:11:08.813304+0000","last_unstale":"2024-02-16T00:12:52.111041+0000","last_undegraded":"2024-02-16T00:12:52.111041+0000","last_fullsized":"2024-02-16T00:12:52.111041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'97","last_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_deep_scrub":"29'97","last_deep_scrub_stamp":"2024-02-16T00:12:52.110898+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.110898+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:26:30.300620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.913378+0000","last_change":"2024-02-16T00:13:02.913378+0000","last_active":"2024-02-16T00:13:02.913378+0000","last_peered":"2024-02-16T00:13:02.913378+0000","last_clean":"2024-02-16T00:13:02.913378+0000","last_became_active":"2024-02-16T00:11:10.824930+0000","last_became_peered":"2024-02-16T00:11:10.824930+0000","last_unstale":"2024-02-16T00:13:02.913378+0000","last_undegraded":"2024-02-16T00:13:02.913378+0000","last_fullsized":"2024-02-16T00:13:02.913378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:02.913264+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.913264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:45.929231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:02.193822+0000","last_change":"2024-02-16T00:13:02.193822+0000","last_active":"2024-02-16T00:13:02.193822+0000","last_peered":"2024-02-16T00:13:02.193822+0000","last_clean":"2024-02-16T00:13:02.193822+0000","last_became_active":"2024-02-16T00:11:12.825565+0000","last_became_peered":"2024-02-16T00:11:12.825565+0000","last_unstale":"2024-02-16T00:13:02.193822+0000","last_undegraded":"2024-02-16T00:13:02.193822+0000","last_fullsized":"2024-02-16T00:13:02.193822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:02.193681+0000","last_clean_scrub_stamp":"2024-02-16T00:13:02.193681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:11:17.543487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.291822+0000","last_change":"2024-02-16T00:13:29.291852+0000","last_active":"2024-02-16T00:13:29.291822+0000","last_peered":"2024-02-16T00:13:29.291822+0000","last_clean":"2024-02-16T00:13:29.291822+0000","last_became_active":"2024-02-16T00:11:12.825945+0000","last_became_peered":"2024-02-16T00:11:12.825945+0000","last_unstale":"2024-02-16T00:13:29.291822+0000","last_undegraded":"2024-02-16T00:13:29.291822+0000","last_fullsized":"2024-02-16T00:13:29.291822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:29.291739+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:29.291739+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.291739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:54.517083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.185628+0000","last_change":"2024-02-16T00:13:18.185628+0000","last_active":"2024-02-16T00:13:18.185628+0000","last_peered":"2024-02-16T00:13:18.185628+0000","last_clean":"2024-02-16T00:13:18.185628+0000","last_became_active":"2024-02-16T00:11:04.810564+0000","last_became_peered":"2024-02-16T00:11:04.810564+0000","last_unstale":"2024-02-16T00:13:18.185628+0000","last_undegraded":"2024-02-16T00:13:18.185628+0000","last_fullsized":"2024-02-16T00:13:18.185628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:18.185505+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.185505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:49.777334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:44.025093+0000","last_change":"2024-02-16T00:13:44.025116+0000","last_active":"2024-02-16T00:13:44.025093+0000","last_peered":"2024-02-16T00:13:44.025093+0000","last_clean":"2024-02-16T00:13:44.025093+0000","last_became_active":"2024-02-16T00:11:02.812781+0000","last_became_peered":"2024-02-16T00:11:02.812781+0000","last_unstale":"2024-02-16T00:13:44.025093+0000","last_undegraded":"2024-02-16T00:13:44.025093+0000","last_fullsized":"2024-02-16T00:13:44.025093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:44.025000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:44.025000+0000","last_clean_scrub_stamp":"2024-02-16T00:13:44.025000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:05:41.110252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"29'2","reported_seq":204,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.629040+0000","last_change":"2024-02-16T00:12:52.629040+0000","last_active":"2024-02-16T00:12:52.629040+0000","last_peered":"2024-02-16T00:12:52.629040+0000","last_clean":"2024-02-16T00:12:52.629040+0000","last_became_active":"2024-02-16T00:11:06.804317+0000","last_became_peered":"2024-02-16T00:11:06.804317+0000","last_unstale":"2024-02-16T00:12:52.629040+0000","last_undegraded":"2024-02-16T00:12:52.629040+0000","last_fullsized":"2024-02-16T00:12:52.629040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:12:52.628926+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.628926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:49.990836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'45","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.017778+0000","last_change":"2024-02-16T00:13:09.017778+0000","last_active":"2024-02-16T00:13:09.017778+0000","last_peered":"2024-02-16T00:13:09.017778+0000","last_clean":"2024-02-16T00:13:09.017778+0000","last_became_active":"2024-02-16T00:11:08.816783+0000","last_became_peered":"2024-02-16T00:11:08.816783+0000","last_unstale":"2024-02-16T00:13:09.017778+0000","last_undegraded":"2024-02-16T00:13:09.017778+0000","last_fullsized":"2024-02-16T00:13:09.017778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-02-16T00:13:09.017638+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.017638+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:52:00.113238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.985144+0000","last_change":"2024-02-16T00:13:14.985144+0000","last_active":"2024-02-16T00:13:14.985144+0000","last_peered":"2024-02-16T00:13:14.985144+0000","last_clean":"2024-02-16T00:13:14.985144+0000","last_became_active":"2024-02-16T00:11:10.830893+0000","last_became_peered":"2024-02-16T00:11:10.830893+0000","last_unstale":"2024-02-16T00:13:14.985144+0000","last_undegraded":"2024-02-16T00:13:14.985144+0000","last_fullsized":"2024-02-16T00:13:14.985144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.985010+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.985010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:56:26.901071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:06.788597+0000","last_change":"2024-02-16T00:13:06.788597+0000","last_active":"2024-02-16T00:13:06.788597+0000","last_peered":"2024-02-16T00:13:06.788597+0000","last_clean":"2024-02-16T00:13:06.788597+0000","last_became_active":"2024-02-16T00:11:12.819131+0000","last_became_peered":"2024-02-16T00:11:12.819131+0000","last_unstale":"2024-02-16T00:13:06.788597+0000","last_undegraded":"2024-02-16T00:13:06.788597+0000","last_fullsized":"2024-02-16T00:13:06.788597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:06.788487+0000","last_clean_scrub_stamp":"2024-02-16T00:13:06.788487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:24:05.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'14","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.329280+0000","last_change":"2024-02-16T00:13:34.329280+0000","last_active":"2024-02-16T00:13:34.329280+0000","last_peered":"2024-02-16T00:13:34.329280+0000","last_clean":"2024-02-16T00:13:34.329280+0000","last_became_active":"2024-02-16T00:11:50.850548+0000","last_became_peered":"2024-02-16T00:11:50.850548+0000","last_unstale":"2024-02-16T00:13:34.329280+0000","last_undegraded":"2024-02-16T00:13:34.329280+0000","last_fullsized":"2024-02-16T00:13:34.329280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-02-16T00:13:34.329155+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-02-16T00:13:34.329155+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.329155+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:55.927835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.263698+0000","last_change":"2024-02-16T00:13:23.263698+0000","last_active":"2024-02-16T00:13:23.263698+0000","last_peered":"2024-02-16T00:13:23.263698+0000","last_clean":"2024-02-16T00:13:23.263698+0000","last_became_active":"2024-02-16T00:11:02.805492+0000","last_became_peered":"2024-02-16T00:11:02.805492+0000","last_unstale":"2024-02-16T00:13:23.263698+0000","last_undegraded":"2024-02-16T00:13:23.263698+0000","last_fullsized":"2024-02-16T00:13:23.263698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.263575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.263575+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.263575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:11.087871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:40.045412+0000","last_change":"2024-02-16T00:12:40.045412+0000","last_active":"2024-02-16T00:12:40.045412+0000","last_peered":"2024-02-16T00:12:40.045412+0000","last_clean":"2024-02-16T00:12:40.045412+0000","last_became_active":"2024-02-16T00:11:06.809449+0000","last_became_peered":"2024-02-16T00:11:06.809449+0000","last_unstale":"2024-02-16T00:12:40.045412+0000","last_undegraded":"2024-02-16T00:12:40.045412+0000","last_fullsized":"2024-02-16T00:12:40.045412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:40.045296+0000","last_clean_scrub_stamp":"2024-02-16T00:12:40.045296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:30:50.821845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.941093+0000","last_change":"2024-02-16T00:12:45.941093+0000","last_active":"2024-02-16T00:12:45.941093+0000","last_peered":"2024-02-16T00:12:45.941093+0000","last_clean":"2024-02-16T00:12:45.941093+0000","last_became_active":"2024-02-16T00:11:08.813366+0000","last_became_peered":"2024-02-16T00:11:08.813366+0000","last_unstale":"2024-02-16T00:12:45.941093+0000","last_undegraded":"2024-02-16T00:12:45.941093+0000","last_fullsized":"2024-02-16T00:12:45.941093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:12:45.940956+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.940956+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:35:12.093182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:43.279177+0000","last_change":"2024-02-16T00:12:43.279177+0000","last_active":"2024-02-16T00:12:43.279177+0000","last_peered":"2024-02-16T00:12:43.279177+0000","last_clean":"2024-02-16T00:12:43.279177+0000","last_became_active":"2024-02-16T00:11:10.819362+0000","last_became_peered":"2024-02-16T00:11:10.819362+0000","last_unstale":"2024-02-16T00:12:43.279177+0000","last_undegraded":"2024-02-16T00:12:43.279177+0000","last_fullsized":"2024-02-16T00:12:43.279177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:43.279059+0000","last_clean_scrub_stamp":"2024-02-16T00:12:43.279059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:20:05.341803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:38.908872+0000","last_change":"2024-02-16T00:13:38.908872+0000","last_active":"2024-02-16T00:13:38.908872+0000","last_peered":"2024-02-16T00:13:38.908872+0000","last_clean":"2024-02-16T00:13:38.908872+0000","last_became_active":"2024-02-16T00:11:12.828176+0000","last_became_peered":"2024-02-16T00:11:12.828176+0000","last_unstale":"2024-02-16T00:13:38.908872+0000","last_undegraded":"2024-02-16T00:13:38.908872+0000","last_fullsized":"2024-02-16T00:13:38.908872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:38.908707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:38.908707+0000","last_clean_scrub_stamp":"2024-02-16T00:13:38.908707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:33:16.697067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.767257+0000","last_change":"2024-02-16T00:13:14.767257+0000","last_active":"2024-02-16T00:13:14.767257+0000","last_peered":"2024-02-16T00:13:14.767257+0000","last_clean":"2024-02-16T00:13:14.767257+0000","last_became_active":"2024-02-16T00:11:04.800741+0000","last_became_peered":"2024-02-16T00:11:04.800741+0000","last_unstale":"2024-02-16T00:13:14.767257+0000","last_undegraded":"2024-02-16T00:13:14.767257+0000","last_fullsized":"2024-02-16T00:13:14.767257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-02-16T00:13:14.767144+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.767144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:48:02.591440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.213509+0000","last_change":"2024-02-16T00:13:19.213509+0000","last_active":"2024-02-16T00:13:19.213509+0000","last_peered":"2024-02-16T00:13:19.213509+0000","last_clean":"2024-02-16T00:13:19.213509+0000","last_became_active":"2024-02-16T00:11:02.814552+0000","last_became_peered":"2024-02-16T00:11:02.814552+0000","last_unstale":"2024-02-16T00:13:19.213509+0000","last_undegraded":"2024-02-16T00:13:19.213509+0000","last_fullsized":"2024-02-16T00:13:19.213509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.213392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.213392+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.213392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:11.599146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.057565+0000","last_change":"2024-02-16T00:12:56.057565+0000","last_active":"2024-02-16T00:12:56.057565+0000","last_peered":"2024-02-16T00:12:56.057565+0000","last_clean":"2024-02-16T00:12:56.057565+0000","last_became_active":"2024-02-16T00:11:06.809111+0000","last_became_peered":"2024-02-16T00:11:06.809111+0000","last_unstale":"2024-02-16T00:12:56.057565+0000","last_undegraded":"2024-02-16T00:12:56.057565+0000","last_fullsized":"2024-02-16T00:12:56.057565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.057413+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.057413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:55:26.439361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:52.803076+0000","last_change":"2024-02-16T00:12:52.803076+0000","last_active":"2024-02-16T00:12:52.803076+0000","last_peered":"2024-02-16T00:12:52.803076+0000","last_clean":"2024-02-16T00:12:52.803076+0000","last_became_active":"2024-02-16T00:11:08.810035+0000","last_became_peered":"2024-02-16T00:11:08.810035+0000","last_unstale":"2024-02-16T00:12:52.803076+0000","last_undegraded":"2024-02-16T00:12:52.803076+0000","last_fullsized":"2024-02-16T00:12:52.803076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-02-16T00:12:52.802940+0000","last_clean_scrub_stamp":"2024-02-16T00:12:52.802940+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:56:55.924565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:50.555567+0000","last_change":"2024-02-16T00:12:50.555567+0000","last_active":"2024-02-16T00:12:50.555567+0000","last_peered":"2024-02-16T00:12:50.555567+0000","last_clean":"2024-02-16T00:12:50.555567+0000","last_became_active":"2024-02-16T00:11:10.823588+0000","last_became_peered":"2024-02-16T00:11:10.823588+0000","last_unstale":"2024-02-16T00:12:50.555567+0000","last_undegraded":"2024-02-16T00:12:50.555567+0000","last_fullsized":"2024-02-16T00:12:50.555567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:50.555443+0000","last_clean_scrub_stamp":"2024-02-16T00:12:50.555443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:51.432013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.079543+0000","last_change":"2024-02-16T00:13:27.079543+0000","last_active":"2024-02-16T00:13:27.079543+0000","last_peered":"2024-02-16T00:13:27.079543+0000","last_clean":"2024-02-16T00:13:27.079543+0000","last_became_active":"2024-02-16T00:11:12.830839+0000","last_became_peered":"2024-02-16T00:11:12.830839+0000","last_unstale":"2024-02-16T00:13:27.079543+0000","last_undegraded":"2024-02-16T00:13:27.079543+0000","last_fullsized":"2024-02-16T00:13:27.079543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:27.079415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:27.079415+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.079415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:34:32.883445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.080743+0000","last_change":"2024-02-16T00:12:57.080743+0000","last_active":"2024-02-16T00:12:57.080743+0000","last_peered":"2024-02-16T00:12:57.080743+0000","last_clean":"2024-02-16T00:12:57.080743+0000","last_became_active":"2024-02-16T00:11:04.811033+0000","last_became_peered":"2024-02-16T00:11:04.811033+0000","last_unstale":"2024-02-16T00:12:57.080743+0000","last_undegraded":"2024-02-16T00:12:57.080743+0000","last_fullsized":"2024-02-16T00:12:57.080743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.080604+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.080604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:32:49.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.661262+0000","last_change":"2024-02-16T00:13:23.661262+0000","last_active":"2024-02-16T00:13:23.661262+0000","last_peered":"2024-02-16T00:13:23.661262+0000","last_clean":"2024-02-16T00:13:23.661262+0000","last_became_active":"2024-02-16T00:11:02.813723+0000","last_became_peered":"2024-02-16T00:11:02.813723+0000","last_unstale":"2024-02-16T00:13:23.661262+0000","last_undegraded":"2024-02-16T00:13:23.661262+0000","last_fullsized":"2024-02-16T00:13:23.661262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-02-16T00:13:23.661125+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-02-16T00:13:23.661125+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.661125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:14:43.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13,"num_write":40,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.884373+0000","last_change":"2024-02-16T00:12:49.884373+0000","last_active":"2024-02-16T00:12:49.884373+0000","last_peered":"2024-02-16T00:12:49.884373+0000","last_clean":"2024-02-16T00:12:49.884373+0000","last_became_active":"2024-02-16T00:11:06.802704+0000","last_became_peered":"2024-02-16T00:11:06.802704+0000","last_unstale":"2024-02-16T00:12:49.884373+0000","last_undegraded":"2024-02-16T00:12:49.884373+0000","last_fullsized":"2024-02-16T00:12:49.884373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:49.884258+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.884258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:21.476087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'34","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:53.114102+0000","last_change":"2024-02-16T00:12:53.114102+0000","last_active":"2024-02-16T00:12:53.114102+0000","last_peered":"2024-02-16T00:12:53.114102+0000","last_clean":"2024-02-16T00:12:53.114102+0000","last_became_active":"2024-02-16T00:11:08.810517+0000","last_became_peered":"2024-02-16T00:11:08.810517+0000","last_unstale":"2024-02-16T00:12:53.114102+0000","last_undegraded":"2024-02-16T00:12:53.114102+0000","last_fullsized":"2024-02-16T00:12:53.114102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-02-16T00:12:53.113947+0000","last_clean_scrub_stamp":"2024-02-16T00:12:53.113947+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:53.697900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.267908+0000","last_change":"2024-02-16T00:12:44.267908+0000","last_active":"2024-02-16T00:12:44.267908+0000","last_peered":"2024-02-16T00:12:44.267908+0000","last_clean":"2024-02-16T00:12:44.267908+0000","last_became_active":"2024-02-16T00:11:10.819468+0000","last_became_peered":"2024-02-16T00:11:10.819468+0000","last_unstale":"2024-02-16T00:12:44.267908+0000","last_undegraded":"2024-02-16T00:12:44.267908+0000","last_fullsized":"2024-02-16T00:12:44.267908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.267784+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.267784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:28:21.260343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.096086+0000","last_change":"2024-02-16T00:13:28.096116+0000","last_active":"2024-02-16T00:13:28.096086+0000","last_peered":"2024-02-16T00:13:28.096086+0000","last_clean":"2024-02-16T00:13:28.096086+0000","last_became_active":"2024-02-16T00:11:04.799668+0000","last_became_peered":"2024-02-16T00:11:04.799668+0000","last_unstale":"2024-02-16T00:13:28.096086+0000","last_undegraded":"2024-02-16T00:13:28.096086+0000","last_fullsized":"2024-02-16T00:13:28.096086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-02-16T00:13:28.095997+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-02-16T00:13:28.095997+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.095997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:06:51.772323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:44.987426+0000","last_change":"2024-02-16T00:13:44.987456+0000","last_active":"2024-02-16T00:13:44.987426+0000","last_peered":"2024-02-16T00:13:44.987426+0000","last_clean":"2024-02-16T00:13:44.987426+0000","last_became_active":"2024-02-16T00:11:02.822133+0000","last_became_peered":"2024-02-16T00:11:02.822133+0000","last_unstale":"2024-02-16T00:13:44.987426+0000","last_undegraded":"2024-02-16T00:13:44.987426+0000","last_fullsized":"2024-02-16T00:13:44.987426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:44.987331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:44.987331+0000","last_clean_scrub_stamp":"2024-02-16T00:13:44.987331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:03.437870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.805078+0000","last_change":"2024-02-16T00:12:57.805078+0000","last_active":"2024-02-16T00:12:57.805078+0000","last_peered":"2024-02-16T00:12:57.805078+0000","last_clean":"2024-02-16T00:12:57.805078+0000","last_became_active":"2024-02-16T00:11:06.807067+0000","last_became_peered":"2024-02-16T00:11:06.807067+0000","last_unstale":"2024-02-16T00:12:57.805078+0000","last_undegraded":"2024-02-16T00:12:57.805078+0000","last_fullsized":"2024-02-16T00:12:57.805078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:57.804963+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.804963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:37.236667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'67","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.901456+0000","last_change":"2024-02-16T00:12:47.901456+0000","last_active":"2024-02-16T00:12:47.901456+0000","last_peered":"2024-02-16T00:12:47.901456+0000","last_clean":"2024-02-16T00:12:47.901456+0000","last_became_active":"2024-02-16T00:11:08.813261+0000","last_became_peered":"2024-02-16T00:11:08.813261+0000","last_unstale":"2024-02-16T00:12:47.901456+0000","last_undegraded":"2024-02-16T00:12:47.901456+0000","last_fullsized":"2024-02-16T00:12:47.901456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-02-16T00:12:47.901291+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.901291+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:15:48.763246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:45.239756+0000","last_change":"2024-02-16T00:12:45.239756+0000","last_active":"2024-02-16T00:12:45.239756+0000","last_peered":"2024-02-16T00:12:45.239756+0000","last_clean":"2024-02-16T00:12:45.239756+0000","last_became_active":"2024-02-16T00:11:10.819250+0000","last_became_peered":"2024-02-16T00:11:10.819250+0000","last_unstale":"2024-02-16T00:12:45.239756+0000","last_undegraded":"2024-02-16T00:12:45.239756+0000","last_fullsized":"2024-02-16T00:12:45.239756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:45.239638+0000","last_clean_scrub_stamp":"2024-02-16T00:12:45.239638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:29:12.913457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:36.903756+0000","last_change":"2024-02-16T00:13:36.903783+0000","last_active":"2024-02-16T00:13:36.903756+0000","last_peered":"2024-02-16T00:13:36.903756+0000","last_clean":"2024-02-16T00:13:36.903756+0000","last_became_active":"2024-02-16T00:11:12.826080+0000","last_became_peered":"2024-02-16T00:11:12.826080+0000","last_unstale":"2024-02-16T00:13:36.903756+0000","last_undegraded":"2024-02-16T00:13:36.903756+0000","last_fullsized":"2024-02-16T00:13:36.903756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:36.903666+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:36.903666+0000","last_clean_scrub_stamp":"2024-02-16T00:13:36.903666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:54.251517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:12.800160+0000","last_change":"2024-02-16T00:13:12.800216+0000","last_active":"2024-02-16T00:13:12.800160+0000","last_peered":"2024-02-16T00:13:12.800160+0000","last_clean":"2024-02-16T00:13:12.800160+0000","last_became_active":"2024-02-16T00:11:04.798137+0000","last_became_peered":"2024-02-16T00:11:04.798137+0000","last_unstale":"2024-02-16T00:13:12.800160+0000","last_undegraded":"2024-02-16T00:13:12.800160+0000","last_fullsized":"2024-02-16T00:13:12.800160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:12.800049+0000","last_clean_scrub_stamp":"2024-02-16T00:13:12.800049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:14:49.109384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.660012+0000","last_change":"2024-02-16T00:13:19.660012+0000","last_active":"2024-02-16T00:13:19.660012+0000","last_peered":"2024-02-16T00:13:19.660012+0000","last_clean":"2024-02-16T00:13:19.660012+0000","last_became_active":"2024-02-16T00:11:02.819986+0000","last_became_peered":"2024-02-16T00:11:02.819986+0000","last_unstale":"2024-02-16T00:13:19.660012+0000","last_undegraded":"2024-02-16T00:13:19.660012+0000","last_fullsized":"2024-02-16T00:13:19.660012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.659900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.659900+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.659900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:40:41.558813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:00.155308+0000","last_change":"2024-02-16T00:13:00.155308+0000","last_active":"2024-02-16T00:13:00.155308+0000","last_peered":"2024-02-16T00:13:00.155308+0000","last_clean":"2024-02-16T00:13:00.155308+0000","last_became_active":"2024-02-16T00:11:06.805421+0000","last_became_peered":"2024-02-16T00:11:06.805421+0000","last_unstale":"2024-02-16T00:13:00.155308+0000","last_undegraded":"2024-02-16T00:13:00.155308+0000","last_fullsized":"2024-02-16T00:13:00.155308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:00.155119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:00.155119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:49:57.517028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'44","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.019925+0000","last_change":"2024-02-16T00:13:08.019925+0000","last_active":"2024-02-16T00:13:08.019925+0000","last_peered":"2024-02-16T00:13:08.019925+0000","last_clean":"2024-02-16T00:13:08.019925+0000","last_became_active":"2024-02-16T00:11:08.817521+0000","last_became_peered":"2024-02-16T00:11:08.817521+0000","last_unstale":"2024-02-16T00:13:08.019925+0000","last_undegraded":"2024-02-16T00:13:08.019925+0000","last_fullsized":"2024-02-16T00:13:08.019925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:13:08.019795+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.019795+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:14:01.526130+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:58.644040+0000","last_change":"2024-02-16T00:12:58.644040+0000","last_active":"2024-02-16T00:12:58.644040+0000","last_peered":"2024-02-16T00:12:58.644040+0000","last_clean":"2024-02-16T00:12:58.644040+0000","last_became_active":"2024-02-16T00:11:10.825463+0000","last_became_peered":"2024-02-16T00:11:10.825463+0000","last_unstale":"2024-02-16T00:12:58.644040+0000","last_undegraded":"2024-02-16T00:12:58.644040+0000","last_fullsized":"2024-02-16T00:12:58.644040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:58.643930+0000","last_clean_scrub_stamp":"2024-02-16T00:12:58.643930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:19:14.513005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:58.926066+0000","last_change":"2024-02-16T00:13:58.926126+0000","last_active":"2024-02-16T00:13:58.926066+0000","last_peered":"2024-02-16T00:13:58.926066+0000","last_clean":"2024-02-16T00:13:58.926066+0000","last_became_active":"2024-02-16T00:11:12.832376+0000","last_became_peered":"2024-02-16T00:11:12.832376+0000","last_unstale":"2024-02-16T00:13:58.926066+0000","last_undegraded":"2024-02-16T00:13:58.926066+0000","last_fullsized":"2024-02-16T00:13:58.926066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:58.925976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:58.925976+0000","last_clean_scrub_stamp":"2024-02-16T00:13:58.925976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:25:37.148879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.909416+0000","last_change":"2024-02-16T00:12:51.909416+0000","last_active":"2024-02-16T00:12:51.909416+0000","last_peered":"2024-02-16T00:12:51.909416+0000","last_clean":"2024-02-16T00:12:51.909416+0000","last_became_active":"2024-02-16T00:11:04.814781+0000","last_became_peered":"2024-02-16T00:11:04.814781+0000","last_unstale":"2024-02-16T00:12:51.909416+0000","last_undegraded":"2024-02-16T00:12:51.909416+0000","last_fullsized":"2024-02-16T00:12:51.909416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:12:51.909268+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.909268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:00:23.726726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:25.724889+0000","last_change":"2024-02-16T00:13:25.724889+0000","last_active":"2024-02-16T00:13:25.724889+0000","last_peered":"2024-02-16T00:13:25.724889+0000","last_clean":"2024-02-16T00:13:25.724889+0000","last_became_active":"2024-02-16T00:11:02.796260+0000","last_became_peered":"2024-02-16T00:11:02.796260+0000","last_unstale":"2024-02-16T00:13:25.724889+0000","last_undegraded":"2024-02-16T00:13:25.724889+0000","last_fullsized":"2024-02-16T00:13:25.724889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:25.724773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:25.724773+0000","last_clean_scrub_stamp":"2024-02-16T00:13:25.724773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:11.014119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.196573+0000","last_change":"2024-02-16T00:13:03.196573+0000","last_active":"2024-02-16T00:13:03.196573+0000","last_peered":"2024-02-16T00:13:03.196573+0000","last_clean":"2024-02-16T00:13:03.196573+0000","last_became_active":"2024-02-16T00:11:06.802783+0000","last_became_peered":"2024-02-16T00:11:06.802783+0000","last_unstale":"2024-02-16T00:13:03.196573+0000","last_undegraded":"2024-02-16T00:13:03.196573+0000","last_fullsized":"2024-02-16T00:13:03.196573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.196453+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.196453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:28:01.366669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'44","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.821474+0000","last_change":"2024-02-16T00:12:51.821474+0000","last_active":"2024-02-16T00:12:51.821474+0000","last_peered":"2024-02-16T00:12:51.821474+0000","last_clean":"2024-02-16T00:12:51.821474+0000","last_became_active":"2024-02-16T00:11:08.811980+0000","last_became_peered":"2024-02-16T00:11:08.811980+0000","last_unstale":"2024-02-16T00:12:51.821474+0000","last_undegraded":"2024-02-16T00:12:51.821474+0000","last_fullsized":"2024-02-16T00:12:51.821474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-02-16T00:12:51.821350+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.821350+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:13:29.475897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.806808+0000","last_change":"2024-02-16T00:12:54.806808+0000","last_active":"2024-02-16T00:12:54.806808+0000","last_peered":"2024-02-16T00:12:54.806808+0000","last_clean":"2024-02-16T00:12:54.806808+0000","last_became_active":"2024-02-16T00:11:10.820375+0000","last_became_peered":"2024-02-16T00:11:10.820375+0000","last_unstale":"2024-02-16T00:12:54.806808+0000","last_undegraded":"2024-02-16T00:12:54.806808+0000","last_fullsized":"2024-02-16T00:12:54.806808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:54.806699+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.806699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:52.208925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:59.889647+0000","last_change":"2024-02-16T00:13:59.889669+0000","last_active":"2024-02-16T00:13:59.889647+0000","last_peered":"2024-02-16T00:13:59.889647+0000","last_clean":"2024-02-16T00:13:59.889647+0000","last_became_active":"2024-02-16T00:11:12.832484+0000","last_became_peered":"2024-02-16T00:11:12.832484+0000","last_unstale":"2024-02-16T00:13:59.889647+0000","last_undegraded":"2024-02-16T00:13:59.889647+0000","last_fullsized":"2024-02-16T00:13:59.889647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:59.889556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:59.889556+0000","last_clean_scrub_stamp":"2024-02-16T00:13:59.889556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:58:50.448427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.850574+0000","last_change":"2024-02-16T00:13:20.850574+0000","last_active":"2024-02-16T00:13:20.850574+0000","last_peered":"2024-02-16T00:13:20.850574+0000","last_clean":"2024-02-16T00:13:20.850574+0000","last_became_active":"2024-02-16T00:11:04.801447+0000","last_became_peered":"2024-02-16T00:11:04.801447+0000","last_unstale":"2024-02-16T00:13:20.850574+0000","last_undegraded":"2024-02-16T00:13:20.850574+0000","last_fullsized":"2024-02-16T00:13:20.850574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:20.850447+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:20.850447+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.850447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:07:49.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:55.860553+0000","last_change":"2024-02-16T00:13:55.860587+0000","last_active":"2024-02-16T00:13:55.860553+0000","last_peered":"2024-02-16T00:13:55.860553+0000","last_clean":"2024-02-16T00:13:55.860553+0000","last_became_active":"2024-02-16T00:11:02.813075+0000","last_became_peered":"2024-02-16T00:11:02.813075+0000","last_unstale":"2024-02-16T00:13:55.860553+0000","last_undegraded":"2024-02-16T00:13:55.860553+0000","last_fullsized":"2024-02-16T00:13:55.860553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:55.860434+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:55.860434+0000","last_clean_scrub_stamp":"2024-02-16T00:13:55.860434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:08:31.029705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:56.635127+0000","last_change":"2024-02-16T00:12:56.635127+0000","last_active":"2024-02-16T00:12:56.635127+0000","last_peered":"2024-02-16T00:12:56.635127+0000","last_clean":"2024-02-16T00:12:56.635127+0000","last_became_active":"2024-02-16T00:11:06.801758+0000","last_became_peered":"2024-02-16T00:11:06.801758+0000","last_unstale":"2024-02-16T00:12:56.635127+0000","last_undegraded":"2024-02-16T00:12:56.635127+0000","last_fullsized":"2024-02-16T00:12:56.635127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:56.634994+0000","last_clean_scrub_stamp":"2024-02-16T00:12:56.634994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:33:54.037220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.029345+0000","last_change":"2024-02-16T00:12:59.029345+0000","last_active":"2024-02-16T00:12:59.029345+0000","last_peered":"2024-02-16T00:12:59.029345+0000","last_clean":"2024-02-16T00:12:59.029345+0000","last_became_active":"2024-02-16T00:11:08.813825+0000","last_became_peered":"2024-02-16T00:11:08.813825+0000","last_unstale":"2024-02-16T00:12:59.029345+0000","last_undegraded":"2024-02-16T00:12:59.029345+0000","last_fullsized":"2024-02-16T00:12:59.029345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-02-16T00:12:59.029179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.029179+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:54:59.276538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'243","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:42.288308+0000","last_change":"2024-02-16T00:12:42.288308+0000","last_active":"2024-02-16T00:12:42.288308+0000","last_peered":"2024-02-16T00:12:42.288308+0000","last_clean":"2024-02-16T00:12:42.288308+0000","last_became_active":"2024-02-16T00:11:10.826812+0000","last_became_peered":"2024-02-16T00:11:10.826812+0000","last_unstale":"2024-02-16T00:12:42.288308+0000","last_undegraded":"2024-02-16T00:12:42.288308+0000","last_fullsized":"2024-02-16T00:12:42.288308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'243","last_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_deep_scrub":"29'243","last_deep_scrub_stamp":"2024-02-16T00:12:42.288179+0000","last_clean_scrub_stamp":"2024-02-16T00:12:42.288179+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:49.835119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.027246+0000","last_change":"2024-02-16T00:13:31.027246+0000","last_active":"2024-02-16T00:13:31.027246+0000","last_peered":"2024-02-16T00:13:31.027246+0000","last_clean":"2024-02-16T00:13:31.027246+0000","last_became_active":"2024-02-16T00:11:12.832056+0000","last_became_peered":"2024-02-16T00:11:12.832056+0000","last_unstale":"2024-02-16T00:13:31.027246+0000","last_undegraded":"2024-02-16T00:13:31.027246+0000","last_fullsized":"2024-02-16T00:13:31.027246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:31.027119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:31.027119+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.027119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:25:29.388109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.183094+0000","last_change":"2024-02-16T00:13:04.183094+0000","last_active":"2024-02-16T00:13:04.183094+0000","last_peered":"2024-02-16T00:13:04.183094+0000","last_clean":"2024-02-16T00:13:04.183094+0000","last_became_active":"2024-02-16T00:11:04.798002+0000","last_became_peered":"2024-02-16T00:11:04.798002+0000","last_unstale":"2024-02-16T00:13:04.183094+0000","last_undegraded":"2024-02-16T00:13:04.183094+0000","last_fullsized":"2024-02-16T00:13:04.183094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:04.182975+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.182975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:34:01.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:31.721955+0000","last_change":"2024-02-16T00:13:31.721955+0000","last_active":"2024-02-16T00:13:31.721955+0000","last_peered":"2024-02-16T00:13:31.721955+0000","last_clean":"2024-02-16T00:13:31.721955+0000","last_became_active":"2024-02-16T00:11:02.809222+0000","last_became_peered":"2024-02-16T00:11:02.809222+0000","last_unstale":"2024-02-16T00:13:31.721955+0000","last_undegraded":"2024-02-16T00:13:31.721955+0000","last_fullsized":"2024-02-16T00:13:31.721955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:31.721779+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:31.721779+0000","last_clean_scrub_stamp":"2024-02-16T00:13:31.721779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:10:40.361580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:51.582387+0000","last_change":"2024-02-16T00:12:51.582387+0000","last_active":"2024-02-16T00:12:51.582387+0000","last_peered":"2024-02-16T00:12:51.582387+0000","last_clean":"2024-02-16T00:12:51.582387+0000","last_became_active":"2024-02-16T00:11:06.804692+0000","last_became_peered":"2024-02-16T00:11:06.804692+0000","last_unstale":"2024-02-16T00:12:51.582387+0000","last_undegraded":"2024-02-16T00:12:51.582387+0000","last_fullsized":"2024-02-16T00:12:51.582387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:51.582242+0000","last_clean_scrub_stamp":"2024-02-16T00:12:51.582242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:31:29.436735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'73","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.419632+0000","last_change":"2024-02-16T00:12:44.419632+0000","last_active":"2024-02-16T00:12:44.419632+0000","last_peered":"2024-02-16T00:12:44.419632+0000","last_clean":"2024-02-16T00:12:44.419632+0000","last_became_active":"2024-02-16T00:11:08.812495+0000","last_became_peered":"2024-02-16T00:11:08.812495+0000","last_unstale":"2024-02-16T00:12:44.419632+0000","last_undegraded":"2024-02-16T00:12:44.419632+0000","last_fullsized":"2024-02-16T00:12:44.419632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-02-16T00:12:44.419516+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.419516+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:22.507611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:44.985037+0000","last_change":"2024-02-16T00:12:44.985037+0000","last_active":"2024-02-16T00:12:44.985037+0000","last_peered":"2024-02-16T00:12:44.985037+0000","last_clean":"2024-02-16T00:12:44.985037+0000","last_became_active":"2024-02-16T00:11:10.815279+0000","last_became_peered":"2024-02-16T00:11:10.815279+0000","last_unstale":"2024-02-16T00:12:44.985037+0000","last_undegraded":"2024-02-16T00:12:44.985037+0000","last_fullsized":"2024-02-16T00:12:44.985037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:44.984923+0000","last_clean_scrub_stamp":"2024-02-16T00:12:44.984923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.568877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:33.725049+0000","last_change":"2024-02-16T00:13:33.725049+0000","last_active":"2024-02-16T00:13:33.725049+0000","last_peered":"2024-02-16T00:13:33.725049+0000","last_clean":"2024-02-16T00:13:33.725049+0000","last_became_active":"2024-02-16T00:11:12.827694+0000","last_became_peered":"2024-02-16T00:11:12.827694+0000","last_unstale":"2024-02-16T00:13:33.725049+0000","last_undegraded":"2024-02-16T00:13:33.725049+0000","last_fullsized":"2024-02-16T00:13:33.725049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:33.724914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:33.724914+0000","last_clean_scrub_stamp":"2024-02-16T00:13:33.724914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:31.664833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.234145+0000","last_change":"2024-02-16T00:13:10.234145+0000","last_active":"2024-02-16T00:13:10.234145+0000","last_peered":"2024-02-16T00:13:10.234145+0000","last_clean":"2024-02-16T00:13:10.234145+0000","last_became_active":"2024-02-16T00:11:04.802488+0000","last_became_peered":"2024-02-16T00:11:04.802488+0000","last_unstale":"2024-02-16T00:13:10.234145+0000","last_undegraded":"2024-02-16T00:13:10.234145+0000","last_fullsized":"2024-02-16T00:13:10.234145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:10.234022+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.234022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:40:31.916468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:34.010682+0000","last_change":"2024-02-16T00:13:34.010708+0000","last_active":"2024-02-16T00:13:34.010682+0000","last_peered":"2024-02-16T00:13:34.010682+0000","last_clean":"2024-02-16T00:13:34.010682+0000","last_became_active":"2024-02-16T00:11:02.815217+0000","last_became_peered":"2024-02-16T00:11:02.815217+0000","last_unstale":"2024-02-16T00:13:34.010682+0000","last_undegraded":"2024-02-16T00:13:34.010682+0000","last_fullsized":"2024-02-16T00:13:34.010682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:34.010590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:34.010590+0000","last_clean_scrub_stamp":"2024-02-16T00:13:34.010590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:32:26.871007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"29'5","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.021341+0000","last_change":"2024-02-16T00:12:57.021341+0000","last_active":"2024-02-16T00:12:57.021341+0000","last_peered":"2024-02-16T00:12:57.021341+0000","last_clean":"2024-02-16T00:12:57.021341+0000","last_became_active":"2024-02-16T00:11:06.809097+0000","last_became_peered":"2024-02-16T00:11:06.809097+0000","last_unstale":"2024-02-16T00:12:57.021341+0000","last_undegraded":"2024-02-16T00:12:57.021341+0000","last_fullsized":"2024-02-16T00:12:57.021341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-02-16T00:12:57.021207+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.021207+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:57.897777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'43","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:48.929840+0000","last_change":"2024-02-16T00:12:48.929840+0000","last_active":"2024-02-16T00:12:48.929840+0000","last_peered":"2024-02-16T00:12:48.929840+0000","last_clean":"2024-02-16T00:12:48.929840+0000","last_became_active":"2024-02-16T00:11:08.812604+0000","last_became_peered":"2024-02-16T00:11:08.812604+0000","last_unstale":"2024-02-16T00:12:48.929840+0000","last_undegraded":"2024-02-16T00:12:48.929840+0000","last_fullsized":"2024-02-16T00:12:48.929840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-02-16T00:12:48.929717+0000","last_clean_scrub_stamp":"2024-02-16T00:12:48.929717+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:22:28.327582+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":61,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.044584+0000","last_change":"2024-02-16T00:13:04.044584+0000","last_active":"2024-02-16T00:13:04.044584+0000","last_peered":"2024-02-16T00:13:04.044584+0000","last_clean":"2024-02-16T00:13:04.044584+0000","last_became_active":"2024-02-16T00:11:10.826625+0000","last_became_peered":"2024-02-16T00:11:10.826625+0000","last_unstale":"2024-02-16T00:13:04.044584+0000","last_undegraded":"2024-02-16T00:13:04.044584+0000","last_fullsized":"2024-02-16T00:13:04.044584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.044474+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.044474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:49:49.333820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.064655+0000","last_change":"2024-02-16T00:13:19.064655+0000","last_active":"2024-02-16T00:13:19.064655+0000","last_peered":"2024-02-16T00:13:19.064655+0000","last_clean":"2024-02-16T00:13:19.064655+0000","last_became_active":"2024-02-16T00:11:12.829236+0000","last_became_peered":"2024-02-16T00:11:12.829236+0000","last_unstale":"2024-02-16T00:13:19.064655+0000","last_undegraded":"2024-02-16T00:13:19.064655+0000","last_fullsized":"2024-02-16T00:13:19.064655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.064537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.064537+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.064537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:58:36.412388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.067648+0000","last_change":"2024-02-16T00:13:21.067648+0000","last_active":"2024-02-16T00:13:21.067648+0000","last_peered":"2024-02-16T00:13:21.067648+0000","last_clean":"2024-02-16T00:13:21.067648+0000","last_became_active":"2024-02-16T00:11:04.806282+0000","last_became_peered":"2024-02-16T00:11:04.806282+0000","last_unstale":"2024-02-16T00:13:21.067648+0000","last_undegraded":"2024-02-16T00:13:21.067648+0000","last_fullsized":"2024-02-16T00:13:21.067648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:21.067525+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:21.067525+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.067525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:07:11.711126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:19.888247+0000","last_change":"2024-02-16T00:13:19.888276+0000","last_active":"2024-02-16T00:13:19.888247+0000","last_peered":"2024-02-16T00:13:19.888247+0000","last_clean":"2024-02-16T00:13:19.888247+0000","last_became_active":"2024-02-16T00:11:02.801711+0000","last_became_peered":"2024-02-16T00:11:02.801711+0000","last_unstale":"2024-02-16T00:13:19.888247+0000","last_undegraded":"2024-02-16T00:13:19.888247+0000","last_fullsized":"2024-02-16T00:13:19.888247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:19.888155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:19.888155+0000","last_clean_scrub_stamp":"2024-02-16T00:13:19.888155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:45.113499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:47.487257+0000","last_change":"2024-02-16T00:12:47.487257+0000","last_active":"2024-02-16T00:12:47.487257+0000","last_peered":"2024-02-16T00:12:47.487257+0000","last_clean":"2024-02-16T00:12:47.487257+0000","last_became_active":"2024-02-16T00:11:06.811290+0000","last_became_peered":"2024-02-16T00:11:06.811290+0000","last_unstale":"2024-02-16T00:12:47.487257+0000","last_undegraded":"2024-02-16T00:12:47.487257+0000","last_fullsized":"2024-02-16T00:12:47.487257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:47.487142+0000","last_clean_scrub_stamp":"2024-02-16T00:12:47.487142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:05:48.071095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'36","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:54.996296+0000","last_change":"2024-02-16T00:12:54.996296+0000","last_active":"2024-02-16T00:12:54.996296+0000","last_peered":"2024-02-16T00:12:54.996296+0000","last_clean":"2024-02-16T00:12:54.996296+0000","last_became_active":"2024-02-16T00:11:08.813558+0000","last_became_peered":"2024-02-16T00:11:08.813558+0000","last_unstale":"2024-02-16T00:12:54.996296+0000","last_undegraded":"2024-02-16T00:12:54.996296+0000","last_fullsized":"2024-02-16T00:12:54.996296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-02-16T00:12:54.996158+0000","last_clean_scrub_stamp":"2024-02-16T00:12:54.996158+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:18:24.457006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.982002+0000","last_change":"2024-02-16T00:13:10.982002+0000","last_active":"2024-02-16T00:13:10.982002+0000","last_peered":"2024-02-16T00:13:10.982002+0000","last_clean":"2024-02-16T00:13:10.982002+0000","last_became_active":"2024-02-16T00:11:10.830738+0000","last_became_peered":"2024-02-16T00:11:10.830738+0000","last_unstale":"2024-02-16T00:13:10.982002+0000","last_undegraded":"2024-02-16T00:13:10.982002+0000","last_fullsized":"2024-02-16T00:13:10.982002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:10.981885+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:58:09.819667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:14:01.951819+0000","last_change":"2024-02-16T00:14:01.951866+0000","last_active":"2024-02-16T00:14:01.951819+0000","last_peered":"2024-02-16T00:14:01.951819+0000","last_clean":"2024-02-16T00:14:01.951819+0000","last_became_active":"2024-02-16T00:11:12.833435+0000","last_became_peered":"2024-02-16T00:11:12.833435+0000","last_unstale":"2024-02-16T00:14:01.951819+0000","last_undegraded":"2024-02-16T00:14:01.951819+0000","last_fullsized":"2024-02-16T00:14:01.951819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:14:01.951706+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:14:01.951706+0000","last_clean_scrub_stamp":"2024-02-16T00:14:01.951706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:22:33.359748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.188599+0000","last_change":"2024-02-16T00:13:05.188599+0000","last_active":"2024-02-16T00:13:05.188599+0000","last_peered":"2024-02-16T00:13:05.188599+0000","last_clean":"2024-02-16T00:13:05.188599+0000","last_became_active":"2024-02-16T00:11:04.798326+0000","last_became_peered":"2024-02-16T00:11:04.798326+0000","last_unstale":"2024-02-16T00:13:05.188599+0000","last_undegraded":"2024-02-16T00:13:05.188599+0000","last_fullsized":"2024-02-16T00:13:05.188599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:05.188488+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.188488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:37.525070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:21.673914+0000","last_change":"2024-02-16T00:13:21.673945+0000","last_active":"2024-02-16T00:13:21.673914+0000","last_peered":"2024-02-16T00:13:21.673914+0000","last_clean":"2024-02-16T00:13:21.673914+0000","last_became_active":"2024-02-16T00:11:02.819855+0000","last_became_peered":"2024-02-16T00:11:02.819855+0000","last_unstale":"2024-02-16T00:13:21.673914+0000","last_undegraded":"2024-02-16T00:13:21.673914+0000","last_fullsized":"2024-02-16T00:13:21.673914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:21.673810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:21.673810+0000","last_clean_scrub_stamp":"2024-02-16T00:13:21.673810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:55:21.921169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:49.549032+0000","last_change":"2024-02-16T00:12:49.549032+0000","last_active":"2024-02-16T00:12:49.549032+0000","last_peered":"2024-02-16T00:12:49.549032+0000","last_clean":"2024-02-16T00:12:49.549032+0000","last_became_active":"2024-02-16T00:11:06.808706+0000","last_became_peered":"2024-02-16T00:11:06.808706+0000","last_unstale":"2024-02-16T00:12:49.549032+0000","last_undegraded":"2024-02-16T00:12:49.549032+0000","last_fullsized":"2024-02-16T00:12:49.549032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-02-16T00:12:49.548866+0000","last_clean_scrub_stamp":"2024-02-16T00:12:49.548866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:23:44.002627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'51","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.986591+0000","last_change":"2024-02-16T00:13:09.986591+0000","last_active":"2024-02-16T00:13:09.986591+0000","last_peered":"2024-02-16T00:13:09.986591+0000","last_clean":"2024-02-16T00:13:09.986591+0000","last_became_active":"2024-02-16T00:11:08.814172+0000","last_became_peered":"2024-02-16T00:11:08.814172+0000","last_unstale":"2024-02-16T00:13:09.986591+0000","last_undegraded":"2024-02-16T00:13:09.986591+0000","last_fullsized":"2024-02-16T00:13:09.986591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-02-16T00:13:09.986464+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.986464+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:29:21.387242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:41.919234+0000","last_change":"2024-02-16T00:12:41.919234+0000","last_active":"2024-02-16T00:12:41.919234+0000","last_peered":"2024-02-16T00:12:41.919234+0000","last_clean":"2024-02-16T00:12:41.919234+0000","last_became_active":"2024-02-16T00:11:10.819038+0000","last_became_peered":"2024-02-16T00:11:10.819038+0000","last_unstale":"2024-02-16T00:12:41.919234+0000","last_undegraded":"2024-02-16T00:12:41.919234+0000","last_fullsized":"2024-02-16T00:12:41.919234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:12:41.919121+0000","last_clean_scrub_stamp":"2024-02-16T00:12:41.919121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:24:20.007216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.085957+0000","last_change":"2024-02-16T00:13:23.085957+0000","last_active":"2024-02-16T00:13:23.085957+0000","last_peered":"2024-02-16T00:13:23.085957+0000","last_clean":"2024-02-16T00:13:23.085957+0000","last_became_active":"2024-02-16T00:11:12.830315+0000","last_became_peered":"2024-02-16T00:11:12.830315+0000","last_unstale":"2024-02-16T00:13:23.085957+0000","last_undegraded":"2024-02-16T00:13:23.085957+0000","last_fullsized":"2024-02-16T00:13:23.085957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.085805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.085805+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.085805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:30:48.122611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:05.556771+0000","last_change":"2024-02-16T00:13:05.556771+0000","last_active":"2024-02-16T00:13:05.556771+0000","last_peered":"2024-02-16T00:13:05.556771+0000","last_clean":"2024-02-16T00:13:05.556771+0000","last_became_active":"2024-02-16T00:11:04.813602+0000","last_became_peered":"2024-02-16T00:11:04.813602+0000","last_unstale":"2024-02-16T00:13:05.556771+0000","last_undegraded":"2024-02-16T00:13:05.556771+0000","last_fullsized":"2024-02-16T00:13:05.556771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:05.556664+0000","last_clean_scrub_stamp":"2024-02-16T00:13:05.556664+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:11.578783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:07.247747+0000","last_change":"2024-02-16T00:13:07.247747+0000","last_active":"2024-02-16T00:13:07.247747+0000","last_peered":"2024-02-16T00:13:07.247747+0000","last_clean":"2024-02-16T00:13:07.247747+0000","last_became_active":"2024-02-16T00:11:02.816186+0000","last_became_peered":"2024-02-16T00:11:02.816186+0000","last_unstale":"2024-02-16T00:13:07.247747+0000","last_undegraded":"2024-02-16T00:13:07.247747+0000","last_fullsized":"2024-02-16T00:13:07.247747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:07.247620+0000","last_clean_scrub_stamp":"2024-02-16T00:13:07.247620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:45:46.679324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:22.927236+0000","last_change":"2024-02-16T00:13:22.927266+0000","last_active":"2024-02-16T00:13:22.927236+0000","last_peered":"2024-02-16T00:13:22.927236+0000","last_clean":"2024-02-16T00:13:22.927236+0000","last_became_active":"2024-02-16T00:11:04.801574+0000","last_became_peered":"2024-02-16T00:11:04.801574+0000","last_unstale":"2024-02-16T00:13:22.927236+0000","last_undegraded":"2024-02-16T00:13:22.927236+0000","last_fullsized":"2024-02-16T00:13:22.927236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:22.927156+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:22.927156+0000","last_clean_scrub_stamp":"2024-02-16T00:13:22.927156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:29:35.487431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.776378+0000","last_change":"2024-02-16T00:13:09.776405+0000","last_active":"2024-02-16T00:13:09.776378+0000","last_peered":"2024-02-16T00:13:09.776378+0000","last_clean":"2024-02-16T00:13:09.776378+0000","last_became_active":"2024-02-16T00:11:02.808029+0000","last_became_peered":"2024-02-16T00:11:02.808029+0000","last_unstale":"2024-02-16T00:13:09.776378+0000","last_undegraded":"2024-02-16T00:13:09.776378+0000","last_fullsized":"2024-02-16T00:13:09.776378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:09.776278+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.776278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:06:41.368106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:59.999252+0000","last_change":"2024-02-16T00:12:59.999252+0000","last_active":"2024-02-16T00:12:59.999252+0000","last_peered":"2024-02-16T00:12:59.999252+0000","last_clean":"2024-02-16T00:12:59.999252+0000","last_became_active":"2024-02-16T00:11:04.809768+0000","last_became_peered":"2024-02-16T00:11:04.809768+0000","last_unstale":"2024-02-16T00:12:59.999252+0000","last_undegraded":"2024-02-16T00:12:59.999252+0000","last_fullsized":"2024-02-16T00:12:59.999252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:12:59.999131+0000","last_clean_scrub_stamp":"2024-02-16T00:12:59.999131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:41:21.804655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:29.099286+0000","last_change":"2024-02-16T00:13:29.099321+0000","last_active":"2024-02-16T00:13:29.099286+0000","last_peered":"2024-02-16T00:13:29.099286+0000","last_clean":"2024-02-16T00:13:29.099286+0000","last_became_active":"2024-02-16T00:11:02.823093+0000","last_became_peered":"2024-02-16T00:11:02.823093+0000","last_unstale":"2024-02-16T00:13:29.099286+0000","last_undegraded":"2024-02-16T00:13:29.099286+0000","last_fullsized":"2024-02-16T00:13:29.099286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:29.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:29.099164+0000","last_clean_scrub_stamp":"2024-02-16T00:13:29.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:39:51.091195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.853688+0000","last_change":"2024-02-16T00:13:18.853728+0000","last_active":"2024-02-16T00:13:18.853688+0000","last_peered":"2024-02-16T00:13:18.853688+0000","last_clean":"2024-02-16T00:13:18.853688+0000","last_became_active":"2024-02-16T00:11:04.801194+0000","last_became_peered":"2024-02-16T00:11:04.801194+0000","last_unstale":"2024-02-16T00:13:18.853688+0000","last_undegraded":"2024-02-16T00:13:18.853688+0000","last_fullsized":"2024-02-16T00:13:18.853688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:18.853579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:18.853579+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.853579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:21:17.955716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:27.959937+0000","last_change":"2024-02-16T00:13:27.959965+0000","last_active":"2024-02-16T00:13:27.959937+0000","last_peered":"2024-02-16T00:13:27.959937+0000","last_clean":"2024-02-16T00:13:27.959937+0000","last_became_active":"2024-02-16T00:11:02.796820+0000","last_became_peered":"2024-02-16T00:11:02.796820+0000","last_unstale":"2024-02-16T00:13:27.959937+0000","last_undegraded":"2024-02-16T00:13:27.959937+0000","last_fullsized":"2024-02-16T00:13:27.959937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:27.959842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:27.959842+0000","last_clean_scrub_stamp":"2024-02-16T00:13:27.959842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:11:15.208309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.878278+0000","last_change":"2024-02-16T00:13:04.878278+0000","last_active":"2024-02-16T00:13:04.878278+0000","last_peered":"2024-02-16T00:13:04.878278+0000","last_clean":"2024-02-16T00:13:04.878278+0000","last_became_active":"2024-02-16T00:11:04.810031+0000","last_became_peered":"2024-02-16T00:11:04.810031+0000","last_unstale":"2024-02-16T00:13:04.878278+0000","last_undegraded":"2024-02-16T00:13:04.878278+0000","last_fullsized":"2024-02-16T00:13:04.878278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:04.878154+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.878154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:02.624777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:23.945083+0000","last_change":"2024-02-16T00:13:23.945108+0000","last_active":"2024-02-16T00:13:23.945083+0000","last_peered":"2024-02-16T00:13:23.945083+0000","last_clean":"2024-02-16T00:13:23.945083+0000","last_became_active":"2024-02-16T00:11:02.801201+0000","last_became_peered":"2024-02-16T00:11:02.801201+0000","last_unstale":"2024-02-16T00:13:23.945083+0000","last_undegraded":"2024-02-16T00:13:23.945083+0000","last_fullsized":"2024-02-16T00:13:23.945083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:23.944993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:23.944993+0000","last_clean_scrub_stamp":"2024-02-16T00:13:23.944993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:50:09.234339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:01.624499+0000","last_change":"2024-02-16T00:13:01.624499+0000","last_active":"2024-02-16T00:13:01.624499+0000","last_peered":"2024-02-16T00:13:01.624499+0000","last_clean":"2024-02-16T00:13:01.624499+0000","last_became_active":"2024-02-16T00:11:04.813885+0000","last_became_peered":"2024-02-16T00:11:04.813885+0000","last_unstale":"2024-02-16T00:13:01.624499+0000","last_undegraded":"2024-02-16T00:13:01.624499+0000","last_fullsized":"2024-02-16T00:13:01.624499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-02-16T00:13:01.624385+0000","last_clean_scrub_stamp":"2024-02-16T00:13:01.624385+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:28:27.761857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:30.735349+0000","last_change":"2024-02-16T00:13:30.735377+0000","last_active":"2024-02-16T00:13:30.735349+0000","last_peered":"2024-02-16T00:13:30.735349+0000","last_clean":"2024-02-16T00:13:30.735349+0000","last_became_active":"2024-02-16T00:11:02.810338+0000","last_became_peered":"2024-02-16T00:11:02.810338+0000","last_unstale":"2024-02-16T00:13:30.735349+0000","last_undegraded":"2024-02-16T00:13:30.735349+0000","last_fullsized":"2024-02-16T00:13:30.735349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:30.735261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:30.735261+0000","last_clean_scrub_stamp":"2024-02-16T00:13:30.735261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:36.718371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'14","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:08.736968+0000","last_change":"2024-02-16T00:13:08.736968+0000","last_active":"2024-02-16T00:13:08.736968+0000","last_peered":"2024-02-16T00:13:08.736968+0000","last_clean":"2024-02-16T00:13:08.736968+0000","last_became_active":"2024-02-16T00:11:04.797434+0000","last_became_peered":"2024-02-16T00:11:04.797434+0000","last_unstale":"2024-02-16T00:13:08.736968+0000","last_undegraded":"2024-02-16T00:13:08.736968+0000","last_fullsized":"2024-02-16T00:13:08.736968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-02-16T00:13:08.736845+0000","last_clean_scrub_stamp":"2024-02-16T00:13:08.736845+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:47:44.033579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:17.153427+0000","last_change":"2024-02-16T00:13:17.153454+0000","last_active":"2024-02-16T00:13:17.153427+0000","last_peered":"2024-02-16T00:13:17.153427+0000","last_clean":"2024-02-16T00:13:17.153427+0000","last_became_active":"2024-02-16T00:11:02.814995+0000","last_became_peered":"2024-02-16T00:11:02.814995+0000","last_unstale":"2024-02-16T00:13:17.153427+0000","last_undegraded":"2024-02-16T00:13:17.153427+0000","last_fullsized":"2024-02-16T00:13:17.153427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:17.153338+0000","last_clean_scrub_stamp":"2024-02-16T00:13:17.153338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:25:45.706109+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:09.556358+0000","last_change":"2024-02-16T00:13:09.556358+0000","last_active":"2024-02-16T00:13:09.556358+0000","last_peered":"2024-02-16T00:13:09.556358+0000","last_clean":"2024-02-16T00:13:09.556358+0000","last_became_active":"2024-02-16T00:11:04.796541+0000","last_became_peered":"2024-02-16T00:11:04.796541+0000","last_unstale":"2024-02-16T00:13:09.556358+0000","last_undegraded":"2024-02-16T00:13:09.556358+0000","last_fullsized":"2024-02-16T00:13:09.556358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-02-16T00:13:09.556228+0000","last_clean_scrub_stamp":"2024-02-16T00:13:09.556228+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:18:33.081661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.945782+0000","last_change":"2024-02-16T00:13:28.945842+0000","last_active":"2024-02-16T00:13:28.945782+0000","last_peered":"2024-02-16T00:13:28.945782+0000","last_clean":"2024-02-16T00:13:28.945782+0000","last_became_active":"2024-02-16T00:11:02.797114+0000","last_became_peered":"2024-02-16T00:11:02.797114+0000","last_unstale":"2024-02-16T00:13:28.945782+0000","last_undegraded":"2024-02-16T00:13:28.945782+0000","last_fullsized":"2024-02-16T00:13:28.945782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:28.945668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:28.945668+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.945668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:38:34.928777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:18.632508+0000","last_change":"2024-02-16T00:13:18.632508+0000","last_active":"2024-02-16T00:13:18.632508+0000","last_peered":"2024-02-16T00:13:18.632508+0000","last_clean":"2024-02-16T00:13:18.632508+0000","last_became_active":"2024-02-16T00:11:04.802577+0000","last_became_peered":"2024-02-16T00:11:04.802577+0000","last_unstale":"2024-02-16T00:13:18.632508+0000","last_undegraded":"2024-02-16T00:13:18.632508+0000","last_fullsized":"2024-02-16T00:13:18.632508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-02-16T00:13:18.632397+0000","last_clean_scrub_stamp":"2024-02-16T00:13:18.632397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:31:36.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:37.070899+0000","last_change":"2024-02-16T00:13:37.070930+0000","last_active":"2024-02-16T00:13:37.070899+0000","last_peered":"2024-02-16T00:13:37.070899+0000","last_clean":"2024-02-16T00:13:37.070899+0000","last_became_active":"2024-02-16T00:11:02.820296+0000","last_became_peered":"2024-02-16T00:11:02.820296+0000","last_unstale":"2024-02-16T00:13:37.070899+0000","last_undegraded":"2024-02-16T00:13:37.070899+0000","last_fullsized":"2024-02-16T00:13:37.070899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:37.070808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:37.070808+0000","last_clean_scrub_stamp":"2024-02-16T00:13:37.070808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:09:32.756372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:20.058665+0000","last_change":"2024-02-16T00:13:20.058665+0000","last_active":"2024-02-16T00:13:20.058665+0000","last_peered":"2024-02-16T00:13:20.058665+0000","last_clean":"2024-02-16T00:13:20.058665+0000","last_became_active":"2024-02-16T00:11:04.806553+0000","last_became_peered":"2024-02-16T00:11:04.806553+0000","last_unstale":"2024-02-16T00:13:20.058665+0000","last_undegraded":"2024-02-16T00:13:20.058665+0000","last_fullsized":"2024-02-16T00:13:20.058665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:20.058539+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:20.058539+0000","last_clean_scrub_stamp":"2024-02-16T00:13:20.058539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T02:48:43.050884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.959088+0000","last_change":"2024-02-16T00:13:26.959116+0000","last_active":"2024-02-16T00:13:26.959088+0000","last_peered":"2024-02-16T00:13:26.959088+0000","last_clean":"2024-02-16T00:13:26.959088+0000","last_became_active":"2024-02-16T00:11:02.796870+0000","last_became_peered":"2024-02-16T00:11:02.796870+0000","last_unstale":"2024-02-16T00:13:26.959088+0000","last_undegraded":"2024-02-16T00:13:26.959088+0000","last_fullsized":"2024-02-16T00:13:26.959088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.958995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.958995+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.958995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:41.755010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:03.884620+0000","last_change":"2024-02-16T00:13:03.884620+0000","last_active":"2024-02-16T00:13:03.884620+0000","last_peered":"2024-02-16T00:13:03.884620+0000","last_clean":"2024-02-16T00:13:03.884620+0000","last_became_active":"2024-02-16T00:11:04.812164+0000","last_became_peered":"2024-02-16T00:11:04.812164+0000","last_unstale":"2024-02-16T00:13:03.884620+0000","last_undegraded":"2024-02-16T00:13:03.884620+0000","last_fullsized":"2024-02-16T00:13:03.884620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:03.884486+0000","last_clean_scrub_stamp":"2024-02-16T00:13:03.884486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:25:09.906605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:28.726085+0000","last_change":"2024-02-16T00:13:28.726111+0000","last_active":"2024-02-16T00:13:28.726085+0000","last_peered":"2024-02-16T00:13:28.726085+0000","last_clean":"2024-02-16T00:13:28.726085+0000","last_became_active":"2024-02-16T00:11:02.809132+0000","last_became_peered":"2024-02-16T00:11:02.809132+0000","last_unstale":"2024-02-16T00:13:28.726085+0000","last_undegraded":"2024-02-16T00:13:28.726085+0000","last_fullsized":"2024-02-16T00:13:28.726085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:28.725987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:28.725987+0000","last_clean_scrub_stamp":"2024-02-16T00:13:28.725987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:57:43.522003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:11.581881+0000","last_change":"2024-02-16T00:13:11.581881+0000","last_active":"2024-02-16T00:13:11.581881+0000","last_peered":"2024-02-16T00:13:11.581881+0000","last_clean":"2024-02-16T00:13:11.581881+0000","last_became_active":"2024-02-16T00:11:04.795999+0000","last_became_peered":"2024-02-16T00:11:04.795999+0000","last_unstale":"2024-02-16T00:13:11.581881+0000","last_undegraded":"2024-02-16T00:13:11.581881+0000","last_fullsized":"2024-02-16T00:13:11.581881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-02-16T00:13:11.581768+0000","last_clean_scrub_stamp":"2024-02-16T00:13:11.581768+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T05:18:19.215064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:26.683499+0000","last_change":"2024-02-16T00:13:26.683524+0000","last_active":"2024-02-16T00:13:26.683499+0000","last_peered":"2024-02-16T00:13:26.683499+0000","last_clean":"2024-02-16T00:13:26.683499+0000","last_became_active":"2024-02-16T00:11:02.796092+0000","last_became_peered":"2024-02-16T00:11:02.796092+0000","last_unstale":"2024-02-16T00:13:26.683499+0000","last_undegraded":"2024-02-16T00:13:26.683499+0000","last_fullsized":"2024-02-16T00:13:26.683499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:26.683411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:26.683411+0000","last_clean_scrub_stamp":"2024-02-16T00:13:26.683411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:51:48.282091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"27'2","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:12:57.642973+0000","last_change":"2024-02-16T00:12:57.642973+0000","last_active":"2024-02-16T00:12:57.642973+0000","last_peered":"2024-02-16T00:12:57.642973+0000","last_clean":"2024-02-16T00:12:57.642973+0000","last_became_active":"2024-02-16T00:11:04.814689+0000","last_became_peered":"2024-02-16T00:11:04.814689+0000","last_unstale":"2024-02-16T00:12:57.642973+0000","last_undegraded":"2024-02-16T00:12:57.642973+0000","last_fullsized":"2024-02-16T00:12:57.642973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:12:57.642852+0000","last_clean_scrub_stamp":"2024-02-16T00:12:57.642852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:43:29.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:40.046065+0000","last_change":"2024-02-16T00:13:40.046094+0000","last_active":"2024-02-16T00:13:40.046065+0000","last_peered":"2024-02-16T00:13:40.046065+0000","last_clean":"2024-02-16T00:13:40.046065+0000","last_became_active":"2024-02-16T00:11:02.813752+0000","last_became_peered":"2024-02-16T00:11:02.813752+0000","last_unstale":"2024-02-16T00:13:40.046065+0000","last_undegraded":"2024-02-16T00:13:40.046065+0000","last_fullsized":"2024-02-16T00:13:40.046065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:40.045982+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:40.045982+0000","last_clean_scrub_stamp":"2024-02-16T00:13:40.045982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:21:27.710357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:32.734544+0000","last_change":"2024-02-16T00:13:32.734570+0000","last_active":"2024-02-16T00:13:32.734544+0000","last_peered":"2024-02-16T00:13:32.734544+0000","last_clean":"2024-02-16T00:13:32.734544+0000","last_became_active":"2024-02-16T00:11:04.803268+0000","last_became_peered":"2024-02-16T00:11:04.803268+0000","last_unstale":"2024-02-16T00:13:32.734544+0000","last_undegraded":"2024-02-16T00:13:32.734544+0000","last_fullsized":"2024-02-16T00:13:32.734544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-16T00:13:32.734457+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-16T00:13:32.734457+0000","last_clean_scrub_stamp":"2024-02-16T00:13:32.734457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T03:57:06.034129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:53.809680+0000","last_change":"2024-02-16T00:13:53.809705+0000","last_active":"2024-02-16T00:13:53.809680+0000","last_peered":"2024-02-16T00:13:53.809680+0000","last_clean":"2024-02-16T00:13:53.809680+0000","last_became_active":"2024-02-16T00:11:02.811798+0000","last_became_peered":"2024-02-16T00:11:02.811798+0000","last_unstale":"2024-02-16T00:13:53.809680+0000","last_undegraded":"2024-02-16T00:13:53.809680+0000","last_fullsized":"2024-02-16T00:13:53.809680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:53.809589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:53.809589+0000","last_clean_scrub_stamp":"2024-02-16T00:13:53.809589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T00:45:50.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:13.984512+0000","last_change":"2024-02-16T00:13:13.984512+0000","last_active":"2024-02-16T00:13:13.984512+0000","last_peered":"2024-02-16T00:13:13.984512+0000","last_clean":"2024-02-16T00:13:13.984512+0000","last_became_active":"2024-02-16T00:11:04.807978+0000","last_became_peered":"2024-02-16T00:11:04.807978+0000","last_unstale":"2024-02-16T00:13:13.984512+0000","last_undegraded":"2024-02-16T00:13:13.984512+0000","last_fullsized":"2024-02-16T00:13:13.984512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:13.984383+0000","last_clean_scrub_stamp":"2024-02-16T00:13:13.984383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T08:45:31.856700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.197615+0000","last_change":"2024-02-16T00:13:15.197615+0000","last_active":"2024-02-16T00:13:15.197615+0000","last_peered":"2024-02-16T00:13:15.197615+0000","last_clean":"2024-02-16T00:13:15.197615+0000","last_became_active":"2024-02-16T00:11:02.816154+0000","last_became_peered":"2024-02-16T00:11:02.816154+0000","last_unstale":"2024-02-16T00:13:15.197615+0000","last_undegraded":"2024-02-16T00:13:15.197615+0000","last_fullsized":"2024-02-16T00:13:15.197615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.197470+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.197470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:06:16.065697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:14.604882+0000","last_change":"2024-02-16T00:13:14.604882+0000","last_active":"2024-02-16T00:13:14.604882+0000","last_peered":"2024-02-16T00:13:14.604882+0000","last_clean":"2024-02-16T00:13:14.604882+0000","last_became_active":"2024-02-16T00:11:04.798080+0000","last_became_peered":"2024-02-16T00:11:04.798080+0000","last_unstale":"2024-02-16T00:13:14.604882+0000","last_undegraded":"2024-02-16T00:13:14.604882+0000","last_fullsized":"2024-02-16T00:13:14.604882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:14.604766+0000","last_clean_scrub_stamp":"2024-02-16T00:13:14.604766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T01:18:57.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:47.915444+0000","last_change":"2024-02-16T00:13:47.915470+0000","last_active":"2024-02-16T00:13:47.915444+0000","last_peered":"2024-02-16T00:13:47.915444+0000","last_clean":"2024-02-16T00:13:47.915444+0000","last_became_active":"2024-02-16T00:11:02.813206+0000","last_became_peered":"2024-02-16T00:11:02.813206+0000","last_unstale":"2024-02-16T00:13:47.915444+0000","last_undegraded":"2024-02-16T00:13:47.915444+0000","last_fullsized":"2024-02-16T00:13:47.915444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:47.915352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:47.915352+0000","last_clean_scrub_stamp":"2024-02-16T00:13:47.915352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T09:53:47.570930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:46.903411+0000","last_change":"2024-02-16T00:13:46.903441+0000","last_active":"2024-02-16T00:13:46.903411+0000","last_peered":"2024-02-16T00:13:46.903411+0000","last_clean":"2024-02-16T00:13:46.903411+0000","last_became_active":"2024-02-16T00:11:02.822476+0000","last_became_peered":"2024-02-16T00:11:02.822476+0000","last_unstale":"2024-02-16T00:13:46.903411+0000","last_undegraded":"2024-02-16T00:13:46.903411+0000","last_fullsized":"2024-02-16T00:13:46.903411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:46.903316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:46.903316+0000","last_clean_scrub_stamp":"2024-02-16T00:13:46.903316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T04:58:08.574812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'6","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:10.783477+0000","last_change":"2024-02-16T00:13:10.783477+0000","last_active":"2024-02-16T00:13:10.783477+0000","last_peered":"2024-02-16T00:13:10.783477+0000","last_clean":"2024-02-16T00:13:10.783477+0000","last_became_active":"2024-02-16T00:11:04.798142+0000","last_became_peered":"2024-02-16T00:11:04.798142+0000","last_unstale":"2024-02-16T00:13:10.783477+0000","last_undegraded":"2024-02-16T00:13:10.783477+0000","last_fullsized":"2024-02-16T00:13:10.783477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-16T00:13:10.783361+0000","last_clean_scrub_stamp":"2024-02-16T00:13:10.783361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:12:58.244265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:15.814276+0000","last_change":"2024-02-16T00:13:15.814276+0000","last_active":"2024-02-16T00:13:15.814276+0000","last_peered":"2024-02-16T00:13:15.814276+0000","last_clean":"2024-02-16T00:13:15.814276+0000","last_became_active":"2024-02-16T00:11:02.807512+0000","last_became_peered":"2024-02-16T00:11:02.807512+0000","last_unstale":"2024-02-16T00:13:15.814276+0000","last_undegraded":"2024-02-16T00:13:15.814276+0000","last_fullsized":"2024-02-16T00:13:15.814276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T00:13:15.814161+0000","last_clean_scrub_stamp":"2024-02-16T00:13:15.814161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T07:19:27.336244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-16T00:13:04.581370+0000","last_change":"2024-02-16T00:13:04.581370+0000","last_active":"2024-02-16T00:13:04.581370+0000","last_peered":"2024-02-16T00:13:04.581370+0000","last_clean":"2024-02-16T00:13:04.581370+0000","last_became_active":"2024-02-16T00:11:04.813796+0000","last_became_peered":"2024-02-16T00:11:04.813796+0000","last_unstale":"2024-02-16T00:13:04.581370+0000","last_undegraded":"2024-02-16T00:13:04.581370+0000","last_fullsized":"2024-02-16T00:13:04.581370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-16T00:13:04.581244+0000","last_clean_scrub_stamp":"2024-02-16T00:13:04.581244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:31:47.597212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":214,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":214,"num_whiteouts":0,"num_read":1820,"num_read_kb":1574,"num_write":771,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1644,"ondisk_log_size":1644,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705707,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44072,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327768,"statfs":{"total":96636764160,"available":96591634432,"internally_reserved":0,"allocated":425984,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41399999999999998,"15min":0.40600000000000003},"min":{"1min":0.33200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.42099999999999999},"min":{"1min":0.34999999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Feb 16 00:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.23699999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.438,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.26500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.53100000000000003,"5min":0.628,"15min":0.628},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Feb 16 00:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54100000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.26300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48799999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.371}]}]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":966656,"data_stored":723796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.51800000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.505},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.45400000000000001,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.222,"15min":0.222},"max":{"1min":0.50600000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Fri Feb 16 00:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.313,"15min":0.317},"min":{"1min":0.22,"5min":0.215,"15min":0.215},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.315,"15min":0.32300000000000001},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44600000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.309}]},{"osd":3,"last update":"Fri Feb 16 00:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.35999999999999999,"15min":0.38900000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48299999999999998,"5min":1.851,"15min":1.851},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34899999999999998},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.33000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705707,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":728030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 00:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.33300000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.5,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Feb 16 00:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.308,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.377,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.41399999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.24199999999999999}]},{"osd":3,"last update":"Fri Feb 16 00:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.33200000000000002,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.38700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46400000000000002,"5min":0.495,"15min":0.495},"last":0.28299999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":137181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 00:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63300000000000001,"5min":0.753,"15min":0.753},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.5},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60499999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Feb 16 00:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.46800000000000003},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.62}]},{"osd":3,"last update":"Fri Feb 16 00:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64400000000000002,"5min":1.506,"15min":1.506},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66000000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T00:14:21.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-16T00:14:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f166933b640 1 Processor -- start 2024-02-16T00:14:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f166933b640 1 -- start start 2024-02-16T00:14:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f166933b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f166406d130 0x7f166406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f166933b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1664098a60 con 0x7f166406da50 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f166933b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166409b590 con 0x7f166406d130 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f1662ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f166406d130 0x7f166406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f165bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f166406da50 0x7f166412dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60836/0 (socket says 172.21.15.2:60836) 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.782+0000 7f165bfff640 1 -- 172.21.15.2:0/2015202153 learned_addr learned my addr 172.21.15.2:0/2015202153 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.783+0000 7f1662ffd640 1 -- 172.21.15.2:0/2015202153 >> v1:172.21.15.2:6789/0 conn(0x7f166406da50 legacy=0x7f166412dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.783+0000 7f1662ffd640 1 -- 172.21.15.2:0/2015202153 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166406ead0 con 0x7f166406d130 2024-02-16T00:14:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.783+0000 7f16627fc640 1 -- 172.21.15.2:0/2015202153 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973275912 0 0) 0x7f1664098a60 con 0x7f166406da50 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.783+0000 7f1662ffd640 1 --2- 172.21.15.2:0/2015202153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f166406d510 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1654009720 tx=0x7f165402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee7dd11b5268ef8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f16627fc640 1 -- 172.21.15.2:0/2015202153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f165402e070 con 0x7f166406d130 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f16627fc640 1 -- 172.21.15.2:0/2015202153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16540316d0 con 0x7f166406d130 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f16627fc640 1 -- 172.21.15.2:0/2015202153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1654031990 con 0x7f166406d130 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 -- 172.21.15.2:0/2015202153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 msgr2=0x7f166406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 --2- 172.21.15.2:0/2015202153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f166406d510 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1654009720 tx=0x7f165402b840 comp rx=0 tx=0).stop 2024-02-16T00:14:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 -- 172.21.15.2:0/2015202153 shutdown_connections 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 --2- 172.21.15.2:0/2015202153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f166406d510 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 -- 172.21.15.2:0/2015202153 >> 172.21.15.2:0/2015202153 conn(0x7f166409c210 msgr2=0x7f1664071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 -- 172.21.15.2:0/2015202153 shutdown_connections 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.784+0000 7f166933b640 1 -- 172.21.15.2:0/2015202153 wait complete. 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f166933b640 1 Processor -- start 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f166933b640 1 -- start start 2024-02-16T00:14:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f166933b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f1664121d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f166933b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664124fc0 con 0x7f166406d130 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f1662ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f1664121d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f1662ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f1664121d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47606/0 (socket says 172.21.15.2:47606) 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.785+0000 7f1662ffd640 1 -- 172.21.15.2:0/1657019463 learned_addr learned my addr 172.21.15.2:0/1657019463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f1662ffd640 1 -- 172.21.15.2:0/1657019463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654009400 con 0x7f166406d130 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f1662ffd640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f1664121d80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f165402b880 tx=0x7f16540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1654004160 con 0x7f166406d130 2024-02-16T00:14:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16540042c0 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166406e460 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1654032780 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.786+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16641242f0 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.787+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f16540328e0 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.787+0000 7f165b7fe640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1644037ef0 0x7f164403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.787+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1664122f70 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.787+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f165406d8b0 con 0x7f166406d130 2024-02-16T00:14:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.787+0000 7f165bfff640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1644037ef0 0x7f164403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T00:14:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.788+0000 7f165bfff640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1644037ef0 0x7f164403a3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f164c000c00 tx=0x7f164c007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T00:14:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.791+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1654032b90 con 0x7f166406d130 2024-02-16T00:14:21.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.970+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f16640627b0 con 0x7f166406d130 2024-02-16T00:14:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.972+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1654045390 con 0x7f166406d130 2024-02-16T00:14:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.972+0000 7f165b7fe640 1 -- 172.21.15.2:0/1657019463 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1654045390 con 0x7f166406d130 2024-02-16T00:14:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1644037ef0 msgr2=0x7f164403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1644037ef0 0x7f164403a3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f164c000c00 tx=0x7f164c007910 comp rx=0 tx=0).stop 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 msgr2=0x7f1664121d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f1664121d80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f165402b880 tx=0x7f16540046c0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 shutdown_connections 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.42:6824/1216866101,v1:172.21.15.42:6825/1216866101] conn(0x7f1644037ef0 0x7f164403a3b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 --2- 172.21.15.2:0/1657019463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f166406d130 0x7f1664121d80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 >> 172.21.15.2:0/1657019463 conn(0x7f166409c210 msgr2=0x7f166411ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 shutdown_connections 2024-02-16T00:14:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-02-16T00:14:21.974+0000 7f166933b640 1 -- 172.21.15.2:0/1657019463 wait complete. 2024-02-16T00:14:21.986 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-16T00:14:21.986 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-16T00:14:21.987 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-16T00:14:21.987 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:14:22.027 INFO:tasks.ceph.osd.0:Stopped 2024-02-16T00:14:22.027 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-16T00:14:22.028 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:14:22.061 INFO:tasks.ceph.osd.1:Stopped 2024-02-16T00:14:22.062 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-16T00:14:22.062 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:14:22.134 INFO:tasks.ceph.osd.2:Stopped 2024-02-16T00:14:22.134 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-16T00:14:22.134 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:14:22.203 INFO:tasks.ceph.osd.3:Stopped 2024-02-16T00:14:22.203 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-16T00:14:22.204 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-16T00:14:22.204 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:14:22.273 INFO:tasks.ceph.mgr.x:Stopped 2024-02-16T00:14:22.274 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-16T00:14:22.274 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-16T00:14:22.274 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T00:14:22.285 INFO:tasks.ceph.mon.a:Stopped 2024-02-16T00:14:22.285 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-16T00:14:22.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-02-16T00:14:22.354 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-02-16T00:14:22.355 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-16T00:14:22.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:14:22.534 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-16T00:14:22.649 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:14:22.649 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-16T00:14:22.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:14:22.707 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-16T00:14:22.765 INFO:tasks.ceph:Archiving mon data... 2024-02-16T00:14:22.766 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/data/mon.a.tgz 2024-02-16T00:14:22.766 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-02-16T00:14:22.784 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.sfZcS8cMrh 2024-02-16T00:14:22.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sfZcS8cMrh 2024-02-16T00:14:22.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.sfZcS8cMrh 2024-02-16T00:14:22.992 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.sfZcS8cMrh is 233KB 2024-02-16T00:14:23.086 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.sfZcS8cMrh 2024-02-16T00:14:23.100 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-16T00:14:23.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-16T00:14:23.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-16T00:14:23.220 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-16T00:14:23.238 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-16T00:14:23.238 INFO:tasks.ceph:Archiving crash dumps... 2024-02-16T00:14:23.240 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/remote/smithi002/crash 2024-02-16T00:14:23.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-16T00:14:23.287 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/remote/smithi042/crash 2024-02-16T00:14:23.288 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-16T00:14:23.332 INFO:tasks.ceph:Compressing logs... 2024-02-16T00:14:23.332 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T00:14:23.335 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T00:14:23.373 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33154.log 2024-02-16T00:14:23.373 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-16T00:14:23.373 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33070.log 2024-02-16T00:14:23.373 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32191.log 2024-02-16T00:14:23.373 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.33154.log.gz 2024-02-16T00:14:23.373 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33280.log 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.33070.log.gz 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32092.log 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32191.log.gz 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31950.log 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.33280.log.gz 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32361.log 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31950.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32092.log.gz 2024-02-16T00:14:23.374 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33028.log 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31950.log.gz 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32361.log.gz 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32360.log 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31992.log 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33028.log.gz 2024-02-16T00:14:23.375 INFO:teuthology.orchestra.run.smithi002.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33238.log 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32360.log.gz 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32860.log 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33238.log: 85.9%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.31992.log.gz /var/log/ceph/ceph.audit.log 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32860.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.33238.log.gz 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33112.log 2024-02-16T00:14:23.376 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32902.log 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32902.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33112.log.gz 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32902.log.gz 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32509.log 2024-02-16T00:14:23.377 INFO:teuthology.orchestra.run.smithi002.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32638.log 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32470.log 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32638.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32509.log.gz 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30793.log 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32638.log.gz 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33322.log 2024-02-16T00:14:23.378 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30793.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32470.log.gz 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32944.log 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33322.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30793.log.gz 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31908.log 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.33322.log.gz 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32042.log 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32776.log 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32944.log.gz 2024-02-16T00:14:23.379 INFO:teuthology.orchestra.run.smithi002.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31908.log.gz 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32193.log 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32042.log.gz 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30954.log 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32193.log: gzip -5 --verbose -- 85.3% /var/log/ceph/ceph-client.admin.32194.log 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32776.log.gz 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32193.log.gz 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33490.log 2024-02-16T00:14:23.380 INFO:teuthology.orchestra.run.smithi002.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.30954.log.gz 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32532.log 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32510.log 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32194.log.gz 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.33490.log.gz 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33364.log 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32532.log.gz 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33530.log 2024-02-16T00:14:23.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33364.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32510.log.gz 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33530.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.33364.log.gz 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31851.log 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.33530.log.gz 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32722.log 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31851.log: gzip 85.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz --verbose 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-osd.0.log 2024-02-16T00:14:23.382 INFO:teuthology.orchestra.run.smithi002.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31851.log.gz 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32722.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29079.log 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32722.log.gz 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose/var/log/ceph/ceph.tmp-client.admin.29079.log: -- /var/log/ceph/ceph-client.admin.30911.log 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29079.log.gz 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32192.log 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.30911.log.gz 2024-02-16T00:14:23.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32818.log 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32986.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32192.log.gz 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32362.log 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33448.log 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32362.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.32818.log.gz 2024-02-16T00:14:23.384 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32362.log.gz 2024-02-16T00:14:23.385 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33448.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-02-16T00:14:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74322.log 2024-02-16T00:14:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87614.log 2024-02-16T00:14:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.74322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66457.log 2024-02-16T00:14:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.87614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89411.log 2024-02-16T00:14:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.66457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83397.log 2024-02-16T00:14:23.462 INFO:teuthology.orchestra.run.smithi042.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87614.log.gz 2024-02-16T00:14:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.89411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59197.log 2024-02-16T00:14:23.462 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.74322.log.gz 2024-02-16T00:14:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.83397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56172.log 2024-02-16T00:14:23.463 INFO:teuthology.orchestra.run.smithi042.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.0.89411.log.gz 2024-02-16T00:14:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.59197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78557.log 2024-02-16T00:14:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.56172.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66457.log.gz 2024-02-16T00:14:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85212.log 2024-02-16T00:14:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log/var/log/ceph/ceph-client.0.78557.log: 2024-02-16T00:14:23.463 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.83397.log.gz 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.85212.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.59197.log.gz 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62222.log 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72507.log 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.62222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77347.log 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56172.log.gz 2024-02-16T00:14:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 91.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.85212.log.gz /var/log/ceph/ceph-client.admin.36512.log 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78557.log.gz 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.72507.log: /var/log/ceph/ceph-client.0.77347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70692.log 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50122.log 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36512.log.gz 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.70692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54357.log 2024-02-16T00:14:23.465 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.62222.log.gz 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.50122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65852.log 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77347.log.gz 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72507.log.gz 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.54357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49517.log 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.65852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40448.log 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.49517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79162.log 2024-02-16T00:14:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.40448.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50122.log.gz 2024-02-16T00:14:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36552.log 2024-02-16T00:14:23.467 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54357.log.gz 2024-02-16T00:14:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.79162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88812.log 2024-02-16T00:14:23.467 INFO:teuthology.orchestra.run.smithi042.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.40448.log.gz 2024-02-16T00:14:23.467 INFO:teuthology.orchestra.run.smithi042.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.70692.log.gz 2024-02-16T00:14:23.467 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49517.log.gz 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.65852.log.gz 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44677.log 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36552.log.gz 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.88812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71297.log 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.44677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52542.log 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.79162.log.gz 2024-02-16T00:14:23.468 INFO:teuthology.orchestra.run.smithi042.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.88812.log.gz 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.71297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48307.log 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.52542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90062.log 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.48307.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44677.log.gz 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84607.log 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45282.log 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.90062.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71297.log.gz 2024-02-16T00:14:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.84607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69482.log 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.45282.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.52542.log.gz 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77952.log 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.48307.log.gz 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.69482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53147.log 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.77952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53752.log 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.53147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87015.log 2024-02-16T00:14:23.470 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45282.log.gz 2024-02-16T00:14:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.53752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79767.log 2024-02-16T00:14:23.471 INFO:teuthology.orchestra.run.smithi042.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.84607.log.gz/var/log/ceph/ceph-client.0.87015.log: 2024-02-16T00:14:23.471 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77952.log.gz 2024-02-16T00:14:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88213.log 2024-02-16T00:14:23.471 INFO:teuthology.orchestra.run.smithi042.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69482.log.gz 2024-02-16T00:14:23.471 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0%/var/log/ceph/ceph-client.0.79767.log: -- replaced with /var/log/ceph/ceph-client.0.53147.log.gz 2024-02-16T00:14:23.472 INFO:teuthology.orchestra.run.smithi042.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.90062.log.gz 2024-02-16T00:14:23.472 INFO:teuthology.orchestra.run.smithi042.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.87015.log.gz 2024-02-16T00:14:23.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38028.log 2024-02-16T00:14:23.472 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53752.log.gz 2024-02-16T00:14:23.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.88213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36472.log 2024-02-16T00:14:23.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.38028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64037.log 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36472.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.88213.log.gz 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45887.log 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.64037.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36472.log.gz 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47097.log 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79767.log.gz 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.45887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33053.log 2024-02-16T00:14:23.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.47097.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38028.log.gz 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62827.log 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73717.log 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33053.log: /var/log/ceph/ceph-client.0.62827.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.64037.log.gz 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.33053.log.gz 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84002.log 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45887.log.gz 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61617.log 2024-02-16T00:14:23.474 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47097.log.gz 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.73717.log: /var/log/ceph/ceph-client.0.84002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71902.log 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.61617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43467.log 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.71902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82187.log 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.73717.log.gz 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62827.log.gz 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.43467.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84002.log.gz 2024-02-16T00:14:23.475 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.82187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46492.log 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.61617.log.gz 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57987.log 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71902.log.gz 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.46492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41652.log 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43467.log.gz 2024-02-16T00:14:23.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.57987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47702.log 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82187.log.gz 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.41652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67062.log 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46492.log.gz 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.47702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70087.log 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32973.log 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.67062.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57987.log.gz 2024-02-16T00:14:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.70087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56777.log 2024-02-16T00:14:23.478 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41652.log.gz 2024-02-16T00:14:23.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48912.log 2024-02-16T00:14:23.478 INFO:teuthology.orchestra.run.smithi042.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32973.log.gz 2024-02-16T00:14:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.56777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39238.log 2024-02-16T00:14:23.479 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47702.log.gz 2024-02-16T00:14:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.0.48912.log: -5 --verbose -- 91.4% -- replaced with /var/log/ceph/ceph-client.0.67062.log.gz 2024-02-16T00:14:23.479 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.0.75532.log 2024-02-16T00:14:23.479 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.39238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44072.log 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.75532.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.44072.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56777.log.gz 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81582.log 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.48912.log.gz 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39238.log.gz 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.70087.log.gz 2024-02-16T00:14:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51332.log 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.75532.log.gz 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50727.log 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.81582.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.44072.log.gz 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.51332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36592.log 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.0.50727.log: -5 --verbose -- /var/log/ceph/ceph-client.0.73112.log 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68877.log 2024-02-16T00:14:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.73112.log: gzip 86.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.36592.log.gz --verbose 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.0.68272.log 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.81582.log.gz 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51332.log.gz 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.68877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37423.log 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0%/var/log/ceph/ceph-client.0.68272.log: -- replaced with /var/log/ceph/ceph-client.0.50727.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.37423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-02-16T00:14:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67667.log 2024-02-16T00:14:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68877.log.gz 2024-02-16T00:14:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33013.log: gzip 85.2% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-02-16T00:14:23.483 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.54962.log 2024-02-16T00:14:23.483 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68272.log.gz 2024-02-16T00:14:23.483 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73112.log.gz 2024-02-16T00:14:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.67667.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.37423.log.gz 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76137.log 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42862.log 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.54962.log: /var/log/ceph/ceph-client.0.76137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63432.log 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.42862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60407.log 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.67667.log.gz 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.63432.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54962.log.gz 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59802.log 2024-02-16T00:14:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.60407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57382.log 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% 91.2% -- replaced with /var/log/ceph/ceph-client.0.42862.log.gz 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.0.76137.log.gz 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.59802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64642.log 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.57382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42257.log 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63432.log.gz 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-16T00:14:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.64642.log: /var/log/ceph/ceph-client.0.42257.log: 91.2% 90.9% -- replaced with /var/log/ceph/ceph-client.0.60407.log.gz 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.0.59802.log.gz 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57382.log.gz 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64642.log.gz 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82792.log 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.0.42257.log.gz 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.80977.log 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr: 90.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-16T00:14:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.82792.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.80977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80372.log 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38633.log 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.80372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51937.log 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1%/var/log/ceph/ceph-client.0.38633.log: -- replaced with /var/log/ceph/ceph-client.0.80977.log.gz 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.51937.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82792.log.gz 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74927.log 2024-02-16T00:14:23.487 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.80372.log.gz 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.74927.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38633.log.gz 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51937.log.gz 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58592.log 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85817.log 85.5% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-02-16T00:14:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41047.log 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74927.log.gz 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.85817.log: /var/log/ceph/ceph-client.0.58592.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.85817.log.gz 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61012.log 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.41047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86416.log 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.58592.log.gz 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.61012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65247.log 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.86416.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.41047.log.gz 2024-02-16T00:14:23.489 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.86416.log.gz 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55567.log 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.65247.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39843.log 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.0.61012.log.gz 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.55567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76742.log 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.39843.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.65247.log.gz 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.76742.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.55567.log.gz 2024-02-16T00:14:23.490 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39843.log.gz 2024-02-16T00:14:23.491 INFO:teuthology.orchestra.run.smithi042.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76742.log.gz 2024-02-16T00:14:23.491 INFO:teuthology.orchestra.run.smithi042.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-16T00:14:23.492 INFO:teuthology.orchestra.run.smithi042.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-16T00:14:23.504 INFO:teuthology.orchestra.run.smithi002.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-16T00:14:24.155 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-16T00:14:24.157 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-02-16T00:14:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m0.810s 2024-02-16T00:14:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m0.933s 2024-02-16T00:14:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.062s 2024-02-16T00:14:24.162 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-16T00:14:24.272 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-16T00:14:24.287 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-16T00:14:24.290 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-02-16T00:14:24.290 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.889s 2024-02-16T00:14:24.290 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m2.537s 2024-02-16T00:14:24.290 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.176s 2024-02-16T00:14:24.291 INFO:tasks.ceph:Archiving logs... 2024-02-16T00:14:24.291 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/remote/smithi002/log 2024-02-16T00:14:24.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T00:14:24.504 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/remote/smithi042/log 2024-02-16T00:14:24.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T00:14:24.969 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-16T00:14:24.981 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-16T00:14:24.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T00:14:24.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T00:14:25.071 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-16T00:14:25.080 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-16T00:14:25.080 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T00:14:25.083 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T00:14:25.095 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-02-16T00:14:25.097 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-02-16T00:14:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T00:14:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-02-16T00:14:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 -968us[ -968us] +/- 106ms 2024-02-16T00:14:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -1867us[-1860us] +/- 76ms 2024-02-16T00:14:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +3065us[+3065us] +/- 89ms 2024-02-16T00:14:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:14:25.101 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-16T00:14:25.101 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-02-16T00:14:25.101 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 -984us[ -984us] +/- 106ms 2024-02-16T00:14:25.102 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -1883us[-1881us] +/- 76ms 2024-02-16T00:14:25.102 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +3059us[+3061us] +/- 89ms 2024-02-16T00:14:25.102 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-16T00:14:25.103 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-16T00:14:25.113 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-16T00:14:25.114 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-16T00:14:25.127 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-16T00:14:25.207 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-16T00:14:25.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T00:14:25.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T00:14:25.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-16T00:14:25.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T00:14:25.337 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-16T00:14:25.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-16T00:14:25.358 INFO:teuthology.task.internal:Duration was 682.329140 seconds 2024-02-16T00:14:25.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-16T00:14:25.370 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-16T00:14:25.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T00:14:25.372 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T00:14:25.413 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T00:14:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-16T00:14:25.760 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-16T00:14:25.761 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-02-16T00:14:25.761 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T00:14:25.781 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-02-16T00:14:25.781 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T00:14:25.801 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-16T00:14:25.801 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T00:14:25.824 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T00:14:25.870 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-16T00:14:25.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T00:14:25.893 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T00:14:26.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-16T00:14:26.016 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-16T00:14:26.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T00:14:26.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T00:14:26.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-16T00:14:26.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T00:14:26.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T00:14:26.108 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-02-16T00:14:26.134 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-02-16T00:14:26.161 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T00:14:26.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T00:14:26.187 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T00:14:26.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T00:14:26.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-16T00:14:26.228 INFO:teuthology.task.internal:Transferring archived files... 2024-02-16T00:14:26.229 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/remote/smithi002 2024-02-16T00:14:26.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T00:14:26.264 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739/remote/smithi042 2024-02-16T00:14:26.265 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T00:14:26.299 INFO:teuthology.task.internal:Removing archive directory... 2024-02-16T00:14:26.300 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T00:14:26.302 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T00:14:26.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-16T00:14:26.363 INFO:teuthology.task.internal:Not uploading archives. 2024-02-16T00:14:26.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-16T00:14:26.376 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-16T00:14:26.376 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T00:14:26.379 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T00:14:26.390 INFO:teuthology.orchestra.run.smithi002.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 00:14 /home/ubuntu/cephtest 2024-02-16T00:14:26.403 INFO:teuthology.orchestra.run.smithi042.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 00:14 /home/ubuntu/cephtest 2024-02-16T00:14:26.404 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-16T00:14:26.417 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-16T00:14:26.452 INFO:teuthology.nuke:Checking targets against current locks 2024-02-16T00:14:26.477 DEBUG:teuthology.nuke:shortname: smithi002 2024-02-16T00:14:26.478 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T00:14:26.505 DEBUG:teuthology.nuke:shortname: smithi042 2024-02-16T00:14:26.505 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T00:14:26.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:54:46.277020', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEH+KhokNcHpZWggZirFpySWhReuX32XHsL6TUgWvGEoU59RoE6oG9711jUvDWqQ89fdkkFFLUiY6Mvtxe/TGqw='} 2024-02-16T00:14:26.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-15_21:10:42-rgw-wip-yuri2-testing-2024-02-15-0913-squid-distro-default-smithi/7561739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 23:54:46.275506', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2CF3qZKlLdIA78yBYMU3nWGsx2QcOBR1MqoNjZrUvYDEJw6q8NhgRSVSnYC5jIuJE0mOJ6e5dybHmWoY9RAHU='} 2024-02-16T00:14:26.561 INFO:teuthology.orchestra.console.smithi002:Power off 2024-02-16T00:14:26.561 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T00:14:26.591 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2024-02-16T00:14:26.591 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T00:14:26.612 INFO:teuthology.orchestra.console.smithi042:Power off 2024-02-16T00:14:26.613 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T00:14:26.623 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2024-02-16T00:14:26.636 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2024-02-16T00:14:26.636 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T00:14:26.664 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-02-16T00:14:30.624 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T00:14:30.666 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T00:14:30.738 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2024-02-16T00:14:30.778 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-02-16T00:14:34.739 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T00:14:34.780 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T00:14:34.854 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2024-02-16T00:14:34.893 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-02-16T00:14:34.954 INFO:teuthology.orchestra.console.smithi002:Power off completed 2024-02-16T00:14:34.994 INFO:teuthology.orchestra.console.smithi042:Power off completed 2024-02-16T00:14:35.099 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 682.3291401863098 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000007379f9e6cc253077-0065cea872-4222-default4222-default-default' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=01b03f98347d428d83dd3a220d139b94 status: fail success: false 2024-02-16T00:14:35.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T00:14:35.186 INFO:teuthology.run:FAIL